FAQs
What is the duration of the Associate Data/Software Engineer position?
The position is a fixed-term role lasting for 12 months.
What responsibilities will I have in this role?
You will be responsible for the development and testing of integration, modeling, data persistence, and querying tools, as well as building and maintaining data pipelines, managing metadata, monitoring pipeline performance, implementing data curation, and engaging with business and technology partners.
What technical experience is preferred for this position?
A minimum of 1+ years of experience as a Java or Python developer is preferred, along with an understanding of AWS ecosystems and exposure to various data stack technologies.
What specific AWS services should I be familiar with for this role?
Familiarity with AWS services such as Lambdas, Step Functions, and ECS services is preferred.
Are there any specific data stack technologies that I should know?
Yes, exposure to technologies like Apache Iceberg, Spark, Apache Airflow, Prefect, Dagster, and DBT is preferred.
What kind of data services and metadata management tools should I have experience with?
Experience with data services such as Glue, Lake Formation, EMR, EventBridge, and Athena, as well as metadata management tools like Amundsen, Atlas, DataHub, OpenDataDiscovery, and Marquez, is preferred.
Is knowledge of relational databases required for this position?
Exposure to relational databases, particularly PostgreSQL, would be a plus but is not explicitly required.
Will I be working independently or as part of a team?
You will be an individual contributor, but you will also engage with business and technology partners, indicating some collaboration within the team.
What is the main goal for this role within the company?
The main goal is to ensure that the data platform fully meets the firm’s needs by effectively architecting, building, testing, and maintaining it.