Logo of Huzzle

Home

Matches

Explore

Manage

Data Engineer

image

Actalent

12d ago

  • Job
    Full-time
    Mid Level
  • Data
    Software Engineering
  • Aurora

AI generated summary

  • You need a degree in a related field, 3+ years in data engineering, experience with Databricks, Spark, AWS, Terraform, and proficiency in Python, SQL, and version control. Strong communication skills are essential.
  • You will architect data pipelines, develop ETL workflows, enhance data quality, innovate technologies, improve data services, define SLAs, ensure data security, document processes, and model business needs.

Requirements

  • Bachelor’s degree in Computer Science, Software Engineering, Information Systems, Engineering, or equivalent
  • 3+ years in data engineering or data architecting, while building highly scalable and secure solutions
  • Proven experience as a Data Engineer, with a focus on designing and building data pipelines using Databricks and Spark
  • Experience with big data technologies such as Hadoop, Hive, or Presto and cloud platforms such as AWS, Azure, or Google Cloud
  • Extensive hands-on experience with code version control (e.g., Git)
  • Proficiency in Python, SQL, and experience working with various databases and data formats
  • Strong communication skills
  • AWS, Terraform
  • Must have at least 3 years of professional experience

Responsibilities

  • - Architect, build, scale, and optimize data pipelines from various databases, internal systems, and third-party tools into data lakes enabling seamless data flow
  • - Develop and maintain ETL workflows, ensuring data quality, consistency, and data lineage throughout the pipeline
  • - Drive innovation and integration of new technologies into organization-wide projects and activities in the big data space
  • - Identify areas of improvement and recommend solutions to enhance the reliability, scalability, and efficiency of data services
  • - Define and support internal SLAs for core datasets
  • - Adopt and maintain engineering best practices in data security and retention
  • - Document data engineering processes, workflows, and solutions for knowledge sharing and future references
  • - Analyzing and translating business needs to create solution data models

FAQs

What qualifications are required for this Data Engineer position?

A Bachelor’s degree in Computer Science, Software Engineering, Information Systems, Engineering, or an equivalent field is required, along with 3+ years of experience in data engineering or data architecting.

What technologies should I be familiar with for this role?

You should have proven experience with Databricks and Spark for building data pipelines, as well as familiarity with big data technologies such as Hadoop, Hive, or Presto, and cloud platforms like AWS, Azure, or Google Cloud.

What programming languages and tools are necessary for this position?

Proficiency in Python and SQL is required, along with experience working with various databases and data formats. Familiarity with code version control, such as Git, is also essential.

Are there specific skills that are a must-have for this role?

Yes, expertise in AWS and Terraform is a must-have skill for this Data Engineer position.

What are the primary responsibilities of a Data Engineer in this role?

Responsibilities include architecting, building, scaling, and optimizing data pipelines, developing and maintaining ETL workflows, driving innovation in big data solutions, and documenting data engineering processes.

How does Actalent approach diversity, equity, and inclusion?

Actalent prioritizes diversity and inclusion by hiring diverse talent, maintaining an inclusive environment, building a culture of care and engagement, and ensuring growth opportunities for all employees.

Is prior experience in data services evaluations necessary?

Yes, prior experience in identifying areas of improvement and recommending solutions to enhance the reliability, scalability, and efficiency of data services is essential for this position.

What level of professional experience is required for the Data Engineer role?

Candidates must have at least 3 years of professional experience in data engineering or data architecting.

Can I request accommodations during the application process?

Yes, if you would like to request a reasonable accommodation due to a disability, you can email actalentaccommodation@actalentservices.com for assistance.

Does Actalent offer equal employment opportunities?

Yes, Actalent is an equal opportunity employer and considers all applications without regard to race, sex, age, color, religion, national origin, veteran status, disability, sexual orientation, gender identity, genetic information, or any protected characteristic by law.

Are there opportunities for professional growth in this position?

Yes, Actalent fosters a culture of growth and provides opportunities for employees to advance their skills and career within the organization.

Actalent

An Engineering and Sciences Services Company | People to Possible

Human Resources
Industry
5001-10,000
Employees

Mission & Purpose

Actalent connects passion with purpose. Our scalable talent solutions and services capabilities drive value and results and provide the expertise to help our customers achieve more. Every day, our experts around the globe are making an impact. We’re supporting critical initiatives in engineering and sciences that advance how companies serve the world. Actalent’s global footprint and flexible delivery models ensure access to specialized talent where and when you need it. We promote consultant engagement through professional development and provide experiences to ensure continuous learning. Our people are the difference. Our expertise spans capabilities in engineering including product and manufacturing, systems and software, construction management, environmental, architecture and civil; and power and utilities. We focus on sciences capabilities in laboratory sciences, healthcare, and clinical research. Actalent is an operating company of Allegis Group, the global leader in talent solutions.