Logo of Huzzle

Home

Matches

Explore

Manage

Data Engineer

image

NHS Professionals

10d ago

  • Job
    Full-time
    Junior Level
  • Wakefield

AI generated summary

  • You need a HNC or higher in a relevant field, 1+ year in data products, strong SQL/Python/Spark skills, ETL experience, data modeling expertise, and the ability to communicate complex concepts simply.
  • You will develop and maintain Azure data pipelines, migrate legacy systems, optimize ETL processes, implement data governance, and collaborate with stakeholders to meet technical requirements.

Requirements

  • HNC or higher in computing science, Mathematics, Engineering or similar subjects. Relevant certification in Azure services is desirable.
  • Proven experience (1+ year) in designing, building, and testing data products that integrate multiple systems using various storage technologies and access method, preferable using Azure services (Synapse, ADF, Databricks, SQL DB).
  • Strong proficiency in SQL, Python, Spark, and SSIS with ability to write and optimize complex code.
  • Must be able to implement and maintain ETL/ELT pipelines connecting operational systems and analytics platforms, with demonstrable experience in optimizing pipeline performance.
  • Proven ability to document source-to-target mappings and maintain accurate metadata repositories for data and systems integration.
  • Demonstrated capability in data modelling, including producing and maintaining data models, and ability to reverse-engineer models from live systems.
  • Skills in data profiling, source system analysis, and presenting clear insights to support end-users of the data.
  • Experience in re-engineering manual data flows into automated, scalable, and reusable solutions that align with organizational standards.
  • Ability to write and maintain programming scripts and code for data engineering tasks, with a focus on creating reusable and well-documented solutions.
  • Understanding of data integration design principles to deliver resilient, scalable, and future-proof data solutions.
  • Practical experience in testing data solutions, including defining test conditions, analysing results, and identifying potential risks and issues.
  • Basic understanding of data streaming systems and ability to support their implementation and maintenance.
  • Ability to translate technical concepts into non-technical language and effectively communicate with both internal and external stakeholders.

Responsibilities

  • As a Data Engineer, you will be responsible for developing and maintaining data pipelines across the organization using Azure cloud platform and SSIS.
  • You will work on migrating legacy systems to cloud, implementing data governance practices, and optimizing data processes.
  • The role involves building Azure-based data solutions, optimizing ETL processes, supporting platform modernization initiatives, and implementing data governance standards.
  • You will collaborate with team members and stakeholders to ensure technical requirements are met effectively.

FAQs

What is the primary responsibility of the Data Engineer at NHS Professionals?

The primary responsibility of the Data Engineer is to develop and maintain data pipelines across the organization using the Azure cloud platform and SSIS, as well as optimizing data solutions for smarter healthcare staffing decisions.

What qualifications are required for this position?

The candidate should have at least an HNC or higher in computing science, Mathematics, Engineering, or similar subjects. Relevant certification in Azure services is desirable.

How many years of experience is required for this role?

The ideal candidate should have a minimum of 1 year of hands-on data engineering experience.

Which technologies should a candidate be proficient in?

Candidates should have strong proficiency in SQL, Python, Spark, and SSIS scripting.

What kind of projects will the Data Engineer be involved in?

The Data Engineer will be involved in building Azure-based data solutions, optimizing ETL processes, migrating legacy systems to the cloud, implementing data governance practices, and supporting platform modernization initiatives.

Is there a focus on data modeling in this role?

Yes, candidates should have demonstrated capability in data modeling, including producing and maintaining data models and the ability to reverse-engineer models from live systems.

What benefits are offered to employees?

Benefits include a generous annual leave allowance, a pension contribution of up to 10%, life assurance, group income protection, a wellbeing programme, and an employee assistance programme.

Are there opportunities for employee recognition?

Yes, NHS Professionals has a "Star of the Month" award which recognizes colleagues or teams that go the extra mile, with a chance to win £100 worth of shopping vouchers.

Does the Data Engineer role involve documentation?

Yes, the role involves documenting source-to-target mappings and maintaining accurate metadata repositories for data and systems integration.

Is experience in testing data solutions required?

Yes, practical experience in testing data solutions, including defining test conditions, analyzing results, and identifying potential risks and issues, is required.

image

NHS Professionals

Putting People in Places to Care

Human Resources
Industry
1001-5000
Employees
2004
Founded Year

Mission & Purpose

NHS Professionals provides workforce solutions and staffing services to the NHS in England. Their mission is to deliver high-quality, flexible staffing solutions that support the NHS in meeting patient care demands efficiently. Their purpose is to ensure that healthcare organizations have access to a skilled and reliable workforce, enhancing service delivery and patient outcomes across the NHS.