Logo of Huzzle

GCP Data Engineer

image

Devoteam

11d ago

  • Job
    Full-time
    Mid & Senior Level
  • Data
    IT & Cybersecurity
  • Madrid
    Remote

AI generated summary

  • You should have proven data engineering experience, strong GCP knowledge (BigQuery, Dataflow, etc.), pipeline design skills with Apache Beam/Airflow, proficiency in Python and SQL, and Google Cloud certifications (preferred).
  • You will collaborate with clients to address data challenges, design and implement GCP data pipelines, develop ETL processes, optimize performance, ensure data quality, and document solutions.

Requirements

  • Experiencia comprobada en ingeniería de datos.
  • Sólido conocimiento de los servicios de GCP, como BigQuery, Dataflow, Dataproc, Cloud Storage, Cloud Functions, Pub/Sub y Composer.
  • Experiencia en el diseño e implementación de pipelines de datos utilizando herramientas como Apache Beam y Airflow.
  • Dominio de lenguajes de programación como Python y SQL.
  • Capacidad para trabajar de forma independiente y como parte de un equipo.
  • Pasión por la tecnología y el aprendizaje continuo.
  • Certificaciones de Google Cloud (deseable).

Responsibilities

  • Colaborar con los clientes para comprender sus necesidades y desafíos de datos, traduciéndolos en soluciones técnicas en GCP.
  • Diseñar, construir e implementar pipelines de datos eficientes y escalables utilizando servicios como Dataflow, Dataproc, Cloud Functions y Composer.
  • Desarrollar e implementar procesos ETL/ELT para integrar datos de diversas fuentes, incluyendo bases de datos, archivos y APIs.
  • Trabajar con grandes conjuntos de datos utilizando tecnologías como BigQuery, Cloud Storage y Dataproc.
  • Implementar y mantener la calidad de los datos y el cumplimiento de las normativas de seguridad.
  • Optimizar el rendimiento y el coste de las soluciones de datos en GCP.
  • Automatizar tareas y procesos utilizando herramientas de orquestación y scripting.
  • Documentar las soluciones implementadas y proporcionar soporte técnico a los clientes.
  • Mantenerse al día con las últimas tecnologías y mejores prácticas de GCP.
  • Contribuir al crecimiento del equipo compartiendo conocimientos y participando en iniciativas de desarrollo.

FAQs

Is the position fully remote?

Yes, the position is 100% remote from Spain.

What technologies will I be working with in this role?

You will be working with GCP services such as BigQuery, Dataflow, Dataproc, Cloud Storage, Cloud Functions, and Pub/Sub, among others.

What are the main responsibilities of a GCP Data Engineer at Devoteam?

Main responsibilities include collaborating with clients to understand their data needs, designing and building data pipelines, implementing ETL/ELT processes, optimizing data solutions, and maintaining data quality and compliance.

What programming languages are required for this job?

Proficiency in Python and SQL is required for this position.

Is experience in data engineering a requirement for this role?

Yes, proven experience in data engineering is a prerequisite for this position.

Do I need any certifications to apply for this job?

While not mandatory, Google Cloud certifications are desirable for this role.

What should I expect in terms of team collaboration?

You should be prepared to work both independently and as part of a team, contributing to team growth by sharing knowledge and participating in development initiatives.

Will there be opportunities for further learning and development?

Yes, there is a strong emphasis on continuous learning, and you'll be encouraged to stay updated with the latest technologies and best practices in GCP.

What experience is preferred in designing data pipelines?

Experience in designing and implementing data pipelines using tools such as Apache Beam and Airflow is preferred for this role.

How important is data quality management in this position?

Maintaining data quality and compliance with security regulations is a critical responsibility in this position.

Consulting
Industry
10,001+
Employees
1995
Founded Year

Mission & Purpose

Devoteam is a leading consulting firm focused on digital strategy, tech platforms, data and cybersecurity. By combining creativity, tech, and data insights, we empower our customers to transform their business and unlock the future. With 25 years’ experience and more than 10,000 employees across Europe, the Middle East and Africa, Devoteam promotes responsible tech for people and works to create better change. Creative tech for Better Change