Logo of Huzzle

Data Engineer

  • Job
    Full-time
    Mid Level
  • Data
    IT & Cybersecurity
  • Toronto

AI generated summary

  • You need 3+ years in data engineering, ETL/ELT, GCP, data ingestion tools (Fivetran), Airflow, CI/CD, and strong SQL/Python skills. Experience with various data formats and teamwork is essential.
  • You will develop data pipelines, automate workflows, collaborate on data requirements, ensure data quality, and manage cloud-based data solutions while using SQL and Python.

Requirements

  • Experience building data pipelines, and composable cloud-based data platforms in Google Cloud Provider (GCP).
  • Experience configuring and using data ingestion tools such as Fivetran, and Qlik Replicate.
  • Have prior experience with data engineering, programming, ETL, ELT, processes for data integration and ingestion.
  • Experience in data modelling, manipulating large data sets and handling raw data, and other cleaning techniques.
  • Experience working with structured, semi-structured, and unstructured data.
  • Experience collaborating and working with DevOps and Scrum Teams.
  • Demonstrated team player with strong communication skills and a track record of successful delivery of product development.
  • Expert at problem solving.
  • Strong scripting skills (SQL, Python).
  • Strong knowledge of cloud infrastructure.
  • 3+ years of experience building Data Warehouse / Data Platforms.
  • 3+ years of experience creating ELT / ETL data pipelines from scratch, working with structured, semi-structured, and unstructured data.
  • 2+ years of experience configuring and using data ingestion/ replication tools such as Fivetran, or Qlik.
  • 2+ years of experience with Cloud: GCP.
  • 2+ years of experience with Airflow.
  • 3+ years of experience working on continuous integrations and continuous deployment pipeline (CI/CD) and working with source control systems such as Github, Bitbucket, and Terraform.

Responsibilities

  • Develop and maintain robust data pipelines for data ingestion and distribution of large datasets for processing and consuming.
  • Utilize SaaS services and tools to build, configure and automate data workflows and streamline the data engineering process.
  • Collaborate with stakeholders and product managers to analyze data requirements, and build ingestion patterns to bring in new data sources to the data platform.
  • Build and monitor application services and pipeline performance.
  • Conduct data quality checks.
  • Experience building data pipelines, and composable cloud-based data platforms in Google Cloud Provider (GCP).
  • Experience configuring and using data ingestion tools such as Fivetran, and Qlik Replicate.
  • Have prior experience with data engineering, programming, ETL, ELT, processes for data integration and ingestion.
  • Experience in data modelling, manipulating large data sets and handling raw data, and other cleaning techniques.
  • Experience working with structured, semi-structured, and unstructured data.
  • Experience collaborating and working with DevOps and Scrum Teams.
  • Demonstrated team player with strong communication skills and a track record of successful delivery of product development.
  • Expert at problem solving.
  • Strong scripting skills (SQL, Python).
  • Strong knowledge of cloud infrastructure.

FAQs

What is the primary responsibility of the Data Engineer role?

The primary responsibility of the Data Engineer role is to design, build, and maintain scalable data architectures that support data-driven initiatives, while leading a team of engineers and collaborating with cross-functional teams.

What qualifications are required for the Data Engineer position?

Candidates should have 3+ years of experience in building Data Warehouse/Data Platforms, creating ELT/ETL data pipelines, and configuring data ingestion/repllication tools such as Fivetran or Qlik, along with 2+ years of experience in GCP and Airflow.

What programming languages and tools should I be familiar with for this role?

Candidates should have strong scripting skills in SQL and Python, along with experience using data ingestion tools like Fivetran or Qlik.

Is team collaboration important in this role?

Yes, collaboration with stakeholders, product managers, and scrum teams is crucial for analyzing data requirements and building effective ingestion patterns.

What opportunities are available for professional development?

The company offers upskilling through online courses, cross-functional development opportunities, and tuition assistance.

What benefits can I expect from working at Scotiabank?

Employees can enjoy a competitive rewards program that includes bonuses, flexible vacation, personal/sick days, and benefits starting on day one.

Is there a focus on diversity and inclusion within the company?

Yes, Scotiabank is committed to creating an inclusive culture that values diversity and provides opportunities for all employees to learn, grow, and participate.

Where is the Data Engineer position located?

The position is located in Toronto, Ontario, Canada, and follows a hybrid working condition.

How does Scotiabank support community engagement?

Scotiabank offers opportunities for community engagement through various programs such as hackathons, contests, and team-building activities.

What should I do if I need accommodation during the recruitment process?

If you require accommodation during the recruitment and selection process, you should inform the Recruitment team for assistance.

Finance
Industry
10,001+
Employees

Mission & Purpose

Welcome to Scotiabank. We serve thousands of customers, families, and communities across the globe, helping them achieve success through advice, products, and services. Follow for news, insights, thought leadership and more.

Culture & Values

  • Respect

    Everyone is always treated with dignity; diverse backgrounds and experiences are what make us better as a whole.

  • Integrity

    Acting honorably comes first – earning the trust of our customers (and each other) is what matters most.

  • Passion

    We’re enthusiastic about what we do, and want you to feel the same way. Imagine coming in to work, and actually feeling excited to learn!

  • Accountability

    We commit, we take action, and most importantly, we take responsibility for those actions. It’s just the right thing to do.