Logo of Huzzle

Senior Data Engineer

  • Job
    Full-time
    Senior Level
  • Data
  • Toronto
  • Quick Apply

AI generated summary

  • You must have 5+ years of data/software engineering experience, Agile mindset, strong problem-solving skills, knowledge of data modeling, ETL processes, AWS, Oracle, Python, Java, Big Data tech, security, CI/CD practices, and excellent communication skills for this Senior Data Engineer role at Interac Corp.
  • You will design, develop, and monitor scalable data processes, collaborate on data strategies, maintain pipelines, test automation, explore new technologies, resolve issues, mentor engineers, and ensure data integrity and performance.

Requirements

  • 5+ years of hands-on experience in data or software engineering. Preferably leading teams.
  • A University degree in Computer Science Engineering or an equivalent combination of education and experience.
  • A solid foundation in data structures, distributed systems, algorithms, data modeling, data pipeline processes, data integration patterns and software design.
  • Eligibility to work for Interac Corp. in Canada in a full-time capacity.
  • Hands on experience with implementing dimensional models in SQL as well as experience with RDBMS (Oracle), BigData (Hive, Impala) environments, Apache Spark framework (PySpark preferred).
  • A demonstration of the Agile mindset, and strong experience in problem-solving within Agile environments.
  • Excellent interpersonal and communication skills with the ability to articulate complex technical concepts to a varied audience.
  • Experience building out a scalable infrastructure to fit the needs of a growing company.
  • Experience with data warehousing, operational data stores, large-scale implementations and ETL/ELT/data streaming processing.
  • Knowledge of and proven experience with:
  • Cloud tools and services (AWS preferred)
  • Cloud based Data Warehousing tools (AWS Redshift preferred)
  • ETL or Data Integration tools (Talend preferred)
  • Oracle PL/SQL, SQL, Python and Java
  • Exposure to Big Data technologies including development, performance tuning, and standard operational activities involved.
  • Awareness that security is one of the most critical parts in any data related projects.
  • Experience in data ingestion and processing including Third-Party APIs
  • Experience with Github and CI/CD practices is an asset
  • Experience with testing frameworks such as Jest, pytest or equivalent.
  • Strong organization, collaboration and relationship building skills.

Responsibilities

  • Designing, developing, implementing, and monitoring highly scalable processes to ingest and process high volume transactions while ensuring high performance and quality.
  • Collaborating with various teams to translate business and analytics requirements into a data fulfillment strategy including building data pipelines, data aggregations, infrastructure and tooling to support business initiatives.
  • Overseeing the design and maintenance of data pipelines and contributing to the continual enhancement of the data engineering architecture.
  • Working with other developers, engineers, data scientists, and business stakeholders to continuously explore new capabilities and technologies to drive innovation.
  • Collaborating with the team to meet performance, scalability, and reliability goals.
  • Developing standards for data processes and automating routine tasks while ensuring the timing of automatic jobs do not conflict with application processes.
  • Writing out tests and thorough documentation for processes and tooling.
  • Supporting data transformation testing and production implementation as required.
  • Adapting to working with new technologies and frameworks, sometimes headlining the investigation into their usefulness to the team.
  • Supporting the team with problem analysis and resolution.
  • Maintaining and expanding existing systems, tooling, and infrastructure.
  • Management and proactive monitoring of data flows ensuring data integrity and performance.
  • Participating in rotating on-call support.
  • Mentoring and coaching a talented team of engineers to maintain best practices in data engineering.

FAQs

What is the primary responsibility of a Senior Data Engineer at Interac?

The primary responsibility of a Senior Data Engineer at Interac is to design, develop, and support the implementation of high-quality and sustainable data fulfillment solutions to improve business outcomes by working with various teams to develop and maintain data pipelines.

What qualifications are required for the Senior Data Engineer position at Interac?

Qualified candidates for the Senior Data Engineer position at Interac should have 5+ years of hands-on experience in data or software engineering, a University degree in Computer Science Engineering or an equivalent combination of education and experience, and eligibility to work for Interac Corp. in Canada in a full-time capacity. Additionally, candidates should have experience with data modeling, data pipeline processes, data integration patterns, and software design.

What technology skills are essential for a Senior Data Engineer at Interac?

Essential technology skills for a Senior Data Engineer at Interac include experience with SQL, RDBMS (Oracle), BigData environments (Hive, Impala), Apache Spark framework (PySpark preferred), cloud tools and services (preferably AWS), cloud-based Data Warehousing tools (AWS Redshift preferred), ETL/Data Integration tools (Talend preferred), Oracle PL/SQL, SQL, Python, Java, and exposure to Big Data technologies. Knowledge of security practices, data ingestion, Third-Party APIs, and testing frameworks is also required.

What are some of the key responsibilities of a Senior Data Engineer at Interac?

Some key responsibilities of a Senior Data Engineer at Interac include designing and developing scalable processes for ingesting and processing high volume transactions, collaborating with various teams to translate business requirements into data fulfillment strategies, overseeing the design and maintenance of data pipelines, exploring new technologies for innovation, automating routine tasks and processes, mentoring and coaching junior engineers, and participating in on-call support.

Get more out of life with INTERAC. Profite plus de la vie avec INTERAC.

Finance
Industry
201-500
Employees
1984
Founded Year

Mission & Purpose

Interac Corp. empowers Canadians to access, spend and send funds whenever and from wherever they choose. With nearly 300 financial institutions connected to our network, we enable payment and ID experiences that support Canadians’ accelerated use of safe and digital payments while prioritizing interoperability, security, privacy, and inclusivity. We are proud to be one of Canada’s leading and most trusted financial brands, with Canadians choosing Interac products an average of 18 million times a day to pay and exchange money. Interac champions workplace culture and corporate citizenship based on the principles of responsibility, diversity and inclusion.