Logo of Huzzle

Devops

  • Job
    Full-time
    Senior Level
  • Software Engineering
    IT & Cybersecurity
  • Pune

AI generated summary

  • You must have experience migrating from Apache to Confluent Kafka, managing Kafka clusters, configuring brokers, monitoring performance, scripting automation, and mentoring junior team members.
  • You will design, deploy, and maintain Kafka clusters, configure brokers and ACLs, monitor performance, troubleshoot issues, implement producers/consumers, automate tasks, and mentor junior team members.

Requirements

  • Migration exp from Apache Kafka to Confluent Kafka
  • Devops, Kubernetes
  • Design, deploy, and maintain Kafka clusters across multiple environments (development, testing, production)
  • Configure Kafka brokers, topics, partitions, and ACLs (Access Control Lists) as per security requirements
  • Monitor Kafka infrastructure performance and ensure high availability and low-latency data transmission
  • Collaborate with DevOps and development teams to optimize Kafka configurations for performance and scalability
  • Troubleshoot and resolve issues related to Kafka cluster connectivity, broker performance, and data replication
  • Implement Kafka producers and consumers, ensuring data pipelines are robust and efficient
  • Develop automation scripts (e.g., using Ansible, Shell scripting) for Kafka cluster provisioning and maintenance tasks
  • Provide guidance and mentorship to junior members of the Kafka administration team
  • Stay updated with Kafka community developments and best practices, recommending upgrades and improvements

Responsibilities

  • Design, deploy, and maintain Kafka clusters across multiple environments (development, testing, production).
  • Configure Kafka brokers, topics, partitions, and ACLs (Access Control Lists) as per security requirements.
  • Monitor Kafka infrastructure performance and ensure high availability and low-latency data transmission.
  • Collaborate with DevOps and development teams to optimize Kafka configurations for performance and scalability.
  • Troubleshoot and resolve issues related to Kafka cluster connectivity, broker performance, and data replication.
  • Implement Kafka producers and consumers, ensuring data pipelines are robust and efficient.
  • Develop automation scripts (e.g., using Ansible, Shell scripting) for Kafka cluster provisioning and maintenance tasks.
  • Provide guidance and mentorship to junior members of the Kafka administration team.
  • Stay updated with Kafka community developments and best practices, recommending upgrades and improvements.

FAQs

What is the primary technology focus of this DevOps position?

The primary technology focus is on migrating and managing Kafka clusters, specifically from Apache Kafka to Confluent Kafka.

What cloud platforms or container orchestration tools should candidates be familiar with?

Candidates should be familiar with Kubernetes as well as other DevOps tools.

What are the responsibilities regarding Kafka cluster management?

Responsibilities include designing, deploying, and maintaining Kafka clusters across multiple environments, configuring brokers, topics, partitions, and ACLs, and monitoring infrastructure performance.

Is experience with automation tools important for this role?

Yes, experience with automation scripts (e.g., using Ansible, Shell scripting) for Kafka cluster provisioning and maintenance tasks is important.

Will I be expected to provide guidance to other team members?

Yes, you will be expected to provide guidance and mentorship to junior members of the Kafka administration team.

How important is troubleshooting experience in this position?

Troubleshooting and resolving issues related to Kafka cluster connectivity, broker performance, and data replication is a key responsibility.

Is there room for professional development in this role?

Yes, candidates will be expected to stay updated with Kafka community developments and best practices, recommending upgrades and improvements.

What type of collaboration is expected with development teams?

Collaboration with DevOps and development teams to optimize Kafka configurations for performance and scalability is expected.

Get the Future You Want

Technology
Industry
10,001+
Employees
1967
Founded Year

Mission & Purpose

Capgemini is a global leader in partnering with companies to transform and manage their business by harnessing the power of technology. The Group is guided everyday by its purpose of unleashing human energy through technology for an inclusive and sustainable future. It is a responsible and diverse organization of 360,000 team members in more than 50 countries. With its strong 55-year heritage and deep industry expertise, Capgemini is trusted by its clients to address the entire breadth of their business needs, from strategy and design to operations, fueled by the fast evolving and innovative world of cloud, data, AI, connectivity, software, digital engineering and platforms. The Group reported in 2022 global revenues of €22 billion.