Logo of Huzzle

Staff Big Data Hadoop Administrator

Applications are closed

  • Job
    Full-time
    Senior & Expert Level
  • Data
    IT & Cybersecurity
  • Dublin
    Remote

Requirements

  • 6 + years of overall experience with at least 4+ years DevOps experience building and administering Hadoop clusters
  • Deep understanding of Hadoop/Big Data Ecosystem. Good knowledge in Querying and analyzing large amount of data on Hadoop HDFS using Hive and Spark Streaming and working on systems like HDFS, YARN, Hive, HBase. Spark, Kafka, RabbitMQ, Impala, Kudu, Redis, Hue.
  • Experience securing Hadoop stack with Sentry, Ranger, LDAP, Kerberos KDC
  • Good knowledge of Perl, Python, Bash, Groovy and Java.
  • In-depth knowledge of Linux internals (Centos 7.x) and shell scripting
  • Ability to learn quickly in a fast-paced, dynamic team environment
  • Experience using tools like Tableau, Grafana, MariaDB, and Prometheus.
  • Experience supporting CI/CD pipelines on Cloudera on Native cloud and Azure/AWS environments
  • Demonstrated expert-level experience in delivering end-end deployment automation leveraging Puppet, Ansible, Terraform, Jenkins, Docker, Kubernetes or similar technologies.
  • A good knowledge of Groovy and/or Java

Responsibilities

  • Responsible for deploying, production monitoring, maintaining and supporting of Big Data infrastructure, Applications on ServiceNow Cloud and Azure environments.
  • Architect and drive the end-end Big Data deployment automation from vision to delivering the automation of Big Data foundational modules (Cloudera CDP), prerequisite components and Applications leveraging Ansible, Puppet, Terraform, Jenkins, Docker, Kubernetes to deliver end-end deployment automation across all ServiceNow environments.
  • Automate Continuous Integration / Continuous Deployment (CI/CD) data pipelines for applications leveraging tools such as Jenkins, Ansible, and Docker.
  • Performance tuning and troubleshooting of various Hadoop components and other data analytics tools in the environment: HDFS, YARN, Hive, HBase. Spark, Kafka, RabbitMQ, Impala, Kudu, Redis, Hue, Kerberos, Tableau, Grafana, MariaDB, and Prometheus.
  • Provide production support to resolve critical Big Data pipelines and application issues and mitigating or minimizing any impact on Big Data applications. Collaborate closely with Site Reliability Engineers (SRE), Customer Support (CS), Developers, QA and System engineering teams in replicating complex issues leveraging broad experience with UI, SQL, Full-stack and Big Data technologies.
  • Responsible for enforcing data governance policies in Commercial and Regulated Big Data environments.

FAQs

What is the primary focus of the Big Data team at ServiceNow?

The Big Data team is responsible for delivering state-of-the-art monitoring, analytics, and actionable business insights by utilizing new tools, Big Data systems, and methodologies like AI and machine learning to improve efficiencies across various company functions.

What are the key responsibilities of a Staff Big Data Hadoop Administrator?

Key responsibilities include deploying, monitoring, maintaining, and supporting Big Data infrastructure and applications on ServiceNow Cloud and Azure environments, automating deployment processes, performance tuning, providing production support, and enforcing data governance policies.

What qualifications are required for this role?

Candidates should have at least 6+ years of overall experience with 4+ years in a DevOps role, extensive knowledge of the Hadoop/Big Data ecosystem, experience in securing Hadoop stacks, proficiency in multiple programming languages, and in-depth knowledge of Linux internals.

Is experience with CI/CD pipelines important for this position?

Yes, experience in supporting CI/CD pipelines, particularly in Cloudera and cloud environments like Azure/AWS, is highly valued for this role.

What programming languages should I be familiar with?

Applicants should have a good knowledge of Perl, Python, Bash, Groovy, and Java.

Are there any tools that would be beneficial to know for this position?

Familiarity with tools such as Tableau, Grafana, MariaDB, Prometheus, and deployment automation technologies like Puppet, Ansible, Terraform, Jenkins, and Docker is beneficial.

What kind of environment is the work persona for this role?

The work persona is flexible with options for remote work, but it may also require in-office presence depending on the nature of the tasks.

Does ServiceNow provide equal employment opportunities?

Yes, ServiceNow is an equal opportunity employer and all qualified applicants will receive consideration without regard to various protected categories.

Can candidates with non-traditional career paths apply for this role?

Yes, ServiceNow encourages candidates with diverse backgrounds and experiences to apply, as unique experiences enrich the team.

What should I do if I need accommodations during the application process?

If you require reasonable accommodations to complete any part of the application process, you can contact talent.acquisition@servicenow.com for assistance.

A purpose-driven company. Making work, work better for people guides everything we do.

Technology
Industry
10,001+
Employees
2004
Founded Year

Mission & Purpose

ServiceNow (NYSE: NOW) makes the world work better for everyone. Our cloud-based platform and solutions help digitize and unify organizations so that they can find smarter, faster, better ways to make work flow. So employees and customers can be more connected, more innovative, and more agile. And we can all create the future we imagine. The world works with ServiceNow.

Culture & Values

  • Wow our customers

  • Win as a team

  • Create belonging

  • Stay hungry and humble

Benefits

  • Generous family leave

  • Flexible PTO

  • Matched donations

  • 401(k) matching

  • Annual learning stipends

  • Paid volunteer time

Get notified when ServiceNow posts a new role

Get Hired with Huzzle

Discover jobs with AI-powered precision. Autofill and track applications, create tailored resumes, and find the best opportunities across the web – all by simply chatting.

Already have an account?