Image Description

Sr. DevOps Engineer Hadoop

Job Description

Posted about 1 month ago

Rate: Depends on Experience

  • Bachelor's/Master's Degree with 6-10 yrs. of experience in Computer Science or related streams. 3+ years of experience of managing data platform, ETL pipelines.
  • Troubleshoot and triage issues related to data pipeline failures or slowness, built using Map Reduce, hive or Spark to ensure SLA adherence. These may be batch as well as streaming processes.
  • Resolve issues related to several data platform components and open source database solutions like Presto/Druid or cloud native components.
  • Resolve issues related to commercial tools and products, which are an integral part of platform.
  • Be a gate keeper to ensure sanity of production systems.
  • Builds tools to continuously monitor and alert platform components data pipelines.
  • Continually improve CI/CD tools, processes and procedures.
  • Participate in ongoing design, implementation, and maintenance of systems and tools across our data platform.
  • Write and maintain infrastructure documentation.
  • Own production incidents/issues and provide level 2 response to infrastructure incidents and alerts.
  • Work with third-party vendors to resolve infrastructure issues.
  • Identify right open source tools to improve infrastructure by performing research, POC/Pilot and/or interacting with various open source forums.
  • Deploy and monitor products on Cloud platforms.
  • Promote and support company policies, procedures, mission, values, and standards of ethics and integrity.
  • Strong understanding of continuous integration, deployment and operations concepts.
  • Experience with code repositories (Git) and continuous integration tools (Jenkins, Maven) and software provisioning and deployment automation tools (Ansible).
  • Excellent knowledge of Linux system.
  • Experience with configuration management. Experience with a UNIX shell scripting languages such as Bash, Ruby, Perl or Python. System administration exposure.
  • Experience in building scalable/highly available distributed systems in production a plus.
  • Ability to work with distributed teams in a collaborative and productive manner.
  • A self-motivated learner and builder with strong customer focus and obsession with quality.
  • Our Ideal Candidate:

    • You have a deep interest and passion for production systems, one who loves to debug issues, learn new technologies and write quick utilities to manage and maintain platform.
    • You have strong problem solving, analytical skills, decision-making and communication skills.
    • You are self-driven and motivated with the desire to work in a fast-paced, results-driven agile environment with varied responsibilities.
    • Also to ensure highest degree of support for this critical platform, you must be willing to be part of a team that supports 24x7 on rotation basis.

Job Summary

Image Description

Similar Jobs

The largest community on the web to find and list jobs that aren't restricted by commutes or a specific location.

Analytics Engineer

  • Mediavine

Mediavine is hiring a Rails engineer to work on their pro...

Doximity is hiring a Site Reliability Engineer. You will ...

Tucows is looking for a Senior Engineer in Test to help t...