Hadoop Admin

Role Overview

This position is for a Hadoop Administrator supporting enterprise-scale big data infrastructure for Infosys in Noida, with a Pan India hiring scope. The role focuses on running, securing, and improving Hadoop environments across the full cluster lifecycle.

Cluster Management

You will be responsible for setting up, configuring, and keeping Hadoop clusters running smoothly across platforms such as Cloudera, Hortonworks, and Apache Hadoop. The work also includes managing essential services like HDFS, YARN, and MapReduce, along with cluster expansion, software upgrades, and patch deployment.

Administration and Monitoring

The role involves continuous oversight of cluster performance, health, and usage trends. You will investigate and fix cluster failures, operational issues, and bottlenecks, while implementing monitoring and alerting solutions through tools such as Ambari, Cloudera Manager, and Grafana.

Security and Governance

You will manage Kerberos-based authentication and enforce data protection controls using Ranger or Sentry. The job also includes defining access permissions and maintaining secure user authorization across the Hadoop ecosystem.

Data Management

This role covers planning and managing storage, replication, and backup approaches for data in HDFS. You will also work on improving storage efficiency, tuning HDFS performance, and supporting data ingestion and integration pipelines.

Performance Optimization

A key part of the position is tuning resource usage across memory, CPU, and storage layers to improve cluster efficiency. You will also optimize YARN allocation and scheduling, and troubleshoot poor-performing jobs to restore expected throughput.

Integration and Ecosystem Support

You will provide support for related Hadoop ecosystem tools and technologies, including Hive, Spark, HBase, Sqoop, Flume, and Kafka.

Eligibility

Applicants should hold a B.Sc. in any specialization, B.C.A. in any specialization, or a B.Tech / B.E. in any specialization.