Hadoop Developer
Core
Deploy, configure, and maintain Cloudera Hadoop clusters in production and nonproduction environments.
Role type
Senior Hadoop Administrator / Infrastructure Engineer
Builds
Enterprise data platforms and distributed computing infrastructure
Domain
Big Data / Distributed Systems
Deliverable
infrastructure
Required skills
Cloudera Hadoop administration, Cloudera Manager, HDFS, YARN, Hive, HBase, Spark, Impala, Oozie, ZooKeeper, Kafka, Linux (RHEL/CentOS), Shell scripting, Python, Ansible, Kerberos, Ranger, LDAP, SSL, cluster monitoring, performance tuning, disaster recovery, high-availability configuration
Preferred skills
Data platform migration, capacity planning, resource allocation
Technologies
Ansible, DevOps, Hadoop, Hive, Kafka, Linux, Python, RHEL, Spark, Yarn, ZooKeeper
Responsibilities
Add, remove, and decommission cluster nodes; Monitor cluster health, performance, capacity, and utilization; Install, upgrade, patch, and manage configurations; Diagnose and resolve cluster, application, storage, and performance issues; Administer Hadoop services; Maintain high-availability and disaster-recovery configurations; Apply security controls; Automate administrative work; Support data platform migrations and modernization; Collaborate with Data Engineering, DevOps, and Application teams; Create and maintain operational documentation.
Seniority
Senior, hands-on IC