Bigdata Developer
Core
Production support engineer for Hadoop-based big data platforms, ensuring system health, troubleshooting incidents, and optimizing performance for enterprise clients.
Role type
Senior IC Big Data Support Engineer
Builds
Maintains and stabilizes production Hadoop clusters and data pipelines for banking/financial clients
Domain
Financial Services / Big Data Infrastructure
Deliverable
infrastructure
Required skills
Hadoop ecosystem (HDFS, YARN, Hive, Spark), Kafka, Linux/Unix administration, SQL, Shell scripting, Python, log analysis, incident management, RCA
Preferred skills
Kubernetes/OpenShift, Airflow, ETL pipelines, cloud platforms (AWS/Azure/GCP), Git/CI/CD
Technologies
Hadoop, HDFS, Hive, Spark, Kafka, Sqoop, Oozie, Flume, NiFi, Cloudera CDP/CDH, YARN, Linux, Bash, Python
Responsibilities
Monitor platform health and analyze logs, troubleshoot production incidents and perform root cause analysis, manage job failures and performance bottlenecks, perform cluster maintenance and upgrades, create operational documentation and runbooks, participate in on-call support and incident management
Seniority
Mid-Senior, hands-on IC
