Big Data Engineer
Core
Operate, monitor, and support Hadoop-based data lake platforms, ensuring performance, reliability, and security of big data infrastructure.
Role type
Senior Big Data Engineer (Infrastructure Operations)
Builds
Hadoop Ecosystem & Data Lake environments
Domain
Big Data Infrastructure / Distributed Systems
Deliverable
infrastructure
Required skills
Hadoop Ecosystem operations, Big Data Services & Query Engines, Security & Access Control in Distributed Environments, Monitoring & Automation, Complex Issue Diagnosis, Capacity Management, Patch Management, Kerberos Authentication, Ranger/Sentry Policies, TLS Encryption
Preferred skills
Kafka, NiFi, Flume, ITIL processes, Cloudera certifications
Technologies
Hadoop, HDFS, Kafka, NiFi, Flume, Kerberos, Ranger, Sentry
Responsibilities
Operate and monitor Hadoop-based data lake platforms; Provide L3 incident response and deep troubleshooting; Ensure data integrity, replication, and capacity management; Develop and automate monitoring and alerting; Apply patches, upgrades, and configuration changes; Manage Kerberos authentication, Ranger/Sentry policies, and TLS encryption.
Seniority
Senior, hands-on IC