DataOps Lead
Core
Design, manage, and deploy highly scalable and fault-tolerant distributed data pipelines and components for massive datasets from multiple channels.
Role type
Senior IC DataOps Lead
Builds
Highly scalable data pipelines, distributed components, and automation infrastructure for Fortune 500 clients
Domain
Big Data, Cloud Infrastructure, Data Engineering
Deliverable
production ML models | infrastructure
Required skills
Big data architecture, CI/CD pipeline design, Linux system management, scripting (Shell/Python), root cause analysis, technical leadership, hiring, team training
Preferred skills
Hadoop ecosystem (HDFS, MapReduce, Oozie, Hive, Impala, Spark, Kerberos, Kafka), container technologies (Docker, Kubernetes), configuration management
Technologies
GCP, AWS, Jenkins, Shell, Python, HDFS, MapReduce, Oozie, Hive, Impala, Spark, Kerberos, Kafka, Docker, Kubernetes
Responsibilities
Interface with VP/Director level clients to understand strategic requirements; Design and deploy scalable distributed components; Drive automation and engineering practices; Perform root cause analysis for production errors; Provide technical leadership and manage team operations; Conduct training for technology stack
Seniority
Senior, hands-on IC with strategic leadership
