Data Engineer _DEPS_ MTCR
Core
Senior Data DevOps Engineer managing and optimizing Cloudera platforms, building CI/CD pipelines, and supporting enterprise-scale data processing workloads for banking and financial services clients.
Role type
Senior IC Data DevOps Engineer
Builds
Production data processing pipelines and optimized Cloudera environments
Domain
Financial services / Big Data Infrastructure
Deliverable
production ML models | infrastructure
Required skills
Cloudera CDP/CDH administration, HDFS, PySpark, Python, Hive, YARN, Jenkins, CI/CD pipeline development, SQL optimization, Linux administration, SAST tool integration (Checkmarx)
Technologies
Cloudera, Hadoop, Spark, Python, Jenkins, GitHub, Bitbucket, Checkmarx, Hive, Impala
Responsibilities
Administer and support Cloudera CDP/CDH platforms; Develop, deploy, and optimize PySpark and Python-based data processing solutions; Build and maintain CI/CD pipelines; Write and optimize SQL queries; Monitor platform health and perform upgrades; Implement security controls and governance best practices
Seniority
Senior, hands-on IC