Senior Data Engineer
Core
Design, develop, and maintain scalable data pipelines and ETL/ELT processes for large enterprise clients using cloud-native data platforms.
Role type
Senior hands-on IC data engineer
Builds
Scalable data pipelines, ETL/ELT processes, and batch workflows for Fortune 500 clients
Domain
Enterprise data engineering, big data, cloud-native platforms
Deliverable
production ML models
Required skills
Databricks, Apache Spark, Python, Scala, Hadoop, Control-M, SQL, ETL/ELT design, distributed data processing, performance tuning
Preferred skills
Generative AI, agentic AI, intelligent automation
Technologies
Databricks, Apache Spark, Python, Scala, Hadoop, Control-M
Responsibilities
Design and maintain scalable data pipelines; Develop and optimize ETL/ELT processes; Work with Hadoop ecosystem to process large volumes of data; Develop and optimize Spark applications; Use Control-M for scheduling and monitoring batch jobs; Troubleshoot job failures and resolve pipeline issues; Implement data validation and quality checks; Collaborate with data architects and analysts to deliver reliable data solutions.
Seniority
Senior, hands-on IC