Lead Data Engineer - Data Engineering 4C
Core
Lead a team of data engineers in developing and implementing Big Data solutions, designing scalable data pipelines, and ensuring data quality and security.
Role type
Senior IC Lead Data Engineer
Builds
Scalable and reliable Big Data solutions, data pipelines, and ETL processes
Domain
Enterprise technology / Big Data
Deliverable
production ML models
Required skills
Apache Airflow, Apache Kafka, Apache Spark, AWS Data Pipeline, Databricks Platform, Snowflake, SQL, Terraform, CI/CD, Data Modeling, Data Quality, Performance Tuning
Preferred skills
Certified Data Management Professional, Databricks Certified Associate Developer for Apache Spark, Microsoft Certified: Azure Data Engineer Associate, Oracle Database 12c Certified Implementation Specialist
Technologies
Apache Airflow, Apache Kafka, Apache Spark, AWS, Databricks, Snowflake, Terraform, Git
Responsibilities
Lead a team of data engineers; Design and build scalable data pipelines and ETL processes; Ensure data quality, integrity, and security; Provide technical guidance and mentorship; Perform data analysis and troubleshooting; Develop and maintain documentation
Seniority
Senior, hands-on IC with leadership responsibilities
