Lead Data Engineer 4C
Core
Lead a team of data engineers in developing and implementing Big Data solutions, designing scalable data pipelines and ETL processes.
Role type
Senior Lead Data Engineer
Builds
Scalable and reliable data pipelines, ETL processes, and Big Data solutions
Domain
Enterprise Data Engineering / Cloud Data Platforms
Required skills
Apache Airflow, Apache Kafka, Apache Spark, AWS Data Pipeline, Databricks Platform, Snowflake, SQL, Terraform, CI/CD, Data Modeling, Data Quality, Performance Tuning
Preferred skills
Certified Data Management Professional, Databricks Certified Associate Developer for Apache Spark, Microsoft Azure Data Engineer Associate, Oracle Database 12c Certified Implementation Specialist
Technologies
Apache Airflow, Apache Kafka, Apache Spark, AWS, Databricks, Snowflake, Terraform, Git
Responsibilities
Lead a team of data engineers; Design and build scalable data pipelines and ETL processes; Ensure data quality, integrity, and security; Collaborate with stakeholders to address business requirements; Provide technical guidance and mentorship to junior team members; Perform data analysis and troubleshooting to optimize system performance; Develop and maintain documentation for data processes and infrastructure.
Seniority
Senior, hands-on IC with leadership responsibilities