Lead Data Engineer 4C
Core
Lead a team of data engineers in designing and delivering scalable, reliable Big Data solutions and ETL processes.
Role type
Senior IC lead data engineer (Big Data)
Builds
Enterprise-scale data pipelines, ETL processes, and data integration workflows
Domain
Big Data, Cloud Data Platforms
Deliverable
production ML models
Required skills
Apache Spark, Apache Kafka, Apache Airflow, Databricks, Snowflake, AWS Data Pipeline, SQL, Terraform, CI/CD, Git, Data Modeling, Data Quality Management
Preferred skills
Certified Data Management Professional, Databricks Certified Associate Developer for Apache Spark, Microsoft Certified: Azure Data Engineer Associate, Oracle Database 12c Certified Implementation Specialist
Technologies
Apache Spark, Apache Kafka, Apache Airflow, Databricks, Snowflake, AWS, Terraform, Git
Responsibilities
Lead and coordinate a team of data engineers in the design, development, and implementation of Big Data solutions; Design, build, and maintain scalable, reliable data pipelines and ETL processes; Ensure data quality, integrity, consistency, and security across data platforms and systems; Collaborate with business stakeholders and technical teams to understand requirements and translate them into effective data engineering solutions; Provide technical direction, guidance, and mentorship to junior data engineers; Monitor, analyze, and troubleshoot data systems to identify performance issues and improve efficiency, reliability, and scalability; Develop, maintain, and update technical documentation covering data processes, systems, pipelines, and infrastructure.
Seniority
Senior, hands-on IC with leadership responsibilities