Lead Data Engineer (m/f/d)
Core
Manage and oversee the entire data engineering process from acquisition to analysis, designing and maintaining scalable data infrastructure.
Role type
Lead Data Engineer
Builds
Scalable and efficient data systems, data pipelines, and data warehouses.
Domain
Big Data, Cloud Infrastructure, Data Engineering
Deliverable
production ML models | infrastructure
Required skills
Python (expert), SQL/NoSQL (expert), Spark, Hadoop, Kafka, ETL/ELT, Data Warehouse design, Cloud platforms (AWS/GCP/Azure)
Preferred skills
Java, Scala, Team management, Project management, Agile methodology
Technologies
Python, Spark, Hadoop, Kafka, AWS, GCP, Azure, SQL, NoSQL
Responsibilities
Design and implement data pipelines for large and complex datasets; Mentor and lead a team of data engineers; Monitor and optimize data system performance; Collaborate with data scientists and business stakeholders to meet data needs.
Seniority
Senior, hands-on IC with leadership responsibilities