Lead Data Engineer Lille (F/H)
Core
Lead Data Engineer leading a team to build and maintain data pipelines, connecting IT and business teams, and supporting data scientists in industrializing their work.
Role type
Senior IC Lead Data Engineer
Builds
Data ingestion, processing, and exposure pipelines; cloud data infrastructure
Domain
IT Consulting / Data Engineering
Deliverable
production ML models | infrastructure
Required skills
Distributed computing frameworks (Spark, Storm, Flink), Programming languages (Python, Java, C/C++, Scala), SQL and NoSQL databases, Data streaming frameworks (Kafka, Kinesis), Cloud platforms (AWS, GCP, Azure), Infrastructure as Code (Terraform, CloudFormation), Agile delivery
Preferred skills
Experience building architectures from scratch to production, Community engagement and knowledge sharing
Technologies
Spark, Storm, Flink, Python, Java, C/C++, Scala, SQL, NoSQL, Kafka, Kinesis, AWS, GCP, Azure, Terraform, CloudFormation
Responsibilities
Lead a data engineering team to develop new data pipelines; Validate team design choices; Ensure production deployment and maintainability of data flows; Collaborate with data scientists to support model industrialization; Deploy full cloud infrastructure using Infrastructure as Code; Participate in internal and external data community events; Document mission learnings through blogs and internal reports
Seniority
Senior, hands-on IC with team leadership