Data Engineer Databricks Senior - H/F - CDI
Core
Senior Data Engineer responsible for end-to-end data integration (acquisition, preparation, modeling, storage, exposure) and managing a team of Big Data and Cloud Engineers.
Role type
Senior IC Data Engineer (Team Lead)
Builds
Data pipelines, data models, and cloud-based data solutions for clients.
Domain
Big Data, Cloud Infrastructure, Data Engineering
Deliverable
production ML models
Required skills
Spark, Databricks, Scala, Python, SQL, Cloud platforms (AWS), Data storage (HDFS, S3), DevOps tools (Jenkins, GitLab, Maven), Data modeling
Preferred skills
Real-time streaming (Kafka + Spark Streaming), DataOps, DataVault, DataMesh concepts, Agile methodologies
Technologies
Databricks, Spark, AWS, Kafka, Jenkins, GitLab, Maven, HDFS, S3, Scala, Python, SQL
Responsibilities
Manage Big Data and Cloud Engineers, provide technical coaching and code reviews, define solution architecture, develop and optimize data pipelines, perform benchmarking and client consulting, share knowledge and conduct internal training
Seniority
Senior, hands-on IC with team management