Data Engineer Databricks confirmé - H/F - CDI
Core
Big Data Engineer responsible for data integration, acquisition, preparation, modeling, storage, and exposure using Databricks and Spark.
Role type
Senior Big Data Engineer (Databricks/Spark)
Builds
Data pipelines and data infrastructure for clients in banking, energy, transport, and other sectors.
Domain
Big Data, Cloud Infrastructure, Data Engineering
Deliverable
production ML models | infrastructure
Required skills
Spark, Databricks, Scala, Python, SQL, HDFS, S3, Kafka, Spark Streaming, Jenkins, GitLab, Maven
Preferred skills
Cloud platform experience (AWS), Real-time data streaming, Agile methodologies
Technologies
Databricks, Spark, Kafka, AWS, HDFS, S3, Jenkins, GitLab, Maven
Responsibilities
Analyze technical business needs, define solution architecture, develop and optimize data pipelines, perform code reviews, support testing and production deployment, share technical knowledge with the team
Seniority
Senior, hands-on IC