Consultant Data Engineer Databricks (H/F)
Core
Design, develop, and optimize scalable data pipelines on Databricks to meet business needs.
Role type
Data Engineer (Databricks)
Builds
Data pipelines, Data Lake, and Data Warehouse architectures
Domain
Big Data, Cloud Data Platforms
Deliverable
production ML models
Required skills
Databricks, Delta Lake, Apache Spark, Python, SQL, Scala, CI/CD
Preferred skills
Azure Data Factory, AWS, Google Cloud
Technologies
Databricks, Delta Lake, Spark, Python, SQL, Scala, Azure Data Factory, AWS, Google Cloud
Responsibilities
Design and develop scalable data pipelines; Automate data ingestion, processing, and storage; Collaborate with Data Science and Analytics teams; Maintain and evolve Data Lake and Data Warehouse architectures; Document processes and train users on Databricks best practices.