Databricks Data Engineer (ICH Europe)
Core
Design and implement scalable end-to-end data pipelines (ETL/ELT) and data models for enterprise-grade data solutions and GenAI use cases.
Role type
Senior Data Engineer (Consulting)
Builds
Production-grade data products, analytics-ready datasets, and AI-ready data pipelines for multinational clients.
Domain
Cloud Data Engineering & Generative AI
Deliverable
production ML models | product features
Required skills
PySpark, Spark SQL, Delta Lake, Medallion architecture, SQL optimization, Git/CI-CD, Cloud platforms (AWS/Azure/GCP)
Preferred skills
Databricks Workflows, Unity Catalog, Kafka, dbt, Terraform, Vector databases
Technologies
Databricks, Apache Spark, Delta Lake, PySpark, Spark SQL, Git, AWS, Azure, GCP, Kafka, dbt, Terraform
Responsibilities
Design and implement scalable ETL/ELT pipelines using Databricks and Delta Live Tables; Develop and maintain data models using Lakehouse and Medallion architecture; Integrate diverse cloud and enterprise data sources into unified datasets; Implement DevOps and DataOps practices including CI/CD pipelines; Collaborate with data scientists to deliver production-grade data products; Build robust data transformations for AI/GenAI use cases.
Seniority
Mid-Senior, hands-on IC