Data Engineer Databricks – H/F
Core
Technical lead for industrializing scalable Big Data pipelines and ML workflows on Databricks for large-scale analytical and AI projects.
Role type
Senior Data Engineer (Databricks)
Builds
Robust, scalable data pipelines and industrialized ML models on Databricks
Domain
Big Data / Cloud / Data Engineering
Deliverable
production ML models
Required skills
Databricks, Delta Lake, Spark SQL, Python, SQL, Scala, Airflow, DBT, CI/CD, Docker, Kubernetes, Terraform
Preferred skills
MLflow, Snowflake, Redshift, BigQuery, AWS, Azure, GCP, DataOps
Responsibilities
Design, develop, and maintain robust and scalable data pipelines on Databricks; Transform and integrate data from multiple sources (relational databases, APIs, files, streaming); Collaborate with Data Scientists to industrialize Machine Learning and Analytics models; Ensure data quality, security, and reliability on Databricks Cloud environments; Participate in Cloud and Big Data architecture choices to optimize performance and scalability; Automate deployment and monitoring processes via DataOps and integrated CI/CD.
Seniority
Senior, hands-on IC
