Data Engineer H/F - Databricks
Core
Design, develop, and maintain robust, scalable data pipelines and cloud data platforms for large corporate clients using Databricks.
Role type
Senior Data Engineer (Databricks/Cloud)
Builds
Cloud data platforms and data pipelines for enterprise clients
Domain
Big Data / Cloud
Deliverable
production ML models | product features
Required skills
Databricks, Delta Lake, Spark SQL, Python, SQL, Scala, Airflow, DBT, CI/CD, Docker, Kubernetes, Terraform
Preferred skills
MLflow, Snowflake, Redshift, BigQuery, NLP, clustering
Technologies
Databricks, Spark, Delta Lake, Hadoop, Snowflake, Redshift, BigQuery, Airflow, DBT, Dataiku, Talend, AWS, Azure, GCP
Responsibilities
Design and maintain scalable data pipelines on Databricks; Integrate data from multiple sources (relational databases, APIs, files, streaming); Collaborate with Data Scientists to industrialize ML models; Ensure data quality, security, and reliability; Participate in Cloud and Big Data architecture decisions; Automate deployment and monitoring via DataOps and CI/CD.
Seniority
Senior, hands-on IC
