Data Engineer (m/w/d) - Azure & Databricks
Core
Design, build, and optimize scalable data pipelines and cloud data platforms (Lakehouse) for a food industry company, integrating data from SAP and non-SAP systems to support analytics and AI initiatives.
Role type
Senior Data Engineer (Cloud & Data Platform)
Builds
Scalable ETL/ELT pipelines, data models, and data products on Azure Databricks
Domain
Food industry, Cloud Data Engineering, Data Platform
Required skills
SQL, Python, Apache Spark, PySpark, Azure Databricks, Data Modeling, ETL/ELT, Data Architecture, Data Quality, Requirements Engineering
Preferred skills
SAP Datasphere, SAP Business Data Cloud, Data Governance
Technologies
Microsoft Azure, Azure Databricks, Apache Spark, PySpark, SAP
Responsibilities
Develop and optimize ETL/ELT processes; Integrate and transform data from SAP and non-SAP systems; Design and evolve modern Cloud Data Platforms and Lakehouse architectures; Ensure data quality, performance, and monitoring; Collaborate with BI, Analytics, and business units to translate requirements into technical solutions.
Seniority
Senior, hands-on IC