Data Engineer -Databricks - Tieto Tech Consulting (m/f/d)
Core
Design and develop scalable data pipelines and Lakehouse solutions using Azure Databricks, PySpark, and Delta Lake to transform enterprise data into business-ready products.
Role type
Senior Data Engineer (Lakehouse/Databricks)
Builds
Bronze, Silver, and Gold Lakehouse data layers; ETL/ELT solutions for manufacturing business processes
Domain
Manufacturing industry data engineering on Azure Databricks
Required skills
Azure Databricks, PySpark, SQL, Delta Lake, Lakehouse architecture, ETL/ELT, data modeling (Star Schema), Git/CI/CD, data quality/governance
Preferred skills
SAP data extraction/integration, manufacturing domain knowledge, Databricks Professional Certification
Technologies
Azure Databricks, PySpark, Apache Spark, Python, SQL, Delta Lake, Git, CI/CD
Responsibilities
Design and maintain scalable data pipelines; Implement Bronze, Silver, and Gold Lakehouse layers; Develop complex ETL/ELT solutions from SAP and other enterprise systems; Optimize Spark/PySpark workloads for performance; Implement data quality checks and monitoring; Develop analytical and dimensional data models; Participate in design reviews and code reviews
Seniority
Senior, hands-on IC