IT engineer data lakehouse M&E/QM
Core
Design, develop, and operate scalable data pipelines and data products in Azure Databricks to enable data-driven decision-making in Manufacturing & Engineering and Quality domains.
Role type
Senior Data Engineer (Data Lakehouse)
Builds
Scalable batch and streaming pipelines, bronze/silver/gold data layers, dimensional models, and curated data marts for Manufacturing & Engineering and Quality.
Domain
Automotive/Industrial Manufacturing & Engineering (M&E) and Quality
Deliverable
production ML models | product features | dashboards & analysis
Required skills
PySpark, Scala, Azure Databricks, CI/CD automation, TDD, data modeling (star/snowflake, 3NF), master data management, data quality rule implementation, performance tuning, legacy code refactoring
Preferred skills
Experience with SAP, Power BI integration, Unity Catalog, international team collaboration
Technologies
Azure Databricks, PySpark, Scala, SAP, Power BI, Unity Catalog
Responsibilities
Design scalable batch and streaming pipelines; Implement ingestion from structured and semi-structured sources; Build bronze/silver/gold data layers; Implement use-case driven dimensional models; Develop automated data validation tests; Monitor pipeline health and implement quality thresholds; Refactor legacy pipelines to improve scalability
Seniority
Mid-Senior, hands-on IC
