Senior Data Engineer
Core
Design and build a governed enterprise data platform on Azure Databricks, Unity Catalog, and Delta Lake for SAP/manufacturing domains.
Role type
Senior IC data engineer (data platform & governance)
Builds
Scalable ELT/ETL pipelines, data catalog, and medallion architecture (Bronze/Silver/Gold) on Azure Databricks
Domain
Semiconductor manufacturing / Supply chain / SAP ecosystem
Deliverable
production ML models | product features | dashboards & analysis
Required skills
Spark, Delta Lake, distributed processing, Advanced SQL, Python, Databricks, Unity Catalog, ELT/ETL, data modelling, orchestration, catalog design, PII handling, data governance, CI/CD, Git
Preferred skills
SAP data (S/4HANA, Datasphere), FI/CO/SD/MM/PP/GL domains, manufacturing/supply-chain business flow, Oracle/SQL Server, CDC ingestion, Jira, GDPR/APPI awareness
Technologies
Azure Databricks, Unity Catalog, Delta Lake, Spark, Fivetran, SAP Datasphere, ADF, Entra ID, Git, Jira
Responsibilities
Design data catalog with functional teams; Align ingestion strategy per source; Model data to medallion flow; Build scalable ELT/ETL pipelines; Apply governance by design; Handle PII correctly; Ensure data quality, performance, and security; Drive CI/CD and DevOps practices; Mentor junior engineers
Seniority
Senior, hands-on IC with mentorship