Principal Data Engineer (Databricks)
Core
Designing, building, and optimizing production-grade data pipelines on Databricks while establishing engineering standards and mentoring the team.
Role type
Principal Data Engineer (Databricks)
Builds
Production data pipelines, semantic layers, and optimized data platforms for Finance and IT stakeholders.
Domain
Data Engineering / Cloud Data Platform
Deliverable
production ML models | product features | infrastructure
Required skills
Databricks, Spark Declarative Pipelines (SDP), Python, SQL, Spark, data modeling, query optimization, CI/CD, data governance, stakeholder management, team mentoring
Preferred skills
SAP S/4HANA, Fivetran (SaaS connectors and HVR), Power BI semantic modelling
Technologies
Databricks, Spark, Python, SQL, Fivetran, SAP S/4HANA, Power BI
Responsibilities
Designing and building robust production-grade data pipelines; optimizing platform performance and cost; defining and maintaining consistent business metrics and a semantic layer; integrating data from core business systems; setting and upholding engineering standards; coaching and mentoring junior and mid-level engineers; partnering with business stakeholders to shape practical solutions.
Seniority
Principal, hands-on IC with leadership
