Principal Data Engineer
Core
Design, develop, and operationalize complex data pipelines and platform capabilities while setting standards for data quality and performance.
Role type
Principal Data Engineer (hands-on IC)
Builds
Scalable data pipelines, bronze-to-gold medallion layers, and lakehouse architectures
Domain
Cloud data engineering (Azure ecosystem)
Deliverable
production ML models | infrastructure
Required skills
SQL, PySpark, Python, Azure Databricks, Unity Catalog, Delta Live Tables, CI/CD, data governance
Preferred skills
Microsoft Fabric, Power BI semantic models, MLflow, cluster optimization
Technologies
Azure Databricks, Delta Live Tables, Azure Data Factory, Azure Synapse, ADLS Gen2, Event Hubs, Azure DevOps, Git
Responsibilities
Design and build scalable data pipelines; Architect bronze-to-gold medallion layers; Govern and extend Unity Catalog; Lead platform reliability engineering; Define and enforce data engineering standards
Seniority
Principal, hands-on IC with significant influence and mentorship