Staff Data Engineer (Databricks)
Core
Design, build, and support an enterprise-scale Azure Databricks lakehouse platform for cross-functional analytics needs.
Role type
Staff Data Engineer (Databricks)
Builds
Azure Databricks lakehouse, data pipelines, orchestration, and integrations with internal systems
Domain
Data Engineering, Cloud (Azure), Big Data
Deliverable
production ML models
Required skills
Azure Databricks, PySpark, Delta Lake, Unity Catalog, SQL, Python, Data Modeling, DevOps (Terraform, GitHub Actions), Architecture Design
Preferred skills
Databricks certifications, Data Governance, Row Level Security (RLS), Vendor Management, Delta Live Tables, Streaming, FinOps
Technologies
Azure Databricks, Delta Lake, Unity Catalog, Azure ADLS, Azure SQL, Azure Data Factory, Terraform, GitHub Actions, Power BI, Tableau
Responsibilities
Define and drive the engineering roadmap for the Azure Databricks lakehouse; Lead architecture and design for new data products; Set engineering standards for CI/CD and testing; Partner with stakeholders to scope solutions; Own production reliability and cost optimization; Lead and coach a team of data engineers.
Seniority
Staff, hands-on IC with leadership