Staff Data Engineer (Azure Databricks Platform)
Core
Lead the development, maintenance, and strategic evolution of the Azure Databricks platform to support healthcare delivery initiatives.
Role type
Staff Platform Data Engineer (Azure Databricks)
Builds
Scalable, reliable, and secure data platform infrastructure on Azure Databricks
Domain
Healthcare / Cloud Data Engineering
Deliverable
infrastructure
Required skills
Azure Databricks administration, Delta Lake, Unity Catalog, Terraform, Python/PySpark, SQL, CI/CD pipelines, distributed systems architecture, incident response, cost optimization
Preferred skills
Azure Synapse, Kafka, Snowflake, healthcare data feeds
Responsibilities
Oversee operational health, monitoring, and alerting of the platform; define strategic roadmap for platform features; manage security and governance policies; optimize cluster performance and cloud costs; maintain IaC and CI/CD tooling; mentor data engineers; lead a team of 2 platform engineers
Seniority
Staff, hands-on leader with team management