Staff Data Engineer (Azure Databricks Platform)
Core
Lead the development, maintenance, and strategic evolution of the Azure Databricks platform to support healthcare delivery initiatives.
Role type
Staff Platform Data Engineer (Azure Databricks)
Builds
Scalable, reliable, and secure data platform infrastructure for healthcare data engineering teams.
Domain
Healthcare / Cloud Data Engineering
Deliverable
infrastructure
Required skills
Azure Databricks administration, Delta Lake, Unity Catalog, Terraform, Python, PySpark, SQL, CI/CD pipelines, distributed systems architecture, cost optimization, incident response, team leadership
Preferred skills
Azure Synapse, Kafka, Snowflake, healthcare data feeds
Technologies
Azure Databricks, Delta Lake, Unity Catalog, Terraform, GitHub, Azure AD, Azure Data Lake Storage, Apache Spark
Responsibilities
Oversee operational health, monitoring, and alerting of the platform; define strategic roadmap for platform features and best practices; manage data security and governance policies; implement cost and performance optimization strategies; maintain automated provisioning and scaling solutions; mentor data engineers and establish best practices; lead and direct platform engineering efforts
Seniority
Staff, hands-on leader with team management
