Data Architect, Databricks
Core
Design and scale an enterprise Databricks lakehouse platform on Azure to enable critical healthcare outcomes and data governance.
Role type
Senior hands-on Data Architect (Databricks)
Builds
Enterprise Databricks lakehouse platform (workspace, Unity Catalog, Delta Lake) for healthcare analytics
Domain
Healthcare technology / Cloud data engineering
Deliverable
production ML models | infrastructure
Required skills
Databricks platform architecture, Azure ADLS Gen2 networking and security, Delta Lake optimization, Unity Catalog governance, CI/CD for data platforms, streaming data ingestion (Kafka, CDC), regulated environment compliance (PHI/PII), technical leadership and mentorship
Preferred skills
Healthcare industry experience (HIPAA), early-stage platform scaling, Infrastructure-as-Code (Terraform, Azure Bicep), AI/ML data readiness pipelines
Technologies
Databricks, Azure, ADLS Gen2, Unity Catalog, Delta Lake, Kafka, Terraform, Azure Bicep
Responsibilities
Own end-to-end architecture for Databricks-on-Azure lakehouse including workspace design and cluster policies; Define medallion architecture standards (Bronze, Silver, Gold); Establish platform standards and reusable patterns; Design secure data access frameworks (RBAC, ABAC); Lead CI/CD and DevOps patterns for deployments; Optimize performance and cost across Delta Lake pipelines; Build reusable ingestion frameworks for structured and streaming data; Provide architectural guidance on PHI/PII data handling; Mentor engineers and establish design review practices
Seniority
Senior, hands-on IC
