Staff Engineer, Databricks Platform
Core
Own and evolve the Databricks platform on AWS to support mission-critical data, analytics, and AI workloads for regulated healthcare data.
Role type
Staff Data Platform Engineer (Individual Contributor)
Builds
Shared Databricks foundation, guardrails, automation, observability, and self-service capabilities for Data Engineering, Analytics, ML Engineering, and AI teams.
Domain
Healthcare / Cloud Data Platform
Deliverable
infrastructure
Required skills
Databricks platform ownership, Unity Catalog administration, Terraform/IaC, AWS networking and IAM, observability and incident response, cloud cost optimization, Python automation, Spark troubleshooting.
Preferred skills
HIPAA-aligned controls, MLflow and model serving, multi-account/multi-region architectures, Databricks/AWS certifications.
Technologies
Databricks, AWS, Terraform, Unity Catalog, MLflow, Spark, Python, CloudWatch.
Responsibilities
Automate workspace provisioning and configuration; administer Unity Catalog and access models; define compute patterns and policies; build IaC strategies with Terraform; implement CI/CD workflows; establish reliability, observability, and FinOps practices; enable data and AI platform standards.
Seniority
Staff, hands-on IC with technical leadership