Senior Staff Engineer, Data Platform
Core
Architect and build the data platform and AI pipelines for a Generative AI healthcare company, focusing on Databricks lakehouse, data governance, and LLM workloads.
Role type
Senior Staff Engineer (Data Platform & AI Infrastructure)
Builds
Production-grade Databricks lakehouse, Spark/SQL pipelines, AI/LLM data foundations, and Temporal orchestration workflows.
Domain
Healthcare + Data Engineering & AI Infrastructure
Deliverable
production ML models
Required skills
Databricks (Lakehouse, Delta Lake, Unity Catalog), Spark, SQL, Python, Temporal, LLM data pipelines, data governance, agentic coding tools, cross-team leadership
Preferred skills
Snowflake, Microsoft Fabric, healthcare data (FHIR, HL7, PHI), cloud infrastructure (GCP/AWS/Azure), Terraform, Kubernetes, open-source contributions
Technologies
Databricks, Spark, Delta Lake, Unity Catalog, Temporal, Python, SQL, Terraform, Kubernetes, GCP, AWS, Azure
Responsibilities
Architect and evolve the Databricks lakehouse; design and optimize Spark/SQL pipelines; define data contracts and PHI-aware governance; build data foundations for LLMs; design durable workflows on Temporal; lead agentic engineering practices; set technical direction and mentor teams.
Seniority
Senior Staff, hands-on IC with strategic scope