Senior Data Engineer
Core
Senior Databricks Platform Engineer leading enterprise platform architecture, governance, security, and enablement for data engineering, analytics, and AI/ML teams.
Role type
Senior IC Databricks Platform Engineer (Technical Leadership)
Builds
Reusable platform frameworks, APIs, automation, reference implementations, and governed ML/GenAI capabilities
Domain
Biotechnology / Data Platform Engineering
Deliverable
production ML models | infrastructure
Required skills
Databricks platform architecture, Unity Catalog, AWS (IAM, VPC, S3, KMS), Python, PySpark, Apache Spark, Delta Lake, MLflow, Terraform, FinOps, observability, security governance
Preferred skills
EKS, Lambda, Glue, EMR, RDS, Declarative Automation Bundles, Collibra integration
Technologies
Databricks, AWS, Terraform, Python, PySpark, Apache Spark, Delta Lake, Unity Catalog, MLflow, Collibra
Responsibilities
Shape platform roadmap and reference architecture; Evaluate Databricks features and third-party technologies; Lead architecture reviews for account, workspace, and security; Build reusable frameworks and provisioning workflows; Design integrations for enterprise metadata and data quality; Enforce security guardrails and identity federation; Lead Databricks FinOps and cost optimization; Establish platform observability and SLOs; Enable governed ML, GenAI, and LLMOps; Improve platform reliability through root-cause analysis; Drive user enablement and best-practice communities
Seniority
Senior, hands-on IC with technical leadership
