Senior Data Engineer
Core
Technical owner of the Databricks Lakehouse platform ensuring reliability, scalability, security, and cost efficiency for enterprise data products, analytics, and AI/ML workloads.
Role type
Senior IC Data Platform Engineer (Databricks)
Builds
Databricks platform infrastructure, IaC, CI/CD pipelines, and reference architectures for AI/ML workloads
Domain
Genomics / Data Platform Engineering
Deliverable
production ML models | infrastructure
Required skills
Databricks platform administration, Unity Catalog, PySpark, Python, SQL, Infrastructure as Code (Terraform), CI/CD, AWS fundamentals, FinOps, platform security and governance, distributed systems design
Preferred skills
Databricks Certified Data Engineer Professional, AWS Certified Solutions Architect, experience in compliance-driven environments (SOX, GxP), mentoring engineers
Technologies
Databricks, Unity Catalog, PySpark, SQL, Terraform, GitHub Actions, AWS (S3, IAM, VPC, KMS), MLflow, Delta Lake
Responsibilities
Own workspace- and account-level architecture including compute policies and identity management; design and review IaC and CI/CD capabilities; manage platform reliability, incident response, and SLOs; run FinOps for cost optimization; implement security and governance controls; enable AI/ML workload patterns; mentor engineers and establish AI-native engineering practices
Seniority
Senior, hands-on IC with mentorship responsibilities
