Data Platform Engineer, Senior Staff
Core
Design, build, and operate a modern data platform using Databricks Lakehouse as the core foundation.
Role type
Senior Staff Data Platform Engineer
Builds
Scalable, distributed data platform systems, end-to-end data pipelines, and cloud infrastructure.
Domain
Cloud Infrastructure & Data Engineering
Deliverable
production ML models
Required skills
System design, Cloud infrastructure, Data pipelines, Infrastructure as Code, CI/CD, Python, Bash, AWS, Databricks, Amazon EKS, Terraform, SQL, NoSQL
Preferred skills
Data observability, Data ingestion tools, Secret management, Policy-as-code, Static code analysis, Data lineage, Serverless compute optimization
Technologies
Databricks, AWS, Terraform, Terramate, Amazon EKS, Unity Catalog, Delta Lake, MLflow, GitHub Actions, Jenkins, Helm, OPA, Sonar
Responsibilities
Design and build scalable distributed data platform systems, Own Databricks workspace architecture and governance, Implement infrastructure as code, Build and support end-to-end data pipelines, Develop and maintain CI/CD pipelines, Operate and optimize Amazon EKS clusters, Define and monitor SLIs/SLOs, Lead incident response and post-mortems, Implement security and compliance controls, Mentor engineers
Seniority
Senior Staff, hands-on IC with mentorship