Senior Databricks DevOps Engineer
Core
Design, automate, and maintain enterprise-scale Databricks environments, serving as a technical leader and mentor to enable data engineers, scientists, and analysts.
Role type
Senior Databricks DevOps Engineer (Platform Engineering)
Builds
CI/CD pipelines, infrastructure as code, workspace governance, and operational reliability across cloud-based Lakehouse environments.
Domain
Cloud Data Engineering & DevOps
Deliverable
production ML models
Required skills
Terraform, Databricks Terraform Provider, Python, Bash, PowerShell, Apache Spark, Delta Lake, Unity Catalog, Git workflows, Cloud networking (VNet/VPC), CI/CD tools (Azure DevOps, GitHub Actions, Jenkins), Monitoring (Datadog, Grafana), MLOps (MLflow)
Preferred skills
Databricks certifications, Cloud certifications (AWS/Azure), Databricks Asset Bundles, Delta Live Tables, Docker, Kubernetes, FinOps
Technologies
Databricks, AWS, Azure, GCP, Terraform, Azure DevOps, GitHub Actions, GitLab CI, Jenkins, Datadog, Azure Monitor, CloudWatch, Grafana, MLflow, Delta Lake, Unity Catalog
Responsibilities
Design and manage Databricks workspaces using IaC; Build and maintain CI/CD pipelines for notebooks, jobs, and ML models; Implement and administer Unity Catalog and data governance; Configure and optimize clusters and SQL warehouses; Establish security best practices including network isolation and SSO; Develop monitoring and observability solutions; Automate environment promotion and release management; Support MLOps workflows; Troubleshoot platform issues and lead root-cause analysis; Partner with engineering and security teams; Mentor junior engineers; Ensure compliance with regulatory requirements.
Seniority
Senior, hands-on IC with mentorship responsibilities