CareerPlan

Senior Databricks DevOps Engineer

Washington, DCFull-time2026-10-26 → 2026-11-16
Citizens onlySecurity clearance required

Core

Design, automate, and maintain enterprise-scale Databricks environments, serving as a technical leader and mentor to enable data engineers, scientists, and analysts.

Role type

Senior Databricks DevOps Engineer (Platform Engineering)

Builds

CI/CD pipelines, infrastructure as code, workspace governance, and operational reliability across cloud-based Lakehouse environments.

Domain

Cloud Data Engineering & DevOps

Deliverable

production ML models

Required skills

Terraform, Databricks Terraform Provider, Python, Bash, PowerShell, Apache Spark, Delta Lake, Unity Catalog, Git workflows, Cloud networking (VNet/VPC), CI/CD tools (Azure DevOps, GitHub Actions, Jenkins), Monitoring (Datadog, Grafana), MLOps (MLflow)

Preferred skills

Databricks certifications, Cloud certifications (AWS/Azure), Databricks Asset Bundles, Delta Live Tables, Docker, Kubernetes, FinOps

Technologies

Databricks, AWS, Azure, GCP, Terraform, Azure DevOps, GitHub Actions, GitLab CI, Jenkins, Datadog, Azure Monitor, CloudWatch, Grafana, MLflow, Delta Lake, Unity Catalog

Responsibilities

Design and manage Databricks workspaces using IaC; Build and maintain CI/CD pipelines for notebooks, jobs, and ML models; Implement and administer Unity Catalog and data governance; Configure and optimize clusters and SQL warehouses; Establish security best practices including network isolation and SSO; Develop monitoring and observability solutions; Automate environment promotion and release management; Support MLOps workflows; Troubleshoot platform issues and lead root-cause analysis; Partner with engineering and security teams; Mentor junior engineers; Ensure compliance with regulatory requirements.

Seniority

Senior, hands-on IC with mentorship responsibilities