DevOps Engineer (Databricks-based Data as a Product Platform)
Core
Designing and building robust CI/CD pipelines and infrastructure-as-code practices for a Data as a Product platform on Databricks and AWS.
Role type
Senior DevOps Engineer (Cloud/Platform)
Builds
Automated CI/CD pipelines, managed platform environments, and integrations for data and engineering teams.
Domain
Cloud Infrastructure, Data Engineering, DevOps
Deliverable
production ML models | infrastructure
Required skills
CI/CD pipeline design and operation, Infrastructure as Code (Terraform), AWS core services, Python/Bash scripting, GitOps practices, Observability integration, DORA metrics tracking, LLM/AI tooling integration
Preferred skills
Databricks workspace administration, Unity Catalog governance, Workflow orchestration tools
Technologies
Databricks, AWS, Terraform, GitHub Actions, GitLab CI, CodePipeline, Datadog, Claude/Anthropic APIs
Responsibilities
Design and maintain CI/CD pipelines for Databricks and AWS workloads; Manage platform environments as code using Terraform; Implement GitOps practices for infrastructure configuration; Build integrations with third-party platforms (Datadog, Claude/Anthropic); Automate provisioning and lifecycle management of AWS resources; Develop monitoring, logging, and alerting for pipeline health; Define and track engineering metrics (DORA metrics) to improve platform efficiency.
Seniority
Senior, hands-on IC
