Data Platform DevOps Engineer
Core
Design, build, secure, and automate an enterprise Data Platform on AWS to enable data teams to operate and scale efficiently.
Role type
Senior Data Platform DevOps Engineer
Builds
Databricks workspaces, AWS infrastructure (VPC, PrivateLink, IAM, S3, Lambda, EKS, Fargate), and CI/CD frameworks
Domain
Cloud Infrastructure (AWS) + Data Engineering (Databricks)
Deliverable
production ML models | infrastructure
Required skills
Terraform, AWS services, Databricks (Unity Catalog, Asset Bundles, Lakehouse architecture), GitLab CI/CD, Python, Bash/Shell scripting, SDLC/DataOps
Preferred skills
Databricks Certified Data Engineer Professional, AWS Solutions Architect certification
Technologies
Terraform, AWS, Databricks, GitLab CI, Unity Catalog, Delta Lake, CloudWatch
Responsibilities
Deploy and maintain Databricks workspaces and AWS infrastructure using Terraform; Automate governance layer and access controls within Unity Catalog; Implement policies and guardrails for governance and cost control; Automate identity and access management using Terraform; Oversee GitLab CI/CD pipelines and transition to automated workflows; Standardize deployment strategies using Databricks Asset Bundles; Configure monitoring, alerting, and logging for platform stability; Serve as escalation point for platform-related incidents; Document best practices and conduct workshops.
Seniority
Senior, hands-on IC