Databricks Platform Engineer (AWS)
Core
Build, secure, automate, and operate Databricks on AWS for enterprise data governance, AI/ML platforms, and GenAI use cases.
Role type
Senior IC Databricks Platform Engineer (AWS)
Builds
Production Databricks workspaces, Unity Catalog metastores, CI/CD pipelines, and AI/ML operationalization platforms
Domain
Cloud Infrastructure (AWS) + Data Platform Engineering (Databricks/Lakehouse)
Deliverable
production ML models | infrastructure
Required skills
Databricks administration, Unity Catalog, AWS infrastructure (VPC, IAM, S3, KMS), Terraform, CloudFormation, Python, SQL, CI/CD pipelines, cost optimization, observability
Preferred skills
Databricks Asset Bundles (DAB), MLflow, Model Serving, Feature Store, Vector Search, Mosaic AI, regulated enterprise environments
Technologies
Databricks, AWS, Terraform, CloudFormation, GitHub Actions, Jenkins, Python, SQL, TypeScript
Responsibilities
Provision and configure Databricks Accounts, Workspaces, Unity Catalog, and supporting AWS infrastructure; Design, deploy, and manage multi-environment platforms and automate provisioning; Implement and govern Unity Catalog for secure data sharing; Implement observability and operational monitoring; Analyze platform usage patterns and infrastructure costs for optimization; Support migration and onboarding of enterprise applications and AI/ML workloads; Leverage Databricks CLI, REST APIs, and Git integration for automation; Enable AI/ML and GenAI capabilities including MLflow and Model Serving; Provide hands-on troubleshooting and operational support; Partner with application teams and data engineers to recommend platform solutions.
Seniority
Senior, hands-on IC