MLOps Engineer (Databricks/AWS)
Core
Design, develop, and maintain end-to-end machine learning operations pipelines on Databricks running on AWS to productionize models.
Role type
Senior MLOps Engineer (Databricks/AWS)
Builds
Scalable, production-grade ML systems and automated ML workflows
Domain
Cloud Infrastructure (AWS) + Machine Learning Operations
Deliverable
production ML models
Required skills
Databricks Machine Learning, MLflow, AWS services, Python, PySpark, SQL, Terraform, CI/CD pipelines, Unity Catalog, Apache Spark, model monitoring
Preferred skills
Multi-environment Databricks deployments, cost optimization strategies, MLOps operational documentation
Technologies
Databricks, AWS, MLflow, Terraform, Git, Bitbucket, Jenkins, Databricks Asset Bundles (DAB), Delta Lake, ECS/EKS, CloudWatch, Secrets Manager
Responsibilities
Design and maintain end-to-end MLOps pipelines; Build and automate ML workflows covering data preparation, feature engineering, training, evaluation, deployment, and monitoring; Deploy and manage ML models using MLflow Model Registry and Databricks Model Serving; Develop and maintain CI/CD pipelines for ML solutions; Collaborate with Data Scientists to productionize models; Monitor model health, prediction quality, data drift, and system performance; Optimize Databricks workloads for performance, scalability, and cost efficiency; Implement Infrastructure as Code using Terraform; Ensure platform security, governance, and compliance using Unity Catalog and AWS IAM; Troubleshoot production issues and perform root cause analysis; Document MLOps processes and operational best practices
Seniority
Senior, hands-on IC