ML Ops Engineer
Core
Build and run the infrastructure that serves ML models in production, managing the path from research to production including packaging, release, serving, and monitoring.
Role type
ML Ops Engineer
Builds
Production ML model serving infrastructure, release flows, and monitoring pipelines
Domain
Cloud infrastructure, AI/ML operations, Enterprise security
Deliverable
production ML models
Required skills
DevOps, cloud infrastructure, CI/CD pipelines, infrastructure as code, containerization, model serving, cost optimization
Preferred skills
AWS SageMaker, LLM serving frameworks, model optimization, Kubernetes, ML workflow tools
Technologies
AWS SageMaker, Terraform, GitHub Actions, Docker, vLLM, TGI, Triton, ONNX, Kubernetes, MLflow, Airflow
Responsibilities
Build and run infrastructure for serving ML models on AWS SageMaker and other cloud platforms; Own the model release flow including packaging, versioning, CI/CD, safe rollout and rollback; Host and run open-weight models and LLMs on CPU and GPU; Build pipelines for datasets, training jobs and evaluation; Monitor models in production for latency, errors, quality, and drift; Keep compute costs under control by choosing instance sizes and tracking GPU spend
Seniority
Mid-Senior, hands-on IC
