ML Ops Lead
Core
Lead infrastructure, cost-optimization, and deployment strategies for machine learning and generative AI models while managing a DevOps team.
Role type
Senior IC ML Ops Technical Lead
Builds
Foundational platforms for ML and GenAI models, including LLM production deployments and CI/CD frameworks
Domain
Cloud infrastructure, MLOps/LLMOps, Generative AI
Deliverable
production ML models
Required skills
Team leadership, MLOps/LLMOps pipeline architecture, LLM production deployment, FinOps and cloud cost management, Kubernetes, Terraform, Python
Preferred skills
Experience with MLflow, Kubeflow, LangSmith, Phoenix, Kubecost, Cloudability, Triton Inference Server, vLLM, Hugging Face TGI
Technologies
AWS, GCP, Azure, Kubernetes, Docker, Terraform, Ansible, Jenkins, GitHub Actions, Python, Bash, Go
Responsibilities
Lead and mentor a dedicated DevOps team; Define infrastructure roadmap for AI/ML workloads using IaC; Architect and optimize MLOps/LLMOps pipelines; Deploy LLMs into production with high availability; Establish FinOps frameworks to manage GPU/CPU budgets; Implement auto-scaling and spot instances for resource efficiency; Establish 24/7 incident response and observability; Enforce data governance and security protocols
Seniority
Senior, hands-on IC with team leadership
