Senior AI DevOps / LLMOps
Core
Design and implement CI/CD pipelines, AI infrastructure as code, and progressive delivery strategies for LLMs and agentic workflows.
Role type
Senior AI DevOps / LLMOps specialist
Builds
Production-ready AI models, agentic workflows, and inference endpoints
Domain
Cloud infrastructure, MLOps, LLMOps, Hybrid Cloud
Deliverable
production ML models
Required skills
Kubernetes (K8s), CI/CD pipelines, Infrastructure as Code (Terraform/Pulumi), GPU cluster management, PromptOps, Progressive Delivery strategies, Observability, Security (OPA/Vault)
Preferred skills
Experience with KubeFlow, Ray, NVIDIA Triton, Weights & Biases, MLflow, LangSmith, Arize Phoenix
Technologies
Kubernetes, GitHub Actions, GitLab CI, Terraform, Pulumi, AWS, Azure, CUDA, Open Policy Agent, Vault
Responsibilities
Design and implement CI/CD pipelines for AI covering model weights and dataset versioning; Provision and manage high-performance compute environments using IaC; Architect Progressive Delivery strategies including Canary releases and Shadowing; Establish deep observability into Inference Endpoints and integrate feedback loops
Seniority
Senior, hands-on IC