CareerPlan

Senior AI DevOps / LLMOps

Remote jobFull-time2026-06-19 → 2026-11-19

Core

Design and implement CI/CD pipelines, AI infrastructure as code, and progressive delivery strategies for LLMs and agentic workflows.

Role type

Senior AI DevOps / LLMOps specialist

Builds

Production-ready AI models, agentic workflows, and inference endpoints

Domain

Cloud infrastructure, MLOps, LLMOps, Hybrid Cloud

Deliverable

production ML models

Required skills

Kubernetes (K8s), CI/CD pipelines, Infrastructure as Code (Terraform/Pulumi), GPU cluster management, PromptOps, Progressive Delivery strategies, Observability, Security (OPA/Vault)

Preferred skills

Experience with KubeFlow, Ray, NVIDIA Triton, Weights & Biases, MLflow, LangSmith, Arize Phoenix

Technologies

Kubernetes, GitHub Actions, GitLab CI, Terraform, Pulumi, AWS, Azure, CUDA, Open Policy Agent, Vault

Responsibilities

Design and implement CI/CD pipelines for AI covering model weights and dataset versioning; Provision and manage high-performance compute environments using IaC; Architect Progressive Delivery strategies including Canary releases and Shadowing; Establish deep observability into Inference Endpoints and integrate feedback loops

Seniority

Senior, hands-on IC