CareerPlanSign in

AI LLMOps Engineering Technical Leader

San Jose, California, US💼 Full-time💰 $216,300–$216,300🗓 2026-08-20 → 2026-09-26

Core

Drive the operationalization of complex autonomous agent architectures (Agentic AI) into secure, scalable, and high-performing production environments for Cisco's Customer Experience platform.

Role type

Senior IC AI LLMOps Engineering Technical Leader

Builds

Agentic AI platforms, MLOps pipelines, and model serving architectures for customer-facing products

Domain

AI/ML, Cloud Infrastructure, Customer Experience

Deliverable

production ML models

Required skills

MLOps practices, LLM operationalization (OpenAI, Anthropic, Llama), LLM frameworks (LangChain, LangSmith), Python/Java, API development (FastAPI, Flask, Spring Boot), CI/CD for ML, MLOps frameworks (ClearML, MLflow, Weights & Biases), containerization (Docker, Kubernetes)

Preferred skills

Agentic AI development, multi-agent workflows, GPU compute scaling, AI API gateways (Apache APISIX, LiteLLM), threat modeling (prompt injection, data leakage), technical mentorship

Technologies

OpenAI, Anthropic, Llama, LangChain, LangSmith, FastAPI, Flask, Spring Boot, ClearML, MLflow, Weights & Biases, Docker, Kubernetes, Apache APISIX, LiteLLM

Responsibilities

Define and establish robust MLOps practices and foundational ML pipelines; Design and implement telemetry monitoring tools for token usage and agent reasoning; Manage containerized models on GPU clusters; Guide architectural choices and mentor peers on Agentic AI platforms

Seniority

Senior, hands-on IC with leadership responsibilities

Sourced via workday · Listed on CareerPlan, which tracks 70,000+ jobs from 20+ sources.