CareerPlanSign in

LLMops Engineer

India💼 Full-time🗓 2026-10-06

Core

Build and maintain the operational backbone for agentic AI systems, ensuring reliable production deployment, monitoring, and cost governance for LLM-powered solutions. (via careerplan.io/jobs/6212857004-llmops-engineer-at-coursera)

Role type

Senior IC LLMOps Engineer

Builds

Production-ready LLM systems, RAG pipelines, and evaluation tooling for internal teams and enterprise customers

Domain

AI/ML Operations, Enterprise Education Platforms

Deliverable

production ML models

Required skills

LLM system operations, RAG pipeline management, vector database infrastructure, prompt/pipeline versioning, automated evaluation suites, cost governance, cloud platform expertise, infrastructure-as-code, CI/CD workflows

Preferred skills

LLMOps-specific tooling (LangFuse, LangSmith), agent orchestration frameworks (LangGraph), MCP implementation, enterprise AI ecosystems (Vertex AI, Bedrock)

Responsibilities

Build operational tooling for prompt/pipeline versioning and CI/CD; Implement monitoring for latency, token usage, and output quality; Design automated evaluation suites for hallucination detection; Manage RAG pipelines and vector stores; Implement safety guardrails and PII redaction; Own cost governance for LLM usage

Seniority

Senior, hands-on IC