LLMops Engineer
Core
Build and maintain the operational backbone for agentic AI systems, ensuring reliable production deployment, monitoring, and cost governance for LLM-powered solutions. (via careerplan.io/jobs/6212857004-llmops-engineer-at-coursera)
Role type
Senior IC LLMOps Engineer
Builds
Production-ready LLM systems, RAG pipelines, and evaluation tooling for internal teams and enterprise customers
Domain
AI/ML Operations, Enterprise Education Platforms
Deliverable
production ML models
Required skills
LLM system operations, RAG pipeline management, vector database infrastructure, prompt/pipeline versioning, automated evaluation suites, cost governance, cloud platform expertise, infrastructure-as-code, CI/CD workflows
Preferred skills
LLMOps-specific tooling (LangFuse, LangSmith), agent orchestration frameworks (LangGraph), MCP implementation, enterprise AI ecosystems (Vertex AI, Bedrock)
Responsibilities
Build operational tooling for prompt/pipeline versioning and CI/CD; Implement monitoring for latency, token usage, and output quality; Design automated evaluation suites for hallucination detection; Manage RAG pipelines and vector stores; Implement safety guardrails and PII redaction; Own cost governance for LLM usage
Seniority
Senior, hands-on IC