LLMops Engineer
Core
Build and maintain the operational backbone for agentic AI systems, ensuring reliable production deployment of LLM-powered solutions for internal teams and enterprise customers.
Role type
Senior IC LLMOps Engineer
Builds
Production-ready AI infrastructure, evaluation harnesses, and custom AI solutions for enterprise clients
Domain
AI/ML Operations, Enterprise Software
Deliverable
production ML models
Required skills
LLM system operations, RAG pipeline management, vector store infrastructure, cost governance, safety/compliance guardrails, CI/CD for AI, prompt versioning, observability
Preferred skills
LangFuse/LangSmith, RAG architectures, agent orchestration (LangGraph), LLM Gateways (LiteLLM), AI governance frameworks
Technologies
Python, Java, TypeScript, Go, Docker, Kubernetes, AWS/GCP/Azure, Terraform, GitHub Actions, Jenkins, SQL, NoSQL, Pinecone, Weaviate, pgvector, Vertex AI, Bedrock
Responsibilities
Build operational tooling for prompt/pipeline versioning and CI/CD; Implement monitoring for latency, token usage, and output quality; Design automated evaluation suites; Manage RAG pipelines and vector stores; Implement safety and compliance guardrails; Own cost governance for LLM usage
Seniority
Senior, hands-on IC
