CareerPlan
IndiaRemoteFull-time2026-10-16 → 2026-11-19

Core

Build and maintain the operational backbone for agentic AI systems, ensuring reliable production deployment of LLM-powered solutions for internal teams and enterprise customers.

Role type

Senior IC LLMOps Engineer

Builds

Production-ready AI infrastructure, evaluation harnesses, and custom AI solutions for enterprise clients

Domain

AI/ML Operations, Enterprise Software

Deliverable

production ML models

Required skills

LLM system operations, RAG pipeline management, vector store infrastructure, cost governance, safety/compliance guardrails, CI/CD for AI, prompt versioning, observability

Preferred skills

LangFuse/LangSmith, RAG architectures, agent orchestration (LangGraph), LLM Gateways (LiteLLM), AI governance frameworks

Technologies

Python, Java, TypeScript, Go, Docker, Kubernetes, AWS/GCP/Azure, Terraform, GitHub Actions, Jenkins, SQL, NoSQL, Pinecone, Weaviate, pgvector, Vertex AI, Bedrock

Responsibilities

Build operational tooling for prompt/pipeline versioning and CI/CD; Implement monitoring for latency, token usage, and output quality; Design automated evaluation suites; Manage RAG pipelines and vector stores; Implement safety and compliance guardrails; Own cost governance for LLM usage

Seniority

Senior, hands-on IC