CareerPlanSign in

LLM Operations Engineer

USA💼 Full-time🗓 2026-09-20 → 2026-09-26

Core

Design and build multi-agent AI systems, LLM applications, and autonomous assistants using prompt engineering, orchestration, and RAG pipelines.

Role type

Senior IC LLM Operations Engineer (Multi-Agent Systems)

Builds

Scalable AI solutions, agentic workflows, and enterprise copilots

Domain

Generative AI, Industrial, Energy, IoT

Deliverable

production ML models

Required skills

Python, Multi-agent orchestration, LLM evaluation frameworks, Knowledge graphs, Prompt engineering, Cloud platforms (Azure/AWS/GCP), Containerization (Docker/Kubernetes)

Preferred skills

Domain experience in industrial, energy, or IoT environments

Technologies

OpenAI, Hugging Face Transformers, LangChain, AutoGen, CrewAI, Semantic Kernel, FAISS, Pinecone, Weaviate

Responsibilities

Design multi-agent collaboration protocols, optimize latency/cost/accuracy, ensure AI safety and governance, deploy scalable AI solutions with LLMOps practices

Seniority

Senior, hands-on IC

Sourced via codingjobboard · Listed on CareerPlan, which tracks 70,000+ jobs from 20+ sources.