Principal AI Engineer
Core
Leads architecture and development of enterprise-scale AI orchestration and retrieval systems, defining how LLMs connect with tools, data sources, APIs, and specialized agents.
Role type
Principal AI Engineer (LLM Orchestration & RAG)
Builds
Central AI platform, MCP servers, agentic workflows, and reusable abstraction layers for product teams.
Domain
Artificial Intelligence, Large Language Models, Enterprise Software
Deliverable
production ML models | infrastructure
Required skills
LLM orchestration, agentic workflows, RAG system design, MCP server implementation, tool exposure strategy, multi-agent architecture, vector databases, hybrid search, context management, evaluation frameworks, observability, abstraction layer design
Preferred skills
None stated
Technologies
LangGraph, LlamaIndex, Semantic Kernel, MCP servers, vector stores
Responsibilities
Design and develop orchestration layers connecting LLMs with tools and data; Build and operate MCP servers; Define tool-surface strategies; Establish multi-agent patterns; Design and optimize RAG systems; Create abstraction layers decoupling product teams from models; Develop routing and context-window management strategies; Define evaluation frameworks; Establish observability and tracing; Implement safety measures and guardrails; Collaborate with product teams to onboard capabilities; Mentor engineers on standards.
Seniority
Principal, strategic leadership with hands-on engineering