AI Operations Engineer
Core
Own the company's internal AI Gateway, deploy and serve LLMs, optimize AI spend, and make codebases agent-ready.
Role type
Senior IC AI Operations Engineer (LLM Gateway & Agent Infrastructure)
Builds
Internal AI Gateway, dashboards for AI spend, agent-ready repositories, and CI/CD guardrails
Domain
Enterprise Network Automation / AI Infrastructure
Deliverable
production ML models
Required skills
Python, production software engineering, container orchestration, CI/CD, API integration, observability, LLM deployment, cost optimization, agent development
Preferred skills
vLLM/Ollama/TGI, LiteLLM/Portkey, React/TypeScript, MCP servers, SOC 2/ISO 27001 awareness
Technologies
Python, vLLM, Ollama, TGI, LiteLLM, Portkey, React, TypeScript, CI/CD tools
Responsibilities
Deploy and serve open-source and third-party LLMs; aggregate AI spend and build cost-reduction dashboards; maintain agent instruction files and CI guardrails; advise on security and data governance; contribute to product AI features
Seniority
Senior, hands-on IC (L2/L3)
