Kong AI Gateway Engineer (Remote, United States)
Core
Architect, design, build, and support enterprise-grade AI Gateway solutions using Kong AI Gateway to manage LLM traffic, security, and governance.
Role type
Senior IC Kong AI Gateway Engineer
Builds
Unified gateway architecture for multiple LLM providers, AI observability dashboards, and secure API management frameworks.
Domain
Insurance technology / Generative AI / API Management
Deliverable
production ML models
Required skills
Kong Gateway (OSS/Enterprise), Kong Konnect, API Management, AI Gateway / LLM Proxy Development, OpenAI / Azure OpenAI Integration, Kubernetes, Docker, Helm, CI/CD, Prometheus, Grafana, Azure, AWS, GCP, Multi-LLM Integration, RAG Architecture, Vector Databases, LLMOps, MCP (Model Context Protocol)
Preferred skills
Cloud-native and microservices architectures, AI Systems, LLM Evaluation, Product Ownership
Technologies
Kong, OpenAI, Azure OpenAI, Anthropic Claude, Google Gemini, Mistral, Llama, Jenkins, GitHub Actions, Azure DevOps, Prometheus, Grafana, ELK, Splunk, Kubernetes, Docker, Helm
Responsibilities
Design and implement enterprise-grade AI Gateway solutions; Configure AI-specific policies including prompt logging and guardrails; Enable secure access to multiple LLM providers; Implement AI observability and cost governance; Develop routing strategies across multiple AI models; Integrate RAG-based AI services; Support AI agent and MCP-based integrations; Deploy and manage Kong in Kubernetes-based environments.
Seniority
Senior, hands-on IC
