Senior AI Platform Engineer, Infrastructure Services
Core
Own the AI Gateway infrastructure (Kong AI Gateway) and self-hosted LLM serving stacks to secure, route, and monitor AI traffic for global enterprises.
Role type
Senior IC platform engineer (AI infrastructure)
Builds
AI Gateway platform, self-hosted LLM inference stacks, LLMOps practices, and observability for AI usage/cost.
Domain
Cybersecurity, AI/LLM infrastructure, Cloud-native platforms
Deliverable
production ML models | infrastructure
Required skills
Kubernetes, GitOps, CI/CD, API gateway, self-hosted LLM inference, infrastructure-as-code, GPU scheduling, LLMOps
Preferred skills
AI/LLM gateway patterns, enterprise auth, engineering productivity metrics, vector databases, model fine-tuning
Technologies
Kong, KCP, EKS, Okta, OIDC, Jenkins, JPAAS, ArgoCD, Artifactory, Xray, GitHub Enterprise, GitHub Actions, vLLM, NVIDIA Triton, TGI, Ollama, Milvus, Pinecone, pgvector
Responsibilities
Architect and scale Kong AI Gateway deployment; lead reliability and incident response for gateway issues; design cross-platform solutions integrating CI/CD and artifact management; evaluate and roll out AI developer tooling; set technical direction and mentor engineers; partner cross-functionally with security and product teams; host and serve local models with GPU capacity planning; support model lifecycle and RAG pipelines; track usage and cost across AI infrastructure.
Seniority
Senior, hands-on IC
