Staff AI Platform Engineer, Infrastructure Services
Core
Design, build, and operate the AI Gateway infrastructure (Kong AI Gateway) and self-hosted LLM serving stacks to secure and deliver AI services for global enterprises.
Role type
Staff AI Platform Engineer (Infrastructure)
Builds
AI Gateway platform, self-hosted LLM inference stacks, and LLMOps infrastructure
Domain
Cybersecurity, AI/ML Infrastructure, Cloud Native
Deliverable
production ML models | infrastructure
Required skills
Kubernetes, API Gateway (Kong), CI/CD, GitOps, Infrastructure as Code, GPU infrastructure, LLMOps, Technical leadership
Preferred skills
AI/LLM gateway patterns, Enterprise auth (Okta/OIDC), Engineering productivity metrics, Vector databases/RAG, Model fine-tuning
Technologies
Kong, KCP, EKS, Okta, OIDC, Jenkins, JPAAS, ArgoCD, Artifactory, Xray, GitHub Enterprise, vLLM, NVIDIA Triton, TGI, Ollama, Milvus, Pinecone, pgvector
Responsibilities
Architect and scale the Kong AI Gateway deployment; lead reliability and incident response for gateway issues; design cross-platform solutions integrating CI/CD and artifact management; evaluate and roll out AI developer tooling; set technical direction and mentor engineers; host and operate self-hosted model serving infrastructure; support the broader model lifecycle including LLMOps practices; track usage and cost across AI services.
Seniority
Staff, high-autonomy technical leadership
