Principal Engineer, Secure AI Gateway
Core
Architect and design a scalable, high-performance cloud API routing and orchestration platform to secure and inspect traffic for LLM providers and Generative AI services.
Role type
Principal Engineer, Secure AI Gateway
Builds
Cloud API Gateway platform for multi-provider LLM orchestration and security inspection
Domain
Cloud Security, Generative AI, Distributed Systems
Deliverable
production ML models | product features
Required skills
Golang, distributed systems, cloud-native architecture, Layer 3-7 networking, microservices, Linux system/kernel, Docker, Kubernetes, threat detection, DLP, credential management
Preferred skills
Generative AI platforms, multi-provider orchestration, deep packet inspection, UEBA, prompt injection mitigation, startup experience
Technologies
GoLang, Docker, Kubernetes, gRPC, REST, gdb, Valgrind
Responsibilities
Design and develop high-performance security systems for LLM APIs; define architectural direction for the Cloud API Gateway; lead engineering teams and mentor junior engineers; implement dynamic routing algorithms and load balancing; integrate security features like DLP and threat protection; perform code reviews and architectural reviews.
Seniority
Principal, hands-on IC with strategic leadership