Principal Engineer, Secure AI Gateway
Core
Architect and design scalable cloud API routing and orchestration platforms for LLM providers and AI services, processing 10+ Gbps of traffic to detect threats and apply dynamic security policies.
Role type
Principal Engineer, Secure AI Gateway
Builds
High-performance cloud-based security systems for LLM APIs and Generative AI applications
Domain
Cloud Security, Generative AI, Distributed Systems
Deliverable
production ML models
Required skills
Golang, distributed systems, microservices, deep packet inspection, threat detection, DLP, UEBA, credential management, system/kernel level Linux, Docker, Kubernetes
Preferred skills
Startup experience, TDD, prompt injection mitigation, jailbreak mitigation
Technologies
GoLang, Docker, Kubernetes, gRPC, REST, gdb, Valgrind
Responsibilities
Design and architect high-performance scalable cloud security systems; Define strategic technical directions for the Cloud API Gateway platform; Lead and mentor junior engineers; Perform architectural and code reviews; Integrate security features like DLP and UEBA for LLM-specific attack patterns.
Seniority
Principal, hands-on IC with leadership
