CareerPlanSign in

Principal Engineer, Secure AI Gateway

USA💼 Full-time🗓 2026-09-02 → 2026-09-26

Core

Architect and develop scalable cloud security systems to detect and mitigate threats against LLM APIs and generative AI applications.

Role type

Principal Engineer, Secure AI Gateway

Builds

Go-based services for API routing, transformation, security, traffic inspection, load balancing, and failover for multi-provider LLM environments.

Domain

Cloud Security, Generative AI, Distributed Systems

Deliverable

production ML models | product features | infrastructure

Required skills

Go, C, C++, microservices, distributed systems, API gateways, networking (L3-L7), Linux kernel operation, Docker, Kubernetes, threat detection, DLP, UEBA, credential management, dynamic routing algorithms

Preferred skills

MSCS degree, startup experience

Technologies

Go, Docker, Kubernetes, gdb, Valgrind

Responsibilities

Define architectural strategy for Cloud API Gateway, design dynamic routing/orchestration algorithms, integrate security capabilities (DLP, UEBA), conduct technical research and code reviews, represent company in external forums

Seniority

Principal, hands-on IC with strategic leadership

Sourced via codingjobboard · Listed on CareerPlan, which tracks 70,000+ jobs from 20+ sources.