Staff / Sr. Staff Engineer, AI Gateway
Core
Architect, build, and scale core backend systems and microservices for the AI Gateway product that enables global enterprises to securely adopt and govern Generative AI.
Role type
Staff / Sr. Staff Software Engineer (Backend & Distributed Systems)
Builds
Scalable backend services, high-throughput APIs, and microservices for SaaS and on-prem/hybrid AI Gateway environments.
Domain
Cybersecurity / Generative AI / Distributed Systems
Deliverable
production ML models
Required skills
Golang, Python, Microservices Architecture, Distributed Systems, Networking (Layer 4-7, Proxy, TLS), Kubernetes, AI Coding Agents, System Design, Debugging
Preferred skills
GenAI Ecosystem (LLM providers, streaming, agentic protocols), Cybersecurity (SWG)
Technologies
Golang, Python, Kubernetes, Docker, RESTful/gRPC, LLM providers (OpenAI, Anthropic, Gemini), LangChain, LlamaIndex
Responsibilities
Architect and build scalable backend services and high-throughput APIs; Integrate and audit AI-driven engineering tools; Design resilient distributed systems for streaming and proxy routing; Collaborate with global teams to translate AI features into software; Drive engineering excellence via reviews and mentorship; Debug complex systemic issues across microservices and networking layers.
Seniority
Staff / Sr. Staff, hands-on IC