Full stack Software Engineer III
Core
Build and evolve AI-aware gateway components that classify and handle AI traffic in real time, implementing policies for rate limits, usage caps, and access rules.
Role type
Senior Full Stack Software Engineer (AI Gateway)
Builds
AI traffic classification systems, policy enforcement engines, and observable usage/billing signals
Domain
Cloud Infrastructure / AI Infrastructure / API Gateways
Deliverable
production ML models
Required skills
Go, TypeScript, React, HTML, CSS, statically typed compiled languages, AI/LLM edge cases, system design, abstraction design
Preferred skills
AI platforms, inference infrastructure, API gateways, usage limits/quotas, billing-adjacent systems, customer-facing observability tools
Technologies
Go, Rust, C++, Java, TypeScript, React, HTML, CSS
Responsibilities
Design and implement AI Gateway Traffic Policy Objects; Build systems to measure AI requests and tokens; Expose observable and explainable signals for traffic and policies; Develop AI-specific gateway abstractions; Collaborate with cross-functional teams on usage data and billing signals; Ship reliable production systems handling traffic spikes and model behavior issues
Seniority
Senior, hands-on IC