Software Engineer, AI Gateway
Core
Developing and enhancing the AI Gateway platform, a unified API for accessing hundreds of AI models from multiple providers to enable developers to ship AI-powered applications.
Role type
Senior backend software engineer (distributed systems & API gateways)
Builds
Unified API endpoints, rate limit management, intelligent failover mechanisms, and provider-agnostic authentication for high-volume AI inference requests.
Domain
Cloud infrastructure, AI/ML integrations, distributed systems
Deliverable
production ML models | product features | infrastructure
Required skills
JavaScript/TypeScript, backend development, API design, cloud infrastructure, distributed systems, rate limiting, caching, failover mechanisms, high-throughput services, open source contribution
Preferred skills
Experience integrating with AI/ML models, working with cross-functional teams including AI researchers
Technologies
Next.js, v0, AI SDK, OpenAI, Anthropic, Google
Responsibilities
Design, implement, and maintain the AI Gateway platform; write clean, efficient, and well-documented code; conduct thorough testing for low-latency responses; integrate new AI providers and models; gather user feedback and analytics to drive innovations.
Seniority
Senior, hands-on IC
