Senior Systems Engineer, AI Gateway
Core
Build a network-edge AI Gateway layer that provides reliable, observable, and cost-controlled access to multiple AI models and providers for developers.
Role type
Senior Systems Engineer (AI Infrastructure)
Builds
High-throughput AI inference systems, APIs, routing primitives, observability features, SDKs, and developer workflows.
Domain
Cloud infrastructure, Edge computing, AI/ML infrastructure, Distributed systems
Deliverable
production ML models | product features | infrastructure
Required skills
Distributed systems design, High-throughput API design, Networking fundamentals, Observability, Reliability engineering, Performance optimization, Developer tooling (SDKs, CLIs, Dashboards), Prototyping, Technical communication
Preferred skills
AI/ML infrastructure experience, Inference platform experience, Proxy/Edge systems, TypeScript/Go/Rust, Agentic development workflows, Cost control strategies
Technologies
Cloudflare Workers AI, AI Gateway, Global network, Provider APIs
Responsibilities
Build core systems handling high-volume inference traffic across providers and models. Design and implement APIs, routing, and observability features. Collaborate with product and infrastructure teams to unify the AI platform. Turn ideas into prototypes and shipped features. Improve reliability, performance, and cost efficiency for latency-sensitive workloads. Build internal tools and automation to accelerate engineering. Mentor engineers through design and code reviews.
Seniority
Senior, hands-on IC
