Senior / Staff AI Platform Engineer
Core
Build APIs, SDKs, and shared tooling (eval infrastructure, tracing, model routing) to enable other teams to ship AI agent features faster.
Role type
Senior IC platform engineer (AI/LLM infrastructure)
Builds
Internal developer platform for AI agents, eval runners, observability dashboards, and model routing gateways
Domain
AI/LLM infrastructure, distributed systems, developer tooling
Deliverable
production ML models
Required skills
Backend/systems engineering, LLM/agent system experience, distributed systems, observability/tracing, SDK/API design, internal stakeholder management
Preferred skills
Eval/tracing product experience, LLM gateway experience, Python backend experience
Technologies
Python, LLM frameworks, distributed tracing tools, model routing infrastructure
Responsibilities
Design and build platform APIs and SDKs for agent features; Develop shared eval infrastructure and dashboards; Implement end-to-end tracing and observability; Manage model provider routing, fallback, and cost controls; Partner with engineering teams to onboard them to the platform
Seniority
Senior, hands-on IC