CareerPlan

Senior / Staff AI Platform Engineer

San FranciscoFull-time$228k–$363k2026-10-20 → 2026-11-20
On-site · United States

Core

Build APIs, SDKs, and shared tooling (eval infrastructure, tracing, model routing) to enable other teams to ship AI agent features faster.

Role type

Senior IC platform engineer (AI/LLM infrastructure)

Builds

Internal developer platform for AI agents, eval runners, observability dashboards, and model routing gateways

Domain

AI/LLM infrastructure, distributed systems, developer tooling

Deliverable

production ML models

Required skills

Backend/systems engineering, LLM/agent system experience, distributed systems, observability/tracing, SDK/API design, internal stakeholder management

Preferred skills

Eval/tracing product experience, LLM gateway experience, Python backend experience

Technologies

Python, LLM frameworks, distributed tracing tools, model routing infrastructure

Responsibilities

Design and build platform APIs and SDKs for agent features; Develop shared eval infrastructure and dashboards; Implement end-to-end tracing and observability; Manage model provider routing, fallback, and cost controls; Partner with engineering teams to onboard them to the platform

Seniority

Senior, hands-on IC