CareerPlanSign in

Staff Engineer, AI Product

USA💼 Full-time🗓 2026-09-23 → 2026-09-26

Core

Design and implement scalable distributed systems for AI agents, optimizing reliability, performance, and cost.

Role type

Staff Engineer, AI Platform Infrastructure

Builds

Scalable distributed systems for AI agents and the underlying AI platform

Domain

AI Infrastructure / Distributed Systems

Deliverable

production ML models | infrastructure

Required skills

distributed systems, microservices, Kubernetes, infrastructure as code, production debugging, observability, system architecture, technical leadership, cross-stack coding

Preferred skills

LLM applications, agent frameworks, AI/ML infrastructure, prompt engineering, RAG patterns, vector databases, multi-model AI systems (OpenAI, Anthropic, Google)

Technologies

Kubernetes, OpenAI, Anthropic, Google

Responsibilities

Design and implement scalable distributed systems for AI agents; Establish testing strategies, observability systems, and engineering practices; Own the technical roadmap and architectural decisions; Mentor engineers and lead technical initiatives; Debug production issues and improve system uptime; Collaborate with ML engineers and researchers to productionize AI capabilities

Seniority

Staff, hands-on IC with leadership

Sourced via codingjobboard · Listed on CareerPlan, which tracks 70,000+ jobs from 20+ sources.