CareerPlanSign in

Director of Engineering, AI Platform

San Francisco💼 Full-time💰 $306,000–$306,000🗓 2026-08-04 → 2026-09-26

Core

Lead the AI Platform organization building foundational systems for retrieval, model serving, inference, and evaluation to power agentic enterprise software workflows.

Role type

Director of Engineering, AI Platform

Builds

AI platform infrastructure including search/retrieval systems, model serving pipelines, inference infrastructure, and evaluation frameworks for enterprise customers.

Domain

Enterprise SaaS / Artificial Intelligence / Infrastructure

Deliverable

production ML models | infrastructure

Required skills

Engineering leadership (managing managers), AI infrastructure architecture, model serving and inference optimization, cost-per-execution management, RAG and agentic frameworks, vendor strategy, cross-functional partnership

Preferred skills

Asynchronous communication, distributed team leadership, evidence-based decision making, platform mindset

Technologies

LLMs, RAG, inference providers, open-weight models, frontier models

Responsibilities

Drive multi-year technical strategy for AI platform, optimize infrastructure costs and unit economics, establish AI evaluation frameworks, lead and mentor engineering managers, manage model portfolio strategy, architect AI infrastructure, partner cross-functionally with product and finance

Seniority

Director, hands-on leadership

Sourced via greenhouse · Listed on CareerPlan, which tracks 70,000+ jobs from 20+ sources.