CareerPlanSign in

Staff Software Engineer, AI Platform

San Francisco💼 Full-time💰 $231,000–$231,000🗓 2026-04-24 → 2026-09-25

Core

Design and build platform-level systems, abstractions, and infrastructure for Harvey's agentic AI products, focusing on model routing, context management, and evaluation frameworks.

Role type

Staff Software Engineer, AI Platform

Builds

Shared AI foundation including model routing, agent infrastructure, context management, and evaluation tooling for all Harvey products.

Domain

Legal technology / Agentic AI / Enterprise AI Platform

Deliverable

production ML models | infrastructure

Required skills

Backend systems architecture, AI/ML engineering, multi-model system design, context management, SDK development, technical leadership, system design judgment, full ownership mindset

Preferred skills

Evaluation framework design, agent/function-calling architectures, legal domain experience, early-stage startup experience

Technologies

Agentic AI systems, foundation models, distributed systems, SDKs

Responsibilities

Design and build abstractions and platform-level systems for agentic products; Own infrastructure for model integration, routing, and evaluation; Build evaluation frameworks for AI quality iteration; Partner with product teams to launch AI products; Evaluate and integrate emerging AI advancements.

Seniority

Staff, hands-on IC with technical leadership

Sourced via ashby · Listed on CareerPlan, which tracks 70,000+ jobs from 20+ sources.