CareerPlanSign in

Software Engineer, Search Infrastructure

San Francisco💼 Full-time🗓 2026-09-25

Core

Design, build, and operate large-scale distributed systems connecting AI models with search at ChatGPT scale, focusing on orchestration, inference efficiency, and production reliability.

Role type

Senior IC software engineer (search infrastructure)

Builds

Search orchestration services, inference systems, experimentation tooling, and search APIs for ChatGPT

Domain

AI/ML infrastructure, distributed systems, search technology

Deliverable

production ML models | product features | infrastructure

Required skills

large-scale distributed systems design, search/information retrieval, ML infrastructure, inference serving, systems debugging, cross-language programming, technical planning, stakeholder alignment

Preferred skills

performance optimization, resource efficiency, A/B testing automation, observability, incident response

Technologies

distributed systems, search APIs, experimentation tooling, observability platforms

Responsibilities

Design and evolve services for search classification, retrieval, ranking, and model inference; Improve end-to-end latency, throughput, and infrastructure efficiency; Build experimentation tooling and automation for A/B tests; Own production reliability through observability and incident response; Build search APIs and tool interfaces for models and agents

Sourced via ashby · Listed on CareerPlan, which tracks 70,000+ jobs from 20+ sources.