Staff Software Engineer, AI/ML Infrastructure
Core
Design, build, and ship scalable AI/ML infrastructure and evaluation platforms enabling GenAI-powered applications, model training, serving, and product teams to harness AI advances.
Role type
Staff Software Engineer (AI/ML Infrastructure)
Builds
AI/ML platform (LLM gateway, model training/serving, feature/data workflows, orchestration, observability) and AI evaluation platform (trace ingestion, scorers, LLM-as-judge calibration, regression gates, self-serve evaluation tooling)
Domain
Home services marketplace, Generative AI, Machine Learning Infrastructure
Deliverable
production ML models | infrastructure
Required skills
Technical leadership at staff level, distributed systems design, LLM-powered systems (gateways, lifecycle management, RAG, agentic architectures), AI evaluation systems, CI/CD, incident leadership, AI coding tools
Preferred skills
None stated
Technologies
LLM gateways, RAG, agentic architectures, LLM-as-judge, CI/CD, orchestration frameworks
Responsibilities
Design and deploy scalable tools for model training, serving, and evaluation; partner with scientists and product teams on multi-quarter roadmaps; evaluate next-gen AI infrastructure frameworks; drive projects to completion with focus on business impact; solve complex technical problems in AI infrastructure
Seniority
Staff, hands-on IC with strategic direction