Staff Software Engineer, AI/ML Infrastructure
Core
Design, build, and ship scalable AI/ML infrastructure and evaluation platforms enabling GenAI applications, model training, serving, and product teams' AI innovation at Thumbtack.
Role type
Staff Software Engineer, AI/ML Infrastructure
Builds
AI/ML platform (LLM gateway, model training/serving, feature/data workflows, orchestration, observability) and AI evaluation platform (trace ingestion, scorers, LLM-as-judge calibration, regression gates, self-serve evaluation tooling)
Domain
Home services marketplace, Generative AI, Machine Learning Infrastructure
Deliverable
production ML models | infrastructure
Required skills
Technical leadership at staff level, distributed systems design, LLM-powered systems (gateways, RAG, agentic architectures), AI evaluation systems, CI/CD for ML, incident leadership, AI coding tools proficiency
Preferred skills
None stated
Technologies
LLM gateways, RAG, agentic architectures, LLM-as-judge, CI/CD, orchestration frameworks
Responsibilities
Design and deploy scalable tools for model training, serving, and evaluation; partner with scientists and product teams on multi-quarter roadmaps; evaluate next-gen AI infrastructure frameworks; solve complex technical problems in AI infrastructure
Seniority
Staff, hands-on IC with technical leadership
