Software Engineer, Benchmarking
Core
Building and maintaining infrastructure to evaluate frontier AI models for researchers, developers, and policymakers.
Role type
Software Engineer (AI Benchmarking)
Builds
AI benchmarking infrastructure and new evaluation benchmarks
Domain
Artificial Intelligence / Machine Learning
Deliverable
production ML models
Required skills
software engineering, benchmarking infrastructure, AI model evaluation, benchmark design, system integration
Preferred skills
experience with AI providers, experiment facilitation
Technologies
AI model evaluation frameworks, benchmarking platforms
Responsibilities
run and maintain benchmarking infrastructure, integrate with AI providers, set up existing benchmarks, design and develop new benchmarks, facilitate internal experiments
Seniority
Individual Contributor
Sourced via lever · Listed on CareerPlan, which tracks 70,000+ jobs from 20+ sources.
