Researcher, Evals
Core
Design evaluation frameworks to measure reasoning, memory, and interaction capabilities of next-generation AI models.
Role type
Senior IC research engineer (evaluations)
Builds
Evaluation pipelines, metrics, and user study systems for frontier generative models
Domain
Generative AI, machine intelligence, model evaluation
Deliverable
production ML models
Required skills
evaluation framework design, statistical analysis, system implementation, quantitative metric definition, user study design
Preferred skills
model alignment concepts, generative model evaluation approaches
Technologies
N/A
Responsibilities
Define key model capabilities and behaviors for next-generation evals; Develop and implement new evaluation pipelines with robust statistical analysis; Partner with model training and research teams to embed evaluation systems; Prototype user studies and behavioral experiments
Seniority
Senior, hands-on IC
