Director, Research - Evaluation & Training
Core
Lead a team of researchers to develop data evaluation, error analysis, and data valuation methods to predict model performance and guide data strategy.
Role type
Director, Research - Evaluation & Training
Builds
Novel evaluation techniques, error analysis frameworks, and data valuation metrics for frontier AI models.
Domain
Artificial Intelligence / Machine Learning / Data Strategy
Deliverable
production ML models
Required skills
Applied AI/ML leadership, data evaluation methodology, error analysis, data valuation techniques, benchmarking strategy, roadmap ownership, cross-functional communication
Preferred skills
Data attribution research, frontier lab experience, commercial AI data product knowledge
Technologies
LLMs, benchmarking frameworks
Responsibilities
Own multi-quarter roadmap for evaluation and data valuation; Synthesize model failure trends into dataset investment recommendations; Lead and grow a team of researchers; Act as bridge between research findings and Product/GTM/customers
Seniority
Director, hands-on IC with team leadership