Research Lead, Open Benchmarks Grants
Core
Design state-of-the-art datasets and benchmarks for frontier AI model training and evaluation, translating research insights into customer-facing narratives.
Role type
Staff/Senior Research Scientist (Data-Centric AI)
Builds
Expert-curated datasets, benchmarks, and evaluation frameworks for frontier and agentic AI systems.
Domain
Artificial Intelligence / Machine Learning / Data-Centric AI
Deliverable
production ML models
Required skills
AI/ML evaluation, NLP, rigorous experimental design, LLM evaluation research, cross-functional collaboration, technical storytelling, GTM strategy alignment
Preferred skills
Ph.D. in machine learning/NLP, startup dynamics experience, commercial AI data services background
Technologies
LLMs, frontier AI models, data operations platforms
Responsibilities
Design datasets for frontier model training/evaluation, translate benchmark insights into customer narratives, collaborate with product/engineering on roadmap, stay at frontier of LLM evaluation research, represent research externally via publications/talks
Seniority
Staff/Senior, hands-on IC with strategic influence
