Intern, AI Agent Evaluations
Core
Evaluate AI agents on real-world tasks, publish results on leaderboards, and support the Agentic Marketplace program.
Role type
Intern, Product Operations (AI Agent Evaluations)
Builds
AI agent evaluation leaderboards and vendor result packets
Domain
B2B Software / AI Agents
Deliverable
dashboards & analysis
Required skills
Task decomposition, test data creation, scoring rule definition, vendor communication, market trend tracking, clear writing
Preferred skills
Built AI agents or benchmarks, B2B software experience, customer-facing roles (support/sales/marketing), public AI writing
Technologies
LLM APIs, chat assistants, AI agents
Responsibilities
Break AI agent jobs into testable steps with tasks and scoring rules; Review scores from AI judges and human reviewers; Engage with hundreds of AI agent vendors; Track competitors and analyst firms in AI agent evaluation
Seniority
Intern
