Software Engineer - Evals
Core
Design, build, and ship mission-critical research platforms and evaluation instruments to measure AI model capabilities, behaviors, and training growth.
Role type
Software Engineer - Evals
Builds
Evaluation infrastructure, datasets, grading schemes, and internal tools for xAI's frontier research.
Domain
Artificial Intelligence / Machine Learning / Research Infrastructure
Deliverable
production ML models | product features
Required skills
Software engineering, first principles reasoning, product taste, attention to detail, rapid prototyping, system design
Preferred skills
AI/ML workflows, annotation tools, evals, component libraries, design systems
Technologies
None explicitly stated
Responsibilities
Create and execute instruments for measuring model capabilities and behaviors; diagnose agent failures and design improvements; manage execution infrastructure; design datasets and grading schemes.
Seniority
All levels (New Grad to Senior)
