Subject Matter Expert, Legal
Core
Define quality standards for legal work and evaluate AI model outputs to improve legal reasoning and analysis capabilities.
Role type
Senior Subject Matter Expert in Law (AI Evaluation)
Builds
AI evaluation rubrics, reference legal documents, and training datasets for legal AI models
Domain
Legal industry + Artificial Intelligence
Deliverable
production ML models
Required skills
Law firm practice experience, deep expertise in commercial transactions/corporate law/litigation/regulatory work, legal research and writing, rubric design, model evaluation, workflow prototyping
Preferred skills
Experience designing AI benchmarks/datasets, improving legal workflows via technology, training lawyers
Technologies
AI tools, LLMs
Responsibilities
Define quality bars for legal work, design realistic AI model evaluations, create reference legal documents, develop rubrics for legal accuracy, evaluate model outputs and provide feedback, partner with research on datasets and training tasks
Seniority
Senior, hands-on IC