CareerPlan

Subject Matter Expert, Legal

San FranciscoFull-time2026-11-10 → 2026-11-16
Hybrid

Core

Define quality standards for legal work and evaluate AI model outputs to improve legal reasoning and analysis capabilities.

Role type

Senior Subject Matter Expert in Law (AI Evaluation)

Builds

AI evaluation rubrics, reference legal documents, and training datasets for legal AI models

Domain

Legal industry + Artificial Intelligence

Deliverable

production ML models

Required skills

Law firm practice experience, deep expertise in commercial transactions/corporate law/litigation/regulatory work, legal research and writing, rubric design, model evaluation, workflow prototyping

Preferred skills

Experience designing AI benchmarks/datasets, improving legal workflows via technology, training lawyers

Technologies

AI tools, LLMs

Responsibilities

Define quality bars for legal work, design realistic AI model evaluations, create reference legal documents, develop rubrics for legal accuracy, evaluate model outputs and provide feedback, partner with research on datasets and training tasks

Seniority

Senior, hands-on IC