Attorney, Evaluation Operations (Contract)
Core
Evaluate AI-generated legal content (memoranda, contracts, research) for accuracy and quality to improve legal AI products.
Role type
Independent contractor legal evaluator (AI product testing)
Builds
AI-powered legal solutions and evaluation datasets
Domain
Legal technology / Artificial Intelligence
Deliverable
production ML models
Required skills
Legal research, contract analysis, AI output evaluation, rubric development, dataset creation, critical thinking, legal writing
Preferred skills
Harvey experience, LexisNexis/Westlaw proficiency, prior AI content evaluation experience
Technologies
Harvey, LexisNexis, Westlaw
Responsibilities
Compare AI responses to legal tasks against rubrics; test pre-release features and provide feedback; review evaluation rubrics; create evaluation datasets; analyze AI-generated legal content; collaborate with product teams on research initiatives
Seniority
Mid-level, hands-on IC