Attorney, Evaluation Operations (Contract)
Remote · from United StatesFreelance / independent contractor
Core
Evaluate and grade AI-generated legal outputs (memos, contracts, research) against rubrics to ensure quality before product release.
Role type
Contract attorney (evaluation operations)
Builds
Evaluation datasets and qualitative feedback for Harvey's AI legal product
Domain
Legal technology / AI evaluation
Deliverable
production ML models
Required skills
Legal analysis, rubric assessment, dataset construction, AI tool usage, legal writing
Preferred skills
Prior AI output grading, Lexis/Westlaw proficiency, in-house experience
Technologies
Harvey platform, Lexis, Westlaw
Responsibilities
Compare AI outputs for legal tasks, test pre-release features, review grading rubrics, build evaluation datasets
Seniority
Mid-level specialist
