CareerPlan

Attorney, Evaluation Operations (Contract)

USRemoteContract2026-11-13 → 2026-11-16
Remote · from United StatesFreelance / independent contractor

Core

Evaluate AI-generated legal content (memoranda, contracts, research) for accuracy and quality to improve legal AI products.

Role type

Independent contractor legal evaluator (AI product testing)

Builds

AI-powered legal solutions and evaluation datasets

Domain

Legal technology / Artificial Intelligence

Deliverable

production ML models

Required skills

Legal research, contract analysis, AI output evaluation, rubric development, dataset creation, critical thinking, legal writing

Preferred skills

Harvey experience, LexisNexis/Westlaw proficiency, prior AI content evaluation experience

Technologies

Harvey, LexisNexis, Westlaw

Responsibilities

Compare AI responses to legal tasks against rubrics; test pre-release features and provide feedback; review evaluation rubrics; create evaluation datasets; analyze AI-generated legal content; collaborate with product teams on research initiatives

Seniority

Mid-level, hands-on IC