Remote Legal Expert
Core
Evaluate and annotate AI model outputs on complex U.S. legal hypotheticals to refine legal reasoning capabilities in large language models.
Role type
Contractor legal expert (LLM evaluation)
Builds
High-quality evaluation and training datasets for frontier AI systems
Domain
Artificial Intelligence / Legal Technology
Deliverable
production ML models
Required skills
U.S. legal reasoning, contract law, torts, criminal law, constitutional law, civil procedure, data annotation, rubric application, gap identification
Preferred skills
Interest in AI and language models
Technologies
Large Language Models (LLMs)
Responsibilities
Review and evaluate model outputs on complex U.S. legal hypotheticals, Apply a structured legal rubric to assess accuracy and reasoning, Identify gaps and edge cases in model performance, Provide clear annotations and detailed feedback for model fine-tuning