Legal Expert (US Law), AI Evaluation
Core
Evaluate realistic US-law tasks and documents used to train and assess large language models to improve data accuracy and quality.
Role type
Senior IC legal expert (AI evaluation)
Builds
High-quality legal evaluation datasets and guidelines for AI training
Domain
Legal + AI/ML
Deliverable
production ML models
Required skills
US law expertise, legal document review, structured feedback, data quality assessment, guideline drafting
Preferred skills
AI system consulting, AI-generated content evaluation, legal training data creation
Technologies
Large language models (LLMs)
Responsibilities
Review US-law tasks and documents for legal accuracy, completeness, and realism; Provide structured feedback on flawed samples and recommend corrections; Rework legal examples to meet quality standards; Draft practical guidelines to improve future legal evaluation datasets
Seniority
Senior, hands-on IC