Legal AI Annotator
Core
Evaluate AI-generated legal answers and define criteria to measure the quality of legal AI services.
Role type
Independent contractor legal AI annotator
Builds
Evaluation sets and benchmarks for legal AI quality
Domain
Legal technology and generative AI
Deliverable
production ML models
Required skills
Italian Bar admission, Italian VAT number, legal expertise in specific practice areas, fluent Italian
Preferred skills
familiarity with legal tech or generative AI tools, experience evaluating AI systems
Technologies
legal AI platforms (via careerplan.io/jobs/0115146e-2b92-49df-89d4-81d2577f53ab-legal-ai-annotator-at-lexroom)
Responsibilities
Evaluate AI-generated answers to legal questions, define positive and negative criteria for judging answer correctness, compare alternative answers from different models and explain choices based on legal accuracy and completeness
Seniority
Independent contractor
