Domain Advisor Consultant (Subject Matter Expert)
Core
Define ground truth rubrics, curate golden data, and analyze model failures for next-generation Large Language Models (LLMs).
Role type
Independent contractor subject matter expert (SME) for AI evaluation and training
Builds
Production ML models (training data and evaluation frameworks)
Domain
Artificial Intelligence / Generative AI
Deliverable
production ML models
Required skills
Elite domain mastery (PhD, MD, JD, or equivalent senior industry status), ability to articulate complex reasoning in writing, professional autonomy
Preferred skills
Prior experience in AI evaluation, published author status, award-winning creative status
Technologies
Large Language Models (LLMs)
Responsibilities
Review and advise on quality criteria for AI outputs, create or certify benchmark examples of perfect prompts and responses, analyze model failures and provide technical breakdowns, consult on prompt complexity and nuance
Seniority
Senior, independent contractor
