AI Response Analyst
Core
Evaluate and rank AI-generated responses to image-based prompts by assessing accuracy, relevance, clarity, safety, and adherence to instructions.
Role type
AI response evaluation analyst
Builds
AI model training data and evaluation metrics
Domain
Artificial Intelligence / Computer Vision
Deliverable
production ML models
Required skills
visual detail recognition, critical thinking, research skills, reading comprehension, written English, consistency in applying guidelines
Preferred skills
image annotation, content review, editing, research, design, localization
Technologies
none stated
Responsibilities
Review images alongside prompts and AI responses; interpret visual and conversational context; compare and rank multiple responses; verify factual claims using research sources; flag unevaluable tasks; write justifications for rankings
Seniority
Individual Contributor, project-based
