Data Annotator - Video Evaluation (Remote, Flexible, Worldwide)
Core
Evaluate AI-generated and real-world media (images and videos) for quality, realism, composition, and adherence to defined evaluation standards to improve AI systems.
Role type
Data Annotator (Video Evaluation)
Builds
Training data for AI systems
Domain
AI research, Media production, Visual arts
Deliverable
production ML models
Required skills
Visual judgment, Structured reasoning, Attention to detail, Analytical reasoning, Logical reasoning, Research skills, English proficiency
Preferred skills
Experience with AI image or video generation tools
Technologies
AI image/video generation tools
Responsibilities
Evaluate visual and media content using structured guidelines and predefined rating frameworks, Provide clear written justifications for evaluation decisions, Identify quality gaps related to realism, composition, motion, lighting, and production standards, Incorporate feedback from LLM performance metrics into training data creation