Product Manager/Product Owner | Remote - Contract
Core
Evaluate and analyze AI-generated responses to writing prompts to train next-generation AI systems, focusing on clarity, tone, instruction adherence, and factual accuracy.
Role type
Contractor AI system evaluation specialist
Builds
Training data for AI models
Domain
Artificial Intelligence / Machine Learning
Deliverable
production ML models
Required skills
Product Management, Product Ownership, Specification Writing, Content Evaluation, Critical Analysis, Attention to Detail
Preferred skills
RLHF, annotation, PRD authoring, executive communication
Technologies
N/A
Responsibilities
Assess and compare AI-generated responses to writing prompts, Score responses based on clarity and instruction adherence, Write detailed rationales for scoring decisions, Identify factual inaccuracies and constraint violations, Collaborate virtually with project managers to ensure assessment consistency
