AI Response Quality Evaluator
Core
Evaluate AI-generated responses for relevance, accuracy, and personalization using connected Google applications to improve user experience.
Role type
AI Response Quality Evaluator (IC)
Builds
Improved AI personalization systems and model outputs
Domain
Artificial Intelligence / Personalization
Deliverable
production ML models
Required skills
Analytical thinking, critical thinking, attention to detail, written English, ability to follow guidelines, independent work
Preferred skills
Experience with Google ecosystem, familiarity with AI evaluation workflows
Technologies
Google applications (Gmail, Calendar, Photos, Drive), Gemini
Responsibilities
Evaluate AI responses against personalized prompts, identify quality issues like incorrect assumptions or irrelevant recommendations, compare multiple AI outputs, provide structured feedback for model improvement, maintain confidentiality of personal data
Seniority
Mid-level, hands-on IC