LLM - AI Quality Analyst (Personalization) - Polish
Core
Evaluate the quality of personalized AI responses in Google Gemini by designing prompts and assessing how well the model integrates user data from Gmail, Search, and YouTube.
Role type
AI Quality Analyst (Personalization)
Builds
Personalized AI interactions for Google Gemini
Domain
AI/ML, Personalization, Large Language Models
Deliverable
production ML models
Required skills
Polish language proficiency, creative prompt engineering, analytical evaluation of AI responses, side-by-side model ranking, data hygiene management
Preferred skills
experience in data annotation, AI quality evaluation, content moderation
Technologies
Google Gemini, Gmail, Google Search, YouTube
Responsibilities
Design multi-turn conversational prompts to test personalization, evaluate model responses for grounding and integration quality, stack-rank side-by-side model outputs, write defensible rationales for comparisons, verify debug info and data sources, maintain data hygiene by deleting evaluation chats
Seniority
Individual Contributor