LLM - AI Quality Analyst (Personalization) - Spanish
Core
Evaluate the personalization quality of the Gemini AI model by testing its ability to use user data (conversations, Gmail, Search, YouTube) to generate relevant, non-generic responses.
Role type
AI Quality Analyst (Personalization)
Builds
Personalization features for the Gemini AI model
Domain
Generative AI / Large Language Models (LLM)
Deliverable
production ML models
Required skills
Prompt design, AI response evaluation, hallucination detection, side-by-side (SxS) comparison, data verification, clear written rationale
Preferred skills
Data annotation, content moderation, prompt engineering, personalization concepts, attention to detail
Technologies
Gemini, LLMs
Responsibilities
Design multi-turn conversational prompts requiring personal data usage; Evaluate model responses for personalization accuracy and grounding; Flag hallucinations or flawed inferences; Stack-rank model responses; Write structured rationales; Verify debug info and data sources; Clear evaluation data after sessions