Senior Product Quality Analyst - AI Voice
Core
Define and measure quality for Spotify's AI voice models (AI DJ, Generative AI Ads, Agent Voice Chat) by creating evaluation rubrics and campaigns.
Role type
Senior Product Quality Analyst (AI Voice)
Builds
AI voice experiences for Spotify products
Domain
Generative AI, Speech Technology, Audio Quality
Deliverable
production ML models
Required skills
evaluation rubric design, qualitative and quantitative analysis, MOS-style evaluations, voice/audio quality assessment, benchmarking against competitors, stakeholder partnership
Preferred skills
experience in product quality or data curation, understanding of generative AI landscape, ability to translate subjective qualities into repeatable metrics
Technologies
AI voice models, generative AI, speech technology
Responsibilities
Define quality standards for different products and use cases, design evaluation approaches measuring naturalness/tone/pacing/pronunciation, plan and execute evaluation campaigns, establish ongoing evaluation rhythms, benchmark against third-party models, surface performance gaps to influence research priorities
Seniority
Senior, hands-on IC
