Italian-Speaking JSON & Coders for Audio Evaluations
Core
Evaluate AI-generated audio responses in real-time conversational scenarios, focusing on language quality, customer experience, technical accuracy, and JSON structure.
Role type
Senior IC AI evaluation specialist (audio & JSON)
Builds
AI audio response quality assessments for an enterprise client
Domain
AI/ML evaluation, conversational AI, audio processing
Deliverable
production ML models
Required skills
Italian (C1/C2 fluency), JSON fluency, audio evaluation, structured rubric usage, written justification, session artifact capture
Preferred skills
Multilingual fluency, coding knowledge, attention to detail
Technologies
JSON, audio recording tools, structured rubrics
Responsibilities
Participate in live conversational scenarios with AI systems, review and label conversation transcripts, evaluate AI-generated responses using structured rubrics, assess responses for language quality and technical accuracy, capture session artifacts including recordings and logs
Seniority
Senior, hands-on IC