CareerPlan

Italian-Speaking JSON & Coders for Audio Evaluations

Rome, Lazio, itRemoteFull-time2026-09-28 → 2026-11-20

Core

Evaluate AI-generated audio responses in real-time conversational scenarios, focusing on language quality, customer experience, technical accuracy, and JSON structure.

Role type

Senior IC AI evaluation specialist (audio & JSON)

Builds

AI audio response quality assessments for an enterprise client

Domain

AI/ML evaluation, conversational AI, audio processing

Deliverable

production ML models

Required skills

Italian (C1/C2 fluency), JSON fluency, audio evaluation, structured rubric usage, written justification, session artifact capture

Preferred skills

Multilingual fluency, coding knowledge, attention to detail

Technologies

JSON, audio recording tools, structured rubrics

Responsibilities

Participate in live conversational scenarios with AI systems, review and label conversation transcripts, evaluate AI-generated responses using structured rubrics, assess responses for language quality and technical accuracy, capture session artifacts including recordings and logs

Seniority

Senior, hands-on IC