Multilingual Audio Evaluator
RemoteFreelance / independent contractor
Core
Evaluate conversational AI agents across multiple languages through live roleplay scenarios, capturing logs and scoring interactions.
Role type
Independent contractor audio evaluator
Builds
Training and evaluation data for frontier AI models
Domain
AI / Conversational AI / Multilingual
Deliverable
production ML models
Required skills
C1/C2 spoken fluency in target languages, JSON reading and validation, live roleplay execution, structured rubric scoring, technical log capture, digital tool usage
Preferred skills
AI evaluation experience, audio annotation, transcript labeling, technical support background, conversational AI familiarity, API knowledge
Technologies
JSON, conversational AI agents, digital recording tools