CareerPlanSign in

Australian English - AI Product Evaluator

Melbourne, Victoria🌐 Remote💼 Full-time💰 $37,440–$37,440🗓 2026-09-17 → 2026-09-28

Core

Evaluate leading AI chatbots and language models through structured conversations and voice interactions to assess response quality, safety, and helpfulness.

Role type

AI Product Evaluator (Independent Contractor)

Builds

Data and insights for Generative AI model development and optimization

Domain

Artificial Intelligence / Natural Language Processing

Deliverable

production ML models

Required skills

Native or expert-level Australian English fluency, hands-on experience with AI models, ability to conduct voice-based conversations, sharp follow-up questioning, written and verbal communication

Preferred skills

Experience with large language models, comfort with web-based tools

Technologies

AI chatbots, large language models, web-based evaluation tools

Responsibilities

Test and evaluate AI chatbots using assigned goals and prompts, conduct voice-based interactions with AI models, submit deliverables including write-ups, ratings, screenshots, or recordings

Seniority

Entry-level, task-based contractor

Sourced via viewjobs · Listed on CareerPlan, which tracks 848,000+ jobs from 20+ sources.