CareerPlan

Conversational AI Data Annotator

Dearborn, MIFull-time2026-11-16
Based in United States

Core

Review and annotate text and audio conversations to improve chatbot accuracy, reliability, and response quality for technical teams.

Role type

Conversational AI Data Annotator

Builds

Annotated datasets for chatbot training and evaluation

Domain

Artificial Intelligence / Conversational AI

Deliverable

production ML models

Required skills

Text and audio annotation, Chatbot evaluation, Guideline interpretation, Evidence and citation review, Written rationales, Quality checks, Issue escalation, Weekly reporting

Preferred skills

Automotive industry knowledge, Large-scale conversational AI support experience

Technologies

Customer-approved annotation tools

Responsibilities

Review chatbot conversations, individual responses, retrieved content, citations, and related metadata; Annotate conversational AI data using approved labeling guidelines, taxonomies, and decision rules; Complete required labels, concise rationales, confidence assessments, and ambiguity indicators; Evaluate intent recognition, task completion, correctness, completeness, relevance, and overall response quality; Check whether responses are supported by available evidence and whether sources are attributed correctly; Identify factual errors, unsupported claims, incomplete answers, safety concerns, and policy issues; Assign approved failure categories and identify when escalation or specialist review is needed; Escalate ambiguous or sensitive cases and situations not covered by existing guidance; Participate in onboarding, calibration sessions, refresher training, quality reviews, and adjudication discussions; Perform first-level quality checks and correct errors identified during review; Maintain accurate annotation records, quality results, exceptions, escalations, and open issues; Prepare weekly reports covering completed volume, productivity, quality, backlog, risks, guideline gaps, and required actions; Recommend improvements to labeling guidance based on recurring issues.

Seniority

Individual Contributor