AI Content & Knowledge Manager Intern
Core
Monitor and evaluate the performance of Fin, an AI customer care agent, by reviewing conversations, identifying defects, and improving quality evaluation processes.
Role type
AI Quality & Evaluation Intern
Builds
Quality evaluation frameworks and feedback loops for an AI customer care agent
Domain
Generative AI / Customer Care
Deliverable
production ML models
Required skills
Analytical skills, Problem-solving, Data investigation, LLM evaluation, Prompt evaluation, Conversational AI, Human-in-the-loop systems, English, French
Preferred skills
LLM evaluation, Prompt evaluation, Conversational AI, Human-in-the-loop systems
Technologies
Generative AI, LLMs, Conversational AI
Responsibilities
Operate and improve quality monitors and scorecards covering accuracy, policy compliance, connector use, escalation quality, tone, hallucinations, and unsupported claims; Review flagged and unflagged conversations to identify false positives, false negatives, and recurring defects; Prepare weekly quality reviews summarizing key findings, risks, and root causes; Analyse Fin's performance across markets, languages, use cases, and rollout phases; Monitor handovers to human agents and customer satisfaction signals; Track corrective actions, owners, and validation status; Improve documentation and versioning of Fin's evaluation framework; Share clear, actionable feedback with product, engineering, content, and data teams.
Seniority
Intern