CareerPlanSign in

Associate Evaluations Manager

California - Irvine, US💼 Full-time🗓 2026-09-24 → 2026-09-26

Core

Measure, monitor, and improve the performance of Salesforce's Agentforce AI agents on Salesforce Help through synthetic evaluations and data analysis.

Role type

Associate Evaluations Manager (AI Product Operations)

Builds

Synthetic evaluation frameworks, scoring rubrics, and actionable insights for Agentforce product decisions.

Domain

AI / Conversational AI / CRM

Deliverable

production ML models | dashboards & analysis

Required skills

Root cause analysis, data analysis, documentation, spreadsheet proficiency, critical thinking, tool fluency, execution reliability

Preferred skills

AI content evaluation, prompt engineering, UAT/QA support, process documentation

Technologies

Salesforce (Agentforce, Tableau, Testing Center, Observability), Google Sheets

Responsibilities

Execute synthetic evaluations for Answer Quality, latency, and instruction adherence; Analyze results to identify trends and root causes; Maintain and evolve evaluation frameworks and golden datasets; Deliver reporting and business reviews for stakeholders; Audit utterance repositories; Synthesize feedback to shape product direction.

Seniority

Associate, hands-on IC

Sourced via workday · Listed on CareerPlan, which tracks 70,000+ jobs from 20+ sources.