Associate Evaluations Manager
Core
Measure, monitor, and improve the performance of Salesforce's Agentforce AI agents on Salesforce Help through synthetic evaluations and data analysis.
Role type
Associate Evaluations Manager (AI Product Operations)
Builds
Synthetic evaluation frameworks, scoring rubrics, and actionable insights for Agentforce product decisions.
Domain
AI / Conversational AI / CRM
Deliverable
production ML models | dashboards & analysis
Required skills
Root cause analysis, data analysis, documentation, spreadsheet proficiency, critical thinking, tool fluency, execution reliability
Preferred skills
AI content evaluation, prompt engineering, UAT/QA support, process documentation
Technologies
Salesforce (Agentforce, Tableau, Testing Center, Observability), Google Sheets
Responsibilities
Execute synthetic evaluations for Answer Quality, latency, and instruction adherence; Analyze results to identify trends and root causes; Maintain and evolve evaluation frameworks and golden datasets; Deliver reporting and business reviews for stakeholders; Audit utterance repositories; Synthesize feedback to shape product direction.
Seniority
Associate, hands-on IC