Analyst/ Associate, GenAI Evaluator Specialist, Regional CSH, Group COO
Core
Build and curate knowledge bases, evaluate and analyze Generative AI responses, and maintain data sets to enhance AI accuracy for customer interactions.
Role type
GenAI Evaluator Specialist (Customer Care Operations)
Builds
High-quality AI-generated responses and customer service interactions
Domain
Banking / Generative AI
Deliverable
production ML models | product features
Required skills
Generative AI evaluation, knowledge base curation, data set maintenance, prompt engineering basics, data pre-processing, data ingestion, demand analysis, stakeholder management, MS Office proficiency, data analytics
Preferred skills
Banking product knowledge, call handling experience, analytical mindset
Technologies
Generative AI systems, MS Office (Word, Excel, Project, PowerPoint)
Responsibilities
Build and curate comprehensive knowledge bases for GenAI models; Evaluate and analyze AI-generated responses to identify improvements; Develop and implement safety scenarios for AI interactions; Curate and maintain diverse data sets; Analyze customer interactions to identify emerging demand topics; Collaborate with product owners and AI development teams to refine AI responses
Seniority
Mid-level, hands-on IC
