Conversational AI Specialist, Vice President
Core
Design and evaluate enterprise-level conversational AI solutions, including virtual assistants and prompt engineering for LLMs, to optimize business processes and user experiences.
Role type
Senior IC Conversational AI Specialist (VP level)
Builds
Enterprise conversational AI solutions, smart automation tools, and refined generative AI models
Domain
Financial services + Generative AI
Deliverable
production ML models
Required skills
Conversational AI solutioning, Prompt engineering, LLM evaluation techniques (F1, RAGAS), Generative AI concepts, Program/project management, Analytical problem-solving
Preferred skills
Experience with commercial/open-source LLMs (GPT, Claude, Gemini, LLAMA), Human feedback analysis
Technologies
GPT, Claude, Gemini, LLAMA, RAGAS
Responsibilities
Develop and maintain conversational experiences for employee and client virtual assistants; Develop and refine context-aware prompts for LLMs; Develop data-driven methodologies for testing and evaluating Generative AI responses; Troubleshoot and optimize LLM model outputs; Identify and mitigate project risks; Collaborate with cross-functional teams and vendors; Track project performance metrics and KPIs.