Senior Manager, QA & Analytic Engineer (Contract till 31st Dec 2028)
Core
Design and execute structured test cases for an AI-powered Parent Engagement Digital Assistant, evaluate third-party agentic AI tools, and analyze conversation logs to drive product improvement.
Role type
Senior Manager, QA & Analytic Engineer (AI Quality Assurance & Data Analytics)
Builds
Parent Engagement Digital Assistant (AI tool for parents)
Domain
Public health / AI safety / Data analytics
Deliverable
production ML models | product features | dashboards & analysis
Required skills
AI quality assurance, regression testing, third-party AI tool evaluation, conversation log analysis, dashboard creation, Python, SQL, Power BI, Tableau, safety and bias assessment, data privacy compliance
Preferred skills
Experience with conversational AI, chatbots, agentic AI tools, academic training in data analytics or computer science
Technologies
Python, SQL, Power BI, Tableau
Responsibilities
Design and execute test cases covering accuracy, tone, safety, and data privacy; Perform full regression testing after model changes; Research and assess external agentic AI tools; Produce recommendation reports for leadership; Analyze conversation logs to surface patterns; Build and maintain live performance dashboards
Seniority
Senior, hands-on IC with management responsibilities
