Senior Manager, QA & Analytic Engineer (Contract till 31st Dec 2028)
Core
Own the end-to-end testing lifecycle of a live AI-powered Parent Engagement Digital Assistant, evaluate emerging agentic AI tools, and translate conversation data into insights to drive continuous improvement.
Role type
Senior Manager, QA & Analytic Engineer
Builds
Parent Engagement Digital Assistant (AI tool), live performance dashboards
Domain
Public sector health promotion, conversational AI, data analytics
Deliverable
production ML models
Required skills
AI quality assurance, regression testing, third-party AI evaluation, data analysis, Python, SQL, Power BI, Tableau, test case design, user acceptance testing, stakeholder management
Preferred skills
Experience with conversational AI, chatbots, AI-enabled products, academic training in data analytics or computer science
Technologies
Python, SQL, Power BI, Tableau
Responsibilities
Design and execute structured test cases for accuracy, tone, safety, and data privacy; Perform full regression testing after prompt updates or model changes; Independently research and assess external agentic AI tools; Analyse conversation logs to surface patterns and build live performance dashboards
Seniority
Senior, hands-on IC with management responsibilities