QA Engineer
Core
Owns technical testing of AI agent outputs, validating accuracy and turnaround time against golden-record datasets to support regulated business processes.
Role type
QA Engineer (AI/LLM output validation)
Builds
Test suites and regression testing frameworks for agent/prompt configurations
Domain
AI/LLM, regulated business processes, document/text processing
Deliverable
production ML models
Required skills
QA/test engineering, ML/LLM output validation, test dataset definition, accuracy benchmarking, regression testing, process familiarity
Responsibilities
Build test suites validating agent outputs against golden-record datasets; Track and report accuracy/turnaround-time metrics; Run regression testing for agent/prompt configuration changes; Feed technical findings into human QA function for final sign-off
Sourced via smartrecruiters · Listed on CareerPlan, which tracks 927,000+ jobs from 20+ sources.