QA Engineer
Core
Owns technical testing of AI agent outputs, validating accuracy and turnaround time against golden-record datasets to support regulated business processes.
Role type
QA Engineer specializing in ML/LLM output validation
Builds
Test suites and regression testing frameworks for agent/prompt configurations
Domain
AI/LLM operations and regulated business process automation
Deliverable
production ML models
Required skills
QA/test engineering, ML/LLM output validation, test dataset definition, accuracy benchmarking, regression testing, document/text-processing system testing
Preferred skills
Domain process familiarity, building realistic test scenarios
Technologies
Golden-record datasets, agent/prompt configuration systems
Responsibilities
Build test suites validating agent outputs against golden-record datasets; Track and report accuracy/turnaround-time metrics; Run regression testing when agent/prompt configurations change; Feed technical findings into the human QA function for final sign-off