QA Engineer
Core
Designing and executing test plans for AI products to validate outputs, guardrails, and evidence citations against hallucinations and prompt injections.
Role type
QA Engineer (AI/LLM validation)
Builds
AI-driven digital health solutions for life sciences organizations
Domain
Digital health, AI/LLM, life sciences
Deliverable
production ML models
Required skills
Test plan design for combinatorial matrices, golden-question suite management, hallucination detection, citation verification, role-based access control testing, SQL query validation, API testing via Postman/Insomnia/curl, OpenAPI spec reading, defect triage
Preferred skills
Understanding of LLM behavior under prompt changes, knowledge of retrieval index mechanics
Technologies
Postman, Insomnia, curl, SQL, OpenAPI
Responsibilities
Build test plans for AI products across large combinatorial matrices, Maintain golden-question test suites, Design coverage for AI-specific failures like hallucinations and prompt injection, Run structured test passes across web UIs and APIs, Validate evidence citations and access controls, File clear and reproducible defects