ML Engineer, Retrieval & Grounded Generation
Core
Own quality for an AI-enabled decision-support system, defining test plans, acceptance criteria, and evidence that delivered work matches specifications.
Role type
Senior Quality Engineering Lead (AI/ML Systems)
Builds
Automated test suites, evaluation sets, and release governance evidence for AI decision-support systems.
Domain
National Security / Defense / AI Systems
Deliverable
dashboards & analysis
Required skills
Test strategy design, automated test suite development, CI/CD integration, performance and load testing, statistical literacy, audit-ready documentation, release governance, independent verification of requirements.
Preferred skills
Top Secret clearance, DevSecOps, contract/API testing, AI-assisted testing, model output validation, responsible AI practices (NIST AI RMF), accessibility verification.
Technologies
Python, pytest, Playwright, Cypress, Selenium, JMeter, k6, Locust.
Responsibilities
Own the system test plan covering functional, integration, performance, and load testing; translate acceptance criteria into executable tests; build and maintain automated test suites integrated into CI/CD; design and run sampled audits to confirm automated decision correctness; measure system misses and user override trends; maintain version inventory and release evidence; gate releases based on acceptance criteria.
Seniority
Senior, hands-on IC with strategic ownership.
