Staff AI Test and Evaluation
Core
Develop test scenarios, simulation environments, and evaluation pipelines to assess agentic AI performance on classified platforms and edge hardware.
Role type
Staff AI Test and Evaluation Engineer
Builds
Reusable evaluation pipelines, automated test harnesses, monitoring dashboards, and end-to-end validation infrastructure for agentic AI and ML models.
Domain
Defense / Aerospace / Classified AI Systems
Deliverable
production ML models
Required skills
Python, simulation environment design, evaluation methodology definition, automated testing, CI infrastructure, metrics analysis, cross-functional coordination, documentation
Preferred skills
ML test and evaluation, SDET for ML systems, simulation engineering, agentic AI evaluation, classified or edge deployment, MLOps, Go, C++
Responsibilities
Develop comprehensive test scenarios and simulation environments for agentic AI; Integrate and validate agentic AI systems on classified platforms and edge hardware; Architect and maintain end-to-end evaluation and validation infrastructure; Analyze and resolve issues found during evaluation and deployment.
Seniority
Staff, hands-on IC
