AI QA Engineer, AVP
Core
Design and implement scalable test frameworks to validate AI-driven product behavior, ensuring reliability, accuracy, and safety of intelligent features within enterprise investment management platforms.
Role type
Mid-level AI Quality Assurance Engineer
Builds
Reusable QA frameworks and test strategies for AI-enabled capabilities in the CRIMS / State Street Alpha product suite
Domain
Financial services / Asset management / AI testing
Deliverable
production ML models | product features
Required skills
AI testing methodologies, automated and manual test framework design, API and integration testing, CI/CD pipeline integration, risk-based testing, defect lifecycle management, probabilistic output assessment, drift detection, test data strategy
Preferred skills
Financial services domain expertise, experience with intelligent test generation, model behavior monitoring
Technologies
CI/CD tools, test automation frameworks, scripting languages
Responsibilities
Design test strategies for AI-specific quality dimensions like consistency and explainability; Develop automated and manual test frameworks for AI-enabled features; Validate product behavior including guardrails and response accuracy; Integrate automated testing into CI/CD pipelines; Monitor AI behavior in production for drift and output quality; Collaborate with engineering teams to define acceptance criteria for AI user stories
Seniority
Mid-level, hands-on IC