AI Quality Engineer, Safety and RAG - Assistant Vice President
Core
Quality Engineer for complex autonomous AI systems, ensuring safety, accuracy, and production-readiness for Agentic AI and RAG pipelines.
Role type
Senior IC AI Quality Engineer (Agentic AI & RAG)
Builds
Production-ready, safe, and reliable autonomous AI systems for Retail and Wealth Risk Engineering
Domain
Financial Services / AI/ML Quality Engineering
Deliverable
production ML models
Required skills
Agentic AI testing, RAG pipeline validation, AI safety & security testing, performance & reliability engineering, test automation, red-teaming, chaos engineering
Preferred skills
MCP (Model Context Protocol), multi-modal agent testing, regulated industry experience, chaos engineering tools
Technologies
AutoGen, CrewAI, LangGraph, RAGAS, TruLens, DeepEval, Great Expectations, Deequ, AI Fairness 360, Aequitas, OWASP Top 10 for LLM Applications, Chaos Monkey, Gremlin, LitmusChaos
Responsibilities
Design end-to-end test strategies for Agentic AI and RAG pipelines; conduct red-teaming and adversarial testing for AI safety; build automated test harnesses and evaluation pipelines; define and execute performance, stress, and chaos engineering tests.
Seniority
Senior, hands-on IC
