Associate, AI Model Validation, RQA
Core
Independent validation of AI tools, agents, and workflows (including RAG and agentic systems) to ensure accuracy, guardrail effectiveness, and data integrity within enterprise risk frameworks.
Role type
Associate, AI Model Validation (Risk & Quantitative Analysis)
Builds
Validated AI solutions and risk assessments for BlackRock's enterprise operations
Domain
Financial Services / AI Risk Management
Deliverable
production ML models
Required skills
Generative AI (LLMs, RAG, agentic systems), Python, PyTorch/TensorFlow, AI validation methodologies, data quality assessment, functional and performance testing, security testing (prompt injection, data leakage), cloud-based AI platforms, MCP/APIs, responsible AI practices
Preferred skills
Experience validating LLMs in business contexts, AI observability, model fine-tuning, prompt engineering, memory management
Technologies
Python, PyTorch, TensorFlow, LLMs, RAG, MCP, APIs
Responsibilities
Design validation strategies and test plans for AI use cases; Execute functional and performance tests; Review data quality and engineering decisions; Document findings and provide recommendations; Collaborate with AI Engineering and Data Science teams; Communicate validation conclusions to stakeholders
Seniority
Mid-level (3-7 years experience), hands-on IC
