Sr Analyst Model Risk & AI, Gen AI Model Validation
Core
Lead validation of Generative AI and agentic AI models across the enterprise, ensuring they meet risk management standards, regulatory expectations, and ethical principles.
Role type
Senior IC model risk analyst (GenAI)
Builds
Validated GenAI models, challenger solutions, testing frameworks, and validation reports
Domain
Insurance + Generative AI / Machine Learning
Deliverable
production ML models
Required skills
GenAI concepts (prompt/context engineering, RAG, LLM internals, multi-agent systems), Python, SQL, Git, statistical evaluation methodologies, cloud AI tools (GCP/Vertex AI, AWS/SageMaker, LangChain, HuggingFace, OpenAI APIs)
Preferred skills
P&C/Group/Life insurance product experience
Technologies
Vertex AI, Google ADK, LangChain, LangGraph, HuggingFace, OpenAI APIs
Responsibilities
Perform model validations on GenAI use cases; design and build challenger solutions and testing methods; assess data inputs, assumptions, and prompt engineering; execute testing approaches for non-deterministic AI systems; deliver effective challenge to modeling elements; identify findings and compile validation reports; enhance validation frameworks with standardized metrics; strengthen partnerships with Data Science teams; evaluate cutting-edge tools and solution alignment with governance standards
Seniority
Senior, hands-on IC