Model Validation 2nd LOD Lead Analyst
Core
Lead independent validation and risk management for Generative AI, AI, and ML models across the full lifecycle, including initial review, ongoing monitoring, and periodic assessments.
Role type
Senior IC Model Validation Lead (GenAI/AI/ML)
Builds
Independent validation reports, risk assessments, and compensating control recommendations for AI/ML objects.
Domain
Financial Services / Model Risk Management / Generative AI
Deliverable
production ML models
Required skills
Model Risk Management, Generative AI, Machine Learning, Natural Language Processing, Statistical Data Analysis, Python, R, SQL, PyTorch, TensorFlow, Azure ML, Spark, Statistical Modeling, Hypothesis Testing, Sensitivity Analysis, Stress Testing, Back-Testing, Technical Documentation, Stakeholder Engagement, Cross-functional Collaboration, AI Alignment, Bias Detection & Mitigation, Guardrail Implementation, Interpretability
Preferred skills
Generative Artificial Intelligence, Big Data, Object Oriented Programming, LLMs, Transformer Architectures, RAG Pipelines, Prompt Engineering, Fine-Tuning, Embedding Models, Vector Databases, Multi-Modal Models, Agentic AI Frameworks, Databricks, Uncertainty Quantification, BERT Score, HuggingFace, MLflow, Vertex AI, LangChain, BLEU, ROUGE, Validation Report Authoring, Regulatory Communication
Technologies
PyTorch, TensorFlow, Azure ML, Spark, Databricks, HuggingFace, MLflow, Vertex AI, LangChain, Vector Databases
Responsibilities
Conduct independent review and challenge of Generative AI/AI/ML soundness and fit-for-purpose; Manage AI/ML risk across lifecycle activities; Identify weaknesses and inform stakeholders of risk profiles; Develop NLP and GenAI applications to automate validation processes; Lead collaborative efforts with cross-functional teams on key AI/ML projects; Provide structured mentorship for junior validators; Drive adoption of innovative methodologies to enhance validation efficiency.
Seniority
Senior, hands-on IC with leadership responsibilities
