Data Scientist - Responsible AI
Core
Develop, apply, and validate methods to evaluate generative AI, agentic AI, and other AI-enabled business applications for fairness, explainability, transparency, safety, and reliability.
Role type
Senior IC data scientist (Responsible AI evaluation)
Builds
Evaluation methods, benchmark datasets, test suites, and model cards for AI systems
Domain
Financial services + Responsible AI / Generative AI
Deliverable
production ML models
Required skills
statistical analysis, experimentation design, Python programming, SQL, AI evaluation, fairness metrics, explainability techniques, hallucination detection, robustness testing, technical documentation
Preferred skills
LLM evaluation, retrieval-augmented generation assessment, adversarial testing, NIST/ISO Responsible AI frameworks, financial services experience, technical publications
Technologies
Python, SQL, LLMs, agentic AI systems, automated testing frameworks
Responsibilities
Apply statistical analysis to evaluate AI applications; develop and maintain Responsible AI measures and benchmark datasets; evaluate AI systems for bias, safety, and robustness; establish performance baselines and monitor behavior changes; design proofs of concept for new evaluation approaches; partner with engineering and governance teams to align methods with requirements; create model cards and evaluation reports; communicate findings to stakeholders.
Seniority
Mid-level to Senior, hands-on IC
