CareerPlanSign in

Senior Data Scientist

Sydney, New South Wales💼 Full-time🗓 2026-09-17 → 2026-09-27

Core

Independent technical validation and risk assessment of the bank's critical ML and AI models to ensure they are fit for purpose and safely deployed.

Role type

Senior IC AI Model Validator

Builds

Independent validation reports, risk assessments, and validation standards/tooling for AI systems.

Domain

Financial Services / Generative AI & Machine Learning

Deliverable

production ML models

Required skills

GenAI and agentic architecture design, LLM evaluation (LLM-as-a-Judge), transformer model fine-tuning, synthetic data generation, Python, SQL, CI/CD pipelines, AI coding agents, traditional ML evaluation

Preferred skills

TypeScript, R, LangChain, OpenAI Agents SDK, LangGraph, Pydantic, Langfuse/HoneyHive, Claude Code, Codex

Technologies

LangChain, OpenAI Agents SDK, LangGraph, Pydantic, Langfuse, HoneyHive, GitHub, CI/CD, XGBoost, Random Forests

Responsibilities

Design and execute proportionate validation covering data, methodology, assumptions, and outcomes; challenge model developers and product owners on AI fit-for-purpose; develop team validation practices and tooling; explain findings to technical and non-technical stakeholders.

Seniority

Senior, hands-on IC

Sourced via viewjobs · Listed on CareerPlan, which tracks 813,000+ jobs from 20+ sources.