CareerPlanSign in

Expression of Interest: Principal Data Scientist – ML, Gen AI Model Validation

Sydney CBD Area, AU💼 Full-time🗓 2026-09-25

Core

Independent technical review, challenge, and validation of complex ML, GenAI, and agentic systems at scale to ensure they are fit for purpose and risks are controlled.

Role type

Principal Data Scientist (ML & Gen AI Model Validation)

Builds

Independent validation streams, test plans, and evaluation pipelines for Group-wide AI models

Domain

Fintech / Generative AI / Model Governance

Deliverable

production ML models

Required skills

ML/AI & statistics, GenAI & agentic systems, Python, R, TypeScript, PyTorch, AWS SageMaker, LangChain, LangGraph, OpenAI Agents SDK, Pydantic, Langfuse/HoneyHive, CI/CD, test harness development, codebase navigation

Preferred skills

Experience with transformer fine-tuning, agentic architecture, LLM-as-a-Judge, multi-agent routing, memory/persona handling, RAG pipelines

Technologies

PyTorch, AWS SageMaker, LangChain, LangGraph, OpenAI Agents SDK, Pydantic, Langfuse, HoneyHive, GitHub, Claude Code, Codex

Responsibilities

Design validation of complex ML and Gen AI Models at scale, Shape model validation in collaboration with Data Science, Engineering and Governance stakeholders, Drive and lead best validation practices, tooling and standards

Seniority

Principal, technical leadership & independent judgement

Sourced via workday · Listed on CareerPlan, which tracks 70,000+ jobs from 20+ sources.