CareerPlanSign in
This role has closed. Browse similar live roles below, or see all open jobs →

Lead Data and AI Quality Engineer

TORONTO, Ontario, Canada💼 Full-time🗓 2026-07-20 → 2026-09-25

Core

Lead Data and AI Quality Engineer ensuring quality assurance for AI and Non-Financial Risk Reporting initiatives within a Risk and Compliance team.

Role type

Lead Data and AI Quality Engineer

Builds

Robust, high-quality AI and risk reporting solutions meeting regulatory standards

Domain

Financial Services / Risk and Compliance / AI Quality Engineering

Deliverable

production ML models | product features | dashboards & analysis

Required skills

Python (5+ years), OOP, async programming, AI model testing, AI code agent testing, LLM testing (prompt engineering, hallucination detection), MCP testing, SQL/NoSQL databases, DevOps, containerization, CI/CD (Git, GitHub Actions)

Preferred skills

Data governance frameworks, AI agent orchestration, Infrastructure as Code

Technologies

Python, pytest, requests, django, fastapi, Oracle, SQL Server, PostgreSQL, MongoDB, Git, GitHub Actions

Responsibilities

Design and implement test strategies for AI and risk reporting; Code test utilities and QA tools; Validate database schemas and data integrity; Develop automated test frameworks and execute CI/CD pipelines; Test AI code agents and autonomous systems for accuracy and compliance.

Seniority

Senior, hands-on IC with strategic planning

Sourced via workday · Listed on CareerPlan, which tracks 70,000+ jobs from 20+ sources.