Machine Learning Quality Engineer
Core
Define evaluation frameworks, build automated test pipelines, and mitigate agentic failure modes for LSEG's internal agentic AI ecosystem and MCP tools.
Role type
Senior Associate Machine Learning Quality Engineer
Builds
Production-grade agentic AI platforms, MCP tools, and Skills with embedded quality controls
Domain
Financial markets infrastructure, Agentic AI, Large Language Models (LLM), Retrieval-Augmented Generation (RAG)
Deliverable
production ML models
Required skills
Python, LLM and RAG evaluation frameworks, Test automation (unit, integration, regression), Agentic system risk assessment, Governance and security compliance
Preferred skills
Experience in regulated engineering environments, Partnering with ML engineers to embed testability
Technologies
Python, MCP (Model Context Protocol), LLM, RAG
Responsibilities
Define evaluation frameworks for correctness, safety, and regression; Build automated test pipelines for agentic behaviors; Evaluate and mitigate agentic failure modes; Produce testing evidence for Permit to Build/Operate; Partner with ML engineers to embed testability hooks; Help define long-term quality and governance models
Seniority
Senior Associate, hands-on IC