Machine Learning Quality Engineer
Core
Define evaluation frameworks, build automated test pipelines, and mitigate agentic failure modes for LSEG's internal agentic AI ecosystem and MCP tools.
Role type
Senior IC machine learning quality engineer (agentic AI/MCP)
Builds
Production-grade agentic AI platform (LSEG AI Assist, QAS, Internal MCP Gateway) and evaluation/governance mechanisms
Domain
Financial markets infrastructure + Agentic AI / LLM / RAG
Deliverable
production ML models
Required skills
Python, LLM and RAG evaluation frameworks, test automation (unit/integration/regression), agentic system risk assessment, governance and security auditing
Preferred skills
Experience in regulated engineering environments
Technologies
Python, MCP (Model Context Protocol), LLM, RAG
Responsibilities
Define evaluation frameworks for correctness, safety, and regression; Build automated test pipelines for agentic behaviors; Evaluate and mitigate agentic failure modes (hallucination, tool misuse); Produce testing evidence for Permit to Build/Operate; Partner with ML Engineers to embed testability hooks; Define long-term quality and governance models
Seniority
Senior, hands-on IC
