CareerPlanSign in

Member of Technical Staff - Applied AI Lead, Health

United Kingdom, London, London💼 Full-time🗓 2026-07-10 → 2026-09-26

Core

Design and oversee evaluation systems for LLMs in the health domain, guide the design of agentic multi-step systems, and improve internal tooling and data pipelines for model deployment.

Role type

Senior IC Applied AI Lead (LLM Evaluation & Orchestration)

Builds

Evaluation systems, agentic multi-step systems, and data pipelines for LLMs in healthcare.

Domain

Healthcare technology + Large Language Models (LLM)

Deliverable

production ML models

Required skills

LLM evaluation pipeline design, LLM orchestration, prompt/context engineering, tool use, retrieval, agentic system design, data engineering, Python programming, machine learning research, technical leadership

Preferred skills

formal people-management experience, 0-to-1 product building experience

Technologies

Python, LLMs, agentic systems

Responsibilities

Design and oversee evaluation systems testing LLM capabilities in health; guide design of agentic, multi-step systems; improve internal tooling and data pipelines for evaluations and model deployment.

Seniority

Senior, hands-on IC with leadership responsibilities

Sourced via microsoft · Listed on CareerPlan, which tracks 70,000+ jobs from 20+ sources.