CareerPlan

Senior Scientist, Clinical AI Research & Evaluation (Regulatory & Responsible AI)

US - Cambridge Kendall SQ - MAFull-time$125k–$187k2026-11-05 → 2026-11-10
Hybrid

Core

Design and run evaluations of LLM-based and agentic clinical systems, serving as a technical advisor to Regulatory Affairs on evidence standards and risk.

Role type

Senior Scientist (Researcher-first with regulatory advisory responsibilities)

Builds

Reusable evaluation assets (test sets, scoring rubrics, pipelines) and evaluation practices for clinical AI systems

Domain

Clinical development, Regulated medicine, Responsible AI

Deliverable

production ML models

Required skills

LLM evaluation, Python, SQL, failure analysis, red-teaming, statistical rigor, uncertainty quantification

Preferred skills

Clinical NLP, user study design, causal inference, model risk management, agentic system evaluation

Technologies

Python, SQL, LLMs, agentic workflows

Responsibilities

Design benchmarks and evaluation harnesses for clinical AI, translate evaluation evidence for regulatory teams, build reusable analysis pipelines, conduct failure-mode analysis, advise on validation documentation and risk assessment

Seniority

Senior, hands-on IC