Senior Scientist, Clinical AI Research & Evaluation (Regulatory & Responsible AI)
Core
Design and run evaluations of LLM-based and agentic clinical systems, serving as a technical AI advisor to Regulatory Affairs.
Role type
Senior Scientist, Clinical AI Research & Evaluation
Builds
Reusable evaluation assets (test sets, scoring rubrics, annotation protocols, regression suites, analysis pipelines) for clinical AI systems.
Domain
Clinical development, Regulated medicine, Large Language Models (LLM), Responsible AI
Deliverable
production ML models
Required skills
LLM/NLP evaluation, Python, SQL, Research track record, Failure analysis, Uncertainty communication
Preferred skills
Clinical NLP, User study design, Regulated environment exposure, Retrieval-augmented systems evaluation
Technologies
Python, SQL, LLMs
Responsibilities
Design benchmarks and evaluation harnesses for clinical AI systems, Build reusable evaluation assets, Translate evaluation evidence for Regulatory Affairs, Conduct failure analysis and red-teaming, Support validation-planning and risk-assessment discussions, Write production-quality code for experiments
Seniority
Senior, hands-on IC
