Associate Director, Clinical AI Evaluation and Responsible Deployment
Core
Create evidence systems to determine if clinical AI is useful, reliable, safe, and ready to scale for AstraZeneca's clinical development pipeline.
Role type
Senior IC clinical AI evaluation and deployment lead
Builds
Evaluation harnesses, curated test sets, simulation environments, automated regression suites, and analysis pipelines
Domain
Life sciences / Clinical development / Responsible AI
Deliverable
production ML models
Required skills
Python, SQL, experimental design, statistical inference, LLM evaluation, agentic system evaluation, GCP/GxP compliance, failure analysis, red-teaming, traceability, cross-functional leadership
Preferred skills
Clinical trial conduct, medical monitoring, causal inference, weak supervision, MLOps/LLMOps, peer-reviewed publications
Technologies
Python, SQL, LLMs, agentic workflows
Responsibilities
Define evaluation strategy for clinical AI models; build evaluation harnesses and pipelines; translate expert judgment into scoring rubrics; evaluate complete workflows including retrieval and orchestration; design approaches for noisy ground truth; lead failure analysis and red-teaming; establish traceability from intended use to release decisions; align evidence with regulatory expectations; advise on deployment readiness; create reusable evaluation components; communicate findings and risks to stakeholders; mentor teams in rigorous experimentation.
