Tech Lead Data Scientist, AI Evaluation & Monitoring
Core
Principal technical expert guiding the evaluation, monitoring, and optimization of AI systems in production for healthcare applications.
Role type
Senior IC Tech Lead Data Scientist (AI Evaluation & Monitoring)
Builds
Reusable evaluation playbooks, monitoring metrics, and technical frameworks for AI validation
Domain
Healthcare AI / Clinical Data Science
Deliverable
production ML models
Required skills
Experimental design, causal inference, LLM/generative AI evaluation, fairness and equity analysis, drift detection, Python, SQL, technical mentorship
Preferred skills
Healthcare or clinical industry experience, MS or PhD in quantitative field
Technologies
Python, SQL, cloud-native data platforms, LLM-as-Judge frameworks, simulation harnesses
Responsibilities
Define technical evaluation methodology for enterprise AI programs, design validation studies and monitoring plans, mentor data analysts on statistical rigor, translate failure modes into measurable metrics, review analysis code and study designs
Seniority
Senior, hands-on IC with technical leadership
