AI/ML Evaluation Reviewer- Healthcare AI (Contract)
Core
Independently assess technical evidence for healthcare AI applications to inform regulatory recommendations for pilot deployment.
Role type
Senior IC machine learning evaluation reviewer (healthcare AI)
Builds
Regulatory recommendations and structured evaluation findings for healthcare AI pilot deployment
Domain
Healthcare + AI/ML evaluation
Deliverable
production ML models
Required skills
Machine learning evaluation, statistical analysis, model validation, data quality assessment, technical reliability assessment, monitoring plan review, human-in-the-loop evaluation, analytical writing
Preferred skills
Clinical AI evaluation frameworks (TRIPOD+AI, STARD-AI), generative AI/LLM evaluation, robustness testing, FDA guidance knowledge, independent technical review experience
Technologies
Clinical NLP, LLMs, medical imaging, computer vision, tabular predictive models
Responsibilities
Evaluate model performance and validation methods; Assess data quality and representativeness; Evaluate technical reliability and failure modes; Review proposed evaluation plans; Assess technical safeguards and human oversight; Evaluate monitoring and change management; Collaborate with multidisciplinary reviewers; Produce structured evaluation findings; Participate in reviewer calibration; Maintain independence and confidentiality
Seniority
Senior, hands-on IC