CareerPlan

AI/ML Evaluation Reviewer- Healthcare AI (Contract)

Contract2026-10-19 → 2026-11-16

Core

Independently assess technical evidence for healthcare AI applications to inform regulatory recommendations for pilot deployment.

Role type

Senior IC machine learning evaluation reviewer (healthcare AI)

Builds

Regulatory recommendations and structured evaluation findings for healthcare AI pilot deployment

Domain

Healthcare + AI/ML evaluation

Deliverable

production ML models

Required skills

Machine learning evaluation, statistical analysis, model validation, data quality assessment, technical reliability assessment, monitoring plan review, human-in-the-loop evaluation, analytical writing

Preferred skills

Clinical AI evaluation frameworks (TRIPOD+AI, STARD-AI), generative AI/LLM evaluation, robustness testing, FDA guidance knowledge, independent technical review experience

Technologies

Clinical NLP, LLMs, medical imaging, computer vision, tabular predictive models

Responsibilities

Evaluate model performance and validation methods; Assess data quality and representativeness; Evaluate technical reliability and failure modes; Review proposed evaluation plans; Assess technical safeguards and human oversight; Evaluate monitoring and change management; Collaborate with multidisciplinary reviewers; Produce structured evaluation findings; Participate in reviewer calibration; Maintain independence and confidentiality

Seniority

Senior, hands-on IC