Evaluation Engineer
Core
Build a comprehensive, high-speed auto-evaluation platform to assess how an AI research platform helps users make better decisions in pharma, while creating dashboards for ML engineers and product managers.
Role type
Senior IC backend engineer (evaluation systems)
Builds
Core auto-eval platform, dashboards, and developer tools for ML engineers
Domain
AI research / Pharma decision support
Deliverable
production ML models
Required skills
Complex backend systems, Python (asyncio/trio, parallel processing), Statistics (power/credence intervals), Front-end development, TypeScript, Developer tools, AI infrastructure
Preferred skills
Data engineering, Pharma/biomed domain knowledge, ML system evaluation, Language-model-based systems
Responsibilities
Design and build lightning-fast evaluation infrastructure, develop dashboards for performance monitoring, ensure statistical accuracy of evaluation results, mentor interns, collaborate on specific evaluation flows
Seniority
Senior, hands-on IC
