Data Scientist Talent Network
Core
Building a network of experienced data scientists for future projects evaluating AI systems' performance on real-world data science tasks.
Role type
Senior IC data scientist (evaluation & grading)
Builds
Evaluation criteria, assessments, and technical justifications for AI-generated or human-created data science work
Domain
AI research and data science evaluation
Deliverable
production ML models
Required skills
Python, SQL, statistical modeling, machine learning, experimentation, causal inference, feature engineering, translating messy real-world data into rigorous analyses
Preferred skills
Experience at leading technology, research, or quantitative firms (FAANG, AI labs, top-tier quant funds)
Technologies
Python, SQL
Responsibilities
Designing precise grading criteria for data science deliverables; Evaluating AI-generated or human-created work against established criteria; Providing detailed written justifications for evaluations and scores; Applying consistent, evidence-based judgment for reproducible assessments; Incorporating structured feedback from senior reviewers and iterating on submitted work
