Data Scientist, Preparedness
Core
Build, evaluate, and improve mitigation systems to detect and prevent catastrophic harms from frontier AI models, balancing over-blocking and under-blocking risks.
Role type
Senior IC data scientist (AI safety & risk mitigation)
Builds
Mitigation intelligence and monitoring systems for AI safety
Domain
AI safety, frontier model risk, cybersecurity, and trust & safety
Deliverable
production ML models
Required skills
experimentation design, causal thinking, observational inference, SQL, Python, classifier evaluation, calibration, thresholding, error analysis, metrics engineering, cross-functional collaboration
Preferred skills
cybersecurity data science, threat modeling, adversarial dynamics, abuse pattern analysis, detection systems in adversarial settings
Technologies
SQL, Python
Responsibilities
Evaluate and improve mitigation systems (classifiers, detection pipelines); diagnose false positives/negatives via deep error analysis; build monitoring frameworks to track mitigation effectiveness; identify trends in over/under-blocking and propose interventions; develop insights from customer feedback to detect adversarial shifts; expand risk monitoring into new areas (cybersecurity, model loss-of-control); communicate results to technical and executive stakeholders
Seniority
Senior, hands-on IC