Senior Data Scientist, Data Quality and AI Evaluation
Core
Define quality metrics and evaluation methods for auto-labeling pipelines, build human-verified golden datasets, and analyze sensor/annotation data to identify root causes and systematic errors in autonomous driving systems.
Role type
Senior IC data scientist (data quality and AI evaluation)
Builds
Human-verified golden datasets, automated failure clustering tools, statistically sound audits, and release acceptance criteria dashboards
Domain
Autonomous driving, computer vision, sensor data (camera, LiDAR), machine learning evaluation
Deliverable
production ML models
Required skills
Statistics, experimental design, sampling, hypothesis testing, uncertainty estimation, Python, SQL, precision/recall analysis, class imbalance handling, selection bias detection, data leakage detection
Preferred skills
Autonomous driving domain knowledge, robotics, computer vision, 2D/3D annotations, multi-object tracking, occupancy networks, temporal/cross-sensor consistency, human-in-the-loop labeling workflows, annotator agreement measurement, versioned benchmark management
Technologies
Python, SQL
Responsibilities
Define quality metrics and evaluation methods for auto-labeling pipelines; Build and maintain human-verified golden datasets covering representative driving conditions; Analyze large-scale sensor and annotation data to identify root causes and systematic errors; Develop automated approaches for failure clustering and similar-case discovery; Build statistically sound audits and experiments to establish release acceptance criteria; Partner with labeling operations to improve annotation guidelines and reviewer consistency