Researcher - Pretraining Data Team
Core
Design and curate high-quality datasets to power frontier AI models, develop data collection strategies, and build scalable pipelines for ingestion, processing, and annotation.
Role type
Senior IC researcher (pretraining data)
Builds
High-quality datasets for training and evaluation, scalable data pipelines, lightweight tools for auditing and versioning
Domain
Artificial Intelligence / Large Language Models / Data Engineering
Deliverable
production ML models
Required skills
Python, Pandas, NumPy, Spark, Ray, Apache Beam, statistics, exploratory data analysis, data engineering, data analysis
Preferred skills
Data curation, dataset auditing, visualization, versioning, collaboration with Safety/Ethics teams
Responsibilities
Design and curate high-quality datasets, develop novel data collection strategies, run experiments on new datasets (data ablations), build scalable data pipelines, analyze real-world datasets for quality and diversity, build lightweight tools for dataset auditing and visualization
Seniority
Senior, hands-on IC