Research Engineer - Pretraining Data
Core
Build the data behind Prime Intellect's next generation of open models by finding, evaluating, and collecting valuable training data from web, code, and technical sources.
Role type
Senior IC research engineer (pretraining data)
Builds
Training-ready corpora for broad pretraining and data used to develop reasoning, coding, and long-context capabilities
Domain
Frontier AI / Large Language Model Pretraining
Deliverable
production ML models
Required skills
Python, large-scale data processing, distributed systems, data quality diagnostics, data mixture design, synthetic data generation, reproducible data pipelines
Preferred skills
Web crawling, document extraction, deduplication, text classification, quality scoring, Spark, Ray, multilingual data, tokenization, training data loaders
Technologies
Python, Spark, Ray
Responsibilities
Find, evaluate, and collect valuable training data from web, code, and technical sources; Build scalable pipelines that turn raw data into training-ready corpora; Develop checks for data quality, coverage, and contamination; Work with researchers on data mixtures and sampling strategies; Prepare and evaluate data for long-context learning, reasoning, and coding; Run controlled data experiments and use model evaluations to decide scaling choices; Make large-scale data processing efficient, reproducible, and recoverable
Seniority
Senior, hands-on IC
