Machine Learning Research Engineer, Pretraining Data — Foundation Models
Core
Develop novel algorithms and scalable systems for pretraining data curation, quality assessment, and optimization to advance foundation model capabilities.
Role type
Senior IC machine learning research engineer (pretraining data)
Builds
Scalable data processing systems and novel algorithms for data curation and quality assessment
Domain
Artificial Intelligence / Foundation Models / Large Language Models
Deliverable
production ML models
Required skills
Python, large-scale data processing, distributed computing, machine learning fundamentals, deep learning architectures, experimental design, data quality assessment, synthetic data generation
Preferred skills
LLM pretraining experience, Spark/Ray, PyTorch, data filtering/deduplication, scaling laws, data mixture optimization
Technologies
Python, Spark, Ray, PyTorch
Responsibilities
Design and implement algorithms for data curation, quality filtering, deduplication, and mixture optimization; Build scalable data processing systems for massive datasets; Develop ML-based approaches for data quality and synthetic data generation; Collaborate on training experiments and analyze model performance; Investigate relationships between data characteristics and model scaling; Translate research prototypes into production-ready systems
Seniority
Senior, hands-on IC
