Pretraining Data
Core
Design, curate, and evaluate large-scale datasets to train frontier AI models at Microsoft.
Role type
Senior Research Engineer (Pre-training Data)
Builds
High-quality datasets and scalable data pipelines for foundation models
Domain
Artificial Intelligence / Deep Learning
Deliverable
production ML models
Required skills
Python, data analysis, data engineering, statistics, exploratory data analysis, Spark, Ray, Apache Beam
Preferred skills
Advanced data processing strategies, dataset auditing, versioning tools
Technologies
Python, Pandas, NumPy, Spark, Ray, Apache Beam
Responsibilities
Create high-quality datasets for training and evaluation; develop scalable data pipelines for ingestion and processing; analyze real-world datasets for quality and diversity; build tools for dataset auditing and visualization; collaborate with Safety and Ethics teams on responsible AI practices.
Seniority
Senior, hands-on IC