Sr. Software Engineer, Pretraining Data
Core
Design, build, and scale distributed data infrastructure to convert raw web, code, and multimodal data into training-ready datasets for frontier AI models.
Role type
Senior IC distributed systems engineer (pretraining data infrastructure)
Builds
High-throughput data pipelines, orchestration systems, web crawling infrastructure, and data cleaning/classification tools
Domain
Artificial Intelligence / Large-scale Data Infrastructure
Deliverable
production ML models
Required skills
Distributed systems architecture, high-throughput pipeline orchestration, web crawling infrastructure, data lineage and observability, algorithm design for data classification and deduplication, technical leadership, system debugging at frontier scale
Preferred skills
Experience with AI agents, deep expertise in specific infrastructure domains
Technologies
Web crawling frameworks, distributed data processing frameworks, orchestration systems
Responsibilities
Design and build distributed data infrastructure for training datasets; own high-throughput pipelines and orchestration systems; build and deploy models for data classification and cleaning; lead complex initiatives across data platform and crawling teams; drive architecture and mentor engineers
Seniority
Senior, hands-on IC with leadership responsibilities
