CareerPlan

Sr. Software Engineer, Pretraining Data

USAFull-time2026-11-12 → 2026-11-18
On-site

Core

Design, build, and scale distributed data infrastructure to convert raw web, code, and multimodal data into training-ready datasets for frontier AI models.

Role type

Senior IC distributed systems engineer (pretraining data infrastructure)

Builds

High-throughput data pipelines, orchestration systems, web crawling infrastructure, and data cleaning/classification tools

Domain

Artificial Intelligence / Large-scale Data Infrastructure

Deliverable

production ML models

Required skills

Distributed systems architecture, high-throughput pipeline orchestration, web crawling infrastructure, data lineage and observability, algorithm design for data classification and deduplication, technical leadership, system debugging at frontier scale

Preferred skills

Experience with AI agents, deep expertise in specific infrastructure domains

Technologies

Web crawling frameworks, distributed data processing frameworks, orchestration systems

Responsibilities

Design and build distributed data infrastructure for training datasets; own high-throughput pipelines and orchestration systems; build and deploy models for data classification and cleaning; lead complex initiatives across data platform and crawling teams; drive architecture and mentor engineers

Seniority

Senior, hands-on IC with leadership responsibilities