Member of Technical Staff - Data Engineering
Core
Build the data platform for pre-training, post-training, and evaluation of multimodal AI models, including petabyte-scale text corpora processing and synthetic data pipelines.
Role type
Staff / Senior IC Data Engineer
Builds
Data ingestion, storage, processing pipelines, and visualization tooling for ML training
Domain
AI Research / Large Language Models / Data Engineering
Deliverable
production ML models
Required skills
Python, Rust or C++, distributed data processing (Spark, Ray, Dask, Beam), object storage, columnar formats (Parquet, Arrow), data quality assurance, pipeline testing and monitoring
Preferred skills
Multimodal data experience, synthetic data generation, data governance (GDPR, EU AI Act)
Technologies
Spark, Ray, Dask, Beam, Parquet, Arrow
Responsibilities
Build and scale pipelines for petabyte-scale text corpora; Build synthetic data and rephrasing pipelines; Ensure data reproducibility and compliance (versioning, lineage, PII handling); Maintain high-throughput data loading and streaming for multi-node training; Build dataset visualization and QA tooling; Collaborate with research team on data mixtures and ablations
Seniority
Staff / Senior, hands-on IC