Research Engineer - Data Infrastructure
Core
Building large-scale data pipelines and infrastructure to collect, process, filter, and transform datasets for training state-of-the-art AI models.
Role type
Senior IC research engineer (data infrastructure)
Builds
Data processing pipelines, curation tooling, and infrastructure for AI model training
Domain
AI/ML data infrastructure
Deliverable
production ML models
Required skills
distributed data processing, Kubernetes, data pipeline architecture, model training for data curation, data quality evaluation, tooling development
Preferred skills
web crawler development, data augmentation strategies
Technologies
Kubernetes
Responsibilities
Build large-scale data pipelines for collecting and transforming datasets; Train classifiers and quality filters for data processing; Design data curation strategies including deduplication and augmentation; Create tooling for researchers to explore and train on massive datasets
Seniority
Senior, hands-on IC