Principal Engineer - Data Retrieval
Core
Architect and scale the data acquisition infrastructure that powers NVIDIA's foundation models, including crawling the open web, discovering sources, and delivering high-quality data to training pipelines.
Role type
Principal Engineer (Data Retrieval & Distributed Systems)
Builds
Unified platform for source discovery, URL indexing, crawl frontiers, predictive ranking, scheduling, distributed fetching, and ingestion.
Domain
AI/ML Infrastructure, Distributed Systems, Web Crawling
Deliverable
production ML models
Required skills
Large-scale distributed systems design, Web crawling and ingestion infrastructure, System architecture, High-throughput data processing, Pipeline consistency and recovery, Technical leadership
Preferred skills
Foundation model pretraining data supply, Publisher consent and provenance infrastructure, Browser-based or agentic data collection, Multimodal dataset integration
Technologies
Distributed storage, Queueing systems, Crawl execution layers, Streaming pipelines, Observability tools
Responsibilities
Design scalable frontier storage and queueing systems, Develop shared crawl execution layers, Build extensible pipelines for open-web and partner content, Implement provenance and policy enforcement, Own production readiness and capacity planning, Coordinate dependencies across teams
Seniority
Principal, hands-on technical leadership
