Principal Data Engineer, Data Quality & Datasets Pipelines
Core
Building systems to ingest, filter, retain, and offload petabyte-scale driving data for Wayve's AI Driver, ensuring data quality and storage cost efficiency.
Role type
Principal Data Engineer (Data Quality & Pipelines)
Builds
Data movement pipelines, filtering/retention/offload policies, and pre-ingestion selection infrastructure for autonomous driving datasets.
Domain
Autonomous driving / AI / Cloud Data Engineering
Deliverable
production ML models
Required skills
Python, Spark, cloud data engineering, petabyte-scale data pipeline design, data filtering and quality judgment, system design, live system iteration
Preferred skills
AV/robotics/fleet data experience, retention and data lifecycle policies, high-volume IoT
Technologies
Python, Spark, Cloud platforms
Responsibilities
Implement filtering, retention, and offload policies across hot, cold, and archive storage; build data movement pipelines for pre-ingestion selection models; decide where selection models run to balance compute cost vs data value; build early low-compute decision points to avoid expensive standardization of low-value data; monitor data quality to ensure datasets reflect model training needs.
Seniority
Principal, hands-on IC with strategic impact
