SWE, Data Ingestion
Core
Build and maintain robust, high-scale data ingestion pipelines to process real-world driving data for Wayve's self-driving AI models.
Role type
Senior Data Engineer (Data Ingestion)
Builds
Scalable data ingestion pipelines, ETL workflows, and data processing systems for autonomous driving data.
Domain
Autonomous driving / Embodied AI / Data Engineering
Deliverable
production ML models
Required skills
Apache Spark, Python, large-scale data ingestion, distributed data processing, pipeline debugging, data orchestration, throughput optimization, PB-scale data handling
Preferred skills
Airflow, Flyte, Databricks Workflows, Delta Lake, Scala, Java, queue-based processing, cost optimization, automotive/robotics domain experience
Technologies
Apache Spark, Python, Airflow, Flyte, Databricks, Delta Lake, Scala, Java
Responsibilities
Debug and resolve failing ingestion pipelines, investigate corrupt or malformed data, design resilient pipelines, optimize Spark jobs for throughput and efficiency, manage multi-step workflow orchestration, reduce operational toil, partner with downstream teams to unblock datasets.
Seniority
Senior, hands-on IC