Senior Software Engineer, Data & Orchestration
Core
Design, build, and evolve scalable data pipeline and orchestration infrastructure for Wayve's autonomous driving data platform.
Role type
Senior IC software engineer (data engineering & orchestration)
Builds
Data pipeline platform, DAG-based workflow orchestration system, tooling for data ingestion/processing/inference/evaluation
Domain
Autonomous driving, data engineering, distributed systems
Deliverable
production ML models | infrastructure
Required skills
Python, distributed systems, event streaming (Apache Kafka), database principles (consistency models), traditional databases/data warehouses (Postgres, ClickHouse)
Preferred skills
data engineering, workflow orchestration, ML infrastructure, large-scale batch processing, compute scheduling, Ray/Flyte/Spark
Technologies
Python, Apache Kafka, Postgres, ClickHouse, Harness, Ray, Flyte, Spark
Responsibilities
Design scalable data pipeline and orchestration infrastructure; Contribute to revamping Harness and building new DAG-based workflow platform; Build tooling for data ingestion, processing, inference, and evaluation; Ensure platform runs hundreds of parallel pipeline steps efficiently; Support batch inference and performance optimization; Improve platform reliability and incident response workflows; Collaborate with partner teams on pipeline requirements
Seniority
Senior, hands-on IC
