Staff Data Platform Engineer
Core
Design and build a globally distributed hub-and-spoke ingestion system to transfer petabytes of sensor data per day from partner-operated vehicles to enable AI model training.
Role type
Staff Data Platform Engineer (Infrastructure)
Builds
Globally distributed data transfer pipelines and cloud-to-cloud networking solutions for autonomous driving data.
Domain
Autonomous driving / Embodied AI / Cloud Infrastructure
Deliverable
infrastructure
Required skills
Large-scale data transfer pipelines, Workflow orchestration (Flyte), Cloud platform architecture (Azure), Python, Infrastructure as Code (Terraform), Cross-cloud networking
Preferred skills
Kafka, Multi-cloud experience (AWS/GCP), External partner integration, Autonomous vehicles domain knowledge
Technologies
Flyte, Kafka, Azure, Terraform, Python
Responsibilities
Set technical direction for the Data Transfer Hub, Lead technical design and delivery of the ingestion system, Design parallelised distributed data transfer pipelines, Build and operate a globally distributed hub-and-spoke model, Write infrastructure-as-code, Drive cloud-to-cloud and cross-cloud networking solutions
Seniority
Staff, hands-on technical leadership
