CareerPlanSign in

Senior Data Engineer, Behavior ML Planning & Prediction

Tokyo💼 Full-time🗓 2026-07-14 → 2026-09-25

Core

Designing and building scalable data pipelines to unify petabytes of multimodal fleet and simulation data into a trusted foundation for ML-based motion planning in autonomous vehicles.

Role type

Senior Data Engineer (Autonomous Driving Data Platform)

Builds

Canonical datasets, metrics, and self-serve tools for onboard and offboard autonomous driving systems

Domain

Autonomous driving / Mobility / Cloud & AI

Deliverable

production ML models

Required skills

SQL, Python, cloud data warehouse design, ETL/ELT, data architecture ownership, technical leadership, ambiguity management, cross-team influence

Preferred skills

Lakehouse architecture (Apache Iceberg), distributed data processing (Spark, Ray), autonomous driving domain concepts (kinematics, trajectories, motion planning), self-serve analytics tooling

Technologies

BigQuery, Snowflake, Redshift, dbt, Airflow, Spark, Ray, Flyte, Union, Parquet, Iceberg

Responsibilities

Set technical direction for end-to-end data architecture; design and build data pipelines from ingestion to visualization; define data products, SLAs, and monitoring practices; mentor engineers and establish data engineering standards; document architecture and decisions for organizational adoption

Seniority

Senior, technical leader with org-wide influence

Sourced via lever · Listed on CareerPlan, which tracks 70,000+ jobs from 20+ sources.