Senior Data Engineer, Behavior ML Planning & Prediction
Core
Designing and building scalable data pipelines to unify petabytes of multimodal fleet and simulation data into a trusted foundation for ML-based motion planning in autonomous vehicles.
Role type
Senior Data Engineer (Autonomous Driving Data Platform)
Builds
Canonical datasets, metrics, and self-serve tools for onboard and offboard autonomous driving systems
Domain
Autonomous driving / Mobility / Cloud & AI
Deliverable
production ML models
Required skills
SQL, Python, cloud data warehouse design, ETL/ELT, data architecture ownership, technical leadership, ambiguity management, cross-team influence
Preferred skills
Lakehouse architecture (Apache Iceberg), distributed data processing (Spark, Ray), autonomous driving domain concepts (kinematics, trajectories, motion planning), self-serve analytics tooling
Technologies
BigQuery, Snowflake, Redshift, dbt, Airflow, Spark, Ray, Flyte, Union, Parquet, Iceberg
Responsibilities
Set technical direction for end-to-end data architecture; design and build data pipelines from ingestion to visualization; define data products, SLAs, and monitoring practices; mentor engineers and establish data engineering standards; document architecture and decisions for organizational adoption
Seniority
Senior, technical leader with org-wide influence