CareerPlan

Senior Data Engineer

Santa Clara, CAFull-time$180k–$260k2026-11-13 → 2026-11-19

Core

Own the data platform that turns raw fleet and simulation logs into training-ready, searchable, and versioned datasets for autonomous driving model training and safety analysis.

Role type

Senior IC data engineer (autonomous driving)

Builds

Production-grade data pipelines, feature stores, metadata systems, and dataset versioning for multi-sensor logs (camera, lidar, radar) and simulation data.

Domain

Autonomous driving / Robotics / Logistics

Deliverable

production ML models

Required skills

Python, SQL, C++, Apache Spark, Flyte, Union, Ray, Airflow, AWS (S3, EC2, EKS, Glue, Athena), Protobuf, ROS/ROS 2 bags, MCAP, data quality, observability, lineage

Preferred skills

AD/ADAS, Kubeflow, SageMaker, Vertex AI, H3, S2, PostGIS, Delta Lake, Apache Iceberg, Parquet, CI/CD

Technologies

Apache Spark, Flyte, Union, Ray, Airflow, AWS, S3, EC2, EKS, Glue, Athena, Protobuf, ROS, MCAP, Delta Lake, Apache Iceberg, Parquet

Responsibilities

Design and operate pipelines ingesting multi-sensor logs from autonomous truck fleet and simulation; Build internal tools for data labeling, curation, indexing, and cataloging; Partner with ML researchers to design schemas and APIs for model training; Develop feature stores and dataset versioning for structured and unstructured data; Integrate synthetic and simulated data with real-world logs; Build scenario-mining and event-tagging pipelines; Optimize pipelines for cost, latency, and traceability; Set data quality and observability standards.

Seniority

Senior, hands-on IC