Senior Data Engineer
Core
Own the data platform that turns raw fleet and simulation logs into training-ready, searchable, and versioned datasets for autonomous driving model training and safety analysis.
Role type
Senior IC data engineer (autonomous driving)
Builds
Production-grade data pipelines, feature stores, metadata systems, and dataset versioning for multi-sensor logs (camera, lidar, radar) and simulation data.
Domain
Autonomous driving / Robotics / Logistics
Deliverable
production ML models
Required skills
Python, SQL, C++, Apache Spark, Flyte, Union, Ray, Airflow, AWS (S3, EC2, EKS, Glue, Athena), Protobuf, ROS/ROS 2 bags, MCAP, data quality, observability, lineage
Preferred skills
AD/ADAS, Kubeflow, SageMaker, Vertex AI, H3, S2, PostGIS, Delta Lake, Apache Iceberg, Parquet, CI/CD
Technologies
Apache Spark, Flyte, Union, Ray, Airflow, AWS, S3, EC2, EKS, Glue, Athena, Protobuf, ROS, MCAP, Delta Lake, Apache Iceberg, Parquet
Responsibilities
Design and operate pipelines ingesting multi-sensor logs from autonomous truck fleet and simulation; Build internal tools for data labeling, curation, indexing, and cataloging; Partner with ML researchers to design schemas and APIs for model training; Develop feature stores and dataset versioning for structured and unstructured data; Integrate synthetic and simulated data with real-world logs; Build scenario-mining and event-tagging pipelines; Optimize pipelines for cost, latency, and traceability; Set data quality and observability standards.
Seniority
Senior, hands-on IC
