Lead Data Infrastructure Engineer
Core
Own the data backbone for a robotics fleet, ensuring reliable pipelines for sensor recordings, telemetry, and autonomy events to support engineering, operations, and ML workloads.
Role type
Lead Data Infrastructure Engineer
Builds
Batch and streaming pipelines, data quality frameworks, observability dashboards, and integrated data lakehouse solutions for robotics data.
Domain
Robotics / Autonomous Vehicles / Last-mile logistics
Deliverable
production ML models
Required skills
Python, SQL, Spark, Flink, Kafka, Airflow, Iceberg, Delta, Hudi, Prometheus, Grafana, Terraform, Docker, Kubernetes, Alibaba Cloud, AWS
Preferred skills
ROS 2, MCAP, Foxglove, Kubeflow, MLflow, CARLA, NVIDIA Isaac Sim
Technologies
Spark, Flink, Kafka, Airflow, Dagster, Argo Workflows, Iceberg, Delta, Hudi, Presto, Trino, BigQuery, Prometheus, Grafana, Superset, Tableau, Alibaba Cloud, AWS, Terraform, Docker, Kubernetes
Responsibilities
Design and operate batch and streaming pipelines for robot telemetry and sensor data; implement data quality and validation frameworks with alerting; build observability for pipeline throughput, lag, and failure modes; maintain dashboards and curated datasets for self-service; integrate robotics data onto central ML platforms; design storage and retention strategies for high-volume sensor data; partner with ML engineers to version training datasets; drive down platform costs through storage tiering and compute optimization.
Seniority
Senior, hands-on IC
