Staff Software Engineer, ML Data Infrastructure, Autonomy
Core
Own the unified metadata and query layer for autonomy data, enabling engineers to query concepts rather than databases across document metadata, high-cardinality analytics, real-time search, and sensor payloads.
Role type
Staff Software Engineer, ML Data Infrastructure
Builds
Unified data lake, metadata access APIs, batch/streaming pipelines, and indexing layers for fleet-scale autonomy data.
Domain
Autonomous Vehicles / Machine Learning Data Infrastructure
Deliverable
production ML models
Required skills
Columnar and analytical data stores, schema design, data modeling, batch and streaming pipelines, Python, Go/C++/Rust, queueing and event-driven systems, production monitoring and alerting, engineering leadership.
Preferred skills
Applied ML for data problems, robotics or AV data experience, vector databases, feature stores.
Technologies
ClickHouse, Pinot, Druid, BigQuery, Databricks, Snowflake, Parquet, Arrow, Iceberg, Delta, Kafka, Kinesis, Prometheus, Grafana, Datadog, CloudWatch, ROS/ROS 2, MCAP.
Responsibilities
Design the architecture for the datalake and metadata access APIs; define canonical schemas and drive migration paths; build pipelines for eval data; improve data mining tools for scenario discovery; ensure data correctness with validation and alerting; set data engineering standards and mentor engineers.
Seniority
Staff, technical lead & mentorship