Staff Software Engineer, Data Platform
Core
Design, develop, and maintain the infrastructure for ingesting, processing, discovery, serving, and analysis of massive datasets generated by fleet-scale humanoid robots.
Role type
Staff Software Engineer, Data Platform
Builds
Cloud-based data platforms and observability systems for robot fleets
Domain
Robotics, Big Data, Cloud Infrastructure
Deliverable
production ML models | infrastructure
Required skills
Distributed systems, Microservices architectures, Big data frameworks (Spark, Kafka, Beam, Flink), Cloud providers (AWS, GCP, Azure), Observability tools (OpenTelemetry, Prometheus), Data formats (Parquet, Arrow, Iceberg, Avro, Protobuf), JVM languages (Java, Scala), Python
Preferred skills
Robotics/Autonomous Vehicles, IoT/Edge computing, Embedded devices, Data catalogs (Datahub, Amundsen, Unity Catalog), Databricks, Kubernetes, Build systems (Bazel/Blaze), C++, Rust, Robot data formats (mcap, ROS), Data visualization (Rerun)
Technologies
Spark, Kafka, Beam, Flink, AWS S3, Athena, Sagemaker, Fluentbit, OpenTelemetry, Prometheus, Parquet, Arrow, Iceberg, Avro, Protobuf, Java, Scala, Python, Kubernetes, Databricks, Bazel, Rust, C++, mcap, ROS, Rerun
Responsibilities
Design and implement scalable data pipelines for telemetry, logs, and sensor data; Develop and maintain data ingestion agents for low-connectivity environments; Maintain and develop optimized data formats and protocols; Develop observability systems for real-time monitoring; Implement solutions for high-volume data preparation; Build tools for business intelligence and fleet analytics; Leverage IoT experience to improve data collection pipelines
Seniority
Staff, hands-on IC with strategic impact