Senior Data Engineer
Core
Design and build a scalable data platform to ingest, store, and transform high-volume telemetry from robots and industrial stations for downstream insights and agent operations.
Role type
Senior Data Software Engineer (Data Platform)
Builds
Data ingestion services, storage tiers, pipeline machinery, ID keying tables, and retention/egress policies for robotics telemetry.
Domain
Robotics, Industrial IoT, Data Infrastructure
Deliverable
production ML models | product features | infrastructure
Required skills
Go, Python, Rust, Java, or C++ production development; durable message/streaming systems (Kafka, NATS, Pulsar); columnar stores (ClickHouse) and object-storage lakes (Parquet, Iceberg); relational and NoSQL databases; CI/CD, monitoring, and alerting; schema governance and data contracts.
Preferred skills
Robotics/IoT/industrial telemetry experience (MCAP); GCP (GCS, BigQuery/BigLake); Kubernetes; on-prem/edge/air-gapped data systems; Prometheus and Grafana; data preparation for ML/RL training.
Technologies
Go, Python, Rust, Java, C++, Kafka, NATS, Pulsar, ClickHouse, Parquet, Iceberg, GCS, BigQuery, BigLake, Kubernetes, Prometheus, Grafana, MCAP
Responsibilities
Design data capture lanes, storage tiers, and pipeline layout; re-design ingestion services for scale; build transform machinery and durable storage paths; construct ID keying and crosswalk tables; own retention policies and site-to-cloud replication; manage CI/CD, monitoring, and alerting for services running in cloud and customer facilities.
Seniority
Senior, hands-on IC