Senior Data Platform Engineer
Core
Own the end-to-end autonomy data pipeline for recovering, storing, cataloging, and querying flight data from unmanned systems to support testing, simulation, and ML training.
Role type
Senior IC data platform engineer
Builds
Cloud storage, catalog, query infrastructure, and immutable datasets for autonomy test and simulation runs
Domain
Defense technology / Autonomous systems / Robotics
Deliverable
production ML models | infrastructure
Required skills
Python, SQL, relational database design, cloud object storage, distributed batch processing, job orchestration, time synchronization, data schema design
Preferred skills
Robotics/autonomous vehicle data infrastructure, video handling at scale, infrastructure as code, export-controlled environment experience, model training pipeline integration
Technologies
Azure, AWS, GCP, Spark, Ray, Dask, Airflow, Dagster, PostgreSQL, rosbag, MCAP, HDF5, Parquet
Responsibilities
Build data recovery paths from field vehicles with prioritized upload and integrity verification; Decode and time-align multi-sensor and video streams; Design catalog and tag models for indexing flight data; Build query layers for retrieving specific flight conditions; Serve logs to evaluation harnesses with stable ordering and reproducible results; Create versioned, immutable datasets with lineage tracking
Seniority
Senior, hands-on IC
