Senior Data Engineer
Core
Design, build, and scale data infrastructure to ingest, process, and store large volumes of autonomous vehicle telemetry, sensor, and operational data for AGSE operations.
Role type
Senior IC data engineer (autonomous systems)
Builds
Cloud-based data pipelines and infrastructure for autonomous ground support equipment
Domain
Aviation + autonomous systems + cloud data engineering
Deliverable
production ML models
Required skills
Python, SQL, AWS (S3, Kinesis, Lambda, Glue, Redshift), distributed systems, data modeling, pipeline reliability, observability, Terraform, Kubernetes
Preferred skills
Autonomous vehicles/robotics, time-series/unstructured data, edge-to-cloud ingestion, data lake architectures, ML/simulation workflows, ROS/ROS bags
Technologies
AWS, Kubernetes, Terraform, ROS, ROS bags
Responsibilities
Design scalable data pipelines for telemetry and sensor data; Develop batch and streaming pipelines for near-real-time monitoring; Build cloud-based data infrastructure; Move data from edge devices to cloud storage; Design data models and storage architectures; Ensure data quality and observability; Optimize processing performance and costs; Collaborate with autonomy and software teams; Build tools for data accessibility; Take end-to-end ownership of data infrastructure
Seniority
Senior, hands-on IC