Data Engineer (Detect & Track Distillation)
Core
Build and maintain scalable data pipelines to ingest, curate, and version terabytes of unstructured field data (video, sensor streams) for training defense AI models.
Role type
Senior Data Engineer (ML Data Infrastructure)
Builds
Production-ready, versioned datasets and data loading tools for deep-learning pipelines
Domain
Defense technology / Multimodal AI / Unstructured data processing
Deliverable
production ML models
Required skills
Python, data pipeline engineering, unstructured data handling (video/sensor), data curation, dataset versioning, PyTorch optimization, distributed data processing
Preferred skills
Multimodal sensor data expertise, labeling workflow design, dataset construction for ML
Technologies
PyTorch, columnar/sharded storage formats
Responsibilities
Ingest and decode raw field logs and public datasets; Align multiple data streams temporally and spatially; Define data gathering and labeling requirements; Build task-specific datasets for training and evaluation; Manage dataset versioning and lineage; Optimize storage formats and loading tools for training efficiency
Seniority
Senior, hands-on IC