Staff Engineer, Crusoe Managed Data Transfer (Distributed Systems)
Core
Technical lead and systems architect for Crusoe's Managed Data Transfer (MDT) service, moving petabyte-scale training data between hyperscaler storage and Crusoe storage.
Role type
Staff Engineer, distributed systems
Builds
MDT service (control plane, transfer worker fleet, storage/network integration)
Domain
AI infrastructure, cloud storage, data transfer
Deliverable
production ML models
Required skills
distributed systems design, data movement and storage performance, systems integration, cross-team influence, operational ownership, Go proficiency
Preferred skills
bulk data transfer systems experience, cloud networking and interconnects, cross-account cloud IAM, ANN indexing, AI/HPC data pipelines
Technologies
Kubernetes, Go, object storage, TCP, AWS DataSync, Google Storage Transfer Service, rclone, AWS Direct Connect, GCP Interconnect
Responsibilities
Own end-to-end design of MDT (job API, scheduler, workers, storage integration), evaluate and migrate production prototype, set data-plane strategy for throughput and correctness, define cross-team interfaces, design for extensibility and build-versus-buy, establish operational excellence, partner with Product on scope and pricing, mentor engineers
Seniority
Staff, technical lead and architect
