Senior Software Engineer, Crusoe Managed Data Transfer
Core
Build the control plane (API, scheduler, job state) for Crusoe's Managed Data Transfer service to move petabyte-scale training data from AWS S3 and other clouds into Crusoe storage.
Role type
Senior Software Engineer (Backend/Platform)
Builds
Production backend services and APIs for data transfer orchestration
Domain
Cloud infrastructure, AI data pipelines, distributed systems
Deliverable
production ML models | product features
Required skills
Backend engineering in Go, gRPC/REST, relational databases, Kubernetes, distributed systems design, API design, security/identity management, operational ownership
Preferred skills
Large-scale data movement (S3 multipart, rclone, AWS DataSync), cross-cloud identity (AWS IAM/STS, GCP impersonation), job orchestration (Temporal, Argo), GPU/AI infrastructure experience
Technologies
Go, gRPC, REST, Kubernetes, AWS S3, AWS IAM/STS, Terraform, CLI tools
Responsibilities
Design and build the data-transfer API with a provider-neutral model; Build the scheduler and state machine for splitting work and tracking progress; Implement secure access with short-lived credentials; Ship CLI and Terraform/Console experiences; Instrument the service with metrics, logs, and alerts; Collaborate with Storage, Network, IAM, and Console teams
Seniority
Senior, hands-on IC
