Software Engineer, Data Infrastructure
Core
Design, build, and operate distributed storage systems for model-training and evaluation workloads at petabyte scale.
Role type
Senior IC data infrastructure engineer (distributed storage)
Builds
Stateful storage systems on Kubernetes clusters for large-scale model training
Domain
Cloud infrastructure + distributed systems + AI/ML training infrastructure
Deliverable
production ML models
Required skills
distributed storage systems, Kubernetes stateful workloads, Python, Go, cloud object storage, POSIX-style filesystems, data lifecycle management, networking, I/O optimization, cross-region data movement
Preferred skills
parallel/HPC filesystems (Weka, VAST, Lustre), data-loading and checkpointing patterns in large-scale model training
Responsibilities
Design and operate distributed storage systems, run stateful storage systems across Kubernetes clusters, collaborate with researchers to define throughput/latency/durability requirements, solve networking and cross-region data-movement problems
Seniority
Senior, hands-on IC