HPC Storage Engineer | Experienced Hire
Core
Design, implement, and optimize distributed and parallel filesystems and storage infrastructure for high-performance computing (HPC) environments to support compute-intensive workloads.
Role type
Senior IC HPC Storage Engineer
Builds
Scalable, performant, and resilient storage solutions tightly integrated with compute nodes
Domain
High-performance computing (HPC) and distributed systems
Deliverable
production ML models | infrastructure
Required skills
Parallel/distributed filesystems, Linux systems administration, High-performance I/O optimization, Large-scale distributed systems development (C++), Data movement workflows, HPC scheduler integration, Troubleshooting complex storage issues, Automation for storage lifecycle
Preferred skills
Object storage, Hierarchical Storage Management (HSM), Scientific/ML/AI workload support
Technologies
Lustre, GPFS/IBM Spectrum Scale, BeeGFS, Ceph, Slurm
Responsibilities
Design and deploy HPC storage systems and parallel/distributed filesystems; Own data movement workflows including ingest, replication, tiering, and archiving; Optimize filesystem and storage performance for large-scale parallel workloads; Design and tune load-balancing strategies across storage targets and data pipelines; Troubleshoot storage, I/O, and data movement issues across HPC clusters; Develop and maintain automation for storage provisioning and monitoring; Partner with compute and networking teams to ensure end-to-end performance; Advise users on I/O patterns and performance tuning; Evaluate and integrate new storage technologies.
Seniority
Senior, hands-on IC
