Member of Technical Staff, Cloud Orchestration (Remote)
Core
Design systems for cluster management, deployment automation, and production monitoring to keep vLLM running reliably at massive scale.
Role type
Senior IC cloud orchestration engineer (GPU inference)
Builds
Operational backbone for vLLM inference engine
Domain
AI inference infrastructure / GPU clusters
Deliverable
production ML models
Required skills
Kubernetes, container orchestration, custom Kubernetes operators, Python/Rust/Go, infrastructure-as-code (Terraform, Helm), GPU cluster management, cloud platforms (AWS, GCP, Azure) (via careerplan.io/jobs/c0f52cce-53fc-478c-894e-1ee601148cc6-member-of-technical-staff-cloud-orchestration-remote-at-inferact)
Preferred skills
ML-specific orchestration tools (Ray, Slurm), GPU scheduling, multi-tenancy, resource optimization, vLLM deployment patterns
Technologies
vLLM, Kubernetes, Ray, Slurm, Terraform, Helm, Python, Rust, Go
Responsibilities
Design cluster management systems, implement deployment automation, build production monitoring solutions, debug hardware issues, manage GPU clusters
Seniority
Senior, hands-on IC
