Software Engineer Graduate - 2027 Start
Core
Design and build ML platform orchestration capabilities, including multi-tenant resource scheduling, GPU utilization optimization, and model-serving lifecycle management.
Role type
Graduate Software Engineer (ML Infrastructure)
Builds
ML platform orchestration systems, scheduling systems, and model-serving infrastructure.
Domain
Cloud Infrastructure / Machine Learning Systems
Deliverable
production ML models | infrastructure
Required skills
Go, C++, Python, distributed systems, concurrent programming, Linux, data structures, algorithms
Preferred skills
Kubernetes, container runtimes, FinOps, vLLM, SGLang, Triton, Ray Serve, KV Cache, Continuous Batching, model parallelism
Technologies
Kubernetes, Volcano, Koordinator, OpenKruise, vLLM, SGLang, Triton, KServe, Ray Serve
Responsibilities
Develop multi-tenant resource and quota management systems; Improve GPU utilization through resource pooling; Build model-serving lifecycle capabilities including deployment and autoscaling; Develop topology-aware scheduling and intelligent request routing.
Seniority
Graduate (Entry Level)