Software Engineer Graduate - 2027 Start
Core
Design and build orchestration capabilities for Kubernetes Operators, container runtimes, and lifecycle management of jobs, services, and stateful workloads.
Role type
Graduate Software Engineer (Systems/ML Infrastructure)
Builds
Multi-tenant resource systems, online model-serving lifecycle orchestration, and serving orchestration for disaggregated clusters.
Domain
Cloud Infrastructure / Distributed Systems / AI Model Serving
Deliverable
production ML models | infrastructure
Required skills
Go, C++, Python, data structures, algorithms, Linux, operating systems, computer networks, concurrent programming, distributed systems, source code investigation, metrics analysis, log analysis, profiling, hypothesis testing, system validation.
Preferred skills
Kubernetes, container runtimes, resource scheduling, quota management, multi-tenant systems, FinOps, Volcano, Koordinator, OpenKruise, vLLM, SGLang, Triton, KServe, Ray Serve, KV Cache, Continuous Batching, Prefill/Decode disaggregation, model parallelism, online services, traffic management, autoscaling, performance optimization, GPU/NPU programming, heterogeneous resource scheduling, model distribution, inference performance analysis.
Technologies
Kubernetes, Go, C++, Python, Linux, vLLM, SGLang, Triton, KServe, Ray Serve, Volcano, Koordinator, OpenKruise
Responsibilities
Design and build orchestration capabilities for Kubernetes Operators and container runtimes. Develop multi-tenant resource and quota systems. Build online model-serving lifecycle orchestration. Develop serving orchestration and traffic management for disaggregated serving clusters.
Seniority
Graduate (PhD required)