System Software Engineer - AI
Core
Design and implement communication and execution primitives to enable large-scale AI models to run efficiently across thousands of GPUs.
Role type
Senior System Software Engineer (AI Infrastructure)
Builds
Foundational technology layer for large-scale AI data center clusters
Domain
AI Infrastructure / High-Performance Computing
Deliverable
production ML models
Required skills
C++, Python, Systems Programming, Linux, Networking Protocols
Preferred skills
CUDA, Distributed AI Frameworks (PyTorch, JAX, DeepSpeed), Cluster Orchestration, Production Deployment
Technologies
CUDA, PyTorch, JAX, DeepSpeed, vLLM, SGLang, Dynamo, TRT-LLM
Responsibilities
Collaborate across the stack to influence foundational technology design; Identify and resolve performance bottlenecks in distributed training and inference; Conduct rigorous performance benchmarking on multi-node clusters.
Seniority
Senior, hands-on IC