System Software Engineer - AI
Core
Design and implement communication and execution primitives to enable efficient large-scale AI model training and inference across thousands of GPUs.
Role type
Senior IC system software engineer (AI infrastructure)
Builds
Foundational technology for large-scale AI data center clusters
Domain
AI infrastructure, high-performance computing, distributed systems
Deliverable
production ML models
Required skills
C++, Python, systems programming, Linux, memory management, concurrency, OS internals
Preferred skills
CUDA, GPU programming, performance optimization, distributed AI frameworks (PyTorch, JAX, DeepSpeed), inference engines (vLLM, SGLang, Dynamo/TRT-LLM), cluster orchestration, telemetry
Technologies
CUDA, PyTorch, JAX, DeepSpeed, vLLM, SGLang, Dynamo, TRT-LLM
Responsibilities
Collaborate across the stack to influence foundational technology design; Identify and resolve performance bottlenecks in distributed training and inference; Conduct rigorous performance benchmarking and characterization on multi-node clusters
Seniority
Senior, hands-on IC
