Senior System Software Engineer - Local AI
Core
Architect and develop high-performance local AI inference software for RTX and DGX-class systems, focusing on low latency, optimized memory, and deployment on resource-constrained platforms.
Role type
Senior IC systems software engineer (local AI inference)
Builds
Modern inference runtimes and execution stacks for LLM, vision-language, TTS, ASR, and diffusion-based AI workloads
Domain
AI computing / GPU systems / Local inference
Deliverable
production ML models
Required skills
C++ programming, data structures, algorithms, machine learning, system-level debugging, performance tuning, model optimization (quantization, pruning, sparsity, distillation), hardware-aware optimization
Preferred skills
AOT graph-compilation systems, low-level systems and GPU kernel programming, CUDA, open-source inference runtime contributions, Vulkan, DirectX, vLLM
Technologies
llama.cpp, vLLM, PyTorch, WinML, DXCGC, TensorRT-RTX, CUDA
Responsibilities
Partner with software, research, architecture, and product leadership to align technical requirements; Build and optimize the local AI inference stack for diverse hardware architectures; Architect and develop inference runtimes; Perform end-to-end optimization of AI models and data pipelines; Lead system-level debugging and performance analysis; Mentor engineers and review architecture proposals
Seniority
Senior, hands-on IC with mentorship