Senior System Software Engineer
Core
Building efficient on-device AI software for high-performance local inference, low latency, and efficient memory use on resource-constrained platforms.
Role type
Senior IC systems software engineer (AI inference)
Builds
Modern inference runtimes and execution stacks for LLMs, vision-language, TTS, ASR, and diffusion AI workloads.
Domain
AI computing, GPU systems, edge computing
Deliverable
production ML models
Required skills
C++, CUDA, data structures, algorithms, machine learning, system-level debugging, performance optimization, quantization, pruning, sparsity, distillation, memory management, graph execution, hardware-aware optimization
Preferred skills
Open-source contributions to inference runtimes, model tooling, or performance infrastructure, distributed team delivery experience
Technologies
Llama.cpp, vLLM, PyTorch, WinML, DXCGC, TensorRT-RTX, Vulkan, DirectX
Responsibilities
Build and optimize local AI inference stack for RTX, RTX Pro, and DGX GPUs; Architecture and development of modern inference runtimes and execution stacks; Perform end-to-end optimization of AI models, data pipelines, and inference runtimes; Apply model optimization techniques to enable efficient deployment of large models on local and edge devices; Perform system-level debugging, performance optimization, and performance–accuracy trade-off analysis; Establish engineering guidelines to accelerate bring-up and ensure production readiness of new models and inference backends
Seniority
Senior, hands-on IC