CareerPlan

Senior System Software Engineer

USAFull-time2026-07-26 → 2026-11-16

Core

Building efficient on-device AI software for high-performance local inference, low latency, and efficient memory use on resource-constrained platforms.

Role type

Senior IC systems software engineer (AI inference)

Builds

Modern inference runtimes and execution stacks for LLMs, vision-language, TTS, ASR, and diffusion AI workloads.

Domain

AI computing, GPU systems, edge computing

Deliverable

production ML models

Required skills

C++, CUDA, data structures, algorithms, machine learning, system-level debugging, performance optimization, quantization, pruning, sparsity, distillation, memory management, graph execution, hardware-aware optimization

Preferred skills

Open-source contributions to inference runtimes, model tooling, or performance infrastructure, distributed team delivery experience

Technologies

Llama.cpp, vLLM, PyTorch, WinML, DXCGC, TensorRT-RTX, Vulkan, DirectX

Responsibilities

Build and optimize local AI inference stack for RTX, RTX Pro, and DGX GPUs; Architecture and development of modern inference runtimes and execution stacks; Perform end-to-end optimization of AI models, data pipelines, and inference runtimes; Apply model optimization techniques to enable efficient deployment of large models on local and edge devices; Perform system-level debugging, performance optimization, and performance–accuracy trade-off analysis; Establish engineering guidelines to accelerate bring-up and ensure production readiness of new models and inference backends

Seniority

Senior, hands-on IC