CareerPlan

Senior System Software Engineer - Local AI

India, PuneFull-time2026-09-28 → 2026-11-15

Core

Architect and develop high-performance local AI inference software for RTX and DGX-class systems, focusing on low latency, optimized memory, and deployment on resource-constrained platforms.

Role type

Senior IC systems software engineer (local AI inference)

Builds

Modern inference runtimes and execution stacks for LLM, vision-language, TTS, ASR, and diffusion-based AI workloads

Domain

AI computing / GPU systems / Local inference

Deliverable

production ML models

Required skills

C++ programming, data structures, algorithms, machine learning, system-level debugging, performance tuning, model optimization (quantization, pruning, sparsity, distillation), hardware-aware optimization

Preferred skills

AOT graph-compilation systems, low-level systems and GPU kernel programming, CUDA, open-source inference runtime contributions, Vulkan, DirectX, vLLM

Technologies

llama.cpp, vLLM, PyTorch, WinML, DXCGC, TensorRT-RTX, CUDA

Responsibilities

Partner with software, research, architecture, and product leadership to align technical requirements; Build and optimize the local AI inference stack for diverse hardware architectures; Architect and develop inference runtimes; Perform end-to-end optimization of AI models and data pipelines; Lead system-level debugging and performance analysis; Mentor engineers and review architecture proposals

Seniority

Senior, hands-on IC with mentorship