CareerPlan

Senior System Software Engineer - Local AI Automation

India, PuneFull-time2026-10-12 → 2026-11-16

Core

Design, implement, and maintain robust system software and infrastructure for deploying, benchmarking, and qualifying high-quality AI applications and models.

Role type

Senior System Software Engineer (AI Infrastructure)

Builds

Inference backends, local model repositories, automated build/deployment pipelines, and system diagnostics for AI workloads.

Domain

Artificial Intelligence / System Software

Deliverable

infrastructure

Required skills

C/C++, C#, Java, Python, multithreaded software, process and resource management, debugging, performance analysis, SQL, CI/CD, Linux/Windows system programming, Kubernetes, Docker, observability tools.

Preferred skills

System profiling, performance optimization, Nsight Systems traces, CPU/GPU resource utilization, memory management, concurrency, AI workload characteristics.

Technologies

Llama.cpp, Ollama, PyTorch, vLLM, WinML, TRT-RTX, Git, Perforce, Jenkins, Grafana, Kibana, Nsight Systems.

Responsibilities

Design and maintain system software for AI inference backends; develop infrastructure for model repository management and synchronization; analyze system workload metrics and implement data processing pipelines; collaborate on system-level instrumentation and debugging; design automated build, integration, and deployment infrastructure; debug issues and optimize performance in existing frameworks.

Seniority

Senior, hands-on IC