Senior System Software Engineer - Local AI Automation
Core
Design, implement, and maintain robust system software and infrastructure for deploying, benchmarking, and qualifying high-quality AI applications and models using various inference backends.
Role type
Senior System Software Engineer (AI Infrastructure)
Builds
Local AI automation infrastructure, model repositories, and inference frameworks
Domain
Artificial Intelligence / System Software
Deliverable
infrastructure
Required skills
C/C++, C#, Java, Python, system APIs, multithreaded software, process and resource management, debugging, performance analysis, SQL, CI/CD, Linux/Windows system programming, Kubernetes, Docker, observability tools
Preferred skills
System profiling, performance optimization, telemetry/observability infrastructure, Nsight Systems traces, CPU/GPU resource utilization, memory management, concurrency
Technologies
Llama.cpp, Ollama, PyTorch, vLLM, WinML, TRT-RTX, Git, Perforce, Jenkins, Grafana, Kibana, Nsight Systems
Responsibilities
Design and maintain system software for AI workloads across inference backends; develop infrastructure for model repository management and synchronization; analyze system workload metrics and implement data processing pipelines; collaborate on system-level instrumentation and debugging; design automated build, integration, and deployment infrastructure; debug issues and optimize performance in existing frameworks.
Seniority
Senior, hands-on IC
