Senior System Software Engineer - Local AI Automation
Core
Design, implement, and maintain robust system software and infrastructure for deploying, benchmarking, and qualifying high-quality AI applications and models.
Role type
Senior System Software Engineer (AI Infrastructure)
Builds
Inference backends, local model repositories, automated build/deployment pipelines, and system diagnostics for AI workloads.
Domain
Artificial Intelligence / System Software
Deliverable
infrastructure
Required skills
C/C++, C#, Java, Python, multithreaded software, process and resource management, debugging, performance analysis, SQL, CI/CD, Linux/Windows system programming, Kubernetes, Docker, observability tools.
Preferred skills
System profiling, performance optimization, Nsight Systems traces, CPU/GPU resource utilization, memory management, concurrency, AI workload characteristics.
Technologies
Llama.cpp, Ollama, PyTorch, vLLM, WinML, TRT-RTX, Git, Perforce, Jenkins, Grafana, Kibana, Nsight Systems.
Responsibilities
Design and maintain system software for AI inference backends; develop infrastructure for model repository management and synchronization; analyze system workload metrics and implement data processing pipelines; collaborate on system-level instrumentation and debugging; design automated build, integration, and deployment infrastructure; debug issues and optimize performance in existing frameworks.
Seniority
Senior, hands-on IC