Senior Software Engineer, AI Frameworks
Core
Design and implement end-to-end integrations of NVIDIA Grove with open-source AI frameworks (Dynamo, llm-d, Ray, PyTorch) to enable seamless adoption, scaling, and operation of AI capabilities.
Role type
Senior Software Engineer (AI Frameworks & Distributed Systems)
Builds
Production-grade adapters, plugins, operators, runtime components, reference workflows, and developer tooling for AI training and inference stacks.
Domain
AI Infrastructure / Distributed Systems / GPU Computing
Deliverable
production ML models
Required skills
Go, C++, Python, distributed systems (RPC, scheduling, fault tolerance), Kubernetes, containers (Docker), AI framework integration (PyTorch, Ray, Triton), performance optimization (multi-node/GPU), observability (metrics, logging, tracing)
Preferred skills
Open-source contributions, large-scale model serving, SDK/API development, GPU profiling (Nsight), reproducibility and versioning
Technologies
NVIDIA Grove, Dynamo, llm-d, Ray, PyTorch, Kubernetes, Helm, Kustomize, Docker, CUDA, Nsight
Responsibilities
Design and implement integrations of Grove with open-source AI frameworks; Build and maintain adapters, plugins, and runtime components; Partner with framework owners to upstream changes; Develop reference workflows and best-practice guides; Optimize performance and scalability for distributed training/inference; Improve observability and operational readiness for Kubernetes deployments; Diagnose complex issues spanning containers, networking, and GPU utilization.
Seniority
Senior, hands-on IC
