Senior Software Engineer, AI Frameworks
Core
Design and implement end-to-end integrations of NVIDIA Grove with open-source AI frameworks (Dynamo, llm-d, Ray, PyTorch) to enable seamless adoption, scaling, and operation of AI capabilities.
Role type
Senior Software Engineer (AI Frameworks)
Builds
Production-grade software, adapters, plugins, operators, runtime components, reference workflows, sample apps, and developer tooling for AI ecosystems.
Domain
AI infrastructure, distributed training/inference, open-source frameworks, GPU computing
Deliverable
production ML models | infrastructure
Required skills
Software engineering in Go, C++, and/or Python; integrating with major AI frameworks/runtimes; distributed systems concepts (RPC, scheduling, fault tolerance); Kubernetes operations; containers and cloud-native tooling; performance optimization for multi-node/multi-GPU environments; observability and debugging.
Preferred skills
Open-source contributions to ML infrastructure projects; experience with large-scale model serving or multi-tenant AI platforms; building SDKs/APIs; GPU performance profiling and kernel-level tuning.
Technologies
NVIDIA Grove, Dynamo, llm-d, Ray, PyTorch, Kubernetes, Helm, Kustomize, Docker, CUDA, Nsight
Responsibilities
Design and implement integrations of Grove with open-source AI frameworks; build and maintain adapters, plugins, and runtime components; partner with framework owners to upstream changes; develop reference workflows and best-practice guides; optimize performance and scalability for distributed training/inference; improve observability and operational readiness for Kubernetes deployments; diagnose complex issues spanning containers, networking, and GPU utilization.
Seniority
Senior, hands-on IC