Senior Research Engineer - Enterprise Products
Core
Design and evaluate routing policies for LLM traffic, build agentic benchmarks, and ship optimized inferencing technologies to support generative AI deployment.
Role type
Senior Research Engineer (Generative AI Inference)
Builds
Optimized inferencing technologies, routing policies, and agentic benchmarks for NVIDIA's generative AI stack.
Domain
Generative AI, Large Language Models (LLM), Deep Learning, Distributed Systems
Deliverable
production ML models
Required skills
Deep Learning frameworks (PyTorch, TensorFlow), LLM evaluation/benchmarking, Machine Learning, Deep Neural Networks, Natural Language Processing, Empirical research, Algorithms and data structures, Parallel and distributed computing, System software
Preferred skills
Large-scale distributed systems architecture, Agentic benchmark creation, GPU architecture knowledge, CUDA programming, Mentoring
Technologies
PyTorch, TensorFlow, CUDA, NVIDIA accelerated serving stack
Responsibilities
Design and evaluate routing policies for LLM traffic to best use mixture of model systems; Build and run agentic benchmarks to measure algorithm quality and generate calibration data; Ship design docs, code, and community contributions to open-source repos; Collaborate with engineering teams to ensure software integration across the NVIDIA stack.
Seniority
Senior, hands-on IC
