Solutions Architect, Inference Deployments
Core
Design and deploy scalable AI inference solutions using NVIDIA GPU technology and Kubernetes for enterprise customers.
Role type
Senior Solutions Architect (AI Inference)
Builds
Enterprise generative AI inference pipelines and disaggregated inference systems
Domain
AI/ML Infrastructure, GPU Computing, Cloud Native
Deliverable
production ML models
Required skills
Distributed systems architecture, Kubernetes orchestration, GPU resource management, LLM optimization, Low-latency networking, System tuning
Preferred skills
NVIDIA Dynamo/NIM/Grove experience, Transformer architecture expertise, Open-source contributions
Technologies
NVIDIA Dynamo, Triton Inference Server, TensorRT-LLM, vLLM, SGLang, Kubernetes, NVIDIA GPU Operator, RDMA, UCX
Responsibilities
Build inference pipelines with NVIDIA tools, Orchestrate disaggregated inference on Kubernetes, Accelerate pipelines using TensorRT-LLM/vLLM, Provide technical leadership and mentorship
Seniority
Senior, hands-on IC
