Senior Software Engineer, Distributed Systems - NIM Factory
Core
Design and build factory infrastructure and automation pipelines to validate and deploy NVIDIA Inference Microservices (NIMs) across heterogeneous cloud, on-prem, and Kubernetes environments.
Role type
Senior IC distributed systems engineer (factory infrastructure)
Builds
Scalable factory pipelines, backends, Docker build systems, test harnesses, and observability tools for AI model deployment
Domain
AI/ML infrastructure, distributed systems, cloud computing
Deliverable
production ML models
Required skills
Distributed systems design, microservices architecture, containerization (Docker, K8s), cloud technologies, data modeling, schema design, performance engineering, log ingestion, event-driven architecture
Preferred skills
Temporal, Kafka, Redis, CI/CD pipelines, large-scale full stack development
Technologies
Docker, Kubernetes, Helm, Prometheus, Kafka, Redis, Temporal
Responsibilities
Develop factory pipelines to produce validated deployable services; design interfaces and expand observability over compute infrastructure; collaborate with AI model teams to build efficient infrastructure; define metrics and drive improvements based on feedback; mentor team members
Seniority
Senior, hands-on IC
