Director, Engineering – Software Engineering and AI Inferencing Platforms
Core
Lead engineering teams in Vietnam to design, architect, and deliver high-performance system software platforms and AI delivery services (NIMs, Blueprints) for NVIDIA's AI products.
Role type
Director of Engineering (Software Engineering and AI Inferencing Platforms)
Builds
High-performance system software platforms, AI delivery platforms (NIMs, Blueprints), and distributed testing infrastructure for NVIDIA AI products.
Domain
Artificial Intelligence, High-Performance Computing, System Software
Deliverable
production ML models | infrastructure
Required skills
Large team leadership, system software architecture, cloud and accelerated computing technologies, distributed systems design, CI/CD implementation, security and compliance testing, strategic planning, technical mentorship
Preferred skills
AI/ML inferencing platform scaling, GPU programming and CUDA optimization, microservices architecture, open-source ecosystem contributions, deep learning frameworks (RAG, embeddings)
Technologies
Spark, Kubernetes, Dask, Python, CUDA, Temporal, Gitlab DevOps Platform, RAPIDS, NeMo Curator, Morpheus
Responsibilities
Build and scale engineering teams in Vietnam, drive design and delivery of system software platforms, partner with global teams on performance and scalability, oversee AI delivery platform development, develop distributed system testing processes, ensure security and compliance, mentor talent
Seniority
Director, strategic leadership with hands-on technical depth