AI and HPC Systems Performance Engineer
Core
Senior engineer optimizing AI training and inference workloads on HPE GPU server infrastructure, focusing on performance characterization, system tuning, and automation.
Role type
Senior IC AI and HPC Systems Performance Engineer
Builds
Optimized AI/ML platforms and reference architectures for enterprise customers
Domain
High-Performance Computing (HPC) and Artificial Intelligence
Deliverable
production ML models | infrastructure
Required skills
Linux system administration, GPU server configuration, performance profiling and telemetry analysis, automation scripting (Python/Bash/Go/C++), distributed computing, container orchestration (Kubernetes/Docker), InfiniBand/RDMA networking, LLM serving frameworks (vLLM, TensorRT-LLM, SGLang), CUDA/NCCL, root-cause analysis
Preferred skills
Experience with PyTorch, JAX, Hugging Face, DeepSpeed, Megatron-LM, Ray, vLLM, SGLang, TensorRT-LLM, Dynamo, ONNX Runtime, Kubernetes, Redis, Vector Databases, RAG architectures, multi-GPU interconnects, technical research and white paper authoring
Technologies
InfiniBand, Ethernet fabric, GPUDirect, RDMA, CUDA, NCCL, PyTorch, JAX, Hugging Face Transformers, DeepSpeed, Megatron-LM, Ray, vLLM, SGLang, TensorRT-LLM, Dynamo, ONNX Runtime, Kubernetes, Docker, Redis, InfiniBand, Mellanox
Responsibilities
Install, configure, and optimize complex AI infrastructure components including GPU servers, storage, and networking; Develop automation scripts and Infrastructure-as-Code solutions; Perform system-level performance characterization of AI workloads; Design and analyze performance benchmarks for LLMs and distributed training; Characterize performance across multi-GPU environments using modern interconnects; Capture and interpret system telemetry to identify bottlenecks; Develop tools for workload observability and scalability testing; Collaborate with customers and partners to optimize AI solutions; Evaluate emerging AI technologies and provide technical recommendations; Author technical reports, white papers, and reference architectures; Provide technical leadership and mentoring to junior engineers
Seniority
Senior, hands-on IC with research and mentorship responsibilities