Software Development Engineer - AI Workload Optimization
Core
Define and drive end-to-end software optimization strategy for AMD's AI software stack to achieve industry-leading performance for top-tier customers.
Role type
Senior IC machine-learning engineer (AI workload optimization)
Builds
AMD's software stack (ROCm, compilers, high-level AI frameworks) tuned for maximum performance on demanding AI workloads
Domain
Semiconductor / AI Infrastructure
Deliverable
production ML models
Required skills
AI framework expertise (PyTorch, JAX, vLLM, SGLang), ROCm stack mastery, distributed inference/training optimization, performance profiling (TorchProfiler, ROCm Profiler, Nsight), modern model architecture knowledge (Transformer, Attention, KV Cache), optimization techniques (quantization, speculative decoding, FlashAttention), hardware-software co-design
Preferred skills
High-level technical leadership (Fellow or equivalent), cross-functional initiative driving, open-source community engagement, mentoring
Technologies
ROCm, PyTorch, JAX, vLLM, SGLang, TorchProfiler, Nsight
Responsibilities
Set technical vision and roadmap for workload optimization, lead profiling and tuning of large-scale models (LLMs, Diffusion, Multimodal, MoE), partner with hyperscalers to deliver tailored optimizations, collaborate with hardware/compiler teams to influence silicon features, drive development of performance estimation tools, mentor technical leaders
Seniority
Senior, hands-on IC with leadership responsibilities
