Senior Software Architect, AI Networking
Core
Design and optimize inference infrastructure for large language models running on sophisticated GPU clusters, focusing on memory orchestration, compute scheduling, and inter-node communication.
Role type
Senior IC software architect (AI networking & distributed systems)
Builds
Scalable multi-node LLM inference systems and high-performance serving infrastructure
Domain
Generative AI, GPU clusters, high-performance networking
Deliverable
production ML models
Required skills
Distributed systems design, GPU acceleration, C++, Python, CUDA, system-level optimization, memory management, networking protocols
Preferred skills
LLM inference pipelines, transformer model optimization, model-parallel deployments, performance profiling, congestion control, load balancing
Technologies
CUDA, Core Spectrum-X, GPU clusters
Responsibilities
Design scalable architectures for multi-node LLM inference; Develop infrastructure to optimize latency, throughput, and cost-efficiency; Prototype novel approaches to KV cache handling and parallel execution; Collaborate with model, systems, compiler, and networking teams; Author design documents and technical specs.
Seniority
Senior, hands-on IC
