CareerPlan

System Software Architect, AI Hardware and Software Performance

China, ShanghaiFull-time2026-10-19 → 2026-11-10

Core

Design and build automation platforms that evaluate the performance and quality of accelerated computing workloads for large language models, agentic AI, and HPC clusters.

Role type

Senior System Software Architect (AI Hardware & Performance)

Builds

Scalable benchmark infrastructure, reusable software services, and automated workflows for performance evaluation.

Domain

AI Hardware, High-Performance Computing (HPC), Distributed Systems

Deliverable

production ML models

Required skills

System software architecture, distributed systems, Python, AI hardware performance analysis, cloud-native systems, quantitative analysis, technical leadership, cross-functional alignment, mentoring

Preferred skills

Modern compute hardware stack knowledge (silicon, networking, clusters), AI workload stress testing, custom agent harnesses, AI frameworks (vLLM, SGLang, TensorRT-LLM, PyTorch, JAX)

Responsibilities

Define technical direction and architecture for benchmark infrastructure, lead implementation of automated benchmark workflows, establish engineering approaches for reliability and scalability, perform hands-on AI benchmarking and analysis, lead delivery across team boundaries, raise engineering bar through code reviews and mentoring, contribute to open-source projects

Seniority

Senior, hands-on IC with technical leadership