高性能推理优化研发工程师 - 安全与风控
Core
Building high-performance, high-reliability AICC confidential inference infrastructure for large-scale AI computing platforms by optimizing the full link of large model inference.
Role type
Senior IC AI Infra Research Engineer (Confidential Inference)
Builds
Confidential inference infrastructure, inference engine adaptations, cloud-native deployment systems, and CI/CD pipelines for large GPU clusters.
Domain
Cloud Security, AI Infrastructure, Confidential Computing
Deliverable
production ML models
Required skills
System programming (Python/C++/Go/Rust), Kubernetes architecture & development, Large model inference frameworks (SGLang/vLLM), System performance tuning (CPU/GPU/Memory), Distributed system development
Preferred skills
eBPF, torch.profiler, Nsight, Domestic GPU tuning, TEE/Trusted Execution Environment experience
Technologies
Kubernetes, Helm, Argo CD, SGLang, vLLM, eBPF, TEE
Responsibilities
Adapt and optimize large model inference engines for trusted environments (batching, memory management, KV Cache, operator optimization); Design intelligent routing and auto-scaling mechanisms for Kubernetes-based inference workloads; Build CI/CD pipelines, automated testing, and AIOps systems for confidential AI Infra.
Seniority
Senior, hands-on IC
