AI Infrastructure Engineer - Recommendation & LLM
Core
Design, develop, and optimize large-scale AI training and online inference infrastructure for TikTok's For You recommendation system and Large Language Models (LLMs).
Role type
Senior IC AI Infrastructure Engineer (Recommendation & LLM)
Builds
Core training and serving infrastructure for billions of personalized recommendations and foundation models
Domain
Internet / AI Infrastructure & Distributed Systems
Deliverable
production ML models
Required skills
C++, Python, PyTorch, TensorFlow, distributed systems, GPU optimization, CUDA, Triton, model parallelism, KV Cache, Continuous Batching, FlashAttention
Preferred skills
LLM inference optimization, speculative decoding, high-performance computing, open-source contributions, technical mentorship
Technologies
PyTorch, TensorFlow, CUDA, Triton, FSDP, ZeRO, FlashAttention
Responsibilities
Design and optimize large-scale AI training and inference infrastructure; Drive architecture of distributed training and serving systems; Optimize end-to-end model performance across GPU, memory, and networking; Develop LLM training/serving infrastructure with model parallelism and efficient inference; Resolve performance bottlenecks across the AI stack; Improve system latency, throughput, and cost efficiency; Mentor junior engineers.
Seniority
Senior, hands-on IC