AI Infra Engineer Graduate (Recommendation & LLM) - 2027 Start
Core
Build and optimize infrastructure for large-scale model training and online inference for TikTok's For You recommendation system and Large Language Models (LLMs).
Role type
Graduate AI Infrastructure Engineer (LLM & Recommendation Systems)
Builds
Core training and serving infrastructure for one of the world's largest recommendation systems and foundation models
Domain
Internet / AI Infrastructure / Distributed Systems
Deliverable
production ML models
Required skills
C++, Python, data structures, algorithms, computer systems, PyTorch, TensorFlow, Transformer architectures, LLMs
Preferred skills
LLM training/inference experience, distributed training concepts (DP, TP, PP, FSDP, ZeRO), GPU programming (CUDA, Triton), LLM serving techniques (KV Cache, Continuous Batching, FlashAttention), open-source contributions
Technologies
PyTorch, TensorFlow, CUDA, Triton
Responsibilities
Build and optimize infrastructure for large-scale model training and online inference; Develop distributed systems supporting large recommendation models and LLMs; Improve training and inference performance through GPU optimization and efficient communication; Collaborate with researchers to develop and deploy LLM training and serving solutions; Analyze system bottlenecks and implement performance optimizations