Recommendation Architecture AI/ML Infrastructure Engineer Intern (Data-Arch-TikTok Live) - 2027 Summer
Core
Build and optimize distributed training and inference systems for large-scale recommendation models and LLMs.
Role type
Intern, AI/ML Infrastructure Engineer
Builds
Production infrastructure for TikTok's For You recommendation system and Large Language Models
Domain
AI Infrastructure, Distributed Systems, GPU Computing
Deliverable
infrastructure
Required skills
C++, Python, data structures, algorithms, computer systems, PyTorch, TensorFlow, Transformer architectures, LLMs
Preferred skills
LLM training/inference experience, distributed training concepts (DP, TP, PP, FSDP, ZeRO), GPU programming (CUDA, Triton), LLM serving techniques (KV Cache, Continuous Batching, FlashAttention), open-source contributions
Technologies
PyTorch, TensorFlow, CUDA, Triton, FSDP, ZeRO
Responsibilities
Build and optimize infrastructure for large-scale model training and online inference; Develop distributed systems supporting large recommendation models and LLMs; Improve training and inference performance through GPU optimization and efficient communication; Collaborate with researchers to develop and deploy LLM training and serving solutions; Analyze system bottlenecks and implement performance optimizations