Software Engineer - TikTok AI Search Infrastructure
Core
Building highly performant, scalable, and stable infrastructure for TikTok's AI Search, serving billions of daily search requests using cutting-edge ML/NLP/LLM/VLM technology.
Role type
Senior IC machine-learning infrastructure engineer (AI Search)
Builds
End-to-end serving platforms for AI Search use cases (Q&A cards, in-app chatbot, visual search), multi-agent LLM engines, and large-scale data architectures.
Domain
Internet / AI Search / Large-scale Distributed Systems
Deliverable
production ML models
Required skills
LLM serving and training, RAG paradigms, multi-agent LLM engine development, distributed system performance optimization, large-scale data architecture, algorithm and data structure design, inference acceleration, reinforcement learning, model alignment
Preferred skills
Large-scale C++ system development, Linux system performance optimization, distributed databases, distributed data processing frameworks, GPU inference optimization, VLM serving
Technologies
LLM, NLP, VLM, RAG, ReAct, Tool calling, DAG-based workflows, C++, Linux, GPU
Responsibilities
Evolve TikTok's AI Search multi-agent LLM engine; Deploy and optimize text/multimodal LLMs; Build scalable serving platforms for AI Search use cases; Build large-scale data architecture for billion-level records; Design personalized AI search capabilities; Collaborate with modeling and product teams.
Seniority
Senior, hands-on IC
