Research Scientist / Software Engineer, LLM/Agent Platform - TikTok - Content Ecology AI Innovation & Platform
Core
Design and implement novel LLM/Agent frameworks and architect robust, high-performance infrastructure for next-generation AI and Agent systems at global scale.
Role type
Senior IC Research Scientist / Architect (LLM/Agent Platform)
Builds
Scalable infrastructure for model/agent lifecycle, including registries, feature stores, and high-throughput retrieval/RAG systems
Domain
AI Infrastructure, Large Language Models, Agentic AI
Deliverable
production ML models
Required skills
Distributed systems, Deep learning frameworks (PyTorch, Tensorflow, JAX/FLAX), Model lifecycle management, Observability frameworks, Agentic AI components (planning, tool use, memory)
Preferred skills
GPU scheduling, Model serving (Triton, TensorRT-LLM), Vector databases (FAISS, Milvus), MLOps, Distributed training, KV cache–aware serving, Performance optimization (DeepSpeed/ZeRO, vLLM), Agent architectures (LangChain, LlamaIndex)
Technologies
PyTorch, Tensorflow, JAX/FLAX, Triton, TensorRT-LLM, FAISS, Milvus, DeepSpeed, ZeRO, vLLM, LangChain, LlamaIndex, RDMA, NCCL
Responsibilities
Architect standardized pipelines for model/agent lifecycle from data processing to deployment; Partner with algorithm teams to provide infrastructure accelerating R&D; Build observability and evaluation frameworks for reproducibility and cost-efficiency; Design core platform infrastructure including registries and feature stores; Optimize advanced Agentic AI systems for planning and tool use
Seniority
Senior, hands-on IC with architectural responsibilities