Software Test Engineer (AI), TikTok Search
Core
Design and deliver AI-powered testing and evaluation solutions for TikTok's global search experience, covering query understanding, retrieval, ranking, and generative search (LLM Answers and RAG).
Role type
Senior IC software test engineer (AI/Generative AI)
Builds
LLM-based evaluation pipelines, automated test case generation tools, and AI agents for search quality verification.
Domain
Search Engineering + Generative AI
Deliverable
production ML models
Required skills
software testing methodologies, distributed systems fundamentals, LLM evaluation paradigms, automation testing, algorithm evaluation, Python/Go/Java/C++ proficiency (via careerplan.io/jobs/7668307535980267829-software-test-engineer-ai-tiktok-search-at-tiktok)
Preferred skills
RAG pipeline verification, AI agent evaluation, test platform development, multilingual query set management, search safety red teaming
Technologies
LLMs, RAG, inverted indexes, vector indexes, Python, Go, Java, C++