AI模型运营专家（搜索评测自动化） - TikTok
Core
Design and automate evaluation systems for TikTok's international search business, focusing on relevance, intent understanding, and content quality to support AI model iteration.
Role type
Senior AI Operations Engineer (Search Evaluation & Automation)
Builds
Automated evaluation platforms, large model/Agent workflows for query understanding and result validation, and scalable data pipelines for search algorithms.
Domain
Search engines, Information Retrieval, Large Language Models (LLMs), AI Operations
Deliverable
production ML models
Required skills
Large model fundamentals, Prompt Engineering, Agent workflows, RAG, SQL, Python, Search relevance evaluation, Query understanding, Error analysis
Preferred skills
Experience with search evaluation, AI application deployment, Cross-functional collaboration
Technologies
Python, SQL, Large Language Models, Agents, RAG
Responsibilities
Design evaluation metrics and standards for search relevance and intent; Automate the evaluation pipeline from sample construction to report generation; Implement LLMs and Agents for query understanding and result validation; Analyze model errors and drive continuous iteration of models and tools; Collaborate with algorithm and product teams to translate complex requirements into technical solutions.
