AI模型运营专家（国际电商搜索评测自动化） - TikTok
Core
Design and automate evaluation systems for TikTok's international e-commerce search, focusing on query intent, relevance, and conversion efficiency to support AI model iteration.
Role type
Senior AI Operations Specialist (E-commerce Search Evaluation)
Builds
Automated evaluation platforms, LLM/Agent workflows for intent understanding and quality assessment, and standardized global evaluation frameworks.
Domain
E-commerce, Search, AI/ML Operations
Deliverable
production ML models
Required skills
LLM fundamentals, Prompt Engineering, Agent workflows, RAG, SQL, Python, A/B testing, Search relevance evaluation, Query intent understanding, Data analysis, Experiment design
Preferred skills
E-commerce search engine experience, Information retrieval, Recommendation systems, Error analysis, Cross-functional collaboration
Technologies
LLMs, Agents, RAG, SQL, Python
Responsibilities
Design evaluation metrics and model tasks for search relevance and user satisfaction; Automate the full lifecycle of evaluation and annotation projects; Implement LLMs and Agents for intent understanding, sample generation, and quality control; Establish global SOPs and evaluation methodologies; Collaborate with algorithm and product teams to translate insights into strategy iterations.
