AI Agent策略运营（小云雀Pippit） - 剪映CapCut
Core
Responsible for evaluating and optimizing AI Agent strategies for Pippit, focusing on generation quality, task completion rates, and user satisfaction.
Role type
AI Agent Strategy Operations Specialist
Builds
AI-powered interactive content tools (Pippit) for global users
Domain
AI / Generative AI / Video Editing
Deliverable
production ML models
Required skills
AI Agent strategy, LLM application experience, Prompt engineering, RAG, data analysis, root cause analysis, cross-functional collaboration
Preferred skills
Experience with AI product evaluation, algorithm strategy, context management, tool calling strategies
Technologies
LLM, RAG, Prompt Engineering, Context Management, Tool Calling
Responsibilities
Design and maintain automated and manual evaluation frameworks for AI Agents; Analyze negative user cases to identify issues in model capabilities or strategy; Collaborate with R&D and algorithm teams to implement strategy iterations; Drive strategy optimization through data analysis and experimentation; Monitor core effect metrics to ensure stability and usability in real-world scenarios; Research industry trends to provide strategic insights.
Seniority
Mid-level, hands-on IC
