CareerPlanSign in

AI测试开发工程师(Agent方向) - 抖音研发中台

成都💼 Full-time🗓 2026-09-28

Core

Build AI testing capabilities and evaluation systems for large model applications, specifically focusing on intelligent customer service agents and software engineering quality assurance.

Role type

Senior AI Testing Development Engineer (Agent & LLM Evaluation)

Builds

Intelligent UI automation, test data generation, scenario case generation, code bug white-box identification, and automated evaluation frameworks for AI agents.

Domain

Internet / Large Language Models / AI Quality Assurance

Deliverable

production ML models

Required skills

Python, Go, Java, LLM evaluation, Prompt Engineering, AI agent development, automated testing, code analysis, data analysis

Preferred skills

Experience with AI4SE, intelligent verify capabilities, model effect tracking, cross-functional collaboration on complex systems

Technologies

Python, Go, Java, AI Coding tools, LLM frameworks

Responsibilities

Construct business evaluation systems for intelligent customer service agents; track online model performance and perform root cause analysis; build AI testing capabilities including smart UI automation and test data generation; collaborate with R&D to integrate AI verification into the development lifecycle.

Seniority

Senior, hands-on IC

Sourced via bytedance · Listed on CareerPlan, which tracks 854,000+ jobs from 20+ sources.