AI安全模型与数据运营（数据运营与评测体系方向） - TikTok
Core
Building and operating a unified AI safety model evaluation and data asset system, including quality standards, benchmarks, and closed-loop tracking.
Role type
Senior IC AI Safety Data Operations Engineer
Builds
AI safety evaluation frameworks, data quality assets (Benchmarks, Golden Sets), and standardized metrics.
Domain
AI Safety / Data Operations
Deliverable
production ML models
Required skills
Data quality management, Benchmark design, Golden Set construction, SQL, Python, Data analysis, Problem localization
Preferred skills
AI safety model evaluation, Data asset governance, Productization of evaluation systems, Cross-functional collaboration
Responsibilities
Design and maintain key evaluation assets like Benchmarks and Golden Sets; Establish and optimize data quality systems; Define core metrics for data quality and evaluation efficiency; Iterate data and evaluation schemes based on business scenarios; Drive the productization and tooling of the evaluation system.
Seniority
Senior, hands-on IC