微信视频号-数据Infra高级工程师-(广州/北京)
Core
Design and implement large-scale data processing pipelines for WeChat Channels recommendation and LLM data infrastructure, supporting real-time and offline data needs.
Role type
Senior IC data infrastructure engineer (recommendation & LLM)
Builds
Real-time and offline data pipelines, Flink-based processing frameworks, and large-scale sample processing chains for LLMs
Domain
Internet / Recommendation Systems / Large Language Models
Deliverable
production ML models
Required skills
Flink, Spark, Iceberg, Apache Paimon, large-scale data architecture, real-time processing, offline data processing
Preferred skills
Recommendation system background, LLM data infrastructure experience
Responsibilities
Design and implement large-scale sample processing chains for LLM models; Optimize Flink framework operators and processing flows for performance and stability; Build lakehouse infrastructure and adopt new technologies to solve specific data problems; Process core data including samples, features, and metrics for the recommendation business.