大数据SRE运维开发工程师-Data
Core
Ensuring stability and high availability for recommendation system data pipelines (samples, features, sequences, video) across training and online serving.
Role type
Senior SRE/DevOps Engineer (Big Data/Recommendation Systems)
Builds
Recommendation middle platforms, data middle platforms, and large-scale machine learning online estimation frameworks.
Domain
Internet / Recommendation Systems / Big Data
Deliverable
production ML models
Required skills
Flink, Spark, Kafka, Pulsar, HBase, Cassandra, Redis, HDFS, object storage, Doris, ClickHouse, Python, Go, Java, Scala, cloud-native big data services, root cause analysis, automation scripting
Preferred skills
Large-scale recommendation system data governance, full-link SLO体系建设, feature engineering, sample generation, model training workflows
Responsibilities
Build operational systems for data continuity, timeliness, and consistency from pre-event detection to post-event recovery; Automate and govern stability for core big data components; Standardize operational processes and tools to improve team efficiency and production safety.
