大数据调度工具开发专家/架构师(DataOps 方向)(深圳/北京)
Core
Design and implement a high-performance, high-availability distributed task scheduling engine supporting million-level task scheduling at minute intervals.
Role type
Senior IC backend engineer (distributed systems)
Builds
Distributed task scheduling systems
Domain
Big Data / Distributed Systems
Deliverable
production ML models | product features
Required skills
Java, high-concurrency system design, high-availability architecture, distributed task scheduling, Spark, Flink, Hive, Hadoop, unit testing, code quality
Preferred skills
Commercial scheduling product experience (DataWorks, DataLeap, WeData, Apache DolphinScheduler), open-source scheduler source code familiarity (Airflow, Apache DolphinScheduler, Azkaban), AIOps (intelligent scheduling, resource optimization, cost control), big data ecosystem tuning
Sourced via tencent · Listed on CareerPlan, which tracks 846,000+ jobs from 20+ sources.