大数据开发工程师-流式计算方向
Core
Design and develop real-time streaming computing systems for ByteDance's recommendation engine serving over 1 billion users, ensuring stability and high availability while building a unified feature middle platform.
Role type
Senior IC real-time streaming data engineer
Builds
Scalable real-time data systems, feature services, and distributed infrastructure for recommendation algorithms
Domain
Internet / Recommendation Systems / Big Data
Deliverable
production ML models
Required skills
Flink (DataStream, SQL, Checkpoint, State), Java, C++, Scala, Python, Kafka, RocketMQ, Hudi, Iceberg, DeltaLake
Preferred skills
PB-scale data processing, data lake development, storage systems (HBase, Cassandra, RocksDB), Spark, Kudu, Kubernetes
Responsibilities
Design and implement real-time streaming data systems for large-scale recommendation; Build flexible, scalable, and high-performance storage and computing models; Troubleshoot production systems and design mechanisms/tools for stability; Develop industry-leading distributed streaming computing frameworks
Seniority
Senior, hands-on IC
