Software Engineer (Big Data) - Application Computing
Core
Design and implement real-time streaming data systems for TikTok's billion-user recommendation engine, covering videos, live streams, and e-commerce.
Role type
Senior IC big data software engineer (streaming computing)
Builds
Unified recommendation feature middleware, high-performance storage systems, and scalable real-time computing frameworks
Domain
Internet / Real-time big data systems
Deliverable
production ML models
Required skills
Java, C++, Scala, Python, Flink (DataStream, SQL, Checkpoint, State), distributed systems design, troubleshooting, data lake development
Preferred skills
PB-level data handling, YARN, K8S, Spark, SparkSQL, Kudu, Hbase, Cassandra, RocksDB
Technologies
Flink, Hudi, Iceberg, DeltaLake, YARN, K8S, Spark, SparkSQL, Kudu, Hbase, Cassandra, RocksDB
Responsibilities
Design and implement real-time streaming data systems; create flexible, scalable, stable, and high-performance storage systems and computing models; troubleshoot production system failures and implement stability mechanisms; research, design, and develop computer and network software; analyze user needs and develop software solutions; update software and develop testing and validation procedures; integrate hardware and software systems
Seniority
Senior, hands-on IC
