Backend Software Engineer - TikTok Data Ecosystem (Data Lake)
Core
Design and implement offline/real-time data architecture and scalable storage/computation systems for TikTok's recommendation engine serving over a billion users.
Role type
Senior IC backend software engineer (data infrastructure)
Builds
Distributed storage and processing frameworks (batch/stream) for massive data
Domain
Big data infrastructure, data lakes, recommendation systems
Deliverable
production ML models
Required skills
Java, C++, Scala, Spark, Flink, Hudi, Iceberg, DeltaLake, HDFS, Parquet, ORC, data warehousing modeling
Preferred skills
Hive, HBase, Kudu, petabyte-scale data management
Technologies
Spark, Flink, Hudi, Iceberg, DeltaLake, HDFS, Parquet, ORC, Hive, HBase, Kudu
Responsibilities
Design large-scale data architecture; Build distributed storage and processing frameworks; Troubleshoot production systems; Implement stability mechanisms
Seniority
Senior, hands-on IC