Big Data Engineer - TikTok Ecommerce Recommendation Infrastructure
Core
Designing and implementing scalable storage and computing systems to support massive data processing for TikTok's e-commerce recommendation infrastructure.
Role type
Senior Big Data Engineer (Infrastructure)
Builds
Distributed storage and computing systems, offline data architectures, and data mid-platforms for e-commerce recommendation.
Domain
E-commerce, Big Data Infrastructure, Distributed Systems
Deliverable
infrastructure
Required skills
Big data frameworks (Hadoop, Hive, Flink, Spark, Kafka, HBase, Redis, RocksDB, ElasticSearch), Java, C++, distributed system design, data architecture design, system stability troubleshooting, data mining, data modeling, NLP, machine learning application.
Preferred skills
Experience with Peta Byte level data processing.
Technologies
Hadoop, Hive, Flink, FlinkSQL, Spark, Kafka, HBase, Redis, RocksDB, ElasticSearch, Java, C++.
Responsibilities
Design and implement offline data architecture for large-scale recommendation systems; Build flexible, scalable, stable, and high-performance storage and computing systems; Troubleshoot production systems and implement mechanisms to ensure stability; Develop techniques and analytics applications to transform raw data into meaningful information; Apply data mining, data modeling, NLP, and ML to analyze large structured and unstructured datasets; Visualize, interpret, and report data findings.
Seniority
Mid-Senior, hands-on IC
