Big Data Engineer - TikTok Recommendation Architecture
Core
Designing and implementing offline data architecture, scalable storage and computing systems, and distributed infrastructure for large-scale recommendation systems.
Role type
Senior Big Data Engineer (Recommendation Architecture)
Builds
High-performance storage and computing systems, mid-platform data services, and reliable infrastructure for massive data.
Domain
Big Data, Distributed Systems, Recommendation Systems
Deliverable
infrastructure
Required skills
Java, C++, Hadoop, Hive, Flink, FlinkSQL, Spark, Kafka, HBase, Redis, RocksDB, ElasticSearch, data mining, data modelling, natural language processing, machine learning, data visualization
Preferred skills
Peta Byte level data processing experience
Responsibilities
Design offline data architecture for large-scale recommendation systems; Build flexible, scalable, stable, high-performance storage and computing systems; Troubleshoot production systems and implement stability mechanisms; Develop analytics applications to transform raw data into meaningful information; Apply data mining and ML to extract information from large structured and unstructured datasets; Visualize and report data findings
Seniority
Mid-Senior, hands-on IC
