实时数据仓库工程师-抖音电商
Core
Build and optimize real-time data warehouses for Douyin's e-commerce business, focusing on metric calculation, architecture design, and performance tuning while integrating LLM capabilities.
Role type
Senior IC real-time data warehouse engineer (LLM integration)
Builds
Real-time data warehouse infrastructure, automated data solutions (RAG, Tool Use, Agent workflows), and LLM applications (RAG-QA bots, data insight bots, AICoding)
Domain
E-commerce, Big Data, Generative AI
Deliverable
production ML models
Required skills
Real-time data warehouse methodology, Hadoop, Hive, SQL, Java, Python, RAG architecture, Prompt engineering, Tool Use, Agent workflow orchestration
Preferred skills
LLM application engineering, RAG implementation experience, Python script development for skills
Technologies
Hadoop, Hive, RAG, LLM, Agent frameworks
Responsibilities
Design and develop real-time data models and architectures; Optimize performance of real-time computing jobs; Guide data product and mining teams on big data applications; Integrate RAG and context management into big data scenarios; Deploy and iterate LLM applications like RAG-QA and AICoding based on evaluation metrics.