内容收录策略算法工程师（J92915）
Core
Research and develop core technologies for large-scale spider systems to extract and analyze valuable information from billions of web pages using NLP and large models.
Role type
Senior IC search infrastructure engineer (crawler/retrieval)
Builds
Large-scale web crawling and indexing systems
Domain
Search engines + NLP + Large models
Deliverable
production ML models
Required skills
C/C++/Python, data structures and algorithms, Linux, machine learning, pattern recognition, deep learning
Preferred skills
offline search strategies (crawling, classification, indexing)
Technologies
NLP, large models
Responsibilities
Develop core technologies for large-scale spider systems covering various resource formats; Use NLP and large models to mine content features and update crawling strategies; Extract valuable information from billions of web pages; Generate precise business insights via data mining and analysis
