网页搜索数据工程师（J106465）
Core
Building a distributed web crawling system for massive data collection and overcoming technical challenges in high-performance, high-concurrency scenarios.
Role type
Senior IC web search data engineer (crawling)
Builds
Distributed crawler infrastructure for web search
Domain
Internet search, web scraping, browser automation
Deliverable
production ML models
Required skills
C/C++/Python, HTTP/HTTPS protocols, web scraping, browser rendering principles, Chrome architecture, CDP protocol, browser automation, network request interception, dynamic content collection, reverse engineering (APP/Web), anti-crawling strategy bypass, risk control identification
Preferred skills
Problem-solving for challenging technical scenarios
Technologies
CDP, Chrome DevTools Protocol, HTTP, HTTPS
Responsibilities
Develop and maintain distributed crawler systems, solve high-concurrency technical challenges, write high-quality code and documentation, tackle specific scraping difficulties
Seniority
Senior, hands-on IC