移动抓取与收录研发工程师（J92916）
Core
Building a distributed crawler system for massive data collection and overcoming technical challenges in high-performance, high-concurrency, and high-availability scenarios.
Role type
Senior IC crawler engineer (distributed systems)
Builds
Distributed data crawling infrastructure
Domain
Internet / Data Engineering
Required skills
C/C++/Python, HTTP/HTTPS protocols, Web scraping, browser rendering, Scrapy, BeautifulSoup, Selenium, anti-scraping evasion, app/web reverse engineering, risk control identification
Preferred skills
None stated
Technologies
Scrapy, BeautifulSoup, Selenium
Responsibilities
Participate in building distributed crawler systems; Solve technical challenges in high-performance/high-concurrency scenarios; Develop code, perform self-testing, and write project documentation; Overcome specific scraping difficulties
Seniority
Mid-level, hands-on IC