反爬虫技术专家-国际化
Core
Design and implement data scraping solutions for frontend landing pages (ads, product details, promotions) to extract core information like text, images, and forms.
Role type
Senior IC web scraping engineer (anti-crawling)
Builds
Automated scraping tools and systems for landing pages
Domain
Web scraping and anti-crawling defense
Deliverable
production ML models
Required skills
JavaScript (ES6+), Chrome kernel mechanics, Puppeteer, Playwright, HTML/CSS parsing, XPath/CSS Selector, HTTP/HTTPS protocols, Cookie/Session management, high-concurrency system optimization
Preferred skills
Anti-crawling countermeasures (signature encryption, dynamic tokens, device fingerprints), Web security (XSS, CSRF), Node.js ecosystem, browser plugin development
Responsibilities
Analyze and counter anti-crawling mechanisms (signature verification, UA recognition, IP blocking, CAPTCHA), optimize scraping tool stability and efficiency, evaluate security risks in scraping processes, resolve performance bottlenecks in high-concurrency scenarios
Seniority
Senior, hands-on IC