Web Scraping Engineer - Global Team (India)
Core
Design, build, and maintain robust web scrapers to extract alternative data for market research reports and strategic decisions.
Role type
Senior IC web scraping engineer
Builds
Resilient, scalable data extraction pipelines for investment funds and corporations
Domain
Market research / alternative data analytics
Deliverable
production ML models | product features
Required skills
Web scraping frameworks (Selenium, Playwright, Puppeteer), HTTP/RESTful APIs, HTML parsing, browser rendering, TLS/SSL mechanics, advanced fingerprinting and evasion strategies, cookie/header/session/proxy management, logging/metrics/alerting, troubleshooting
Preferred skills
Residential and data center proxy deployment, dynamic content handling, complex DOM navigation
Technologies
Selenium, Playwright, Puppeteer, proxies
Responsibilities
Refactor and maintain existing scraping scripts for reliability and efficiency; implement advanced scraping techniques to avoid detection; collaborate with analysts to gather requirements and ensure data quality; develop monitoring solutions and alerting frameworks; propose new tooling and methodologies to enhance scraping capabilities
Seniority
Senior, hands-on IC