Senior Web Scraper | BeautifulSoup or Scrapy
Core
Design, implement, and document robust web crawling solutions to collect and validate data for consumer intelligence and retail analytics.
Role type
Senior IC Python developer (web scraping)
Builds
Data collection pipelines and monitoring tools for retail analytics
Domain
Retail Analytics / Consumer Intelligence
Deliverable
production ML models | product features
Required skills
Python, Scrapy, BeautifulSoup, HTTP protocol, RESTful APIs, GraphQL, Docker, Git, pandas, Linux, bash scripting, cloud providers (AWS/GCP/Azure)
Preferred skills
Time series databases (InfluxDB), Single-page applications (JavaScript)
Responsibilities
Design and implement Scrapy spiders resilient to website changes; conduct code review and data validation; architect new developments across codebases; bypass anti-bot countermeasures
Seniority
Senior, hands-on IC
Sourced via smartrecruiters · Listed on CareerPlan, which tracks 70,000+ jobs from 20+ sources.
