Python Developer (Web Scraping)
Core
Develop, maintain, and optimize Python-based web scraping and crawling tools to extract data from various online sources.
Role type
Python developer (web scraping)
Builds
Scalable web scraping architectures and workflows
Domain
Data extraction and web technologies
Deliverable
production ML models | product features | dashboards & analysis
Required skills
Python, BeautifulSoup, Scrapy, Selenium, requests, HTML, CSS, JavaScript, Pandas, NumPy, SQL, NoSQL, Git
Preferred skills
AWS, Google Cloud, Docker, API integration, data visualization, machine learning
Responsibilities
Develop and optimize web scraping tools, design scalable architectures, handle dynamic websites with anti-scraping mechanisms, integrate data into databases/pipelines, troubleshoot data extraction issues, ensure legal/ethical compliance, create documentation, stay updated on trends
Seniority
Mid-level, hands-on IC