Senior Python Data Scraping Engineer
Core
Design and execute end-to-end data extraction workflows to collect, validate, and process structured datasets from complex and dynamic websites.
Role type
Senior Python Data Scraping Engineer
Builds
Structured datasets from dynamic/interactive websites and APIs
Domain
Web scraping and data engineering
Required skills
Python web scraping, BeautifulSoup, Selenium, dynamic content handling, API integration, data cleaning, normalization, validation, anti-bot mechanism handling, AWS, Docker, LLM frameworks (LangChain/OpenRouter)
Preferred skills
GitHub portfolio, degree in engineering/math/CS
Responsibilities
Build custom scraping workflows for complex site structures, implement data quality checks and cross-source consistency controls, scale operations via batching/parallelization, monitor workflow stability and failures.
Seniority
Senior, hands-on IC