Senior Python Data Scraping Engineer
Core
Design and execute end-to-end data extraction workflows to collect, validate, and deliver structured datasets from complex and dynamic web sources.
Role type
Senior Python Data Scraping Engineer
Builds
Structured datasets from dynamic/interactive web sources
Domain
Web scraping and data engineering
Deliverable
production ML models
Required skills
Python web scraping, dynamic content handling, API integration, data cleaning and normalization, anti-bot mechanism handling, cloud infrastructure (AWS), Docker containerization, LLM framework integration (LangChain/OpenRouter)
Preferred skills
Experience with hierarchies and archived pages, GitHub portfolio
Technologies
BeautifulSoup, Selenium, AWS, Docker, LangChain, OpenRouter
Responsibilities
Build custom scraping workflows, extract data from JavaScript-rendered content, scale operations via parallelization, monitor failures and maintain stability, apply validation and consistency checks
Seniority
Senior, hands-on IC