Senior Python Data Scraping Engineer (Freelance)
Core
Senior Python Data Scraping Engineer driving specialized data scraping workflows for real-world applications using tools like Apify and OpenRouter.
Role type
Senior IC data scraping engineer
Builds
Structured datasets (CSV, JSON, Google Sheets) from complex, dynamic, and interactive web sources
Domain
Data engineering / Web scraping
Required skills
Python web scraping (BeautifulSoup, Selenium), dynamic content handling (JS, AJAX, infinite scroll), API integration via proxies, data cleaning and normalization, validation checks, cloud infrastructure (AWS), containerization (Docker), LLM frameworks (LangChain, OpenRouter)
Preferred skills
Experience with archived pages and inconsistent HTML structures, GitHub portfolio
Technologies
Apify, OpenRouter, BeautifulSoup, Selenium, AWS, Docker, LangChain, OpenRouter
Responsibilities
Own end-to-end data extraction workflows ensuring accuracy and reliability; leverage tools and custom workflows to accelerate data collection; ensure reliable extraction from dynamic/interactive sources; enforce data quality standards through validation; scale scraping operations using batching or parallelization
Seniority
Senior, hands-on IC