Senior Python Data Scraping Engineer (Freelance)
Core
Senior Python Data Scraping Engineer driving specialized data scraping workflows within a hybrid AI + human system, providing critical thinking and quality control for accurate data extraction.
Role type
Senior IC data scraping engineer (freelance)
Builds
Structured datasets from complex websites for AI training and analysis
Domain
Generative AI, Web Data Extraction, Automation
Deliverable
production ML models
Required skills
Python web scraping, dynamic content handling (JS/AJAX), API integration, data cleaning and normalization, cloud infrastructure, containerization, LLM frameworks, anti-bot mechanism handling
Preferred skills
GitHub portfolio, Bachelor's or Master's in technical fields
Technologies
Apify, OpenRouter, BeautifulSoup, Selenium, Docker, AWS, LangChain
Responsibilities
Own end-to-end data extraction workflows ensuring accuracy and coverage; Leverage internal tools and custom workflows to accelerate data collection; Ensure reliable extraction from dynamic and interactive web sources; Enforce data quality standards through validation checks; Scale scraping operations for large datasets
Seniority
Senior, hands-on IC