Associate Software Engineer – Web Scraping
Core
Build and maintain real-time web scraping infrastructure for fraud prevention and data enrichment APIs under tight latency constraints.
Role type
Associate Software Engineer (Web Scraping)
Builds
Real-time data collection platform and enrichment APIs
Domain
Fraud prevention, AML compliance, data enrichment
Deliverable
production ML models | product features
Required skills
Python, web scraping, HTTP networking, unit/integration testing, Docker, Git, code review, incident response, SRE practices, observability, AI coding assistants
Preferred skills
Playwright, Selenium, Puppeteer, Scrapy, AWS, infrastructure as code, Grafana, Prometheus, Kibana, InfluxDB, CI/CD (GitHub Actions), Elasticsearch, Redis, DynamoDB, Java/Spring
Technologies
Python, Docker, Kubernetes, AWS, Grafana, Prometheus, Kibana, InfluxDB, GitHub Actions, Elasticsearch, Redis, DynamoDB, Java, Spring, Playwright, Selenium, Puppeteer, Scrapy
Responsibilities
Write production-quality scraper code with comprehensive tests; debug cross-component issues using logging and monitoring; manage proxy infrastructure and handle blocks; participate in incident response; apply SRE and resilience patterns; automate build/test/deploy pipelines; conduct code reviews and onboard teammates
Seniority
Junior, hands-on IC with mentorship