Senior Software Engineer
Core
Design and build scalable distributed scraping architectures, reverse engineer APIs and mobile apps, and bypass anti-bot measures.
Role type
Senior IC software engineer (web scraping & reverse engineering)
Builds
Large-scale distributed scraping systems for thousands of domains
Domain
Web scraping, API reverse engineering, anti-bot evasion
Deliverable
production ML models | product features
Required skills
Python, distributed scraping architectures, API/mobile reverse engineering, anti-bot bypass techniques, JavaScript challenge handling, WAF evasion, proxy management, session management, TLS tuning, debugging (browser/HTTP/device), stream processing (Parquet/Avro), NoSQL databases (MongoDB/InfluxDB/Redis)
Preferred skills
real-device simulation, distributed task queues (Celery/Kafka), Linux, AWS/GCP/Kubernetes/Cloud Run/Cloud Functions
Responsibilities
Design scalable distributed scraping architectures; Reverse engineer APIs and mobile applications; Detect and handle anti-bot measures and WAFs; Set up anomaly detection and monitoring for scraping blockers; Handle proxies, session management, cookie injection, and TLS tuning
Seniority
Senior, hands-on IC