Staff Crawling Engineer (m/w/d)
Hybrid
Core
Design, build, and maintain Node.js-based crawling and data-collection services for static, dynamic, and JavaScript-rendered websites to ensure data completeness and quality.
Role type
Staff Crawling Engineer
Builds
Production-ready web scraping systems and data pipelines
Domain
Healthcare and life sciences data acquisition
Deliverable
production ML models
Required skills
Node.js, JavaScript, HTTP, HTML, DOM structures, Puppeteer, Playwright, Selenium, SQL, Git, Linux, Docker
Preferred skills
TypeScript, Python, Kafka, PostgreSQL, CI/CD, proxy management
Responsibilities
Design and maintain crawling services, integrate with Kafka and downstream systems, diagnose production failures, provide realistic estimates, contribute to architecture and code reviews, mentor other engineers
Seniority
Staff, hands-on IC with mentorship
