Senior Software Engineer (Backend)
Remote
Core
Design and architect scalable data pipeline infrastructure for real-time and batch data processing to power a distributed web crawler and dataset creation systems.
Role type
Senior Backend Engineer (Data Infrastructure)
Builds
Scalable data pipelines, distributed crawler infrastructure, and dataset processing systems
Domain
Internet infrastructure, AI data collection, distributed systems
Deliverable
production ML models
Required skills
Backend development, distributed systems design, system optimization, CI/CD, data flow analysis, Golang, Python, Kubernetes, Redis
Responsibilities
Design and build scalable data pipeline infrastructure, develop backend features focusing on reliability and performance, write well-tested and documented code, review technical designs and documentation
Seniority
Senior, hands-on IC
