Senior Software Engineer (Backend)
Core
Design and architect scalable data pipeline infrastructure for real-time and batch data processing to power a distributed web crawler and dataset creation systems.
Role type
Senior Backend Engineer (Data Infrastructure)
Builds
Scalable data pipelines, distributed crawling infrastructure, and dataset processing systems
Domain
Internet infrastructure, AI data pipelines, distributed systems
Deliverable
production ML models
Required skills
Distributed systems design, Backend development, System optimization, CI/CD, Data pipeline architecture, Troubleshooting live systems, Code documentation
Preferred skills
Golang, Python, Redis, Kubernetes
Technologies
Golang, Python, Redis Clusters, Kubernetes
Responsibilities
Design and build scalable data pipeline infrastructure, Develop new backend features for reliability and performance, Write clear, well-tested, and well-documented code, Create and review technical designs and documentation, Contribute to infrastructure across mobile, desktop, and server-side systems
Seniority
Senior, hands-on IC
