Senior Software Engineer (Backend)
Core
Design and architect scalable backend systems and data pipeline infrastructure for a distributed web crawler and dataset creation platform.
Role type
Senior Backend Engineer (Data Infrastructure)
Builds
Scalable data pipelines, distributed crawling systems, and ingestion/segmentation/annotation tools for web data and media.
Domain
Internet infrastructure, distributed systems, AI data pipelines
Deliverable
production ML models | infrastructure
Required skills
Backend development, distributed systems design, system optimization, CI/CD, data flow analysis, code review, technical documentation
Preferred skills
Golang, Python, Redis, Kubernetes, real-time/batch processing
Technologies
Golang, Python, Redis Clusters, Kubernetes
Responsibilities
Design and build scalable data pipeline infrastructure for real-time and batch processing; Develop new backend features focusing on reliability and performance; Write clear, well-tested, and well-documented code; Create and review technical designs to maintain high engineering standards.
Seniority
Senior, hands-on IC