Backend Developer
Core
Design and scale core data collection systems and high-throughput ingestion pipelines for open, deep, and dark web content.
Role type
Senior Backend Engineer (Data Infrastructure) (via careerplan.io/jobs/D9-00C-2F-07F-backend-developer-at-webzio)
Builds
Scalable data pipelines, microservices, and ingestion architecture for data repositories.
Domain
Internet data collection, web infrastructure, distributed systems.
Required skills
Java (Spring Boot), Python, high-throughput message brokers (Apache Pulsar, Kafka, RabbitMQ), distributed databases (TiDB, Elasticsearch, MySQL, Redis), public cloud (AWS, OCI), Linux, API design.
Preferred skills
None stated.
Technologies
Java, Python, Spring Boot, Apache Pulsar, Apache Kafka, RabbitMQ, TiDB, Elasticsearch, MySQL, Redis, Galera, AWS, OCI, Linux.
Responsibilities
Develop and maintain collection systems and ingestion architecture; Design and implement robust backend services and microservices; Build and optimize scalable data pipelines; Troubleshoot and monitor core product software and distributed databases; Implement architectural optimizations for efficiency and scalability; Collaborate on system architecture and delivery.
Seniority
Senior, hands-on IC
