CareerPlanGet AI match score →
🌐 Remote💼 Full-time🗓 2026-06-25

Core

Building scalable backend infrastructure and data pipelines for a distributed web crawler and dataset creation platform serving AI model training.

Role type

Senior Backend Engineer (Rust)

Builds

Web-scale crawler infrastructure, data ingestion pipelines, and backend API services.

Domain

AI infrastructure / Web-scale data processing

Deliverable

production ML models | infrastructure

Required skills

Rust, scalable system design, CI/CD, debugging live systems, API development, code review, technical documentation

Preferred skills

Node.js, Kubernetes, AWS services (EKS, SQS, DynamoDB, S3), Redis

Technologies

Rust, Node.js, Redis, Kubernetes, AWS

Responsibilities

Develop new features and software improvements, test and deploy backend API services, write clear and tested code, create and review technical designs

Seniority

Senior, hands-on IC

Rewrite
## About the Company We build infrastructure that delivers massive amounts of web data to the companies training the world's most powerful AI models. We're the team that helps to power and support Grass, a bandwidth-sharing network that lets us operate a massive distributed crawler, giving us unique access to high-quality public web data at global scale. On top of that, we've built pipelines for ingesting, segmenting, and annotating billions of videos, transcripts, and audio files, powering dataset creation for frontier labs. We're lean, technical, and move fast. No red tape, no slow decision-making; just a team of builders pushing to expand what's possible for open web data and AI. ## About the Role - Develop new features and software improvements - Test, deploy and debug backend API services - Write clear, tested, documented code - Create and review technical design, code, and documentation - Contribute to Wynd's infrastructure which includes mobile, desktop and server-side applications ## Responsibilities - Develop new features and software improvements - Test, deploy and debug backend API services - Write clear, tested, documented code - Create and review technical design, code, and documentation - Contribute to Wynd's infrastructure which includes mobile, desktop and server-side applications ## Requirements - BS or MS degree in a STEM major or equivalent job experience required - 4+ years experience in software development and writing very high quality code that is robust and easy to maintain - Knowledge on how to build large scalable systems - Knowledge and experience in identifying and solving issues with intricate, live software systems, as well as in-depth familiarity with contemporary software development processes such as continuous integration and continuous deployment. - Professional or native English language proficiency ## Technologies Used - Rust - Node.js - Redis Clusters - Kubernetes - AWS (EKS, SQS, DynamoDB, Elasticache, S3, etc.) ## What We Offer - Opportunity. We are at the forefront of developing a web-scale crawler and knowledge graph that improves access to public web data and extends the value of AI to the people. - Culture. We're a lean team with a high bar. We come to work not to be comfortable, but to find out what we're capable of and to do work that matters. We're not calling for people who keep things moving. We're calling for people who make everyone around them better. - We prioritize low ego and high output. This is a fully remote team. - Compensation. You'll receive a competitive salary, benefits and equity package.
Sourced via wellfound · Listed on CareerPlan, which tracks 70,000+ jobs from 20+ sources.
Apply on Wellfound ↗