Backend Engineer — Data Pipeline
Core
Design and ship backend systems for multi-stage, high-volume data processing pipelines that de-identify sensitive enterprise data, ensuring correctness, replayability, and safe recovery.
Role type
Senior backend engineer (data pipeline systems)
Builds
High-volume, multi-stage data processing pipelines with deterministic verification and safe recovery mechanisms
Domain
Enterprise data monetization, AI model training data preparation, distributed systems
Deliverable
production ML models
Required skills
asynchronous/distributed systems, data pipeline orchestration, idempotency, state management, reconciliation, schema evolution, AI engineering tools, Python, AWS
Preferred skills
batch processing, workflow orchestration, event-driven systems, data movement, payments/ledgers domain, sensitive/multi-tenant data systems
Technologies
Python, AWS, Airflow, Batch, SQS, S3, DynamoDB, PostgreSQL
Responsibilities
Design backend systems for multi-stage data processing, define versioned contracts for manifests and lineage, build independent reconciliation and verification systems, diagnose production behavior across system boundaries, improve correctness and throughput without weakening privacy
Seniority
Senior, hands-on IC
