Software Engineer - X Data
Core
Building and operating a distributed data platform that powers realtime and batch pipelines for user-behavior insights and product decisions.
Role type
Senior IC data engineer (distributed systems)
Builds
Production-grade realtime and batch pipelines, shared datasets, fact tables, and internal data products
Domain
AI product engineering, distributed computing, hybrid storage
Deliverable
production ML models | product features | dashboards & analysis
Required skills
Python, Rust, Scala, Go, Java, Spark, Kafka, Flink, SQL, NoSQL, RMDBs, large-scale system design, data correctness validation
Preferred skills
None stated
Technologies
BigQuery, Trino, Clickhouse, Flink, Kafka, Spark, Scalding
Responsibilities
Design and operate realtime/batch pipelines ingesting billions of events daily; Create shared datasets and internal data products; Prototype tooling for data workflows and self-serve access; Own data correctness via invariants and root-cause analysis; Select and adapt query engines/frameworks; Partner with product/business teams to identify data gaps
Seniority
Senior, hands-on IC
