Staff Software Engineer - Ingestion Platform
Core
Design, build, and operate a distributed data ingestion platform handling streaming and batch workloads, including control planes, connectors, and sink integrations for S3, GCS, and Apache Iceberg.
Role type
Staff Software Engineer (Ingestion Platform)
Builds
Production-ready ingestion paths, modular connectors, and self-service platform APIs for data movement.
Domain
Cloud-native data infrastructure and distributed systems
Required skills
Distributed systems architecture, high-throughput data pipelines, API design, Kubernetes, observability, technical leadership, Go/Python/Java/Scala
Preferred skills
Low-code/self-service platform development, schema evolution, Protocol Buffers, gRPC
Technologies
Kafka, BigQuery, S3, GCS, Apache Iceberg, Flink, Kubernetes, Go, Python, Java, Scala
Responsibilities
Design and deliver reliable software for distributed data movement; own architecture of control plane, data plane, and connectors; expand ingestion paths to S3, GCS, and Iceberg; build modular connectors and abstractions; improve self-service platform usage via APIs and automation; lead safe migrations from legacy systems; establish reliability and security practices; mentor backend and data infrastructure engineers.
Seniority
Staff, hands-on IC with strategic leadership