Staff Software Engineer (Kafka Streaming)
Core
Architect high-throughput real-time data pipelines and a robust Lakehouse architecture to power a global data enrichment platform for brands and retailers.
Role type
Staff Software Engineer (Kafka Streaming & Data Architecture)
Builds
Distributed streaming architectures, real-time data pipelines, and Lakehouse infrastructure.
Domain
Retail technology, real-time data processing, cloud-native infrastructure.
Deliverable
production ML models | product features | infrastructure
Required skills
Scala or Java (8+ years), Kafka ecosystem (Streams, Connect, Flink, Spark), JVM internals, distributed systems design, AWS (MSK, EMR, Athena, Lambda), Terraform, Kubernetes, observability (Datadog/Prometheus), automated testing.
Preferred skills
None explicitly stated.
Technologies
Kafka, Kafka Streams, Spark, Flink, AWS, Terraform, Kubernetes, Datadog, Prometheus, Scala, Java.
Responsibilities
Lead design of distributed streaming architectures, tune system performance for low latency and data integrity, establish engineering standards for reliability and monitoring, refactor and modernize the platform for efficiency.
Seniority
Staff, hands-on IC with architectural leadership.