SDE — Streaming Infrastructure & Operations
Core
Own and operate backend streaming services and infrastructure for real-time data processing, ensuring operational readiness and reliability of mission-critical pipelines.
Role type
Senior IC backend software engineer (streaming infrastructure & operations)
Builds
Real-time data processing pipelines using Apache Flink and Apache Kudu on AWS
Domain
Big data, real-time analytics, cloud infrastructure
Required skills
Apache Flink, Apache Kudu, Kubernetes (EKS), AWS, ETL pipeline development, incident response, capacity planning, system reliability tuning
Preferred skills
Production experience with Kudu+Flink architecture, building operational readiness frameworks (runbooks, SLOs, alerting), contributing to open-source infrastructure projects
Technologies
Apache Flink, Apache Kudu, Kafka Streams, Spark Streaming, Kubernetes, Amazon EKS, AWS
Responsibilities
Operate backend streaming services built on Apache Flink; serve as SME for Apache Kudu operational behavior; build and maintain ETL pipelines; design and implement operational readiness processes; manage and troubleshoot workloads on Kubernetes (Amazon EKS); perform hands-on operational work including monitoring, incident response, and performance tuning; collaborate to harden open-source infrastructure components
Seniority
Senior, hands-on IC