Real-Time Data Engineer
Core
Architect, deploy, and operate large-scale Apache Kafka and Confluent platform environments supporting mission-critical event-driven workloads.
Role type
Senior Real-Time Data Engineer (Kafka Platform)
Builds
Reliable, performant, and developer-friendly streaming platform infrastructure
Domain
Cloud Data Infrastructure / Event Streaming
Deliverable
infrastructure
Required skills
Apache Kafka internals, Confluent Platform, Kafka security (SASL, mTLS, ACLs), Kafka Connect, Schema Registry, Kafka Streams, ksqlDB, HA/DR strategies, Python, Bash, Go, Infrastructure-as-Code (Terraform, Ansible), observability tooling
Preferred skills
Confluent Certified Administrator, Kafka on Kubernetes (Strimzi), managed Kafka services (AWS MSK), stream processing frameworks (Flink, Spark Streaming), data governance and lineage
Technologies
Apache Kafka, Confluent Platform, Kafka Streams, ksqlDB, Terraform, Ansible, Python, Bash, Go, Strimzi, AWS MSK, Flink, Spark Streaming
Responsibilities
Own the Kafka platform end-to-end including cluster sizing, configuration, security, automation, and observability; partner with application teams to deliver a reliable streaming platform; raise the bar through code review, design review, and mentorship of junior engineers
Seniority
Senior, hands-on IC with mentorship responsibilities