Kafka Engineer
Core
Design, build, and maintain high-performance, real-time data streaming pipelines using the Kafka ecosystem.
Role type
Kafka Engineer (Infrastructure & Platform)
Builds
High-throughput streaming applications, data pipelines, and event-driven architectures.
Domain
Data Engineering / Real-time Streaming / Cloud Infrastructure
Deliverable
production ML models | infrastructure
Required skills
Apache Kafka, Confluent Platform, Kafka Connect, Kafka Streams, Schema Registry, KSQL, FlinkSQL, Java, Python, Stream processing, Event-driven architecture, Cloud platforms (AWS/Azure/GCP), Kafka cluster deployment and tuning, CI/CD, Git, Helm, Kubernetes
Preferred skills
Terraform, Pulumi, DataOps
Technologies
Confluent Control Center, DataDog, Jenkins, Confluent Cloud
Responsibilities
Design and manage Kafka/Confluent infrastructure; Implement Kafka Connect, Schema Registry, KSQL, and FlinkSQL; Ensure high availability, performance tuning, and monitoring; Collaborate on integrating streaming pipelines with data lakes/warehouses; Set up Kafka security mechanisms (SASL, SSL, ACLs, RBAC); Create and manage CI/CD pipelines for Kafka components; Monitor and troubleshoot issues using Confluent Control Center and DataDog.