Senior Kafka DevOps Engineer – Streaming Platform & SRE (8–12 Years)
Core
Design, build, and operate large-scale Apache Kafka streaming platforms and persistence services for Webex Teams, Meetings, and the broader Webex Suite.
Role type
Senior IC Kafka DevOps Engineer (Streaming Platform & SRE)
Builds
Scalable Kafka-based streaming platforms, cross-cluster replication, and schema governance systems for Webex services.
Domain
Cloud-native infrastructure, event-driven architecture, and data streaming.
Deliverable
production ML models | product features | dashboards & analysis | research | client delivery | infrastructure | physical/clinical work
Required skills
Apache Kafka architecture and internals, Kafka MirrorMaker, Kafka Schema Registry, AWS EC2/VPC/S3/IAM/EKS/ECS, Terraform, Ansible, Python, CI/CD tools, performance tuning, capacity planning, incident handling, security controls (ACLs, encryption, auth/authorization), disaster recovery strategies.
Preferred skills
PostgreSQL, OpenSearch, Elasticsearch, Docker, Kubernetes, modern data pipelines, streaming systems, AI/ML and GenAI workloads.
Technologies
Apache Kafka, MirrorMaker, Schema Registry, AWS (EC2, VPC, S3, IAM, CloudWatch, EKS, ECS), Terraform, Ansible, Python, Jenkins, GitHub Actions, GitLab CI, Prometheus, Grafana, Docker, Kubernetes, PostgreSQL, OpenSearch, Elasticsearch.
Responsibilities
Design and manage scalable Kafka streaming platforms; configure and operate Kafka MirrorMaker for cross-cluster replication; administer and govern Kafka Schema Registry; monitor and optimize Kafka clusters for performance and reliability; troubleshoot broker, producer, consumer, and replication issues; implement security controls; define DR/failover strategies; establish backup and recovery processes; monitor system health using Prometheus and Grafana; contribute to infrastructure automation.
Seniority
Senior, hands-on IC