Tech Lead - Application Development N 4C
Core
Design, implement, and maintain highly available Apache Kafka clusters in production environments, ensuring reliability, security, and performance for data streaming pipelines.
Role type
Senior Kafka Platform Engineer / Tech Lead
Builds
Scalable data ingestion and streaming pipelines using Kafka, Kafka Connect, Kafka Streams, and Mirror Maker
Domain
Data Engineering / Distributed Systems / Cloud Infrastructure
Deliverable
production ML models | infrastructure
Required skills
Apache Kafka administration, Linux system administration, Python or Bash scripting, Infrastructure as Code (Terraform, Ansible), Kubernetes/OpenShift, Prometheus and Grafana monitoring, ZooKeeper and KRaft architecture
Preferred skills
Confluent Kafka experience, data pipeline integration with Solr or other platforms, Kafka Resiliency (dc/dr) setup
Technologies
Apache Kafka, Confluent Platform, OpenShift, Kubernetes, RHEL, Ubuntu, Prometheus, Grafana, Terraform, Ansible, ZooKeeper, KRaft, Kafka Connect, Kafka Streams, Mirror Maker, Solr
Responsibilities
Design and maintain Kafka clusters; perform upgrades and patching with minimal downtime; administer security protocols and access controls; monitor cluster health and troubleshoot incidents; develop automation scripts and IaC configurations; manage Kafka Connect, Streams, and Mirror Maker; build custom tooling and dashboards for lag and health metrics; perform root cause analysis for platform outages.
Seniority
Senior, hands-on IC with leadership responsibilities