Lead Kafka Engineer
Core
Designing and implementing data integration pipelines between business applications and data warehouses using Kafka.
Role type
Senior IC Kafka Engineer
Builds
Real-time data streaming infrastructure and ETL pipelines
Domain
Financial Services / Data Engineering
Deliverable
production ML models | infrastructure
Required skills
Confluent Kafka, Apache Kafka, Kafka architecture tuning, Confluent Schema Registry, Terraform (IaC), AWS (EC2, S3, RDS, Lambda), Linux VMs, Java, Python
Preferred skills
Spark Streaming, Apache Flink, SRE concepts, Splunk, Data Dog, Dynatrace, CloudWatch
Responsibilities
Develop and implement specialized code for application-to-data-warehouse interfaces; tune Kafka architecture and components; manage infrastructure as code on AWS; support Kafka Connect on Linux VMs; implement monitoring and observability tools for application health checks.
Seniority
Senior, hands-on IC
