Senior Software Engineer -Kafka / Event Streaming
Core
Design, build, and optimize high-performance distributed systems and core data engines for an enterprise software platform powering AI, analytics, and enterprise workloads.
Role type
Senior IC backend infrastructure engineer (distributed systems)
Builds
Next-generation distributed event-streaming and messaging platform (Kafka-protocol-compatible broker)
Domain
Enterprise data infrastructure / AI infrastructure
Deliverable
production ML models
Required skills
C/C++, Linux internals, distributed systems design, networking (TCP/IP), high-performance backend services, debugging and root-cause analysis
Preferred skills
Message brokers or event-streaming systems experience, Apache Kafka internals or wire protocol experience (via careerplan.io/jobs/43-001-7A-D6D-senior-software-engineer-kafka-event-streaming-at-vast-data)
Technologies
C, C++, Linux, Kafka
Responsibilities
Design and develop core components of a next-generation distributed event-streaming and messaging platform; Implement and maintain a high-scale, high-performance Kafka-protocol-compatible broker; Build scalable and resilient distributed services handling petabytes of data across large clusters; Design solutions around correctness semantics (ordering guarantees, transactions, exactly-once / idempotence, repartitioning), load balancing, replication, fault tolerance, and scalability; Investigate and resolve complex production issues across the full produce-to-consume path; Collaborate closely with architects, researchers, and engineering teams to deliver high-performance data infrastructure.
Seniority
Senior, hands-on IC
