Data Engineer (Apache Flink & Kafka / Confluent Platform) @ Square One Resources
Core
Design and implement real-time streaming solutions and data pipelines for the logistics sector using Apache Flink and Kafka/Confluent technologies.
Role type
Senior IC Data Engineer (Streaming)
Builds
Real-time data streaming platforms and event-driven architectures
Domain
Logistics, Event-driven architecture, Distributed systems
Deliverable
production ML models | product features | infrastructure
Required skills
Apache Flink, Flink SQL, Stateful stream processing, Kafka, Confluent Platform, Avro, Schema Registry, Kubernetes, Streaming data architectures, AsyncAPI, Kafka Connect SMT, XML-to-Avro transformations, GitOps, CI/CD pipelines, ArgoCD, Jenkins, GitHub Actions, AI-assisted engineering
Technologies
Apache Flink, Kafka, Confluent Platform, Kubernetes, ArgoCD, Jenkins, GitHub Actions
Responsibilities
Design and implement real-time streaming solutions using Apache Flink, Develop and maintain data pipelines on Kafka / Confluent Platform, Build and integrate Kafka Connect SMTs, Implement and maintain Schema Registry integration, Develop Flink-based filtering and projection frameworks, Support deployment and orchestration of streaming components on Kubernetes, Collaborate in designing and implementing CI/CD and GitOps-based delivery pipelines, Actively participate in an AI-assisted / agentic engineering delivery model
Seniority
Senior, hands-on IC