Data Engineer - Focus Apache Flink (m/f/x)
Core
Design and implement scalable ELT/ETL flows (batch and streaming) to analyze and prepare data from pre-systems, enriching it for a big data environment.
Role type
Data Engineer (Streaming/Real-time)
Builds
Scalable data pipelines and ELT/ETL flows for high-frequency data processing
Domain
Sports betting / Entertainment software / Big Data
Deliverable
production ML models | product features
Required skills
Data modeling, SQL, Apache Hadoop, Kafka, NiFi, Apache Flink, Scala, Java, Python, Linux
Preferred skills
Experience with high-frequency data processing in near-realtime environments
Technologies
Apache Flink, Apache Hadoop, Cloudera, Kafka, NiFi, MS SQL Server, Scala, Java, Python
Responsibilities
Analyze and prepare data from pre-systems; Model and map scalable ELT/ETL flows (batch and streaming); Interface between Data Analysts and Data Scientists; Enrich data and load into big data environment (Apache Hadoop on Cloudera)
