Data Engineer - Focus Apache Flink (m/f/x)
Core
Develop scalable ELT/ETL flows (batch and streaming) to analyze and prepare data from pre-systems, enriching it for a big data environment.
Role type
Data Engineer (Streaming/ELT)
Builds
Scalable ELT/ETL flows, data pipelines for big data environments
Domain
Sports betting technology / Data Engineering
Deliverable
production ML models | product features
Required skills
Data modeling, SQL, Apache Hadoop, Kafka, NiFi, Apache Flink, Scala, Java, Python, Linux
Preferred skills
Experience with high-frequency data processing in near-realtime environments
Technologies
Apache Hadoop, Cloudera, Kafka, NiFi, Flink, Scala, Java, Python, MS SQL Server, Linux
Responsibilities
Analyze and prepare data from pre-systems; Model and map scalable ELT/ETL flows (batch and streaming); Interface between Data Analysts and Data Scientists; Enrich data and load into big data environment (Apache Hadoop on Cloudera)