Senior Data Engineer (m/w/d)
Core
Designing and developing an on-premises data platform with batch and streaming pipelines, focusing on edge deployment without public cloud services.
Role type
Senior Data Engineer (Platform & Infrastructure)
Builds
On-premises data platforms, data orchestration components, and platform automation services.
Domain
Data Engineering, Cloud-Native Infrastructure, Edge Computing
Deliverable
production ML models | infrastructure
Required skills
Kubernetes, Linux, Python, Golang, SQL, Bash, Java, Apache Iceberg, GitOps, NATS.io, Risingwave, Dagster, Spark, Kafka, Flink, Airflow
Preferred skills
Data Science experience, Cursor.ai, NUMA, Core Pinning
Technologies
Kubernetes, S3, Apache Iceberg, GitOps, NATS.io, Risingwave, Dagster, Spark, Kafka, Flink, Airflow, Cursor.ai
Responsibilities
Conceptualize and develop on-premises data platforms; implement batch and streaming data pipelines; integrate workloads on Kubernetes and S3-compatible storage; develop and integrate data catalogs; create Proof of Concepts using AI tools.
Seniority
Senior, hands-on IC