Senior Data Engineer (m/w/d)
Core
Designing and developing an on-premises data platform with data orchestration, deployment, and platform automation components.
Role type
Senior IC data engineer (on-premises platform)
Builds
On-premises data platform, batch and streaming data pipelines, platform services
Domain
Data engineering, cloud-native infrastructure, on-premises data management
Deliverable
production ML models
Required skills
Kubernetes, Linux, Python, Golang, SQL, Bash, Java, Apache Iceberg, Spark, Kafka, Flink, Airflow, GitOps, NATS.io, Risingwave, Dagster, S3-compatible storage
Preferred skills
Cursor.ai, NUMA, Core Pinning, Kappa architecture, Medallion architecture, data catalog integration, data versioning
Technologies
Kubernetes, Linux, Python, Golang, SQL, Bash, Java, Apache Iceberg, Spark, Kafka, Flink, Airflow, GitOps, NATS.io, Risingwave, Dagster, S3
Responsibilities
Conceive and develop an on-premises data platform; develop and integrate components for data orchestration, deployment, and platform automation; implement batch and streaming data pipelines; integrate workloads on Kubernetes and S3-compatible storage solutions; investigate data catalogs and their integration into the platform; create proofs of concept using AI-agent tools like Cursor.ai.
Seniority
Senior, hands-on IC
