Data Engineer Kubernetes (m/w/d)
Core
Designing and developing an on-premises data platform running on Kubernetes, including data orchestration, deployment automation, and batch/streaming pipelines.
Role type
Data Engineer (Kubernetes/On-Premises)
Builds
On-premises data platforms, data orchestration components, batch and streaming pipelines, platform services
Domain
Data Engineering, Cloud Native, On-Premises Infrastructure
Deliverable
production ML models
Required skills
Kubernetes (On-Premises), Linux, Python, Golang, SQL, Rust, Bash, Java, Apache Iceberg, Kafka/RedPanda, NATS.io, Dagster, Spark, Flink, Airflow, S3-compatible storage
Preferred skills
Cursor.ai, NUMA, Core Pinning, Edge computing, Data Science experience
Technologies
Kubernetes, Linux, Python, Golang, SQL, Rust, Bash, Java, Apache Iceberg, Kafka, RedPanda, NATS.io, Dagster, Spark, Flink, Airflow, S3
Responsibilities
Conceptualize and develop on-premises Kubernetes data platforms, implement batch and streaming data pipelines, integrate workloads and S3-compatible storage, create Proof of Concepts, collaborate with Lead Architects and Security teams
Seniority
Mid-Senior, hands-on IC