Senior Data Engineer (m/w/d)
Core
Designing and developing an on-premises data platform with batch and streaming pipelines, orchestration, and automation components.
Role type
Senior Data Engineer (Infrastructure & Platform)
Builds
On-premises data platforms, data orchestration components, batch/streaming pipelines, and platform services.
Domain
Enterprise IT / Data Engineering / Cloud-Native Infrastructure
Deliverable
production ML models | product features | infrastructure
Required skills
Kubernetes, Linux, Container technologies, Python, Golang, SQL (MPP), Bash, Java, S3, Apache Iceberg, GitOps, NATS.io, Risingwave, Dagster, Spark, Kafka, Flink, Airflow, Cursor.ai
Preferred skills
NUMA configuration, Core Pinning, Data Scientist experience
Technologies
Kubernetes, Linux, Python, Golang, SQL, Bash, Java, S3, Apache Iceberg, GitOps, NATS.io, Risingwave, Dagster, Spark, Kafka, Flink, Airflow, Cursor.ai
Responsibilities
Conceptualize and develop on-premises data platforms; Develop and integrate data orchestration, deployment, and automation components; Implement batch and streaming data pipelines; Integrate workloads on Kubernetes and S3-compatible storage; Investigate and integrate data catalogs and versioning; Collaborate with lead architects and security teams.
Seniority
Senior, hands-on IC
