Senior Data Engineer (m/w/d)
Core
Design and develop innovative, highly scalable on-premises and Edge data platforms, building high-performance batch and low-latency streaming pipelines.
Role type
Senior IC data engineer (on-prem/Edge)
Builds
On-premises and Edge data platforms, batch and streaming pipelines
Domain
Data Engineering, Cloud-native infrastructure, Edge computing
Deliverable
production ML models | infrastructure
Required skills
Kubernetes, Python, Golang, SQL, Linux, GitOps, Apache Iceberg, Spark, Kafka, Flink, Airflow, S3-compatible storage
Preferred skills
Data Science experience, Hardware-optimized computing (NUMA, Core Pinning), Edge computing environments
Technologies
Kubernetes, Apache Iceberg, Spark, Kafka, Flink, Airflow, Dagster, NATS.io, Risingwave, S3
Responsibilities
Conceptualize and develop high-performance on-premises and Edge data platforms; Implement robust batch and low-latency streaming data pipelines on Kubernetes clusters; Integrate modern data architectures (e.g., Medallion, Kappa); Create and validate Proof-of-Concepts using modern AI coding tools; Evaluate and integrate data catalogs and data versioning solutions; Collaborate with Lead Architects, Infrastructure, and Security teams.
Seniority
Senior, hands-on IC
