Senior Data Engineer (m/w/d)
Core
Design and develop innovative, highly scalable on-premises and Edge data platforms, building batch and low-latency streaming pipelines without public cloud dependency.
Role type
Senior IC data engineer (on-prem/edge)
Builds
High-performance on-premises and Edge data platforms, batch and streaming pipelines, automated deployment workflows
Domain
Data Engineering, Cloud Infrastructure, Edge Computing
Deliverable
production ML models | infrastructure
Required skills
Kubernetes, Python, Golang, SQL, Linux, GitOps, Apache Iceberg, Apache Spark, Apache Kafka, Apache Flink, Airflow, NATS.io, Risingwave, S3-compatible storage
Preferred skills
Data Science experience, hardware-optimized computing (NUMA, Core Pinning), Edge computing environments
Technologies
Kubernetes, Python, Golang, SQL, Bash, Java, Apache Iceberg, Spark, Kafka, Flink, Airflow, Dagster, NATS.io, Risingwave
Responsibilities
Conceptualize and develop high-performance on-premises and Edge data platforms with orchestration and GitOps components; Implement robust batch and low-latency streaming data pipelines on Kubernetes clusters; Integrate modern data architectures (e.g., Medallion, Kappa) and S3-compatible storage solutions; Create and validate Proof-of-Concepts using modern AI coding tools; Evaluate and integrate data catalogs and data versioning solutions; Collaborate with Lead Architects, Infrastructure, and Security teams on technology evaluation and integration
Seniority
Senior, hands-on IC
