Senior Data Engineer (m/w/d)
Core
Design and development of a high-performance on-premises data platform for modern data management and analytics applications.
Role type
Senior Data Engineer (Cloud-Native & On-Premises)
Builds
Scalable batch and streaming data pipelines, data orchestration components, and platform services for industrial clients.
Domain
Industrial Engineering, Energy, Automotive, Aviation, IT Infrastructure
Deliverable
production ML models | product features | infrastructure
Required skills
Kubernetes, Linux, Python, Golang, SQL, Apache Spark, Apache Kafka, Apache Flink, Apache Airflow, GitOps, S3-compatible storage, Data Governance, Data Catalogs, Batch/Streaming pipelines
Preferred skills
Cursor.ai, AI coding tools, Low-Level Infrastructure (NUMA, Core Pinning), Edge Data Platforms, Data Science background
Technologies
Kubernetes, Linux, Python, Golang, SQL, Bash, Java, Apache Iceberg, NATS.io, RisingWave, Dagster, Apache Spark, Apache Kafka, Apache Flink, Apache Airflow, S3
Responsibilities
Develop and integrate components for data orchestration, deployment, and GitOps workflows; Create and implement Proof of Concepts with AI tools; Build scalable batch and streaming data pipelines; Operate data workloads on Kubernetes and integrate S3-compatible storage; Evaluate and integrate data catalogs and versioning concepts; Collaborate with architects and security teams on system and data architecture.
Seniority
Senior, hands-on IC