Data Engineer (m/w/d)
Core
Designing and developing an on-premises data platform integrating batch and streaming pipelines, orchestration, and automation for security-relevant software projects.
Role type
Senior Data Engineer (Cloud Native/On-Premises)
Builds
On-premises data platforms, data orchestration components, and platform automation services
Domain
Cyber Security, Cloud Native Infrastructure, Data Engineering
Deliverable
production ML models | infrastructure
Required skills
Kubernetes, Linux, Python, Golang, SQL (MPP), Bash, Java, Apache Iceberg, GitOps, NATS.io, Risingwave, Dagster, Spark, Kafka, Flink, Airflow
Preferred skills
Cursor.ai, NUMA, Core Pinning, Edge data management, Data cataloging, Data versioning
Responsibilities
Conceptualize and develop on-premises data platforms; Implement batch and streaming data pipelines; Integrate workloads on Kubernetes and S3-compatible storage; Evaluate and integrate data catalogs and versioning solutions; Collaborate with lead architects and security teams
Seniority
Senior, hands-on IC
