Data Engineer (m/w/d)
Core
Designing and developing an on-premises data platform with batch and streaming pipelines, orchestration, and automation for security-relevant systems.
Role type
Data Engineer (Cloud Native / On-Premises)
Builds
On-premises data platforms, data orchestration components, batch/streaming pipelines, and platform services.
Domain
Cyber Security, Data Engineering, Cloud Native Infrastructure
Deliverable
production ML models
Required skills
Kubernetes, Linux, Python, Golang, SQL, Bash, Java, Apache Spark, Kafka, Flink, Airflow, GitOps, S3, Apache Iceberg, NATS.io, Risingwave, Dagster
Preferred skills
Cursor.ai, NUMA, Core Pinning, Data Catalogs, Data Versioning, Edge Data Management
Technologies
Kubernetes, Linux, Python, Golang, SQL, Bash, Java, S3, Apache Iceberg, GitOps, NATS.io, Risingwave, Dagster, Spark, Kafka, Flink, Airflow, Cursor.ai
Responsibilities
Conceptualize and develop on-premises data platforms; Implement batch and streaming data pipelines; Integrate workloads on Kubernetes and S3-compatible storage; Evaluate and integrate data catalogs and versioning; Collaborate with Lead Architects and Security teams.
Seniority
Mid-Senior, hands-on IC