CareerPlan

Senior Data Engineer, Cloudforce One

London, United KingdomFull-time2026-11-18 → 2026-11-19
Hybrid

Core

Build scalable data pipelines and analytical data stores to transform raw network telemetry into trusted datasets for threat intelligence and abuse detection.

Role type

Senior Data Engineer (Threat Operations)

Builds

Production data pipelines, analytical data stores, and data marts for threat events and trust & safety.

Domain

Cybersecurity / Threat Intelligence / Network Security

Required skills

Python, SQL, Apache Airflow, Apache Spark, Apache Iceberg, ClickHouse, Kubernetes, CI/CD, Data Modeling, Data Quality

Preferred skills

Security/Threat Intelligence domain knowledge, Internet protocols (DNS, HTTP, TLS, BGP), Data Science/ML workflow support, Cloudflare platform experience, AI-assisted development

Technologies

Kubernetes, Airflow, Spark, Apache Iceberg, R2, ClickHouse, Trino/Presto

Responsibilities

Design and operate batch data pipelines on Kubernetes-hosted Airflow and Spark clusters; Build and evolve data stores in Apache Iceberg; Model datasets with correct grain and partitioning; Write and optimize SQL for large-scale analytical data; Build data quality checks and monitoring; Enable partners with reusable datasets; Partner with data scientists to create ML-ready datasets.

Seniority

Senior, hands-on IC