Senior Data Engineer, Cloudforce One
Core
Build scalable data pipelines and analytical data stores to transform raw network telemetry into trusted datasets for threat intelligence and abuse detection.
Role type
Senior Data Engineer (Threat Operations)
Builds
Production data pipelines, analytical data stores, and data marts for threat events and trust & safety.
Domain
Cybersecurity / Threat Intelligence / Network Security
Required skills
Python, SQL, Apache Airflow, Apache Spark, Apache Iceberg, ClickHouse, Kubernetes, CI/CD, Data Modeling, Data Quality
Preferred skills
Security/Threat Intelligence domain knowledge, Internet protocols (DNS, HTTP, TLS, BGP), Data Science/ML workflow support, Cloudflare platform experience, AI-assisted development
Technologies
Kubernetes, Airflow, Spark, Apache Iceberg, R2, ClickHouse, Trino/Presto
Responsibilities
Design and operate batch data pipelines on Kubernetes-hosted Airflow and Spark clusters; Build and evolve data stores in Apache Iceberg; Model datasets with correct grain and partitioning; Write and optimize SQL for large-scale analytical data; Build data quality checks and monitoring; Enable partners with reusable datasets; Partner with data scientists to create ML-ready datasets.
Seniority
Senior, hands-on IC
