Data Platform Engineer, Cybersecurity Operations
Core
Architect and operate scalable data pipelines, storage backbones, and data lakes to ingest, normalize, and serve massive volumes of SOC telemetry for next-generation cybersecurity operations.
Role type
Senior IC data platform engineer (cybersecurity)
Builds
High-throughput batch and streaming pipelines, data lakes, and storage backbones for security analytics
Domain
Cybersecurity operations / Data Engineering
Deliverable
production ML models
Required skills
Data platform architecture, large-scale pipeline engineering (Kafka, Spark, Flink), data lake/warehouse design (Delta Lake, Iceberg, Snowflake), cloud-native infrastructure (AWS/Azure/GCP), security telemetry normalization, Python/Go/Java, schema governance, CI/CD, observability
Preferred skills
SOC/SIEM/XDR environment experience, AI/ML pipeline requirements, open table formats (Hudi)
Technologies
Cribl, Kafka, Spark, Flink, Airflow, Delta Lake, Iceberg, Snowflake, BigQuery, Redshift, AWS, Azure, GCP
Responsibilities
Design and operate scalable data pipelines for security telemetry; develop normalization logic for heterogeneous SOC data; architect storage backbones for SOC data; optimize data lake infrastructure; integrate data into analytics platforms and SIEM/XDR tools; tune pipeline throughput and query performance; implement monitoring and self-healing capabilities; define data schemas and taxonomies; automate onboarding of new telemetry sources; ensure secure handling and compliance of security data; collaborate with security operations and data science teams; maintain architecture documentation
Seniority
Senior, hands-on IC
