Senior Big Data Engineer - Security Research / Detection
Core
Design, build, and maintain scalable data pipelines processing petabytes of security data to enable cyber threat detection research.
Role type
Senior Big Data Engineer (Security Research)
Builds
Production-grade data pipelines and cloud data warehouses for security research
Domain
Cybersecurity / Big Data
Deliverable
production ML models
Required skills
Python, Java, Scala, AWS, Apache Spark, Hadoop, Hive, Iceberg, Trino, data warehousing, data visualization
Preferred skills
Leading cross-functional projects between R&D and product teams
Technologies
AWS, Apache Spark, Hadoop, Hive, Iceberg, Trino, Tableau, PowerBI, Grafana
Responsibilities
Design and build scalable data pipelines for petabyte-scale security data; Operate big data infrastructure and cloud data warehouses; Ensure data quality, observability, and governance; Partner with data scientists and security researchers
Seniority
Senior, hands-on IC
