Staff Security Data Engineer
Core
Design and operate a petabyte-scale security data lakehouse on Databricks and AWS to ingest, store, and serve enterprise telemetry for threat detection, investigations, and compliance.
Role type
Staff Security Data Engineer (hands-on IC)
Builds
Distributed batch and streaming pipelines for EDR, network logs, and identity events; reusable Terraform infrastructure; layered lakehouse data models.
Domain
Cybersecurity data infrastructure, Cloud (AWS), Big Data (Databricks/Spark)
Required skills
Distributed systems design, Spark (batch/streaming), Databricks, Delta Lake, Python, SQL, AWS (storage/compute/networking/IAM), Terraform, Airflow/MWAA, Data governance, CI/CD, Cost optimization
Preferred skills
Security telemetry (OCSF), Unity Catalog, Telemetry routing tools (Cribl Stream/Vector), Multi-region platform design
Responsibilities
Own end-to-end architecture designs for the Security Data Platform; Build and evolve distributed pipelines for security telemetry; Write maintainable Python/SQL and refactor complex code; Design layered lakehouse data models and governance policies; Operate Airflow/MWAA orchestration and resolve production incidents; Profile workloads to improve cost and performance; Mentor engineers and lead technical discussions.
Seniority
Staff, hands-on IC with strategic scope
