Security Data Engineer
Core
Building visibility and protecting infrastructure for advanced defense technology products by designing and implementing data pipelines.
Role type
Security Data Engineer
Builds
Security data lake, log aggregation pipelines, and ETL processes for internal security teams.
Domain
Defense technology / Cybersecurity / Data Engineering
Deliverable
production ML models | infrastructure
Required skills
Data lake architecture, ETL tools (Spark, DuckDB), General-purpose programming (Go, Rust, Java/Scala), Infrastructure as Code (Terraform, AWS CDK, Pulumi), Cloud environments, CI/CD pipelines
Preferred skills
High-volume log ingestion, AWS/Azure/GCP security ecosystems, Multiple data access patterns, Open table formats (Iceberg, Delta Lake)
Technologies
Spark, DuckDB, Go, Rust, Java, Scala, Terraform, AWS CDK, Pulumi, Iceberg, Delta Lake
Responsibilities
Architect and implement log aggregation pipelines; Contribute to the development and maintenance of a security data lake; Design and implement ETL processes for security data ingestion, transformation, and storage; Collaborate with teams to establish best practices for data usage
Seniority
Individual Contributor