Security Data Engineer
Core
Architect and build log aggregation pipelines and maintain a centralized security data lake to expand visibility and protect infrastructure.
Role type
Security Data Engineer
Builds
Log aggregation pipelines, centralized security data lake, ETL workflows for security data
Domain
Defense technology / Information Security
Deliverable
production ML models | infrastructure
Required skills
Data lake architecture, ETL tooling, large-scale data processing (Spark, DuckDB), programming (Go, Rust, Java, Scala), infrastructure-as-code (Terraform, AWS CDK, Pulumi), CI/CD pipelines, cloud operations
Preferred skills
High-volume log ingestion pipelines, cloud security ecosystems (AWS, Azure, GCP), diverse data access patterns, open table formats (Iceberg, Delta Lake)
Technologies
AWS, Azure, CI/CD, ETL, Java, Rust, Scala, Spark, Splunk, Terraform
Responsibilities
Architect and build log aggregation pipelines for infrastructure and applications, develop and maintain a centralized security data lake, design and implement ETL workflows for security data ingestion and transformation, collaborate on best practices for data usage and search functionality
Seniority
Mid-to-Senior, hands-on IC
