Staff Data Engineer
Core
Lead the development and operation of a data lake for cyber operations and intelligence data, designing schemas and building resilient ETL pipelines.
Role type
Staff Data Engineer (Cyber Operations)
Builds
Production data lake, ETL pipelines, and query-optimized data products for intelligence analysts.
Domain
Cyber operations, intelligence, and data infrastructure.
Deliverable
production ML models | product features | dashboards & analysis | infrastructure
Required skills
ETL pipeline design and operation, data lake architecture, column-oriented database expertise, schema and index design, system leadership and mentorship, performance tuning.
Preferred skills
Experience building data systems from the ground up, driving technical initiatives end-to-end.
Technologies
Airflow, AWS, AWS Glue, Redshift, BigQuery, ClickHouse, Hive, Kafka, Spark, Neo4J, RabbitMQ, NATS.
Responsibilities
Design schemas, partitions, and indexes for complex datasets; build and refine observable and resilient ETL pipelines; partner with analysts to define query patterns; drive technical initiatives from architecture to production; establish data quality best practices; mentor engineers on data modeling and performance tuning; identify and resolve bottlenecks in storage and compute layers.
Seniority
Staff, hands-on IC with leadership and mentorship responsibilities.