Data Engineer
Core
Design, build, and maintain scalable, low-latency data pipelines, ETL/ELT, and infrastructure for trillions of live threat events to support real-time detection and risk scoring.
Role type
Senior Data Engineer (real-time infrastructure)
Builds
Scalable data pipelines, data models, and storage layers for high-throughput security telemetry
Domain
Cybersecurity / Mobile App Protection / Big Data
Deliverable
production ML models
Required skills
Python, SQL, NoSQL, Spark/PySpark, Kafka, System Design, Data Modeling, Data Observability
Preferred skills
ClickHouse, Apache Iceberg, Vector Databases, Docker, Kubernetes, ElasticSearch, Redis, DynamoDB
Technologies
Spark, Kafka, ClickHouse, Apache Iceberg, pgvector, ElasticSearch, Redis, DynamoDB, Metabase
Responsibilities
Design and build scalable, low-latency data pipelines and ETL/ELT processes; Architect data models and storage layouts optimized for fast retrieval; Build real-time event-driven ingestion and processing systems; Optimize SQL and NoSQL databases for performance; Own data observability including pipeline health and quality; Collaborate with engineers and data scientists to integrate data into products.
