Senior Data Engineer, Product Data Systems
Core
Build production data services and event-driven pipelines to ingest, normalize, enrich, and deliver threat intelligence for a cybersecurity SaaS product.
Role type
Senior IC data engineer (product data systems)
Builds
Production data services, event-driven pipelines, and APIs for threat intelligence delivery
Domain
Cybersecurity, distributed systems, data engineering
Deliverable
production ML models
Required skills
Go, Python, SQL, Kafka, Azure Event Hubs, PostgreSQL, Neo4j, Kubernetes, CI/CD, containerization, event-driven architecture, idempotency, data lineage, multi-tenant isolation
Preferred skills
Cybersecurity domain knowledge, graph-based data processing, machine-learning feature pipelines, legacy batch migration
Technologies
Go, Python, SQL, Kafka, Azure Event Hubs, Azure Data Lake Storage, Azure Data Explorer, PostgreSQL, Neo4j, Redis, Databricks, Kubernetes
Responsibilities
Design and implement production services for data ingestion, normalization, enrichment, and scoring; develop asynchronous workflows with robust error handling and recovery; ensure data integrity, provenance, and tenant isolation; evaluate managed services vs. custom code; mentor engineers on distributed systems practices
Seniority
Senior, hands-on IC