Distinguished Engineer - Data Architect
Core
Design and build the data foundation for an AI-driven security platform, transforming high-velocity network traffic logs and security alerts into ML-ready data fabrics.
Role type
Distinguished Engineer - Data Architect
Builds
High-performance, ML-ready data fabrics for AI inference and training
Domain
Cybersecurity / Data Engineering / AI Infrastructure
Deliverable
production ML models
Required skills
Distributed streaming engines (Flink, Spark, Kafka, Pulsar), Lakehouse architectures (Iceberg, Delta Lake), Polyglot persistence (ClickHouse, DuckDB, Vector DBs), Cloud-native infrastructure (AWS/GCP/Azure), Kubernetes, Encryption-at-rest/in-transit
Preferred skills
None stated
Technologies
Apache Flink, Spark, Kafka, Pulsar, Iceberg, Delta Lake, ClickHouse, DuckDB, Milvus, Qdrant, Pinecone, Kubernetes, AWS, GCP, Azure
Responsibilities
Architect unified blueprint for petabyte-scale streaming and batch data processing; Partner with Lead AI Engineer to design storage, retrieval systems, and feature stores; Enforce multi-tenant isolation and data privacy guardrails; Optimize infrastructure cost-efficiency and performance tuning; Write clean, foundational code for critical infrastructure components
Seniority
Distinguished, hands-on IC