CareerPlanGet AI match score →

Distinguished Engineer - Data Architect

Pune,Maharashtra - Remote💼 Full-time🗓 2026-07-21 → 2026-07-31

Core

Design and build the data foundation for an AI-driven security platform, transforming high-velocity network traffic logs and security alerts into ML-ready data fabrics.

Role type

Distinguished Engineer - Data Architect

Builds

High-performance, ML-ready data fabrics for AI inference and training

Domain

Cybersecurity / Data Engineering / AI Infrastructure

Deliverable

production ML models

Required skills

Distributed streaming engines (Flink, Spark, Kafka, Pulsar), Lakehouse architectures (Iceberg, Delta Lake), Polyglot persistence (ClickHouse, DuckDB, Vector DBs), Cloud-native infrastructure (AWS/GCP/Azure), Kubernetes, Encryption-at-rest/in-transit

Preferred skills

None stated

Technologies

Apache Flink, Spark, Kafka, Pulsar, Iceberg, Delta Lake, ClickHouse, DuckDB, Milvus, Qdrant, Pinecone, Kubernetes, AWS, GCP, Azure

Responsibilities

Architect unified blueprint for petabyte-scale streaming and batch data processing; Partner with Lead AI Engineer to design storage, retrieval systems, and feature stores; Enforce multi-tenant isolation and data privacy guardrails; Optimize infrastructure cost-efficiency and performance tuning; Write clean, foundational code for critical infrastructure components

Seniority

Distinguished, hands-on IC

Sourced via greenhouse · Listed on CareerPlan, which tracks 70,000+ jobs from 20+ sources.
Apply on Greenhouse ↗