Principal Streaming Data Architect
Core
Lead real-time data streaming and processing architecture for a nationwide sensor detection platform used to monitor secure perimeters and track asset movements.
Role type
Principal Streaming Data Architect
Builds
Stateful, low-latency stream processing engines and pipelines for public safety sensor telemetry
Domain
Public safety / Geospatial data engineering / Real-time streaming
Deliverable
production ML models | infrastructure
Required skills
Distributed systems engineering, Stream processing frameworks, Schema registry design, Data governance, Technical mentorship, Geospatial data pipelines, DevSecOps collaboration, Fault tolerance design
Preferred skills
Azure Event Hubs, Azure Databricks, Real-time ML model operationalization
Technologies
Azure Event Hubs, Azure Databricks
Responsibilities
Assess existing data ingestion solutions and advise on optimal stream processing frameworks; Design and develop stateful stream processing applications for sub-second deduplication; Implement robust schema registry and event-driven data modeling; Build technical data governance foundation ensuring data lineage and auditability; Collaborate with Data Science to deploy real-time ML models into pipelines; Develop processes for telemetry consumption ensuring zero data loss and low latency; Partner with DevSecOps to ensure compliance with CJIS, FIPS 140-3, and FedRAMP High standards; Mentor junior and mid-level team members; Design and validate pipelines for in-stream data anonymization and feeding spatial databases
Seniority
Principal, hands-on IC with mentorship