Principal Streaming Data Architect
Core
Lead real-time data streaming and processing architecture for a nationwide sensor detection platform used by public safety and commercial customers to monitor secure perimeters and track assets.
Role type
Principal Streaming Data Architect
Builds
Stateful, low-latency stream processing engine and real-time data pipelines for sensor telemetry.
Domain
Public safety / Geospatial data engineering / Cloud infrastructure
Deliverable
production ML models
Required skills
Distributed systems engineering, Stream processing frameworks, Schema registry design, Data governance, Technical data lineage, DevSecOps collaboration, Mentorship, Geospatial data pipelines
Preferred skills
Azure Event Hubs, Azure Databricks, Real-time machine learning operationalization, CJIS/FIPS 140-3/FedRAMP compliance
Technologies
Azure Event Hubs, Azure Databricks, Sensor telemetry systems, Spatial databases
Responsibilities
Assess existing data ingestion solutions and advise on optimal stream processing frameworks; Design and develop stateful stream processing applications for sub-second deduplication; Implement robust schema registry and event-driven data modeling; Build technical data governance foundation ensuring data lineage and auditability; Collaborate with Data Science to deploy real-time ML models into pipelines; Develop processes for fault-tolerant telemetry consumption with zero data loss; Partner with DevSecOps to ensure compliance with CJIS, FIPS 140-3, and FedRAMP High standards; Mentor junior and mid-level team members; Design pipelines to anonymize data in-stream and feed real-time UIs.
Seniority
Principal, hands-on IC with mentorship