Senior Data Platform Engineer
Core
Design and build a storage layer that preserves source disagreement, history, and provenance for entity resolution and AI systems, ensuring decisions are reproducible and traceable.
Role type
Senior Data Platform Engineer (Entity Resolution & Provenance)
Builds
A durable storage layer for entity resolution results, evidence records, and versioned rule libraries within a secure government cloud.
Domain
Government cloud, AI/ML, Entity Resolution, Data Engineering
Deliverable
production ML models
Required skills
Python, SQL, PostgreSQL, Temporal/Historized Data Modeling, Probabilistic Data Handling, Provenance & Lineage Implementation
Preferred skills
Bi-temporal Data Modeling, Event Sourcing, Graph Data Modeling, Entity Resolution System Architecture, Regulated Industry Experience
Technologies
PostgreSQL, Python, SQL
Responsibilities
Design storage layers that preserve source disagreement and history; Build result and evidence stores linked to originating records; Implement provenance and lineage across platform nodes; Store versioned rule libraries and configuration contexts; Ensure traceability of writes and reproducibility of decisions; Carry match confidence and uncertainty forward through the platform; Support point-in-time queries regarding historical beliefs and evidence.
Seniority
Senior, hands-on IC