Senior Data Engineer (Data Platform)
Core
Design, build, and operate a containerized data platform connecting fragmented legacy systems, spreadsheets, and sensor feeds to serve Navigator AI agents and logistics SMEs.
Role type
Senior IC data engineer (data platform)
Builds
Containerized data services, open lakehouse, fullstack pipeline tools, and APIs for logistics data
Domain
Defense logistics, AI systems, data infrastructure
Deliverable
production ML models
Required skills
Python, SQL, Apache Iceberg, Trino/Presto/Spark SQL, Kafka/NiFi/Debezium, Kubernetes, Docker, TypeScript, Vue, RESTful API design, data modeling, entity resolution, CI/CD
Preferred skills
Data cataloging, lineage, data versioning, low-code pipeline tools, knowledge graphs, air-gapped deployment experience, operations research
Technologies
Apache Iceberg, Trino, Spark SQL, Kafka, NiFi, Debezium, Kubernetes, Docker, AWS/Azure, Vue, TypeScript, Python
Responsibilities
Design and operate containerized services for external data connections; own the open lakehouse and implement batch/streaming ingestion; build transformation pipelines for entity resolution and data fusion; develop fullstack tools for SMEs to manage pipelines; partner with AI/ML and infrastructure teams on data models and production code.
Seniority
Senior, hands-on IC
