Forward Data Engineer
Core
Design and optimize data pipelines, ensure data pedigree and provenance, clean/preprocess data for analytics, and maintain data services for US federal government missions.
Role type
Senior Data Engineer (Data Lifecycle & ETL)
Builds
Data pipelines, ETL tools, and data services for defense, national security, and public safety organizations.
Domain
US Federal Government / Defense & National Security
Deliverable
production ML models | product features | infrastructure
Required skills
Data lifecycle engineering, ETL development, Cloud and on-prem data storage, Python, SQL, Spark, ElasticSearch, NiFi, Palantir Foundry
Preferred skills
Kubernetes, Apache Iceberg, EMR, Agile/Scrum
Technologies
Spark, Apache Iceberg, EMR, Kubernetes, ElasticSearch, NiFi, Palantir Foundry
Responsibilities
Design and optimize data pipelines using Spark, Apache Iceberg, EMR, and Kubernetes; Ensure data pedigree and provenance; Clean and preprocess data for advanced analytics; Collaborate with enterprise working groups to advance data standards; Collaborate with engineering teams to maintain data services; Conduct quarterly analysis for data tool recommendations; Provide administration and performance tuning of data tools.
Seniority
Mid-to-Senior (4-7+ years experience)