Data Engineer (Hybrid)
Core
Design, develop, and maintain end-to-end data pipelines and enterprise data infrastructure for the National Guard Bureau's Minuteman project team.
Role type
Senior Data Engineer
Builds
Enterprise data environment and Minuteman Community Space data infrastructure
Domain
US Federal Government / Defense Analytics
Required skills
ETL processes, Databricks, Python, Spark, Scala, SQL, Data Modeling, Data Governance, Big Data Technologies
Preferred skills
War Data Platform, Palantir Foundry, APIs, Machine Learning, Generative AI
Technologies
Databricks, Python, Spark, Scala, JavaScript, JSON, SQL, Jupyter Notebooks, Advana, Palantir Foundry
Responsibilities
Design and implement end-to-end data pipelines using ETL processes; Create and optimize data pipelines from scratch; Perform data cleansing, integration, and quality assurance; Collaborate with data scientists and stakeholders to provide data insights; Troubleshoot data-related problems; Implement and enforce data governance policies.
Seniority
Senior, hands-on IC