Data Engineer
Core
Build and maintain data pipelines and infrastructure to enable data-driven decision analysis products for the Department of Defense, supporting testing and evaluation capabilities.
Role type
Senior Data Engineer (National Security)
Builds
Data-driven decision analysis products, testing and evaluation capabilities for DoD
Domain
National Security / Defense / Big Data
Deliverable
production ML models
Required skills
Big data analytics, Python, R, C++, C#, Java, Scala, SQL, Spark, Trino, Hadoop, Hive, Neo4J, JanusGraph, HBase, MS SQL Server, Polybase, VMWare, ETL processes, time series data, geospatial data, distributed storage, containers, Agile, software design patterns
Preferred skills
Data visualization (RShiny, pyShiny, Dash), Jupyter Notebooks, RMarkdown, message queuing, stream processing
Technologies
Spark, Trino, Hadoop, Hive, Neo4J, JanusGraph, HBase, MS SQL Server, Polybase, VMWare, MongoDB, Accumulo, RShiny, pyShiny, Dash, Jupyter Notebooks, RMarkdown
Responsibilities
Build and optimize big data data pipelines and architectures, clean and prepare time series and geospatial data, run and operate analytical tools (CHEETAS) for stakeholders, troubleshoot problems in closed networks without internet access, create documentation and repeatable procedures for reproducible research, design and implement ETL processes, collaborate with data scientists on technical design for analytical products
Seniority
Senior, hands-on IC