Data Engineer
Core
Design, build, and maintain scalable end-to-end data pipelines and transformation workflows for US federal government clients.
Role type
Senior Data Engineer (Cloud & ETL)
Builds
Cloud-native data solutions, unified datasets, and analytics pipelines for defense, national security, and public safety organizations.
Domain
US Federal Government / Cloud Data Engineering
Deliverable
production ML models | product features | infrastructure
Required skills
Python, SQL, PySpark, AWS services (S3, Glue, Lambda, Redshift), Databricks, Spark, data orchestration, data quality processes
Preferred skills
Palantir Foundry, Snowflake, Google Cloud Dataflow, Azure Data Factory, Google BigQuery, ElasticSearch, NiFi, Docker, Kubernetes, Hadoop, ELK stack, Agile/Scrum
Technologies
AWS, Databricks, Spark, Palantir, Snowflake, Google Cloud, Azure, ElasticSearch, NiFi, Docker, Kubernetes, Hadoop, ELK stack
Responsibilities
Design and build scalable data pipelines; develop data processing and transformation workflows; integrate diverse data sources (APIs, databases, cloud storage); implement validation, monitoring, and observability processes; contribute to data governance, security, and automation initiatives; leverage AWS services to deploy cloud-native data solutions.
Seniority
Mid-to-Senior, hands-on IC