Data Engineer
Core
Design, build, and optimize cloud-based data pipelines and enterprise-scale analytics solutions for federal government clients.
Role type
Data Engineer
Builds
Cloud-based data pipelines, data structures, schemas, and ETL processes
Domain
Federal government / Cloud data engineering
Deliverable
production ML models | product features | dashboards & analysis
Required skills
Python, SQL, Databricks, Apache Spark, ETL tools (Airflow, Kafka, AWS Glue), CI/CD pipelines, cloud platforms (AWS, Azure, GCP)
Preferred skills
GitHub/GitLab integration, data validation, troubleshooting
Technologies
Python, SQL, Databricks, Apache Spark, Airflow, Kafka, AWS Glue, GitHub, GitLab, AWS, Azure, GCP
Responsibilities
Build, test, and maintain data pipelines; Design and optimize data structures, schemas, and ETL processes; Develop SQL queries, reports, and dashboards; Manage database objects across environments; Automate workflows using Databricks Workflows or Jobs API; Integrate code into version control and support CI/CD; Troubleshoot data quality issues and perform data validation; Collaborate with developers, analysts, and stakeholders
Seniority
Mid-level, hands-on IC
