Data Engineer
Core
Design and maintain robust data pipelines, perform in-depth analysis of large-scale datasets, and deliver actionable insights to drive mission decisions for federal agencies.
Role type
Senior Data Engineer / Data Analyst (Federal Contract)
Builds
Scalable ETL/ELT data pipelines, data models, and self-service analytics dashboards for federal government clients.
Domain
Federal Government / National Security / Data Intelligence
Required skills
SQL (complex joins, window functions, CTEs), PySpark, Python, Databricks (notebooks, jobs, Unity Catalog), Data Lakehouse (Delta Lake, medallion architecture), Git, ETL/ELT design, Data modeling
Preferred skills
Databricks Certification, AWS GovCloud/Azure Government/GCP for Government, CI/CD (Azure DevOps, GitHub Actions), Tableau/Power BI integration
Technologies
Databricks, PySpark, Python, SQL, Delta Lake, Tableau, Power BI, Azure DevOps, GitHub Actions, Git
Responsibilities
Design and build scalable ETL/ELT pipelines using PySpark and Python; Develop and optimize SQL queries and data models; Automate data ingestion from APIs, flat files, and streaming feeds; Monitor pipeline health and resolve data quality issues; Conduct exploratory data analysis to identify trends; Develop self-service analytics dashboards and reports; Collaborate with data scientists and stakeholders to understand data needs; Document pipelines and analytical notebooks for audit readiness.
Seniority
Mid-Senior, hands-on IC