Data Management Specialist - Data Engineer
Core
Design, build, and maintain scalable data pipelines and ETL/ELT processes to support analytics and business intelligence for the Department of Defense.
Role type
Senior Data Management Specialist / Data Engineer
Builds
Scalable data pipelines, ETL/ELT processes, data models, and metadata catalogs for DSCA OLTP systems.
Domain
Federal Government Contracting / Defense / Data Engineering
Required skills
SQL, Python, Data Modeling, ETL/ELT, Data Governance, Distributed Computing (Spark), Data Quality Management, Metadata Management
Preferred skills
Procurement Lifecycle knowledge, Collibra, Databricks, Erwin
Technologies
Spark, Databricks, Collibra, Erwin, SQL
Responsibilities
Design and maintain scalable data pipelines and ETL/ELT processes; Develop and optimize data models for operational and analytical systems; Ensure data quality, consistency, and governance through monitoring and validation frameworks; Write and maintain efficient SQL queries and scripts; Work with structured and unstructured data from multiple sources; Optimize performance using distributed computing frameworks; Apply security, compliance, and privacy standards; Normalize data elements and build data indexes; Troubleshoot data-related issues; Provide Data Quality measures for silver and gold data zones; Coordinate work across various business lines.
Seniority
Senior, hands-on IC