Data Engineer
Core
Builds and maintains data pipelines, transformations, semantic views, and consumption-ready data models for analytics, reporting, and AI/ML use cases within a federal agency's enterprise data ecosystem.
Role type
Data Engineer
Builds
Cloud-based data storage, analytics, governance, and AI/ML platforms for thousands of users
Domain
Federal government / Cloud data modernization
Deliverable
production ML models
Required skills
ETL/ELT, SQL, Python, Databricks, Azure Data Factory, data modeling, data quality checks, pipeline documentation, lineage support
Preferred skills
Lakehouse architecture (bronze/silver/gold), semantic views, MLOps, feature engineering, Unity Catalog, Power BI, CI/CD integration
Technologies
Databricks, Delta Lake, Apache Spark, Azure Data Factory, Unity Catalog, Power BI, Azure Machine Learning
Responsibilities
Build and maintain data pipelines and transformations; Implement pipeline documentation and lineage support; Work with data owners and governance teams to ensure data reliability; Apply ETL/ELT and orchestration tools; Develop semantic views and consumption-ready datasets; Support MLOps and AI/ML workflows including feature engineering and model serving.
Seniority
Mid-level (3+ years experience)