Data Engineer
Core
Designing scalable data architectures, managing databases and data lakes, and building ETL pipelines to support analysis and reporting for a national library network.
Role type
Data Engineer (Project Contract)
Builds
Data management platform, data pipelines, and unified data views for analysis.
Domain
Public Sector / Library & Archives / Data Engineering
Deliverable
production ML models | product features | dashboards & analysis | infrastructure
Required skills
Data Architecture Design, Database Management, Data Integration, Data Transformation, Data Migration, Data Quality & Governance, Pipeline Monitoring, SQL, Python, AWS Platform Architecture, Apache Airflow
Preferred skills
Databricks, Snowflake, Tableau, Qlik Sense
Technologies
AWS (S3, Glue, Lambda, Athena), Apache Iceberg, Databricks, Snowflake, Apache Airflow, Qlik Sense, Tableau
Responsibilities
Design scalable data architectures, manage databases and data lakes, integrate data from multiple sources, perform data transformations and migrations, implement data quality checks, monitor and troubleshoot data pipelines, document engineering processes, support platform operations and enhancements.
Seniority
Mid-level (2-5 years experience), hands-on IC
