Data Engineer
Core
Design, implement, and automate scalable data pipelines to collect, transform, and process data for a complex logistics network, ensuring data accuracy and reliability for decision-making.
Role type
Senior Data Engineer
Builds
Scalable data pipelines, curated reference datasets, and data assets for EU Transportation
Domain
Logistics / Supply Chain / Data Engineering
Deliverable
production ML models
Required skills
Data pipeline design, Data modeling, ETL development, SQL, Python, AWS services (Redshift, Glue), Data quality monitoring, Root cause analysis
Preferred skills
ETL tool experience (Informatica, ODI, SSIS), Data schema design (normalization, dimensional modeling), AWS Infrastructure knowledge
Technologies
Redshift, Glue, Python, SQL, SparkSQL, Scala, Informatica, ODI, SSIS
Responsibilities
Design and evolve data models and schemas, Own development of curated reference datasets, Monitor and troubleshoot data quality issues, Drive architectural plans for data storage and integration, Collaborate with stakeholders to translate business requirements, Investigate and resolve data defects
Seniority
Senior, hands-on IC