Data Engineer
Core
Design and build efficient data pipelines for logistics operations, collecting, cleaning, and transforming data from diverse sources to enable efficient analysis.
Role type
Data Engineer
Builds
Automated ETL pipelines and data architectures for logistics data
Domain
Logistics / Data Engineering
Deliverable
production ML models
Required skills
Python, SQL, BigQuery, Matillion, SQLMesh, Airflow, Git, NumPy, Pandas, Polars, Data Warehouse design, Data Lake design, Data Vault, Observability, Relational databases, NoSQL databases
Preferred skills
Experience with large-scale data manipulation, Query optimization, Multicultural team collaboration
Technologies
Matillion, SQLMesh, BigQuery, Python, SQL, Airflow, Git, NumPy, Pandas, Polars
Responsibilities
Collect data from databases, CSV files, and APIs; Perform data transformation including deduplication, normalization, validation, and enrichment; Design and build efficient ETL pipelines; Integrate external APIs to enrich datasets; Contribute to efficient data architecture designs for large volumes of data
Seniority
Mid-Senior, hands-on IC (via careerplan.io/jobs/52f30663-cca5-40d8-80fb-19cf4ff5b297-data-engineer-at-skydropx-latam)
