Data Engineer
Core
Building and optimizing data ingestion and transformation pipelines within a global data platform to serve business users and products.
Role type
Senior Data Engineer (Big Data)
Builds
Interconnected data platform (Data Lake/Lakehouse) for business domains
Domain
Maritime shipping / Logistics
Deliverable
production ML models | product features | dashboards & analysis
Required skills
SQL, Python, Azure Data Factory, Spark, Databricks, Medallion architecture, GIT
Preferred skills
Experience with distributed event ingestion
Responsibilities
Building data ingestion and transformation pipelines, Pipeline/process orchestration (scheduling, fault-tolerance, monitoring), Building data quality guarantees into pipelines
Seniority
Senior, hands-on IC
Sourced via adzuna · Listed on CareerPlan, which tracks 70,000+ jobs from 20+ sources.
