Senior Data Engineer
Core
Architecting and building scalable data pipelines and managing cloud-based data lakes/warehouses to power AI and analytics at scale for a logistics and supply chain group.
Role type
Senior Data Engineer
Builds
Scalable data pipelines, data lakes, and data warehouses
Domain
Logistics and supply chain / Big Data Engineering
Deliverable
production ML models
Required skills
SQL, Python, Apache Spark, Kafka, Airflow, dbt, Flink, AWS/GCP/Azure data services, streaming data architectures, data quality frameworks, governance policies, CI/CD, infrastructure-as-code
Preferred skills
Experience with data modelling best practices
Technologies
Apache Spark, Kafka, Airflow, Snowflake, BigQuery, Databricks, dbt, AWS, GCP, Azure, Kinesis
Responsibilities
Architect and build scalable data pipelines; Design and manage cloud-based data lakes and warehouses; Implement data quality frameworks, governance policies and monitoring; Collaborate with data scientists and analysts to ensure data availability; Drive adoption of best practices in data modelling, CI/CD and infrastructure-as-code
Seniority
Senior, hands-on IC
