Data Engineer (Fulfillment) @ Tesco Technology
Core
Design and maintain scalable data pipeline architecture to process order and delivery data, optimizing logistics and safeguarding data integrity for retail and technology operations.
Role type
Senior Data Engineer (Fulfillment)
Builds
Data pipelines, analytics tools, and infrastructure for extraction, transformation, and loading (ETL) of data from diverse sources.
Domain
Retail technology and logistics
Deliverable
production ML models | product features | infrastructure
Required skills
Apache Spark, Scala, Python, Apache HDFS, Apache Yarn, Apache Hive, Apache Airflow, Apache Kafka, Kubernetes, Stream processing, Functional programming
Preferred skills
CI/CD, Cloud alternatives to on-prem tools
Technologies
Apache Spark, Scala, Python, Apache HDFS, Apache Yarn, Apache Hive, Apache Airflow, Apache Kafka, Kubernetes
Responsibilities
Create and maintain optimal data pipeline architecture; Assemble large complex data sets meeting business requirements; Identify and implement internal process improvements to automate manual processes; Build infrastructure for optimal ETL from various data sources; Build analytics tools providing actionable insights into customer acquisition and operational efficiency; Work with stakeholders to assist with data-related technical issues; Keep data separated and secure; Create data tools for analytics and data scientist teams.
Seniority
Senior, hands-on IC
