Data Engineer FMCG / Retail
Core
Building data pipelines, cleaning, and integrating heterogeneous data sources using Spark/PySpark and Generative AI for product matching and classification in the FMCG/Retail sector.
Role type
Data Engineer (Generative AI & Data Integration)
Builds
Data pipelines, product matching solutions, and automated data classification systems
Domain
FMCG / Retail / Data Engineering
Deliverable
production ML models
Required skills
Python, Spark/PySpark, Databricks, Microsoft Azure, Generative AI, LLMs, Prompt Engineering, Embedding, Similarity Matching, Data Cleaning, Data Transformation, Data Integration, Data Quality
Preferred skills
Machine Learning, NLP, Big Data, Structured and Unstructured Data
Responsibilities
Develop pipelines for data collection, transformation, and integration; Implement product matching and record linkage solutions; Support data analysis, quality, and governance; Collaborate with business teams on data classification logic; Maintain cloud-based data solutions.
