Data Engineer
Core
Design, maintain, and optimize large-scale data pipelines and infrastructure to generate facts and insights for retail clients.
Role type
Senior Data Engineer
Builds
Data pipelines, ETL infrastructure, and integrated data models for client insights
Domain
Retail / Consumer Intelligence / Data Engineering
Deliverable
production ML models | product features | dashboards & analysis
Required skills
Apache Spark (Python/Scala), SQL, Python, Scala, Airflow, Docker, Kubernetes, Data Warehousing concepts, CI/CD, DevSecOps
Preferred skills
Retail domain experience, Cloud certifications, AI tools exposure
Technologies
Spark, Scala, Pyspark, Python, Databricks, Airflow, SQL, Docker, Kubernetes, Azure
Responsibilities
Maintain and assemble data pipelines consuming large datasets; integrate finished models into pipelines; optimize Spark code for performance and memory; build infrastructure for data extraction, transformation, and loading; write and maintain documentation.
Seniority
Senior, hands-on IC
