Data Engineer
Core
Build, maintain, and optimize scalable data pipelines and datasets supporting analytics, operational reporting, marketing, and AI-enabled solutions.
Role type
Data Engineer
Builds
Scalable data pipelines, datasets, and data workflows for analytics and downstream platforms
Domain
Retail / Food & Grocery / Data Engineering
Deliverable
production ML models | product features | dashboards & analysis
Required skills
Databricks, Apache Spark, Python, ETL/orchestration tools (Azure Data Factory, Airflow), data modeling, performance optimization, data quality validation
Preferred skills
Agentic AI workflows, MarTech ecosystem familiarity
Technologies
Databricks, Apache Spark, Python, Azure Data Factory, Airflow
Responsibilities
Develop and enhance batch and near-real-time data pipelines; Build data workflows for ingesting, transforming, and publishing large-scale datasets; Optimize data processing jobs for performance, reliability, and cost; Troubleshoot data issues across ingestion, transformation, and delivery layers; Ensure data quality, consistency, and observability through monitoring and testing; Contribute to migrating legacy workflows to cloud-native or lakehouse platforms
Seniority
Mid-to-Senior, hands-on IC
