Data Engineer
Core
Designing and building scalable, cloud-native data platforms on Azure to power analytics, reporting, and AI for a retail cooperative.
Role type
Senior Data Engineer (Azure & Databricks)
Builds
Enterprise-grade data pipelines, data lakehouse architectures, and real-time streaming solutions for a retail cooperative.
Domain
Retail / Grocery / Cloud Data Engineering
Deliverable
production ML models | product features | dashboards & analysis
Required skills
Azure Data Factory, Azure Databricks, PySpark, Delta Lake, Medallion Architecture, Apache Kafka, Azure Event Hub, Service Bus, Python, SQL, Terraform, CI/CD pipelines, Data Governance
Preferred skills
Experience with retail or logistics data environments, machine learning workloads, distributed data processing architectures
Technologies
Azure, Databricks, Kafka, Terraform, Azure DevOps, PySpark, Delta Lake
Responsibilities
Design and implement scalable batch and real-time data pipelines; Build and maintain robust data ingestion frameworks; Develop and manage Medallion Architecture within the enterprise Data Lake; Implement streaming solutions; Develop transformation frameworks; Enable CI/CD pipelines and automate deployments; Drive platform optimization; Ensure adherence to data governance and security standards
Seniority
Senior, hands-on IC
