Data Engineer (Databricks /Azure)
Core
Design and deploy innovative Analytics products for support functions, logistics teams, stores, and consumers using Azure/Databricks.
Role type
Senior Data Engineer (Cloud/Big Data)
Builds
Data pipelines, Data Lake structures, and BI/Analytics products for retail operations.
Domain
Retail / Big Data Analytics / Cloud
Deliverable
production ML models | product features
Required skills
SQL, Scala, Python, PySpark, Delta Lake, Parquet, CI/CD, Unit Testing, Agile methodologies
Preferred skills
Azure certifications, Databricks certifications, Spark certifications
Technologies
Azure, Databricks, Spark, JIRA
Responsibilities
Participate in requirement definition workshops with Product Owners; Build data pipelines for collection, transformation, and processing in Azure Data Lake; Develop advanced processing notebooks on Databricks; Design and model data within the Data Lake; Perform unit, assembly, and integration tests; Prepare delivery packages for CI/CD; Ensure maintenance and evolution of data products; Participate in Agile ceremonies and community building.
Seniority
Senior, hands-on IC