Smart Shopping Based on Internet of Things

This research investigates the use of Internet of Things (IoT) technology for designing and developing smart shopping. The research consists of two parts. The first part focuses on developing smart shopping cart in which a smartphone can be used to record thee events in cart. Events include adding items to the carts, removing items, and replacing items. The technology of edge computing and cloud computing are used to analyze the video, produce shopping bills and support electronic payment. More details about the project can be found in the paper at: https://ieeexplore.ieee.org/document/9120574

The second focuses on smart shelves in which the quantity of items on markets shelves is continuously determined to allow efficient management of markets. This parts uses load cell sensors and computer vision to determine the quantity and locations of an item in a market. This part has not been published yet.

The project is cooperation between Palestine technical university Kadoorie in Palestine and National Chiao Tung University – Taiwan

Muhammad Atif Sarwar; 

Yousef-Awwad Daraghmi; 

Kuan-Wen Liu; 

Hong-Chuan Chi; 

Tsì -Uí İk; 

Yih-Lang Li

The project targets supermarkets, marts, and shopping malls
Demo of project is at:
http://nol.cs.nctu.edu.tw/iCart/index.html

smart shopping cart -high accuracy of:
determine the event such as adding item to the cart, removing item, or replacing item
determine the name of product in the shopping cart

smart shelf:
high accuracy of determining the weight of items on shelves and thus finding the quantity of items on each shelve.

The project has achieved the following:
1- prototype of smart shopping cart: the accuracy of recognizing shopping events and items is about 97%. The accuracy is improved because of using deep learning network for image processing.

2- prototype for smart shelves: accuracy of the load cell sensor that is used to weigh items and identify their position on shelves was improved through the use of deep learning to calibrate the sensors

Not Available

http://nol.cs.nctu.edu.tw/iCart/index.html