Lightweight Food Image Recognition With Global Shuffle Convolution

Abstract

Consumer behaviors and habits in food choices impact their physical health and have implications for climate change and global warming. Efficient food image recognition can assist individuals in making more environmentally friendly and healthier dietary choices using end devices, such as smartphones. Simultaneously, it can enhance the efficiency of server-side training, thereby reducing carbon emissions. We propose a lightweight deep neural network named Global Shuffle Net (GSNet) that can efficiently recognize food images. In GSNet, we develop a novel convolution method called global shuffle convolution, which captures the dependence between long-range pixels. Merging global shuffle convolution with classic local convolution yields a framework that works as the backbone of GSNet. Through GSNet's ability to capture the dependence between long-range pixels at the start of the network, by restricting the number of layers in the middle and rear, the parameters and floating operation operations (FLOPs) can be minimized without compromising the performance, thus permitting a lightweight goal to be achieved. Experimental results on four popular food recognition datasets demonstrate that our approach achieves state-of-the-art performance with higher accuracy and fewer FLOPs and parameters. For example, in comparison to the current state-of-the-art model of MobileViTv2, GSNet achieved 87.9% accuracy of the top-1 level on the Eidgenössische Technische Hochschule Zürich (ETHZ) Food-101 dataset with 28% reduction in the parameters, 37% reduction in the FLOPs, but a 0.7% more accuracy.