{"title":"低成本设备上的低分辨率面部情绪识别","authors":"M. D. Putro, Jane Litouw, V. Poekoel","doi":"10.11591/ijai.v13.i2.pp2201-2211","DOIUrl":null,"url":null,"abstract":"The low-resolution input image is a crucial challenge for applying facial emotion recognition in real-world scenarios. The critical problem is that valuable object features are relatively lost in the extraction process due to their small size. On the other hand, this vision system is required by a machine to run smoothly on low-cost devices. Facial emotion recognition using a lightweight feature extractor is proposed in this study to effectively capture crucial facial components in a low-resolution image. To compromise the running speed, this work offers an efficient feature convolution to discriminate specific facial features. In addition, the system is embedded with an attentive module to capture important features and correlate them. Our model performance is evaluated on low-resolution public datasets achieving the accuracy of 97.34\\%, 81.10\\%, and 80.12\\% on KDEF, RFDB, and FER-plus, respectively. The practical application demands that the deep learning model can operate fast on inexpensive devices. Consequently, the model achieved a speed of 290 FPS on a CPU device.","PeriodicalId":507934,"journal":{"name":"IAES International Journal of Artificial Intelligence (IJ-AI)","volume":"25 19","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2024-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Low-resolution facial emotion recognition on low-cost devices\",\"authors\":\"M. D. Putro, Jane Litouw, V. Poekoel\",\"doi\":\"10.11591/ijai.v13.i2.pp2201-2211\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"The low-resolution input image is a crucial challenge for applying facial emotion recognition in real-world scenarios. The critical problem is that valuable object features are relatively lost in the extraction process due to their small size. On the other hand, this vision system is required by a machine to run smoothly on low-cost devices. Facial emotion recognition using a lightweight feature extractor is proposed in this study to effectively capture crucial facial components in a low-resolution image. To compromise the running speed, this work offers an efficient feature convolution to discriminate specific facial features. In addition, the system is embedded with an attentive module to capture important features and correlate them. Our model performance is evaluated on low-resolution public datasets achieving the accuracy of 97.34\\\\%, 81.10\\\\%, and 80.12\\\\% on KDEF, RFDB, and FER-plus, respectively. The practical application demands that the deep learning model can operate fast on inexpensive devices. Consequently, the model achieved a speed of 290 FPS on a CPU device.\",\"PeriodicalId\":507934,\"journal\":{\"name\":\"IAES International Journal of Artificial Intelligence (IJ-AI)\",\"volume\":\"25 19\",\"pages\":\"\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2024-06-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IAES International Journal of Artificial Intelligence (IJ-AI)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.11591/ijai.v13.i2.pp2201-2211\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IAES International Journal of Artificial Intelligence (IJ-AI)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.11591/ijai.v13.i2.pp2201-2211","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
摘要
低分辨率输入图像是在现实世界场景中应用面部情绪识别的关键挑战。问题的关键在于,由于图像尺寸较小,有价值的对象特征在提取过程中会相对丢失。另一方面,机器要求这种视觉系统能在低成本设备上流畅运行。本研究提出使用轻量级特征提取器进行面部情绪识别,以有效捕捉低分辨率图像中的关键面部组件。为了降低运行速度,本研究提供了一种高效的特征卷积方法来识别特定的面部特征。此外,该系统还嵌入了一个细心模块,以捕捉重要特征并将其关联起来。我们在低分辨率公共数据集上对模型性能进行了评估,在KDEF、RFDB和FER-plus上的准确率分别达到97.34%、81.10%和80.12%。实际应用要求深度学习模型能够在廉价设备上快速运行。因此,该模型在 CPU 设备上的运行速度达到了 290 FPS。
Low-resolution facial emotion recognition on low-cost devices
The low-resolution input image is a crucial challenge for applying facial emotion recognition in real-world scenarios. The critical problem is that valuable object features are relatively lost in the extraction process due to their small size. On the other hand, this vision system is required by a machine to run smoothly on low-cost devices. Facial emotion recognition using a lightweight feature extractor is proposed in this study to effectively capture crucial facial components in a low-resolution image. To compromise the running speed, this work offers an efficient feature convolution to discriminate specific facial features. In addition, the system is embedded with an attentive module to capture important features and correlate them. Our model performance is evaluated on low-resolution public datasets achieving the accuracy of 97.34\%, 81.10\%, and 80.12\% on KDEF, RFDB, and FER-plus, respectively. The practical application demands that the deep learning model can operate fast on inexpensive devices. Consequently, the model achieved a speed of 290 FPS on a CPU device.