{"title":"基于深度学习的姿态和表情变化的热图像识别","authors":"Naser Zaeri , Rusul Qasim","doi":"10.1016/j.jer.2023.10.043","DOIUrl":null,"url":null,"abstract":"<div><div>Thermal infrared face recognition systems have developed as an effective complement to visual systems for biometric identity purposes and military operations. With the help of deep learning and convolutional neural networks, we provide an efficient approach for thermal facial identification that can handle position fluctuations and expression dissimilarities in this study. As an essential deep learning model that has demonstrated its effectiveness in several computer vision and machine learning applications, we employ the ResNet-50 architecture which consists of 50 layers of convolution, activation, and pooling. The structures of those layers are discussed in detail to gain a profound insight about the operation of this architecture. In this regard, a deep and detailed mathematical analysis is furnished. The system is implemented on a dataset of 1500 thermal images, where we execute experiments in various setups and circumstances to address the issues with posture and expression variance. The experimental results show that the system achieves an accuracy rate of 99.4% when it is trained using 30% of the dataset after five epochs. With respect to other performance measures, the system attains 100% recall, precision, F-score, and specificity. In comparison to recently published works, the findings show that the suggested system offers improved discriminability, resilience against fluctuations, as well as high identification rates under diverse settings that mimic real-world scenarios.</div></div>","PeriodicalId":48803,"journal":{"name":"Journal of Engineering Research","volume":"12 4","pages":"Pages 751-760"},"PeriodicalIF":0.9000,"publicationDate":"2024-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Thermal image identification against pose and expression variations using deep learning\",\"authors\":\"Naser Zaeri , Rusul Qasim\",\"doi\":\"10.1016/j.jer.2023.10.043\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Thermal infrared face recognition systems have developed as an effective complement to visual systems for biometric identity purposes and military operations. With the help of deep learning and convolutional neural networks, we provide an efficient approach for thermal facial identification that can handle position fluctuations and expression dissimilarities in this study. As an essential deep learning model that has demonstrated its effectiveness in several computer vision and machine learning applications, we employ the ResNet-50 architecture which consists of 50 layers of convolution, activation, and pooling. The structures of those layers are discussed in detail to gain a profound insight about the operation of this architecture. In this regard, a deep and detailed mathematical analysis is furnished. The system is implemented on a dataset of 1500 thermal images, where we execute experiments in various setups and circumstances to address the issues with posture and expression variance. The experimental results show that the system achieves an accuracy rate of 99.4% when it is trained using 30% of the dataset after five epochs. With respect to other performance measures, the system attains 100% recall, precision, F-score, and specificity. In comparison to recently published works, the findings show that the suggested system offers improved discriminability, resilience against fluctuations, as well as high identification rates under diverse settings that mimic real-world scenarios.</div></div>\",\"PeriodicalId\":48803,\"journal\":{\"name\":\"Journal of Engineering Research\",\"volume\":\"12 4\",\"pages\":\"Pages 751-760\"},\"PeriodicalIF\":0.9000,\"publicationDate\":\"2024-12-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of Engineering Research\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S2307187723003048\",\"RegionNum\":4,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q3\",\"JCRName\":\"ENGINEERING, MULTIDISCIPLINARY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Engineering Research","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2307187723003048","RegionNum":4,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"ENGINEERING, MULTIDISCIPLINARY","Score":null,"Total":0}
Thermal image identification against pose and expression variations using deep learning
Thermal infrared face recognition systems have developed as an effective complement to visual systems for biometric identity purposes and military operations. With the help of deep learning and convolutional neural networks, we provide an efficient approach for thermal facial identification that can handle position fluctuations and expression dissimilarities in this study. As an essential deep learning model that has demonstrated its effectiveness in several computer vision and machine learning applications, we employ the ResNet-50 architecture which consists of 50 layers of convolution, activation, and pooling. The structures of those layers are discussed in detail to gain a profound insight about the operation of this architecture. In this regard, a deep and detailed mathematical analysis is furnished. The system is implemented on a dataset of 1500 thermal images, where we execute experiments in various setups and circumstances to address the issues with posture and expression variance. The experimental results show that the system achieves an accuracy rate of 99.4% when it is trained using 30% of the dataset after five epochs. With respect to other performance measures, the system attains 100% recall, precision, F-score, and specificity. In comparison to recently published works, the findings show that the suggested system offers improved discriminability, resilience against fluctuations, as well as high identification rates under diverse settings that mimic real-world scenarios.
期刊介绍:
Journal of Engineering Research (JER) is a international, peer reviewed journal which publishes full length original research papers, reviews, case studies related to all areas of Engineering such as: Civil, Mechanical, Industrial, Electrical, Computer, Chemical, Petroleum, Aerospace, Architectural, Biomedical, Coastal, Environmental, Marine & Ocean, Metallurgical & Materials, software, Surveying, Systems and Manufacturing Engineering. In particular, JER focuses on innovative approaches and methods that contribute to solving the environmental and manufacturing problems, which exist primarily in the Arabian Gulf region and the Middle East countries. Kuwait University used to publish the Journal "Kuwait Journal of Science and Engineering" (ISSN: 1024-8684), which included Science and Engineering articles since 1974. In 2011 the decision was taken to split KJSE into two independent Journals - "Journal of Engineering Research "(JER) and "Kuwait Journal of Science" (KJS).