{"title":"基于局部约束特征的多标签面部表情识别深度学习新方法","authors":"Wanzhao Li, Peng Zhang, Wei Huang","doi":"10.1109/ICCEAI52939.2021.00048","DOIUrl":null,"url":null,"abstract":"Human emotions always have been reflected by the facial expression. In recent year, the facial expression recognition has been found that it can be treated as a multi-label task and some databases (such as JAFFE, FER+, RAF-ML.) which include information of multi-label facial expression also have been utilize to address relate issue. Simultaneously, some deep learning methods also be used to solve multi-label facial expression task, such as VGG13 and Deep Bi-Manifold CNN (DBM-CNN). But there are also have many weakness such as the inaccurate recognition of multi-label expressions. To overcome this drawback, a novel Deep learning with local constraint framework, called DL- LC framework, is proposed. The proposed framework will use the MTCNN as an implement to crop the local constraints features which include the infromation of facial expression. And the ResNet18 has been applied as a backbone network to extract the feature from the global and local constraint images, which can get more details of original image after incorporating local constraints in this new framework. The effectiveness of this model has been testified through rigorous experiments in this study. Comprehensive analyses reveal that, this model is outperform the recent state-of-the-art approaches for multi-label facial expression recognition.","PeriodicalId":331409,"journal":{"name":"2021 International Conference on Computer Engineering and Artificial Intelligence (ICCEAI)","volume":null,"pages":null},"PeriodicalIF":0.0000,"publicationDate":"2021-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"2","resultStr":"{\"title\":\"A New Deep Learning Method for Multi-label Facial Expression Recognition based on Local Constraint Features\",\"authors\":\"Wanzhao Li, Peng Zhang, Wei Huang\",\"doi\":\"10.1109/ICCEAI52939.2021.00048\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Human emotions always have been reflected by the facial expression. In recent year, the facial expression recognition has been found that it can be treated as a multi-label task and some databases (such as JAFFE, FER+, RAF-ML.) which include information of multi-label facial expression also have been utilize to address relate issue. Simultaneously, some deep learning methods also be used to solve multi-label facial expression task, such as VGG13 and Deep Bi-Manifold CNN (DBM-CNN). But there are also have many weakness such as the inaccurate recognition of multi-label expressions. To overcome this drawback, a novel Deep learning with local constraint framework, called DL- LC framework, is proposed. The proposed framework will use the MTCNN as an implement to crop the local constraints features which include the infromation of facial expression. And the ResNet18 has been applied as a backbone network to extract the feature from the global and local constraint images, which can get more details of original image after incorporating local constraints in this new framework. The effectiveness of this model has been testified through rigorous experiments in this study. Comprehensive analyses reveal that, this model is outperform the recent state-of-the-art approaches for multi-label facial expression recognition.\",\"PeriodicalId\":331409,\"journal\":{\"name\":\"2021 International Conference on Computer Engineering and Artificial Intelligence (ICCEAI)\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2021-08-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"2\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2021 International Conference on Computer Engineering and Artificial Intelligence (ICCEAI)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/ICCEAI52939.2021.00048\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2021 International Conference on Computer Engineering and Artificial Intelligence (ICCEAI)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ICCEAI52939.2021.00048","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
A New Deep Learning Method for Multi-label Facial Expression Recognition based on Local Constraint Features
Human emotions always have been reflected by the facial expression. In recent year, the facial expression recognition has been found that it can be treated as a multi-label task and some databases (such as JAFFE, FER+, RAF-ML.) which include information of multi-label facial expression also have been utilize to address relate issue. Simultaneously, some deep learning methods also be used to solve multi-label facial expression task, such as VGG13 and Deep Bi-Manifold CNN (DBM-CNN). But there are also have many weakness such as the inaccurate recognition of multi-label expressions. To overcome this drawback, a novel Deep learning with local constraint framework, called DL- LC framework, is proposed. The proposed framework will use the MTCNN as an implement to crop the local constraints features which include the infromation of facial expression. And the ResNet18 has been applied as a backbone network to extract the feature from the global and local constraint images, which can get more details of original image after incorporating local constraints in this new framework. The effectiveness of this model has been testified through rigorous experiments in this study. Comprehensive analyses reveal that, this model is outperform the recent state-of-the-art approaches for multi-label facial expression recognition.