基于卷积神经网络的多模态人脸图像情感识别

Minli Wen
{"title":"基于卷积神经网络的多模态人脸图像情感识别","authors":"Minli Wen","doi":"10.1117/12.2667333","DOIUrl":null,"url":null,"abstract":"In the background of changing angle and multi-dimensional posture overlapping, it is necessary to extract and recognize the emotion of multi-modal face images, so as to improve the expression ability of facial emotion. A method of emotion recognition of multi-modal face images under changing angle and multi-dimensional posture overlapping background based on convolution neural network and morphological feature parameter recognition is proposed. Constructing a face feature collection model with variable angle and multi-dimensional posture overlapping background, performing fusion filtering on the collected face images with variable angle and multi-dimensional posture overlapping background, extracting the edge contour feature quantity of the face images with variable angle and multi-dimensional posture overlapping background, and filtering and denoising the original image by using morphological convolution neural network transformation method, Multi-modal wavelet scale decomposition method is used to decompose the emotion features of multi-modal face images under the background of changing angles and multi-dimensional postures, and the detection model of pixel points and similarity features of multi-modal face images under the background of changing angles and multi-dimensional postures is constructed. Morphological convolution neural network transformation method is used to transform the emotion features of multi-modal face images, and edge corner detection and expression feature point clustering analysis are combined to realize the emotion recognition of multi-modal face images. The simulation results show that this method has good performance in feature extraction and clustering of multimodal facial image emotion recognition, good expression ability of facial emotion and high image quality.","PeriodicalId":128051,"journal":{"name":"Third International Seminar on Artificial Intelligence, Networking, and Information Technology","volume":"27 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2023-02-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Emotion recognition of multimodal face images based on convolutional neural network\",\"authors\":\"Minli Wen\",\"doi\":\"10.1117/12.2667333\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"In the background of changing angle and multi-dimensional posture overlapping, it is necessary to extract and recognize the emotion of multi-modal face images, so as to improve the expression ability of facial emotion. A method of emotion recognition of multi-modal face images under changing angle and multi-dimensional posture overlapping background based on convolution neural network and morphological feature parameter recognition is proposed. Constructing a face feature collection model with variable angle and multi-dimensional posture overlapping background, performing fusion filtering on the collected face images with variable angle and multi-dimensional posture overlapping background, extracting the edge contour feature quantity of the face images with variable angle and multi-dimensional posture overlapping background, and filtering and denoising the original image by using morphological convolution neural network transformation method, Multi-modal wavelet scale decomposition method is used to decompose the emotion features of multi-modal face images under the background of changing angles and multi-dimensional postures, and the detection model of pixel points and similarity features of multi-modal face images under the background of changing angles and multi-dimensional postures is constructed. Morphological convolution neural network transformation method is used to transform the emotion features of multi-modal face images, and edge corner detection and expression feature point clustering analysis are combined to realize the emotion recognition of multi-modal face images. The simulation results show that this method has good performance in feature extraction and clustering of multimodal facial image emotion recognition, good expression ability of facial emotion and high image quality.\",\"PeriodicalId\":128051,\"journal\":{\"name\":\"Third International Seminar on Artificial Intelligence, Networking, and Information Technology\",\"volume\":\"27 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2023-02-22\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Third International Seminar on Artificial Intelligence, Networking, and Information Technology\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1117/12.2667333\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Third International Seminar on Artificial Intelligence, Networking, and Information Technology","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1117/12.2667333","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

在角度变化和多维姿态重叠的背景下,有必要对多模态人脸图像的情感进行提取和识别,以提高面部情感的表达能力。提出了一种基于卷积神经网络和形态特征参数识别的多模态变角度和多维姿态重叠背景下人脸图像情绪识别方法。构建变角度、多维姿态背景叠加的人脸特征采集模型,对采集到的变角度、多维姿态背景叠加的人脸图像进行融合滤波,提取变角度、多维姿态背景叠加的人脸图像边缘轮廓特征量;利用形态学卷积神经网络变换方法对原始图像进行滤波去噪,利用多模态小波尺度分解方法对变换角度和多维姿态背景下多模态人脸图像的情感特征进行分解,构建变换角度和多维姿态背景下多模态人脸图像像素点和相似特征检测模型。采用形态学卷积神经网络变换方法对多模态人脸图像的情感特征进行变换,并结合边缘角检测和表情特征点聚类分析实现多模态人脸图像的情感识别。仿真结果表明,该方法在多模态人脸图像情感识别的特征提取和聚类方面具有良好的性能,具有良好的面部情感表达能力和较高的图像质量。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
Emotion recognition of multimodal face images based on convolutional neural network
In the background of changing angle and multi-dimensional posture overlapping, it is necessary to extract and recognize the emotion of multi-modal face images, so as to improve the expression ability of facial emotion. A method of emotion recognition of multi-modal face images under changing angle and multi-dimensional posture overlapping background based on convolution neural network and morphological feature parameter recognition is proposed. Constructing a face feature collection model with variable angle and multi-dimensional posture overlapping background, performing fusion filtering on the collected face images with variable angle and multi-dimensional posture overlapping background, extracting the edge contour feature quantity of the face images with variable angle and multi-dimensional posture overlapping background, and filtering and denoising the original image by using morphological convolution neural network transformation method, Multi-modal wavelet scale decomposition method is used to decompose the emotion features of multi-modal face images under the background of changing angles and multi-dimensional postures, and the detection model of pixel points and similarity features of multi-modal face images under the background of changing angles and multi-dimensional postures is constructed. Morphological convolution neural network transformation method is used to transform the emotion features of multi-modal face images, and edge corner detection and expression feature point clustering analysis are combined to realize the emotion recognition of multi-modal face images. The simulation results show that this method has good performance in feature extraction and clustering of multimodal facial image emotion recognition, good expression ability of facial emotion and high image quality.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
期刊最新文献
Research on the layout of electromagnetic radiation measurement points for explosion of energetic materials Deep learning captcha recognition for mobile based on TensorFlow Research on the design technology of mobile Mix-YOLOv5s model BMSAD: behavior feature and multi-scenario-based Sybil attack detection method in vehicular networks A lightweight model for encrypted traffic classification through sequence modeling
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1