基于迁移学习的动画人物面部情绪检测

Anonnya Ghosh, Raqeebir Rab, Ashikur Rahman
{"title":"基于迁移学习的动画人物面部情绪检测","authors":"Anonnya Ghosh, Raqeebir Rab, Ashikur Rahman","doi":"10.1109/ICCIT57492.2022.10054823","DOIUrl":null,"url":null,"abstract":"Since 1906 till today animation has been a popular method of storytelling. Animated characters portray unique stories in a more perceivable way by expressing diverse facial expressions. Detection of these emotions has not yet gained as much acclaim as detection of human facial expressions. This research aims to classify and predict emotions of animated characters using Deep Learning Techniques. Images of seven facial expressions namely Anger, Disgust, Fear, Joy, Neutral, Sadness and Surprise are classified using Residual Network (ResNet) and Transfer Learning. In order to conduct research on emotion identification in animated faces, we generated a new dataset with fewer images than the existing dataset [1]. Features from the faces are extracted using Uniform Local Binary Patterns (LBP) and fed to Convolutional Neural Network (CNN) model for classification. In our proposed models, the Transfer Learning-based ResNet50 and ResNet101,were trained on the ImageNet [10] dataset. Among the models ResNet101 achieved the highest detection accuracy of 94% and ResNet50 showed lowest time complexity.","PeriodicalId":255498,"journal":{"name":"2022 25th International Conference on Computer and Information Technology (ICCIT)","volume":"512 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-12-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Transfer learning based Facial Emotion Detection for Animated Characters\",\"authors\":\"Anonnya Ghosh, Raqeebir Rab, Ashikur Rahman\",\"doi\":\"10.1109/ICCIT57492.2022.10054823\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Since 1906 till today animation has been a popular method of storytelling. Animated characters portray unique stories in a more perceivable way by expressing diverse facial expressions. Detection of these emotions has not yet gained as much acclaim as detection of human facial expressions. This research aims to classify and predict emotions of animated characters using Deep Learning Techniques. Images of seven facial expressions namely Anger, Disgust, Fear, Joy, Neutral, Sadness and Surprise are classified using Residual Network (ResNet) and Transfer Learning. In order to conduct research on emotion identification in animated faces, we generated a new dataset with fewer images than the existing dataset [1]. Features from the faces are extracted using Uniform Local Binary Patterns (LBP) and fed to Convolutional Neural Network (CNN) model for classification. In our proposed models, the Transfer Learning-based ResNet50 and ResNet101,were trained on the ImageNet [10] dataset. Among the models ResNet101 achieved the highest detection accuracy of 94% and ResNet50 showed lowest time complexity.\",\"PeriodicalId\":255498,\"journal\":{\"name\":\"2022 25th International Conference on Computer and Information Technology (ICCIT)\",\"volume\":\"512 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2022-12-17\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2022 25th International Conference on Computer and Information Technology (ICCIT)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/ICCIT57492.2022.10054823\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2022 25th International Conference on Computer and Information Technology (ICCIT)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ICCIT57492.2022.10054823","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

自1906年至今,动画一直是一种流行的讲故事的方法。动画人物通过表达不同的面部表情,以更直观的方式描绘独特的故事。对这些情绪的检测还没有像对人类面部表情的检测那样受到广泛的赞誉。本研究旨在利用深度学习技术对动画人物的情绪进行分类和预测。利用残差网络(ResNet)和迁移学习对愤怒、厌恶、恐惧、喜悦、中性、悲伤和惊讶七种面部表情图像进行分类。为了对动画人脸的情绪识别进行研究,我们生成了一个比现有数据集图像更少的新数据集[1]。使用统一局部二值模式(LBP)提取人脸特征,并将其输入卷积神经网络(CNN)模型进行分类。在我们提出的模型中,基于迁移学习的ResNet50和ResNet101是在ImageNet[10]数据集上进行训练的。其中,ResNet101的检测准确率最高,达到94%,而ResNet50的时间复杂度最低。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
Transfer learning based Facial Emotion Detection for Animated Characters
Since 1906 till today animation has been a popular method of storytelling. Animated characters portray unique stories in a more perceivable way by expressing diverse facial expressions. Detection of these emotions has not yet gained as much acclaim as detection of human facial expressions. This research aims to classify and predict emotions of animated characters using Deep Learning Techniques. Images of seven facial expressions namely Anger, Disgust, Fear, Joy, Neutral, Sadness and Surprise are classified using Residual Network (ResNet) and Transfer Learning. In order to conduct research on emotion identification in animated faces, we generated a new dataset with fewer images than the existing dataset [1]. Features from the faces are extracted using Uniform Local Binary Patterns (LBP) and fed to Convolutional Neural Network (CNN) model for classification. In our proposed models, the Transfer Learning-based ResNet50 and ResNet101,were trained on the ImageNet [10] dataset. Among the models ResNet101 achieved the highest detection accuracy of 94% and ResNet50 showed lowest time complexity.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
期刊最新文献
SlotFinder: A Spatio-temporal based Car Parking System Land Cover and Land Use Detection using Semi-Supervised Learning Comparative Analysis of Process Scheduling Algorithm using AI models Throughput Optimization of IEEE 802.15.4e TSCH-Based Scheduling: A Deep Neural Network (DNN) Scheme Towards Developing a Voice-Over-Guided System for Visually Impaired People to Learn Writing the Alphabets
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1