Assessment and Application of Digital Museum Visitors' Emotional Experience Based on Virtual Reality Technology and Emotion Recognition Algorithm

Jun An
{"title":"Assessment and Application of Digital Museum Visitors' Emotional Experience Based on Virtual Reality Technology and Emotion Recognition Algorithm","authors":"Jun An","doi":"10.1162/pres_a_00425","DOIUrl":null,"url":null,"abstract":"\n Each person will have different emotional experience for the same scene or exhibit, which reduces the accuracy of emotional recognition and leads to the complexity of the evaluation of visitors' emotional experience in digital museums. In order to improve the user experience of digital museum, the evaluation and optimization methods of visitors' emotional experience of digital museum based on virtual reality technology and emotion recognition algorithm are studied. The spectrogram is generated according to the voice sent by tourists when they visit the digital museum, which is based on CSWNet_ CRNN emotion recognition depth learning model input, evaluate the tourists' emotional experience results, and draw the tourists' emotional types of digital museums; The visual and auditory features of the digital museum scene with positive emotional experience are extracted respectively. Using virtual reality technology, the extracted features are applied to each link of the digital museum scene content design, optimizing the digital museum virtual reality scene, and improving the digital museum experience. The experiment shows that the tourist emotion recognition accuracy of this method is high, and the emotion recognition accuracy of 300 random tourists can reach 100%. In terms of generating new scenes, the feature extraction results of this scene are consistent with the feature estimation of positive emotions by ordinary people. The use of extracted features to optimize the digital museum scene has better realism and detail accuracy, which can be favored by most people and promote the sustainable development of digital museums.","PeriodicalId":501553,"journal":{"name":"PRESENCE: Virtual and Augmented Reality","volume":"115 42","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2024-05-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"PRESENCE: Virtual and Augmented Reality","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1162/pres_a_00425","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

Each person will have different emotional experience for the same scene or exhibit, which reduces the accuracy of emotional recognition and leads to the complexity of the evaluation of visitors' emotional experience in digital museums. In order to improve the user experience of digital museum, the evaluation and optimization methods of visitors' emotional experience of digital museum based on virtual reality technology and emotion recognition algorithm are studied. The spectrogram is generated according to the voice sent by tourists when they visit the digital museum, which is based on CSWNet_ CRNN emotion recognition depth learning model input, evaluate the tourists' emotional experience results, and draw the tourists' emotional types of digital museums; The visual and auditory features of the digital museum scene with positive emotional experience are extracted respectively. Using virtual reality technology, the extracted features are applied to each link of the digital museum scene content design, optimizing the digital museum virtual reality scene, and improving the digital museum experience. The experiment shows that the tourist emotion recognition accuracy of this method is high, and the emotion recognition accuracy of 300 random tourists can reach 100%. In terms of generating new scenes, the feature extraction results of this scene are consistent with the feature estimation of positive emotions by ordinary people. The use of extracted features to optimize the digital museum scene has better realism and detail accuracy, which can be favored by most people and promote the sustainable development of digital museums.
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
基于虚拟现实技术和情感识别算法的数字博物馆参观者情感体验评估与应用
每个人对同一场景或展品的情感体验不同,降低了情感识别的准确性,导致数字博物馆游客情感体验评价的复杂性。为了改善数字博物馆的用户体验,本文研究了基于虚拟现实技术和情感识别算法的数字博物馆参观者情感体验评价与优化方法。根据游客参观数字博物馆时发出的语音生成频谱图,基于CSWNet_ CRNN情感识别深度学习模型输入,对游客情感体验结果进行评估,得出游客对数字博物馆的情感类型;分别提取具有积极情感体验的数字博物馆场景的视觉和听觉特征。利用虚拟现实技术,将提取的特征应用于数字博物馆场景内容设计的各个环节,优化数字博物馆虚拟现实场景,提升数字博物馆体验。实验表明,该方法的游客情感识别准确率较高,对 300 名随机游客的情感识别准确率可达 100%。在生成新场景方面,该场景的特征提取结果与普通人对积极情绪的特征估计一致。利用提取的特征对数字博物馆场景进行优化,具有较好的真实性和细节准确性,可以得到大多数人的青睐,促进数字博物馆的可持续发展。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
自引率
0.00%
发文量
0
期刊最新文献
Center for Cyber-Physical Systems: Immersive Visualization and Simulation Environment First-Person Experience in Virtual Reality Sport Advertisement: Transportation of Embodied Empathy Assessment and Application of Digital Museum Visitors' Emotional Experience Based on Virtual Reality Technology and Emotion Recognition Algorithm Contribution of Virtual Reality to the Reproduction of Social Interaction characteristics in Neuropsychology: A Systematic Review of the Literature Bridging the Headset: Engagement, Collaboration and Learning In and Around Virtual Reality
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1