{"title":"Assessment and Application of Digital Museum Visitors' Emotional Experience Based on Virtual Reality Technology and Emotion Recognition Algorithm","authors":"Jun An","doi":"10.1162/pres_a_00425","DOIUrl":null,"url":null,"abstract":"\n Each person will have different emotional experience for the same scene or exhibit, which reduces the accuracy of emotional recognition and leads to the complexity of the evaluation of visitors' emotional experience in digital museums. In order to improve the user experience of digital museum, the evaluation and optimization methods of visitors' emotional experience of digital museum based on virtual reality technology and emotion recognition algorithm are studied. The spectrogram is generated according to the voice sent by tourists when they visit the digital museum, which is based on CSWNet_ CRNN emotion recognition depth learning model input, evaluate the tourists' emotional experience results, and draw the tourists' emotional types of digital museums; The visual and auditory features of the digital museum scene with positive emotional experience are extracted respectively. Using virtual reality technology, the extracted features are applied to each link of the digital museum scene content design, optimizing the digital museum virtual reality scene, and improving the digital museum experience. The experiment shows that the tourist emotion recognition accuracy of this method is high, and the emotion recognition accuracy of 300 random tourists can reach 100%. In terms of generating new scenes, the feature extraction results of this scene are consistent with the feature estimation of positive emotions by ordinary people. The use of extracted features to optimize the digital museum scene has better realism and detail accuracy, which can be favored by most people and promote the sustainable development of digital museums.","PeriodicalId":501553,"journal":{"name":"PRESENCE: Virtual and Augmented Reality","volume":"115 42","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2024-05-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"PRESENCE: Virtual and Augmented Reality","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1162/pres_a_00425","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
Abstract
Each person will have different emotional experience for the same scene or exhibit, which reduces the accuracy of emotional recognition and leads to the complexity of the evaluation of visitors' emotional experience in digital museums. In order to improve the user experience of digital museum, the evaluation and optimization methods of visitors' emotional experience of digital museum based on virtual reality technology and emotion recognition algorithm are studied. The spectrogram is generated according to the voice sent by tourists when they visit the digital museum, which is based on CSWNet_ CRNN emotion recognition depth learning model input, evaluate the tourists' emotional experience results, and draw the tourists' emotional types of digital museums; The visual and auditory features of the digital museum scene with positive emotional experience are extracted respectively. Using virtual reality technology, the extracted features are applied to each link of the digital museum scene content design, optimizing the digital museum virtual reality scene, and improving the digital museum experience. The experiment shows that the tourist emotion recognition accuracy of this method is high, and the emotion recognition accuracy of 300 random tourists can reach 100%. In terms of generating new scenes, the feature extraction results of this scene are consistent with the feature estimation of positive emotions by ordinary people. The use of extracted features to optimize the digital museum scene has better realism and detail accuracy, which can be favored by most people and promote the sustainable development of digital museums.