{"title":"基于卷积神经网络的语音情感识别","authors":"Kanimozhi N. , Devi Priya R.","doi":"10.1016/j.neucom.2025.129506","DOIUrl":null,"url":null,"abstract":"<div><div>Speech serves as the primary mode of human communication, where semantic meaning is conveyed through the combination and arrangement of words. Recent research in Speech Emotion Recognition (SER) has assisted in maintaining and improving social relationships and behaviors among individuals. In recent times, several advancements have been attained in SER systems due to the incorporation of Deep learning (DL) models. However, the conventional techniques often require large, well-annotated datasets for effective training, which was resource-intensive to collect and label. Moreover, models may struggle to generalize across diverse speakers, emotional expressions, and recording conditions, potentially limiting their real-world applicability. Therefore, this paper presents a Lyrebird Red Panda Optimization _Shepard Convolutional Neural Network (LRPO_ShCNN) for SER. Initially, the input speech signal is preprocessed by using Adaptive Gaussian filter. After that, the significant features from the preprocessed image are extracted. Further, data augmentation process is carried out and it generates new data points from existing data. After that, feature selection is done with LRPO. Finally, SER is accomplished by utilizing ShCNN, where the emotions are classified. Moreover, the hyperparameters of ShCNN are tuned with LRPO, which is developed by the integration of Lyrebird Optimization Algorithm (LOA) and Red Panda Optimization (RPO). The evaluation results shows that the LRPO_ShCNN obtained Accuracy, Positive Predictive Value (PPV), Negative Predictive Value (NPV), True Positive Rate (TPR), and True Negative Rate (TNR) as 91.092 %, 90.552 %, 90.876 %, 91.230 %, and 91.818 % respectively.</div></div>","PeriodicalId":19268,"journal":{"name":"Neurocomputing","volume":"625 ","pages":"Article 129506"},"PeriodicalIF":6.5000,"publicationDate":"2025-04-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Hybrid Lyrebird Red Panda Optimization_Shepard Convolutional Neural Network for recognition of speech emotion in audio signals\",\"authors\":\"Kanimozhi N. , Devi Priya R.\",\"doi\":\"10.1016/j.neucom.2025.129506\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Speech serves as the primary mode of human communication, where semantic meaning is conveyed through the combination and arrangement of words. Recent research in Speech Emotion Recognition (SER) has assisted in maintaining and improving social relationships and behaviors among individuals. In recent times, several advancements have been attained in SER systems due to the incorporation of Deep learning (DL) models. However, the conventional techniques often require large, well-annotated datasets for effective training, which was resource-intensive to collect and label. Moreover, models may struggle to generalize across diverse speakers, emotional expressions, and recording conditions, potentially limiting their real-world applicability. Therefore, this paper presents a Lyrebird Red Panda Optimization _Shepard Convolutional Neural Network (LRPO_ShCNN) for SER. Initially, the input speech signal is preprocessed by using Adaptive Gaussian filter. After that, the significant features from the preprocessed image are extracted. Further, data augmentation process is carried out and it generates new data points from existing data. After that, feature selection is done with LRPO. Finally, SER is accomplished by utilizing ShCNN, where the emotions are classified. Moreover, the hyperparameters of ShCNN are tuned with LRPO, which is developed by the integration of Lyrebird Optimization Algorithm (LOA) and Red Panda Optimization (RPO). The evaluation results shows that the LRPO_ShCNN obtained Accuracy, Positive Predictive Value (PPV), Negative Predictive Value (NPV), True Positive Rate (TPR), and True Negative Rate (TNR) as 91.092 %, 90.552 %, 90.876 %, 91.230 %, and 91.818 % respectively.</div></div>\",\"PeriodicalId\":19268,\"journal\":{\"name\":\"Neurocomputing\",\"volume\":\"625 \",\"pages\":\"Article 129506\"},\"PeriodicalIF\":6.5000,\"publicationDate\":\"2025-04-07\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Neurocomputing\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S092523122500178X\",\"RegionNum\":2,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"2025/1/26 0:00:00\",\"PubModel\":\"Epub\",\"JCR\":\"Q1\",\"JCRName\":\"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Neurocomputing","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S092523122500178X","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2025/1/26 0:00:00","PubModel":"Epub","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0
摘要
言语是人类交流的主要方式,通过词语的组合和排列来传达语义。语音情感识别(SER)的最新研究有助于维持和改善个体之间的社会关系和行为。近年来,由于深度学习(DL)模型的结合,在SER系统中取得了一些进展。然而,传统的技术通常需要大量的、注释良好的数据集来进行有效的训练,这需要大量的资源来收集和标记。此外,模型可能难以在不同的说话者、情感表达和记录条件下进行概括,这可能会限制它们在现实世界中的适用性。为此,本文提出了一种针对SER的Lyrebird - Red Panda优化- shepard卷积神经网络(LRPO_ShCNN)。首先,使用自适应高斯滤波器对输入语音信号进行预处理。然后,从预处理后的图像中提取重要的特征。进一步,进行数据增强处理,从现有数据中生成新的数据点。之后,使用LRPO完成特征选择。最后,使用ShCNN完成SER,其中对情绪进行分类。此外,采用Lyrebird优化算法(LOA)和小熊猫优化算法(RPO)相结合的LRPO算法对ShCNN的超参数进行了调优。评价结果表明,LRPO_ShCNN的准确率、阳性预测值(PPV)、阴性预测值(NPV)、真阳性率(TPR)和真阴性率(TNR)分别为91.092 %、90.552 %、90.876 %、91.230 %和91.818 %。
Hybrid Lyrebird Red Panda Optimization_Shepard Convolutional Neural Network for recognition of speech emotion in audio signals
Speech serves as the primary mode of human communication, where semantic meaning is conveyed through the combination and arrangement of words. Recent research in Speech Emotion Recognition (SER) has assisted in maintaining and improving social relationships and behaviors among individuals. In recent times, several advancements have been attained in SER systems due to the incorporation of Deep learning (DL) models. However, the conventional techniques often require large, well-annotated datasets for effective training, which was resource-intensive to collect and label. Moreover, models may struggle to generalize across diverse speakers, emotional expressions, and recording conditions, potentially limiting their real-world applicability. Therefore, this paper presents a Lyrebird Red Panda Optimization _Shepard Convolutional Neural Network (LRPO_ShCNN) for SER. Initially, the input speech signal is preprocessed by using Adaptive Gaussian filter. After that, the significant features from the preprocessed image are extracted. Further, data augmentation process is carried out and it generates new data points from existing data. After that, feature selection is done with LRPO. Finally, SER is accomplished by utilizing ShCNN, where the emotions are classified. Moreover, the hyperparameters of ShCNN are tuned with LRPO, which is developed by the integration of Lyrebird Optimization Algorithm (LOA) and Red Panda Optimization (RPO). The evaluation results shows that the LRPO_ShCNN obtained Accuracy, Positive Predictive Value (PPV), Negative Predictive Value (NPV), True Positive Rate (TPR), and True Negative Rate (TNR) as 91.092 %, 90.552 %, 90.876 %, 91.230 %, and 91.818 % respectively.
期刊介绍:
Neurocomputing publishes articles describing recent fundamental contributions in the field of neurocomputing. Neurocomputing theory, practice and applications are the essential topics being covered.