{"title":"基于鲁棒前端处理算法的说话人识别模型","authors":"Yingzi Lian, Jing Pang","doi":"10.1117/12.2639261","DOIUrl":null,"url":null,"abstract":"The end-to-end speaker recognition model has made a great breakthrough in the research field and practical application scenarios. However, in practical application, we often suffer the diversity of noise, and the interference of noise will affect the performance of speaker recognition and classification model, and the model usually degrades in unseen scenes with noise. In this paper, a speaker recognition model combined with front-end enhancement is proposed. The front-end enhancement model (DTLN or CRNN) is combined with the back-end speaker recognition model (Res2Net-GhostVLAD) to improve the robustness of the model against noisy scenes, and the generalization capability of the model is increased by the data augmentation method (SpecAugment). Our proposed method was trained on VoxCeleb and AISHELL datasets and tested on VoxCeleb datasets. The test results show that the proposed method significantly improves the performance of the speaker recognition model in noisy scenarios, and the relative improvement of different front-end models is 9% and 13%, respectively.","PeriodicalId":336892,"journal":{"name":"Neural Networks, Information and Communication Engineering","volume":"12 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-06-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Speaker recognition model with robust front-end processing algorithm\",\"authors\":\"Yingzi Lian, Jing Pang\",\"doi\":\"10.1117/12.2639261\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"The end-to-end speaker recognition model has made a great breakthrough in the research field and practical application scenarios. However, in practical application, we often suffer the diversity of noise, and the interference of noise will affect the performance of speaker recognition and classification model, and the model usually degrades in unseen scenes with noise. In this paper, a speaker recognition model combined with front-end enhancement is proposed. The front-end enhancement model (DTLN or CRNN) is combined with the back-end speaker recognition model (Res2Net-GhostVLAD) to improve the robustness of the model against noisy scenes, and the generalization capability of the model is increased by the data augmentation method (SpecAugment). Our proposed method was trained on VoxCeleb and AISHELL datasets and tested on VoxCeleb datasets. The test results show that the proposed method significantly improves the performance of the speaker recognition model in noisy scenarios, and the relative improvement of different front-end models is 9% and 13%, respectively.\",\"PeriodicalId\":336892,\"journal\":{\"name\":\"Neural Networks, Information and Communication Engineering\",\"volume\":\"12 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2022-06-30\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Neural Networks, Information and Communication Engineering\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1117/12.2639261\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Neural Networks, Information and Communication Engineering","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1117/12.2639261","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Speaker recognition model with robust front-end processing algorithm
The end-to-end speaker recognition model has made a great breakthrough in the research field and practical application scenarios. However, in practical application, we often suffer the diversity of noise, and the interference of noise will affect the performance of speaker recognition and classification model, and the model usually degrades in unseen scenes with noise. In this paper, a speaker recognition model combined with front-end enhancement is proposed. The front-end enhancement model (DTLN or CRNN) is combined with the back-end speaker recognition model (Res2Net-GhostVLAD) to improve the robustness of the model against noisy scenes, and the generalization capability of the model is increased by the data augmentation method (SpecAugment). Our proposed method was trained on VoxCeleb and AISHELL datasets and tested on VoxCeleb datasets. The test results show that the proposed method significantly improves the performance of the speaker recognition model in noisy scenarios, and the relative improvement of different front-end models is 9% and 13%, respectively.