使用卷积神经网络的自动口语识别

L. Gris, Arnaldo Candido Junior
{"title":"使用卷积神经网络的自动口语识别","authors":"L. Gris, Arnaldo Candido Junior","doi":"10.5753/latinoware.2020.18603","DOIUrl":null,"url":null,"abstract":"Automatic Spoken Language Identification systems classify the spoken language automatically and can be used in many tasks, for example, to support Automatic Speech Recognition or Video Recommendation systems. In this work, we propose an automatic language identification model obtained through a Convolutional Neural Network trained over audio spectrograms on Portuguese, English and Spanish languages. The audio for the model training was obtained through audiobooks and different corpora for speech recognition systems. The audios were used to generate instances having five seconds each. We addressed the limitation of having few speakers in our dataset with simple data augmentation techniques such as speed and pitch changing on the original instances to increase the size of the dataset. The proposed model was optimized with a random hyperparameter search which provided a final model able to identify the proposed languages with 83% of accuracy on a new, unseen test data, made with audios from different sources.","PeriodicalId":119415,"journal":{"name":"Anais do XVII Congresso Latino-Americano de Software Livre e Tecnologias Abertas (Latinoware 2020)","volume":"38 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2020-12-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"3","resultStr":"{\"title\":\"Automatic Spoken Language Identification using Convolutional Neural Networks\",\"authors\":\"L. Gris, Arnaldo Candido Junior\",\"doi\":\"10.5753/latinoware.2020.18603\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Automatic Spoken Language Identification systems classify the spoken language automatically and can be used in many tasks, for example, to support Automatic Speech Recognition or Video Recommendation systems. In this work, we propose an automatic language identification model obtained through a Convolutional Neural Network trained over audio spectrograms on Portuguese, English and Spanish languages. The audio for the model training was obtained through audiobooks and different corpora for speech recognition systems. The audios were used to generate instances having five seconds each. We addressed the limitation of having few speakers in our dataset with simple data augmentation techniques such as speed and pitch changing on the original instances to increase the size of the dataset. The proposed model was optimized with a random hyperparameter search which provided a final model able to identify the proposed languages with 83% of accuracy on a new, unseen test data, made with audios from different sources.\",\"PeriodicalId\":119415,\"journal\":{\"name\":\"Anais do XVII Congresso Latino-Americano de Software Livre e Tecnologias Abertas (Latinoware 2020)\",\"volume\":\"38 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2020-12-02\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"3\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Anais do XVII Congresso Latino-Americano de Software Livre e Tecnologias Abertas (Latinoware 2020)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.5753/latinoware.2020.18603\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Anais do XVII Congresso Latino-Americano de Software Livre e Tecnologias Abertas (Latinoware 2020)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.5753/latinoware.2020.18603","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 3

摘要

自动口语识别系统自动对口语进行分类,并可用于许多任务,例如,支持自动语音识别或视频推荐系统。在这项工作中,我们提出了一个自动语言识别模型,该模型通过在葡萄牙语、英语和西班牙语的音频谱图上训练的卷积神经网络获得。通过有声读物和语音识别系统的不同语料库获取模型训练所需的音频。音频被用来生成实例,每个实例有5秒。我们通过简单的数据增强技术(如在原始实例上改变速度和音高)来解决数据集中说话人很少的限制,以增加数据集的大小。通过随机超参数搜索对所提出的模型进行了优化,最终模型能够在新的、未见过的、由不同来源的音频制作的测试数据上以83%的准确率识别所提出的语言。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
Automatic Spoken Language Identification using Convolutional Neural Networks
Automatic Spoken Language Identification systems classify the spoken language automatically and can be used in many tasks, for example, to support Automatic Speech Recognition or Video Recommendation systems. In this work, we propose an automatic language identification model obtained through a Convolutional Neural Network trained over audio spectrograms on Portuguese, English and Spanish languages. The audio for the model training was obtained through audiobooks and different corpora for speech recognition systems. The audios were used to generate instances having five seconds each. We addressed the limitation of having few speakers in our dataset with simple data augmentation techniques such as speed and pitch changing on the original instances to increase the size of the dataset. The proposed model was optimized with a random hyperparameter search which provided a final model able to identify the proposed languages with 83% of accuracy on a new, unseen test data, made with audios from different sources.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
期刊最新文献
Protótipo de Irrigação automatizada enquanto ferramenta para o ensino de computação: A Teoria na Prática Avaliando a Geração de Buzz de Issues em Comunidades de Softwares de Código-Aberto Um Framework para facilitar o desenvolvimento de aplicativos para extração e processamento de informações de várias fontes Mapa dinâmico com OpenStreetMap e biblioteca Leaflet: Um estudo de caso de mapeamento da COVID-19 no Brasil Protótipo para monitoramento e controle do tubo de descarga em colhedoras de forragens
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1