Detecting Wilson's disease from unstructured connected speech: An embedding-based approach augmented by attention and bi-directional dependency

IF 2.4 3区 计算机科学 Q2 ACOUSTICS Speech Communication Pub Date : 2023-11-17 DOI:10.1016/j.specom.2023.103011
Zhenglin Zhang , Li-Zhuang Yang , Xun Wang , Hongzhi Wang , Stephen T.C. Wong , Hai Li
{"title":"Detecting Wilson's disease from unstructured connected speech: An embedding-based approach augmented by attention and bi-directional dependency","authors":"Zhenglin Zhang ,&nbsp;Li-Zhuang Yang ,&nbsp;Xun Wang ,&nbsp;Hongzhi Wang ,&nbsp;Stephen T.C. Wong ,&nbsp;Hai Li","doi":"10.1016/j.specom.2023.103011","DOIUrl":null,"url":null,"abstract":"<div><p>Wilson's disease (WD) is a neurodegenerative genetic disorder in which dysarthria is the initial neurological symptom. Automated WD diagnosis from speech is thus a promising and clinically valuable approach. The present study investigates the feasibility of WD detection from unstructured connected speech (UCS) using the embedding-based approach augmented by the attention mechanism and bi-directional dependency. The classification experiment was conducted with a sample of 55 WD patients and 55 matched healthy individuals. We compare the proposed embedding approach with two models: the baseline method using the structured task and the model using conventional acoustic features. Results show that the embedding-based model achieves the best accuracy of 90.3 %, which is 4.2 % and 7 % better than the baseline and acoustic approaches, respectively. The bi-directional semantic dependency and attention mechanism can significantly improve detection performance. Moreover, we reveal that the duration of the UCS task affects the model performance, with favorable results achieved using approximately 30 s epochs. Our method provides new insights into the detection of dysarthria-related disorders.</p></div>","PeriodicalId":49485,"journal":{"name":"Speech Communication","volume":"156 ","pages":"Article 103011"},"PeriodicalIF":2.4000,"publicationDate":"2023-11-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S0167639323001450/pdfft?md5=f433bbc4cd8c673c67c80300ad3c60c4&pid=1-s2.0-S0167639323001450-main.pdf","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Speech Communication","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0167639323001450","RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ACOUSTICS","Score":null,"Total":0}
引用次数: 0

Abstract

Wilson's disease (WD) is a neurodegenerative genetic disorder in which dysarthria is the initial neurological symptom. Automated WD diagnosis from speech is thus a promising and clinically valuable approach. The present study investigates the feasibility of WD detection from unstructured connected speech (UCS) using the embedding-based approach augmented by the attention mechanism and bi-directional dependency. The classification experiment was conducted with a sample of 55 WD patients and 55 matched healthy individuals. We compare the proposed embedding approach with two models: the baseline method using the structured task and the model using conventional acoustic features. Results show that the embedding-based model achieves the best accuracy of 90.3 %, which is 4.2 % and 7 % better than the baseline and acoustic approaches, respectively. The bi-directional semantic dependency and attention mechanism can significantly improve detection performance. Moreover, we reveal that the duration of the UCS task affects the model performance, with favorable results achieved using approximately 30 s epochs. Our method provides new insights into the detection of dysarthria-related disorders.

查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
从非结构化连接语音中检测威尔逊氏病:一种基于嵌入的方法,增强了注意力和双向依赖
威尔逊氏病(WD)是一种神经退行性遗传疾病,其中构音障碍是最初的神经症状。因此,从语音中自动诊断WD是一种有前途和临床价值的方法。本研究利用基于嵌入的方法,结合注意机制和双向依赖,探讨了从非结构化连接语音(UCS)中检测WD的可行性。分类实验以55例WD患者和55例匹配的健康个体为样本。我们将所提出的嵌入方法与两种模型进行了比较:使用结构化任务的基线方法和使用常规声学特征的模型。结果表明,基于嵌入的模型达到了90.3%的最佳精度,比基线方法和声学方法分别提高了4.2%和7%。双向语义依赖和注意机制可以显著提高检测性能。此外,我们发现UCS任务的持续时间会影响模型的性能,使用大约30秒的时间就可以获得良好的结果。我们的方法为构音障碍相关疾病的检测提供了新的见解。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
Speech Communication
Speech Communication 工程技术-计算机:跨学科应用
CiteScore
6.80
自引率
6.20%
发文量
94
审稿时长
19.2 weeks
期刊介绍: Speech Communication is an interdisciplinary journal whose primary objective is to fulfil the need for the rapid dissemination and thorough discussion of basic and applied research results. The journal''s primary objectives are: • to present a forum for the advancement of human and human-machine speech communication science; • to stimulate cross-fertilization between different fields of this domain; • to contribute towards the rapid and wide diffusion of scientifically sound contributions in this domain.
期刊最新文献
A new universal camouflage attack algorithm for intelligent speech system Fixed frequency range empirical wavelet transform based acoustic and entropy features for speech emotion recognition AFP-Conformer: Asymptotic feature pyramid conformer for spoofing speech detection A robust temporal map of speech monitoring from planning to articulation The combined effects of bilingualism and musicianship on listeners’ perception of non-native lexical tones
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1