Automatic recognition and detection of aphasic natural speech

Mara Barberis, Pieter De Clercq, Bastiaan Tamm, Hugo Van hamme, Maaike Vandermosten
{"title":"Automatic recognition and detection of aphasic natural speech","authors":"Mara Barberis, Pieter De Clercq, Bastiaan Tamm, Hugo Van hamme, Maaike Vandermosten","doi":"arxiv-2408.14082","DOIUrl":null,"url":null,"abstract":"Aphasia is a language disorder affecting one third of stroke patients.\nCurrent aphasia assessment does not consider natural speech due to the time\nconsuming nature of manual transcriptions and a lack of knowledge on how to\nanalyze such data. Here, we evaluate the potential of automatic speech\nrecognition (ASR) to transcribe Dutch aphasic speech and the ability of natural\nspeech features to detect aphasia. A picture-description task was administered\nand automatically transcribed in 62 persons with aphasia and 57 controls.\nAcoustic and linguistic features were semi-automatically extracted and provided\nas input to a support vector machine (SVM) classifier. Our ASR model obtained a\nWER of 24.5%, outperforming earlier ASR models for aphasia. The SVM shows high\naccuracy (86.6%) at the individual level, with fluency features as most\ndominant to detect aphasia. ASR and semi-automatic feature extraction can thus\nfacilitate natural speech analysis in a time efficient manner in clinical\npractice.","PeriodicalId":501517,"journal":{"name":"arXiv - QuanBio - Neurons and Cognition","volume":null,"pages":null},"PeriodicalIF":0.0000,"publicationDate":"2024-08-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"arXiv - QuanBio - Neurons and Cognition","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/arxiv-2408.14082","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

Aphasia is a language disorder affecting one third of stroke patients. Current aphasia assessment does not consider natural speech due to the time consuming nature of manual transcriptions and a lack of knowledge on how to analyze such data. Here, we evaluate the potential of automatic speech recognition (ASR) to transcribe Dutch aphasic speech and the ability of natural speech features to detect aphasia. A picture-description task was administered and automatically transcribed in 62 persons with aphasia and 57 controls. Acoustic and linguistic features were semi-automatically extracted and provided as input to a support vector machine (SVM) classifier. Our ASR model obtained a WER of 24.5%, outperforming earlier ASR models for aphasia. The SVM shows high accuracy (86.6%) at the individual level, with fluency features as most dominant to detect aphasia. ASR and semi-automatic feature extraction can thus facilitate natural speech analysis in a time efficient manner in clinical practice.
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
自动识别和检测失语自然语音
失语症是一种语言障碍,影响着三分之一的中风患者。目前的失语症评估并不考虑自然语音,原因是人工转录耗时,而且缺乏如何分析此类数据的知识。在此,我们评估了自动语音识别(ASR)转录荷兰语失语语音的潜力以及自然语音特征检测失语症的能力。我们对 62 名失语症患者和 57 名对照组患者的图片描述任务进行了自动转录,并半自动提取了声学和语言特征,作为支持向量机 (SVM) 分类器的输入。我们的 ASR 模型的误码率为 24.5%,优于早期的失语症 ASR 模型。SVM 在个体水平上显示出较高的准确率(86.6%),其中流利度特征是检测失语症的最主要特征。因此,在临床实践中,ASR 和半自动特征提取能够以省时省力的方式促进自然语音分析。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
自引率
0.00%
发文量
0
期刊最新文献
Early reduced dopaminergic tone mediated by D3 receptor and dopamine transporter in absence epileptogenesis Contrasformer: A Brain Network Contrastive Transformer for Neurodegenerative Condition Identification Identifying Influential nodes in Brain Networks via Self-Supervised Graph-Transformer Contrastive Learning in Memristor-based Neuromorphic Systems Self-Attention Limits Working Memory Capacity of Transformer-Based Models
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1