COMPUTER-AIDED THERAPY USING AUTOMATIC SPEECH RECOGNITION TECHNIQUE FOR DELAYED LANGUAGE DEVELOPMENT CHILDREN

Hala S. Abuelmakarem, S. Fawzi, A. Quriba, Ahmed Elbialy, A. Kandil
{"title":"COMPUTER-AIDED THERAPY USING AUTOMATIC SPEECH RECOGNITION TECHNIQUE FOR DELAYED LANGUAGE DEVELOPMENT CHILDREN","authors":"Hala S. Abuelmakarem, S. Fawzi, A. Quriba, Ahmed Elbialy, A. Kandil","doi":"10.4015/s1016237222500235","DOIUrl":null,"url":null,"abstract":"Objectives: This study aims to develop a computer-aided therapy (CAT) application to help children who suffer from delayed language development (DLD) improve their language, especially during the COVID-19 pandemic. Methods: The implemented system teaches the children their body parts using the Egyptian dialect. Two datasets were collected from healthy children (2800 words) and unhealthy children (236 words) who have DLD at the clinic. The model is implemented using a speaker-independent isolated word recognizer based on a discrete-observation hidden Markov model (DHMM) classifier. After the speech signal preprocessing step, K-means algorithm generated a codebook to cluster the speech segments. This task was completed under the MATLAB environment. The graphical user interface was implemented successfully under the C# umbrella to complete the CAT application task. The system was tested on healthy and DLD children. Also, in a small clinical trial, five children who have DLD tested the program in an actual trial to monitor their pronunciation progress during therapeutic sessions. Results: The max recognition rate was 95.25% for the healthy children dataset, while 93.82% for the DLD dataset. Conclusion: DHMM was implemented successfully using nine and five states based on different codebook sizes (160, 200). The implemented system achieved a high recognition rate using both datasets. The children enjoyed using the application because it was interactive. Children who have DLD can use speech recognition applications.","PeriodicalId":8862,"journal":{"name":"Biomedical Engineering: Applications, Basis and Communications","volume":"397 1","pages":""},"PeriodicalIF":0.6000,"publicationDate":"2022-03-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Biomedical Engineering: Applications, Basis and Communications","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.4015/s1016237222500235","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q4","JCRName":"ENGINEERING, BIOMEDICAL","Score":null,"Total":0}
引用次数: 0

Abstract

Objectives: This study aims to develop a computer-aided therapy (CAT) application to help children who suffer from delayed language development (DLD) improve their language, especially during the COVID-19 pandemic. Methods: The implemented system teaches the children their body parts using the Egyptian dialect. Two datasets were collected from healthy children (2800 words) and unhealthy children (236 words) who have DLD at the clinic. The model is implemented using a speaker-independent isolated word recognizer based on a discrete-observation hidden Markov model (DHMM) classifier. After the speech signal preprocessing step, K-means algorithm generated a codebook to cluster the speech segments. This task was completed under the MATLAB environment. The graphical user interface was implemented successfully under the C# umbrella to complete the CAT application task. The system was tested on healthy and DLD children. Also, in a small clinical trial, five children who have DLD tested the program in an actual trial to monitor their pronunciation progress during therapeutic sessions. Results: The max recognition rate was 95.25% for the healthy children dataset, while 93.82% for the DLD dataset. Conclusion: DHMM was implemented successfully using nine and five states based on different codebook sizes (160, 200). The implemented system achieved a high recognition rate using both datasets. The children enjoyed using the application because it was interactive. Children who have DLD can use speech recognition applications.
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
使用自动语音识别技术的计算机辅助治疗语言发育迟缓儿童
目的:本研究旨在开发一种计算机辅助治疗(CAT)应用程序,以帮助患有语言发育迟缓(DLD)的儿童提高语言能力,特别是在COVID-19大流行期间。方法:采用埃及方言对幼儿进行身体部位教学。从门诊患有DLD的健康儿童(2800字)和不健康儿童(236字)中收集两个数据集。该模型采用基于离散观测隐马尔可夫模型(DHMM)分类器的独立于说话人的孤立词识别器实现。语音信号预处理后,K-means算法生成码本对语音片段进行聚类。本任务是在MATLAB环境下完成的。图形用户界面在c#的保护伞下成功实现,完成了CAT应用任务。该系统在健康儿童和残疾儿童身上进行了测试。此外,在一项小型临床试验中,五名患有DLD的儿童在实际试验中测试了该程序,以监测他们在治疗期间的发音进展。结果:健康儿童数据集的最大识别率为95.25%,DLD数据集的最大识别率为93.82%。结论:基于不同码本大小的九种状态和五种状态(160,200)均可成功实现DHMM。实现的系统在使用两个数据集的情况下取得了较高的识别率。孩子们喜欢使用这个应用程序,因为它是交互式的。患有DLD的儿童可以使用语音识别应用程序。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
Biomedical Engineering: Applications, Basis and Communications
Biomedical Engineering: Applications, Basis and Communications Biochemistry, Genetics and Molecular Biology-Biophysics
CiteScore
1.50
自引率
11.10%
发文量
36
审稿时长
4 months
期刊介绍: Biomedical Engineering: Applications, Basis and Communications is an international, interdisciplinary journal aiming at publishing up-to-date contributions on original clinical and basic research in the biomedical engineering. Research of biomedical engineering has grown tremendously in the past few decades. Meanwhile, several outstanding journals in the field have emerged, with different emphases and objectives. We hope this journal will serve as a new forum for both scientists and clinicians to share their ideas and the results of their studies. Biomedical Engineering: Applications, Basis and Communications explores all facets of biomedical engineering, with emphasis on both the clinical and scientific aspects of the study. It covers the fields of bioelectronics, biomaterials, biomechanics, bioinformatics, nano-biological sciences and clinical engineering. The journal fulfils this aim by publishing regular research / clinical articles, short communications, technical notes and review papers. Papers from both basic research and clinical investigations will be considered.
期刊最新文献
CORRELATION OF POINCARE PLOT DERIVED STRESS SCORE AND HEART RATE VARIABILITY PARAMETERS IN THE ASSESSMENT OF CORONARY ARTERY DISEASE HEURISTIC-ASSISTED ADAPTIVE HYBRID DEEP LEARNING MODEL WITH FEATURE SELECTION FOR EPILEPSY DETECTION USING EEG SIGNALS MAGNETIC RESONANCE IMAGE DENOIZING USING A DUAL-CHANNEL DISCRIMINATIVE DENOIZING NETWORK PREDICTION OF EPILEPSY BASED ON EEMD AND LSSVM DOUBLE CLASSIFICATION FILTER SELECTION FOR REMOVING NOISE FROM CT SCAN IMAGES USING DIGITAL IMAGE PROCESSING ALGORITHM
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1