An EEG signal-based music treatment system for autistic children using edge computing devices

IF 2.1 4区 计算机科学 Q3 COMPUTER SCIENCE, INFORMATION SYSTEMS Wireless Networks Pub Date : 2024-09-10 DOI:10.1007/s11276-024-03826-x
Mingxu Sun, Lingfeng Xiao, Xiujin Zhu, Peng Zhang, Xianping Niu, Tao Shen, Bin Sun, Yuan Xu
{"title":"An EEG signal-based music treatment system for autistic children using edge computing devices","authors":"Mingxu Sun, Lingfeng Xiao, Xiujin Zhu, Peng Zhang, Xianping Niu, Tao Shen, Bin Sun, Yuan Xu","doi":"10.1007/s11276-024-03826-x","DOIUrl":null,"url":null,"abstract":"<p>This paper proposes a system that applies electroencephalogram (EEG) technology to achieve music intervention therapy. The system can identify emotions of autistic children in real-time and play music considering their emotions as a musical treatment to assist the treatment of music therapists and the principle of playing homogenous music is to finally calm people down. The proposed method firstly collects EEG of autistic children using a 14-channel EMOTIV EPOC + and preprocesses signals through bandpass filtering, wavelet decomposition and reconstruction, then extracts frequency band-power characteristics of reconstructed EEG signals. Later, the data are classified as one of the three types of emotions (positive, middle and negative) using a support vector machine (SVM). The system also displays the recognized emotion type on a user interface and gives real-time emotional state feedback on emotional changes, which helps music therapists to evaluate the treatment and results more conveniently and effectively. Real EEG data are used to conduct the verification of system feasibility which reaches a classification accuracy of 88%. As the Internet of Things develops, the combination of edge computing with Wise Information Technology of 120 (WIT120) becomes a new trend. In this work, we propose a system to combine edge computing devices with cloud computing resources to form the music regulation system for autistic children to meet processing requirements for EEG signals in terms of timeliness and computational performance. In the designed system, preprocessing EEG signals is done in edge nodes then the preprocessed signals are sent to the cloud where frequency band-power characteristics can be extracted as features to be used in SVM. At last, the results are sent to a mobile app or computer software for therapists to evaluate.</p>","PeriodicalId":23750,"journal":{"name":"Wireless Networks","volume":"4 1","pages":""},"PeriodicalIF":2.1000,"publicationDate":"2024-09-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Wireless Networks","FirstCategoryId":"94","ListUrlMain":"https://doi.org/10.1007/s11276-024-03826-x","RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"COMPUTER SCIENCE, INFORMATION SYSTEMS","Score":null,"Total":0}
引用次数: 0

Abstract

This paper proposes a system that applies electroencephalogram (EEG) technology to achieve music intervention therapy. The system can identify emotions of autistic children in real-time and play music considering their emotions as a musical treatment to assist the treatment of music therapists and the principle of playing homogenous music is to finally calm people down. The proposed method firstly collects EEG of autistic children using a 14-channel EMOTIV EPOC + and preprocesses signals through bandpass filtering, wavelet decomposition and reconstruction, then extracts frequency band-power characteristics of reconstructed EEG signals. Later, the data are classified as one of the three types of emotions (positive, middle and negative) using a support vector machine (SVM). The system also displays the recognized emotion type on a user interface and gives real-time emotional state feedback on emotional changes, which helps music therapists to evaluate the treatment and results more conveniently and effectively. Real EEG data are used to conduct the verification of system feasibility which reaches a classification accuracy of 88%. As the Internet of Things develops, the combination of edge computing with Wise Information Technology of 120 (WIT120) becomes a new trend. In this work, we propose a system to combine edge computing devices with cloud computing resources to form the music regulation system for autistic children to meet processing requirements for EEG signals in terms of timeliness and computational performance. In the designed system, preprocessing EEG signals is done in edge nodes then the preprocessed signals are sent to the cloud where frequency band-power characteristics can be extracted as features to be used in SVM. At last, the results are sent to a mobile app or computer software for therapists to evaluate.

Abstract Image

查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
利用边缘计算设备为自闭症儿童设计基于脑电信号的音乐治疗系统
本文提出了一种应用脑电图(EEG)技术实现音乐干预治疗的系统。该系统可以实时识别自闭症儿童的情绪,并根据其情绪播放音乐,作为音乐治疗辅助音乐治疗师的治疗,播放同质音乐的原理是使人最终平静下来。该方法首先使用 14 通道 EMOTIV EPOC + 采集自闭症儿童的脑电图,通过带通滤波、小波分解和重构对信号进行预处理,然后提取重构脑电信号的频带功率特征。然后,利用支持向量机(SVM)将数据分类为三种情绪类型(积极情绪、中间情绪和消极情绪)之一。系统还将识别出的情绪类型显示在用户界面上,并实时反馈情绪变化状态,从而帮助音乐治疗师更方便有效地评估治疗方法和效果。真实的脑电图数据用于验证系统的可行性,分类准确率达到 88%。随着物联网的发展,边缘计算与 "智慧 120"(WIT120)信息技术的结合成为一种新趋势。在这项工作中,我们提出了一个系统,将边缘计算设备与云计算资源相结合,形成自闭症儿童音乐调节系统,以满足脑电信号在时效性和计算性能方面的处理要求。在所设计的系统中,先在边缘节点上对脑电信号进行预处理,然后将预处理后的信号发送到云端,在云端提取频段-功率特征作为 SVM 的特征。最后,将结果发送到移动应用程序或计算机软件,供治疗师进行评估。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
Wireless Networks
Wireless Networks 工程技术-电信学
CiteScore
7.70
自引率
3.30%
发文量
314
审稿时长
5.5 months
期刊介绍: The wireless communication revolution is bringing fundamental changes to data networking, telecommunication, and is making integrated networks a reality. By freeing the user from the cord, personal communications networks, wireless LAN''s, mobile radio networks and cellular systems, harbor the promise of fully distributed mobile computing and communications, any time, anywhere. Focusing on the networking and user aspects of the field, Wireless Networks provides a global forum for archival value contributions documenting these fast growing areas of interest. The journal publishes refereed articles dealing with research, experience and management issues of wireless networks. Its aim is to allow the reader to benefit from experience, problems and solutions described.
期刊最新文献
An EEG signal-based music treatment system for autistic children using edge computing devices A DV-Hop localization algorithm corrected based on multi-strategy sparrow algorithm in sea-surface wireless sensor networks Multi-Layer Collaborative Federated Learning architecture for 6G Open RAN Cloud-edge collaboration-based task offloading strategy in railway IoT for intelligent detection Exploiting data transmission for route discoveries in mobile ad hoc networks
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1