Enhancing biofeedback-driven self-guided virtual reality exposure therapy through arousal detection from multimodal data using machine learning.

Q1 Computer Science Brain Informatics Pub Date : 2023-06-21 DOI:10.1186/s40708-023-00193-9
Muhammad Arifur Rahman, David J Brown, Mufti Mahmud, Matthew Harris, Nicholas Shopland, Nadja Heym, Alexander Sumich, Zakia Batool Turabee, Bradley Standen, David Downes, Yangang Xing, Carolyn Thomas, Sean Haddick, Preethi Premkumar, Simona Nastase, Andrew Burton, James Lewis
{"title":"Enhancing biofeedback-driven self-guided virtual reality exposure therapy through arousal detection from multimodal data using machine learning.","authors":"Muhammad Arifur Rahman,&nbsp;David J Brown,&nbsp;Mufti Mahmud,&nbsp;Matthew Harris,&nbsp;Nicholas Shopland,&nbsp;Nadja Heym,&nbsp;Alexander Sumich,&nbsp;Zakia Batool Turabee,&nbsp;Bradley Standen,&nbsp;David Downes,&nbsp;Yangang Xing,&nbsp;Carolyn Thomas,&nbsp;Sean Haddick,&nbsp;Preethi Premkumar,&nbsp;Simona Nastase,&nbsp;Andrew Burton,&nbsp;James Lewis","doi":"10.1186/s40708-023-00193-9","DOIUrl":null,"url":null,"abstract":"<p><p>Virtual reality exposure therapy (VRET) is a novel intervention technique that allows individuals to experience anxiety-evoking stimuli in a safe environment, recognise specific triggers and gradually increase their exposure to perceived threats. Public-speaking anxiety (PSA) is a prevalent form of social anxiety, characterised by stressful arousal and anxiety generated when presenting to an audience. In self-guided VRET, participants can gradually increase their tolerance to exposure and reduce anxiety-induced arousal and PSA over time. However, creating such a VR environment and determining physiological indices of anxiety-induced arousal or distress is an open challenge. Environment modelling, character creation and animation, psychological state determination and the use of machine learning (ML) models for anxiety or stress detection are equally important, and multi-disciplinary expertise is required. In this work, we have explored a series of ML models with publicly available data sets (using electroencephalogram and heart rate variability) to predict arousal states. If we can detect anxiety-induced arousal, we can trigger calming activities to allow individuals to cope with and overcome distress. Here, we discuss the means of effective selection of ML models and parameters in arousal detection. We propose a pipeline to overcome the model selection problem with different parameter settings in the context of virtual reality exposure therapy. This pipeline can be extended to other domains of interest where arousal detection is crucial. Finally, we have implemented a biofeedback framework for VRET where we successfully provided feedback as a form of heart rate and brain laterality index from our acquired multimodal data for psychological intervention to overcome anxiety.</p>","PeriodicalId":37465,"journal":{"name":"Brain Informatics","volume":"10 1","pages":"14"},"PeriodicalIF":0.0000,"publicationDate":"2023-06-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10284788/pdf/","citationCount":"1","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Brain Informatics","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1186/s40708-023-00193-9","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"Computer Science","Score":null,"Total":0}
引用次数: 1

Abstract

Virtual reality exposure therapy (VRET) is a novel intervention technique that allows individuals to experience anxiety-evoking stimuli in a safe environment, recognise specific triggers and gradually increase their exposure to perceived threats. Public-speaking anxiety (PSA) is a prevalent form of social anxiety, characterised by stressful arousal and anxiety generated when presenting to an audience. In self-guided VRET, participants can gradually increase their tolerance to exposure and reduce anxiety-induced arousal and PSA over time. However, creating such a VR environment and determining physiological indices of anxiety-induced arousal or distress is an open challenge. Environment modelling, character creation and animation, psychological state determination and the use of machine learning (ML) models for anxiety or stress detection are equally important, and multi-disciplinary expertise is required. In this work, we have explored a series of ML models with publicly available data sets (using electroencephalogram and heart rate variability) to predict arousal states. If we can detect anxiety-induced arousal, we can trigger calming activities to allow individuals to cope with and overcome distress. Here, we discuss the means of effective selection of ML models and parameters in arousal detection. We propose a pipeline to overcome the model selection problem with different parameter settings in the context of virtual reality exposure therapy. This pipeline can be extended to other domains of interest where arousal detection is crucial. Finally, we have implemented a biofeedback framework for VRET where we successfully provided feedback as a form of heart rate and brain laterality index from our acquired multimodal data for psychological intervention to overcome anxiety.

Abstract Image

Abstract Image

Abstract Image

查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
通过使用机器学习从多模态数据中进行唤醒检测,增强生物反馈驱动的自我引导虚拟现实暴露治疗。
虚拟现实暴露疗法(VRET)是一种新颖的干预技术,它允许个体在安全的环境中体验引起焦虑的刺激,识别特定的触发因素,并逐渐增加他们对感知威胁的暴露。公共演讲焦虑(PSA)是一种普遍的社交焦虑形式,其特征是在向听众演讲时产生压力性兴奋和焦虑。在自我引导的VRET中,参与者可以逐渐增加对暴露的耐受性,并随着时间的推移减少焦虑引起的唤醒和PSA。然而,创造这样一个虚拟现实环境并确定焦虑引起的唤醒或痛苦的生理指标是一个公开的挑战。环境建模、角色创作和动画、心理状态测定以及使用机器学习(ML)模型进行焦虑或压力检测同样重要,需要多学科的专业知识。在这项工作中,我们利用公开可用的数据集(使用脑电图和心率变异性)探索了一系列ML模型来预测唤醒状态。如果我们能检测到焦虑引起的觉醒,我们就能触发平静活动,让人们应对和克服痛苦。在此,我们讨论了唤醒检测中ML模型和参数的有效选择方法。我们提出了一个管道来克服虚拟现实暴露治疗中不同参数设置的模型选择问题。这个管道可以扩展到其他感兴趣的领域,在那里唤醒检测是至关重要的。最后,我们为VRET实施了一个生物反馈框架,我们成功地从我们获得的多模态数据中提供反馈,作为心率和脑侧性指数的一种形式,用于心理干预,以克服焦虑。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
Brain Informatics
Brain Informatics Computer Science-Computer Science Applications
CiteScore
9.50
自引率
0.00%
发文量
27
审稿时长
13 weeks
期刊介绍: Brain Informatics is an international, peer-reviewed, interdisciplinary open-access journal published under the brand SpringerOpen, which provides a unique platform for researchers and practitioners to disseminate original research on computational and informatics technologies related to brain. This journal addresses the computational, cognitive, physiological, biological, physical, ecological and social perspectives of brain informatics. It also welcomes emerging information technologies and advanced neuro-imaging technologies, such as big data analytics and interactive knowledge discovery related to various large-scale brain studies and their applications. This journal will publish high-quality original research papers, brief reports and critical reviews in all theoretical, technological, clinical and interdisciplinary studies that make up the field of brain informatics and its applications in brain-machine intelligence, brain-inspired intelligent systems, mental health and brain disorders, etc. The scope of papers includes the following five tracks: Track 1: Cognitive and Computational Foundations of Brain Science Track 2: Human Information Processing Systems Track 3: Brain Big Data Analytics, Curation and Management Track 4: Informatics Paradigms for Brain and Mental Health Research Track 5: Brain-Machine Intelligence and Brain-Inspired Computing
期刊最新文献
Novel machine learning-driven comparative analysis of CSP, STFT, and CSP-STFT fusion for EEG data classification across multiple meditation and non-meditation sessions in BCI pipeline. Rethinking the residual approach: leveraging statistical learning to operationalize cognitive resilience in Alzheimer's disease. CalciumZero: a toolbox for fluorescence calcium imaging on iPSC derived brain organoids. Blockchain-enabled digital twin system for brain stroke prediction. A temporal-spectral graph convolutional neural network model for EEG emotion recognition within and across subjects.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1