体验项目:通过生物医学信号处理和可解释人工智能实现 "扩展个人现实 "的自动虚拟化 [应用园地]

IF 9.4 1区 工程技术 Q1 ENGINEERING, ELECTRICAL & ELECTRONIC IEEE Signal Processing Magazine Pub Date : 2024-01-01 DOI:10.1109/MSP.2023.3344430
Gaetano Valenza;Mariano Alcañiz;Vladimir Carli;Gabriela Dudnik;Claudio Gentili;Jaime Guixeres Provinciale;Simone Rossi;Nicola Toschi;Virginie van Wassenhove
{"title":"体验项目:通过生物医学信号处理和可解释人工智能实现 \"扩展个人现实 \"的自动虚拟化 [应用园地]","authors":"Gaetano Valenza;Mariano Alcañiz;Vladimir Carli;Gabriela Dudnik;Claudio Gentili;Jaime Guixeres Provinciale;Simone Rossi;Nicola Toschi;Virginie van Wassenhove","doi":"10.1109/MSP.2023.3344430","DOIUrl":null,"url":null,"abstract":"The transformation of communication media has revolutionized social interactions, incorporating audio and video into our lives. Despite the recent availability of virtual reality (VR) technology, its widespread adoption faces obstacles. Technological challenges in creating VR environments and scientific confounding concerning interindividual variability in responses to virtual simulations are key factors hindering its broader integration. The EXPERIENCE project makes real the complex interplay among multisensory perception, emotional responses, and extended social interactions by allowing the public-at-large to create their own VR environments automatically through portable devices (e.g., smartphones/tablets) without the need for technical skills. The VR environment augmented by an individual’s physiological responses, psychological and cognitive descriptors, and behavioral outcomes defines the individual’s subjective experience, namely, an individual’s extended personal reality (EPR). The virtualization of a person’s EPR provides a holistic and quantitative environment that can be shared with others to transfer personalized psychological and emotional responses. Additionally, EPR assessment enables subsequent manipulation of the VR through explainable artificial intelligence (AI) routines merging multisensory biofeedback, individualized perception of time-space, and neuromodulation. This technology can be exploited in a plethora of innovative scenarios, including mental healthcare, gaming, e-learning, and neuroeconomics, also leading to the creation of a new market for sharing and selling (virtual) \n<italic>experiences</i>\n.","PeriodicalId":13246,"journal":{"name":"IEEE Signal Processing Magazine","volume":"41 1","pages":"60-66"},"PeriodicalIF":9.4000,"publicationDate":"2024-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"The EXPERIENCE Project: Automatic virtualization of “extended personal reality” through biomedical signal processing and explainable artificial intelligence [Applications Corner]\",\"authors\":\"Gaetano Valenza;Mariano Alcañiz;Vladimir Carli;Gabriela Dudnik;Claudio Gentili;Jaime Guixeres Provinciale;Simone Rossi;Nicola Toschi;Virginie van Wassenhove\",\"doi\":\"10.1109/MSP.2023.3344430\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"The transformation of communication media has revolutionized social interactions, incorporating audio and video into our lives. Despite the recent availability of virtual reality (VR) technology, its widespread adoption faces obstacles. Technological challenges in creating VR environments and scientific confounding concerning interindividual variability in responses to virtual simulations are key factors hindering its broader integration. The EXPERIENCE project makes real the complex interplay among multisensory perception, emotional responses, and extended social interactions by allowing the public-at-large to create their own VR environments automatically through portable devices (e.g., smartphones/tablets) without the need for technical skills. The VR environment augmented by an individual’s physiological responses, psychological and cognitive descriptors, and behavioral outcomes defines the individual’s subjective experience, namely, an individual’s extended personal reality (EPR). The virtualization of a person’s EPR provides a holistic and quantitative environment that can be shared with others to transfer personalized psychological and emotional responses. Additionally, EPR assessment enables subsequent manipulation of the VR through explainable artificial intelligence (AI) routines merging multisensory biofeedback, individualized perception of time-space, and neuromodulation. This technology can be exploited in a plethora of innovative scenarios, including mental healthcare, gaming, e-learning, and neuroeconomics, also leading to the creation of a new market for sharing and selling (virtual) \\n<italic>experiences</i>\\n.\",\"PeriodicalId\":13246,\"journal\":{\"name\":\"IEEE Signal Processing Magazine\",\"volume\":\"41 1\",\"pages\":\"60-66\"},\"PeriodicalIF\":9.4000,\"publicationDate\":\"2024-01-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Signal Processing Magazine\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10502139/\",\"RegionNum\":1,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENGINEERING, ELECTRICAL & ELECTRONIC\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Signal Processing Magazine","FirstCategoryId":"5","ListUrlMain":"https://ieeexplore.ieee.org/document/10502139/","RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0

摘要

通信媒体的变革彻底改变了社交互动,将音频和视频融入了我们的生活。尽管最近虚拟现实(VR)技术已经问世,但其广泛应用仍面临障碍。创建 VR 环境所面临的技术挑战,以及对虚拟仿真反应的个体差异的科学混淆,都是阻碍其广泛应用的关键因素。EXPERIENCE 项目通过让广大公众通过便携式设备(如智能手机/平板电脑)自动创建自己的 VR 环境,使多感官感知、情绪反应和扩展的社会互动之间复杂的相互作用成为现实,而无需技术技能。由个人生理反应、心理和认知描述以及行为结果增强的 VR 环境定义了个人的主观体验,即个人的扩展个人现实(EPR)。个人 EPR 的虚拟化提供了一个整体的量化环境,可与他人共享,以传递个性化的心理和情感反应。此外,EPR 评估可通过可解释的人工智能(AI)程序对虚拟现实进行后续操作,这些程序融合了多感官生物反馈、个性化时空感知和神经调节。这项技术可以在心理保健、游戏、电子学习和神经经济学等大量创新方案中加以利用,还能创造一个分享和销售(虚拟)体验的新市场。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
The EXPERIENCE Project: Automatic virtualization of “extended personal reality” through biomedical signal processing and explainable artificial intelligence [Applications Corner]
The transformation of communication media has revolutionized social interactions, incorporating audio and video into our lives. Despite the recent availability of virtual reality (VR) technology, its widespread adoption faces obstacles. Technological challenges in creating VR environments and scientific confounding concerning interindividual variability in responses to virtual simulations are key factors hindering its broader integration. The EXPERIENCE project makes real the complex interplay among multisensory perception, emotional responses, and extended social interactions by allowing the public-at-large to create their own VR environments automatically through portable devices (e.g., smartphones/tablets) without the need for technical skills. The VR environment augmented by an individual’s physiological responses, psychological and cognitive descriptors, and behavioral outcomes defines the individual’s subjective experience, namely, an individual’s extended personal reality (EPR). The virtualization of a person’s EPR provides a holistic and quantitative environment that can be shared with others to transfer personalized psychological and emotional responses. Additionally, EPR assessment enables subsequent manipulation of the VR through explainable artificial intelligence (AI) routines merging multisensory biofeedback, individualized perception of time-space, and neuromodulation. This technology can be exploited in a plethora of innovative scenarios, including mental healthcare, gaming, e-learning, and neuroeconomics, also leading to the creation of a new market for sharing and selling (virtual) experiences .
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
IEEE Signal Processing Magazine
IEEE Signal Processing Magazine 工程技术-工程:电子与电气
CiteScore
27.20
自引率
0.70%
发文量
123
审稿时长
6-12 weeks
期刊介绍: EEE Signal Processing Magazine is a publication that focuses on signal processing research and applications. It publishes tutorial-style articles, columns, and forums that cover a wide range of topics related to signal processing. The magazine aims to provide the research, educational, and professional communities with the latest technical developments, issues, and events in the field. It serves as the main communication platform for the society, addressing important matters that concern all members.
期刊最新文献
Front Cover Table of Contents Masthead Calendar [Dates Ahead] Integrating Sensing and Communications: Simultaneously Transmitting and Reflecting Digital Coding Metasurfaces: A successful convergence of physics and signal processsing [Special Issue on Signal Processing for the Integrated Sensing and Communications Revolution]
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1