{"title":"体验项目:通过生物医学信号处理和可解释人工智能实现 \"扩展个人现实 \"的自动虚拟化 [应用园地]","authors":"Gaetano Valenza;Mariano Alcañiz;Vladimir Carli;Gabriela Dudnik;Claudio Gentili;Jaime Guixeres Provinciale;Simone Rossi;Nicola Toschi;Virginie van Wassenhove","doi":"10.1109/MSP.2023.3344430","DOIUrl":null,"url":null,"abstract":"The transformation of communication media has revolutionized social interactions, incorporating audio and video into our lives. Despite the recent availability of virtual reality (VR) technology, its widespread adoption faces obstacles. Technological challenges in creating VR environments and scientific confounding concerning interindividual variability in responses to virtual simulations are key factors hindering its broader integration. The EXPERIENCE project makes real the complex interplay among multisensory perception, emotional responses, and extended social interactions by allowing the public-at-large to create their own VR environments automatically through portable devices (e.g., smartphones/tablets) without the need for technical skills. The VR environment augmented by an individual’s physiological responses, psychological and cognitive descriptors, and behavioral outcomes defines the individual’s subjective experience, namely, an individual’s extended personal reality (EPR). The virtualization of a person’s EPR provides a holistic and quantitative environment that can be shared with others to transfer personalized psychological and emotional responses. Additionally, EPR assessment enables subsequent manipulation of the VR through explainable artificial intelligence (AI) routines merging multisensory biofeedback, individualized perception of time-space, and neuromodulation. This technology can be exploited in a plethora of innovative scenarios, including mental healthcare, gaming, e-learning, and neuroeconomics, also leading to the creation of a new market for sharing and selling (virtual) \n<italic>experiences</i>\n.","PeriodicalId":13246,"journal":{"name":"IEEE Signal Processing Magazine","volume":null,"pages":null},"PeriodicalIF":9.4000,"publicationDate":"2024-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"The EXPERIENCE Project: Automatic virtualization of “extended personal reality” through biomedical signal processing and explainable artificial intelligence [Applications Corner]\",\"authors\":\"Gaetano Valenza;Mariano Alcañiz;Vladimir Carli;Gabriela Dudnik;Claudio Gentili;Jaime Guixeres Provinciale;Simone Rossi;Nicola Toschi;Virginie van Wassenhove\",\"doi\":\"10.1109/MSP.2023.3344430\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"The transformation of communication media has revolutionized social interactions, incorporating audio and video into our lives. Despite the recent availability of virtual reality (VR) technology, its widespread adoption faces obstacles. Technological challenges in creating VR environments and scientific confounding concerning interindividual variability in responses to virtual simulations are key factors hindering its broader integration. The EXPERIENCE project makes real the complex interplay among multisensory perception, emotional responses, and extended social interactions by allowing the public-at-large to create their own VR environments automatically through portable devices (e.g., smartphones/tablets) without the need for technical skills. The VR environment augmented by an individual’s physiological responses, psychological and cognitive descriptors, and behavioral outcomes defines the individual’s subjective experience, namely, an individual’s extended personal reality (EPR). The virtualization of a person’s EPR provides a holistic and quantitative environment that can be shared with others to transfer personalized psychological and emotional responses. Additionally, EPR assessment enables subsequent manipulation of the VR through explainable artificial intelligence (AI) routines merging multisensory biofeedback, individualized perception of time-space, and neuromodulation. This technology can be exploited in a plethora of innovative scenarios, including mental healthcare, gaming, e-learning, and neuroeconomics, also leading to the creation of a new market for sharing and selling (virtual) \\n<italic>experiences</i>\\n.\",\"PeriodicalId\":13246,\"journal\":{\"name\":\"IEEE Signal Processing Magazine\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":9.4000,\"publicationDate\":\"2024-01-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Signal Processing Magazine\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10502139/\",\"RegionNum\":1,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENGINEERING, ELECTRICAL & ELECTRONIC\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Signal Processing Magazine","FirstCategoryId":"5","ListUrlMain":"https://ieeexplore.ieee.org/document/10502139/","RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
The EXPERIENCE Project: Automatic virtualization of “extended personal reality” through biomedical signal processing and explainable artificial intelligence [Applications Corner]
The transformation of communication media has revolutionized social interactions, incorporating audio and video into our lives. Despite the recent availability of virtual reality (VR) technology, its widespread adoption faces obstacles. Technological challenges in creating VR environments and scientific confounding concerning interindividual variability in responses to virtual simulations are key factors hindering its broader integration. The EXPERIENCE project makes real the complex interplay among multisensory perception, emotional responses, and extended social interactions by allowing the public-at-large to create their own VR environments automatically through portable devices (e.g., smartphones/tablets) without the need for technical skills. The VR environment augmented by an individual’s physiological responses, psychological and cognitive descriptors, and behavioral outcomes defines the individual’s subjective experience, namely, an individual’s extended personal reality (EPR). The virtualization of a person’s EPR provides a holistic and quantitative environment that can be shared with others to transfer personalized psychological and emotional responses. Additionally, EPR assessment enables subsequent manipulation of the VR through explainable artificial intelligence (AI) routines merging multisensory biofeedback, individualized perception of time-space, and neuromodulation. This technology can be exploited in a plethora of innovative scenarios, including mental healthcare, gaming, e-learning, and neuroeconomics, also leading to the creation of a new market for sharing and selling (virtual)
experiences
.
期刊介绍:
EEE Signal Processing Magazine is a publication that focuses on signal processing research and applications. It publishes tutorial-style articles, columns, and forums that cover a wide range of topics related to signal processing. The magazine aims to provide the research, educational, and professional communities with the latest technical developments, issues, and events in the field. It serves as the main communication platform for the society, addressing important matters that concern all members.