首页 > 最新文献

Augmented Human Research最新文献

英文 中文
Augmented Cognition via Brainwave Entrainment in Virtual Reality: An Open, Integrated Brain Augmentation in a Neuroscience System Approach 增强认知通过脑波夹带在虚拟现实:一个开放的,集成的大脑增强在神经科学系统的方法
Pub Date : 2017-02-28 DOI: 10.1007/s41133-017-0005-3
Emanuele Argento, George Papagiannakis, Eva Baka, Michail Maniadakis, Panos Trahanias, Michael Sfakianakis, Ioannis Nestoros

Building on augmented cognition theory and technology, our novel contribution in this work enables accelerated, certain brain functions related to task performance as well as their enhancement. We integrated in an open-source framework, latest immersive virtual reality (VR) head-mounted displays, with the Emotiv EPOC EEG headset in an open neuro- and biofeedback system for cognitive state detection and augmentation. Our novel methodology allows to significantly accelerate content presentation in immersive VR, while lowering brain frequency at alpha level—without losing content retention by the user. In our pilot experiments, we tested our innovative VR platform by presenting to N = 25 subjects a complex 3D maze test and different learning procedures for them on how to exit it. The subjects exposed to our VR-induced entrainment learning technology performed significantly better than those exposed to other “classical” learning procedures. In particular, cognitive task performance augmentation was measured for: learning time, complex navigational skills and decision-making abilities, orientation ability.

在增强认知理论和技术的基础上,我们在这项工作中的新贡献使与任务表现相关的某些大脑功能加速并得到增强。我们在一个开源框架中集成了最新的沉浸式虚拟现实(VR)头戴式显示器,以及开放式神经和生物反馈系统中的Emotiv EPOC脑电图耳机,用于认知状态检测和增强。我们的新方法可以显著加快沉浸式VR中的内容呈现,同时降低阿尔法级别的大脑频率,而不会失去用户对内容的保留。在我们的试点实验中,我们测试了我们的创新VR平台,向N=25名受试者展示了一个复杂的3D迷宫测试,以及他们如何退出的不同学习程序。接触我们的VR诱导的夹带学习技术的受试者表现明显好于接触其他“经典”学习程序的受试。特别是,认知任务绩效的提高是针对:学习时间、复杂的导航技能和决策能力、定向能力。
{"title":"Augmented Cognition via Brainwave Entrainment in Virtual Reality: An Open, Integrated Brain Augmentation in a Neuroscience System Approach","authors":"Emanuele Argento,&nbsp;George Papagiannakis,&nbsp;Eva Baka,&nbsp;Michail Maniadakis,&nbsp;Panos Trahanias,&nbsp;Michael Sfakianakis,&nbsp;Ioannis Nestoros","doi":"10.1007/s41133-017-0005-3","DOIUrl":"10.1007/s41133-017-0005-3","url":null,"abstract":"<div><p>Building on augmented cognition theory and technology, our novel contribution in this work enables accelerated, certain brain functions related to task performance as well as their enhancement. We integrated in an open-source framework, latest immersive virtual reality (VR) head-mounted displays, with the Emotiv EPOC EEG headset in an open neuro- and biofeedback system for cognitive state detection and augmentation. Our novel methodology allows to significantly accelerate content presentation in immersive VR, while lowering brain frequency at alpha level—without losing content retention by the user. In our pilot experiments, we tested our innovative VR platform by presenting to <i>N</i> = 25 subjects a complex 3D maze test and different learning procedures for them on how to exit it. The subjects exposed to our VR-induced entrainment learning technology performed significantly better than those exposed to other “classical” learning procedures. In particular, cognitive task performance augmentation was measured for: learning time, complex navigational skills and decision-making abilities, orientation ability.</p></div>","PeriodicalId":100147,"journal":{"name":"Augmented Human Research","volume":"2 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2017-02-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1007/s41133-017-0005-3","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"50051026","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 9
Measuring Affective Well-Being by the Combination of the Day Reconstruction Method and a Wearable Device: Case Study of an Aging and Depopulating Community in Japan 日重建法与可穿戴设备相结合的情感幸福感测量:日本老龄化和人口减少社区的案例研究
Pub Date : 2017-02-23 DOI: 10.1007/s41133-017-0006-2
Junichirou Ishio, Naoya Abe

Affective well-being indicates the changes in the predominance of positive or negative affects of people in response to their daily experiences. For measuring affective well-being, people are usually asked to indicate their affective states in several episodes that they experienced in a day. However, such conventional methods have been problematic in terms of their burdensomeness on participants and the validity of the rating. To overcome these problems, we attempted to introduce a new approach for measuring affective states, based on the combination of the day reconstruction method and the measurement of physiological stress levels by a wristband-type wearable device. As the indicator of physiological stress levels, we used heart rate variability calculated from the data recorded by the device. We examined the interpretability of the physiological stress level as a substitute for affective states by applying this combinational approach to an aging and depopulating village in Japan, because the well-being of the residents in such areas is a matter of public concern. As a result, we could depict the sources of affective well-being and the physiological stressors in the village. We also found a reasonable, but weak, correlation between the scores of affective states and the indicator of physiological stress levels. We discussed the challenges that should be overcome for utilizing the physiological stress level as a substitute for affective state.

情感幸福感是指人们对日常经历的积极或消极影响占主导地位的变化。为了衡量情感幸福感,人们通常被要求在一天中经历的几次事件中表明他们的情感状态。然而,就参与者的负担和评级的有效性而言,这种传统方法一直存在问题。为了克服这些问题,我们试图引入一种测量情感状态的新方法,该方法基于白天重建方法和通过腕带型可穿戴设备测量生理压力水平的组合。作为生理压力水平的指标,我们使用了根据设备记录的数据计算的心率变异性。我们通过将这种组合方法应用于日本一个老龄化和人口减少的村庄,研究了生理压力水平作为情感状态替代品的可解释性,因为这些地区居民的福祉是公众关注的问题。因此,我们可以描述村庄中情感幸福感的来源和生理压力源。我们还发现,情感状态得分与生理压力水平指标之间存在合理但较弱的相关性。我们讨论了利用生理压力水平代替情感状态应该克服的挑战。
{"title":"Measuring Affective Well-Being by the Combination of the Day Reconstruction Method and a Wearable Device: Case Study of an Aging and Depopulating Community in Japan","authors":"Junichirou Ishio,&nbsp;Naoya Abe","doi":"10.1007/s41133-017-0006-2","DOIUrl":"10.1007/s41133-017-0006-2","url":null,"abstract":"<div><p>Affective well-being indicates the changes in the predominance of positive or negative affects of people in response to their daily experiences. For measuring affective well-being, people are usually asked to indicate their affective states in several episodes that they experienced in a day. However, such conventional methods have been problematic in terms of their burdensomeness on participants and the validity of the rating. To overcome these problems, we attempted to introduce a new approach for measuring affective states, based on the combination of the day reconstruction method and the measurement of physiological stress levels by a wristband-type wearable device. As the indicator of physiological stress levels, we used heart rate variability calculated from the data recorded by the device. We examined the interpretability of the physiological stress level as a substitute for affective states by applying this combinational approach to an aging and depopulating village in Japan, because the well-being of the residents in such areas is a matter of public concern. As a result, we could depict the sources of affective well-being and the physiological stressors in the village. We also found a reasonable, but weak, correlation between the scores of affective states and the indicator of physiological stress levels. We discussed the challenges that should be overcome for utilizing the physiological stress level as a substitute for affective state.</p></div>","PeriodicalId":100147,"journal":{"name":"Augmented Human Research","volume":"2 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2017-02-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1007/s41133-017-0006-2","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"50043249","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 5
ARCTiC LawE: An Upper-Body Exoskeleton for Firearm Training ARCTiC LawE:用于枪械训练的上半身外骨骼
Pub Date : 2017-01-09 DOI: 10.1007/s41133-017-0004-4
Thomas M. Schnieders, Richard T. Stone, Tyler Oviatt, Erik Danford-Klein

The Armed Robotic Control for Training in Civilian Law Enforcement, or ARCTiC LawE, is an upper-body exoskeleton designed to assist civilian, military, and law enforcement personnel in accurate, precise, and reliable handgun techniques. This exoskeleton training utilizes a laser-based handgun with similar dimensions, trigger pull, and break action to a Glock® 19 pistol, common to both public and private security sectors. The paper aims to train and test subjects with no handgun training/experience both with and without the ARCTiC LawE and compare the results of accuracy, precision, and speed. Ultimately, the exoskeleton greatly impacts sensory motor learning, and the biomechanical implications are confirmed via both performance and physiological measurements. The researchers believe the ARCTiC LawE is a viable substitute for training with live-fire handguns in order to reduce the cost of training time and munitions. They also believe the ARCTiC LawE will increase accuracy and precision for typical law enforcement and military live-fire drills. Additionally, this paper increases the breadth of knowledge for exoskeletons as a tool for training.

用于平民执法训练的武装机器人控制,或北极LawE,是一种上半身外骨骼,旨在帮助平民,军事和执法人员准确,精确和可靠的手枪技术。这种外骨骼训练利用激光手枪具有类似的尺寸,扳机拉,并打破行动格洛克®19手枪,共同的公共和私人安全部门。本文旨在训练和测试没有手枪训练/经验的受试者使用和不使用北极法,并比较准确性,精度和速度的结果。最终,外骨骼极大地影响了感觉运动学习,生物力学影响通过性能和生理测量得到证实。研究人员认为,为了减少训练时间和弹药的成本,北极法是实弹手枪训练的可行替代品。他们还认为,北极法将提高典型执法和军事实弹演习的准确性和精度。此外,本文增加了外骨骼作为训练工具的知识广度。
{"title":"ARCTiC LawE: An Upper-Body Exoskeleton for Firearm Training","authors":"Thomas M. Schnieders,&nbsp;Richard T. Stone,&nbsp;Tyler Oviatt,&nbsp;Erik Danford-Klein","doi":"10.1007/s41133-017-0004-4","DOIUrl":"10.1007/s41133-017-0004-4","url":null,"abstract":"<div><p>The Armed Robotic Control for Training in Civilian Law Enforcement, or ARCTiC LawE, is an upper-body exoskeleton designed to assist civilian, military, and law enforcement personnel in accurate, precise, and reliable handgun techniques. This exoskeleton training utilizes a laser-based handgun with similar dimensions, trigger pull, and break action to a Glock<sup>®</sup> 19 pistol, common to both public and private security sectors. The paper aims to train and test subjects with no handgun training/experience both with and without the ARCTiC LawE and compare the results of accuracy, precision, and speed. Ultimately, the exoskeleton greatly impacts sensory motor learning, and the biomechanical implications are confirmed via both performance and physiological measurements. The researchers believe the ARCTiC LawE is a viable substitute for training with live-fire handguns in order to reduce the cost of training time and munitions. They also believe the ARCTiC LawE will increase accuracy and precision for typical law enforcement and military live-fire drills. Additionally, this paper increases the breadth of knowledge for exoskeletons as a tool for training.</p></div>","PeriodicalId":100147,"journal":{"name":"Augmented Human Research","volume":"2 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2017-01-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1007/s41133-017-0004-4","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"50015702","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 7
Comparing the Effect of Audio and Visual Notifications on Workspace Awareness Using Head-Mounted Displays for Remote Collaboration in Augmented Reality 比较音频和视觉通知对使用头戴式显示器进行增强现实远程协作的工作空间感知的影响
Pub Date : 2016-10-10 DOI: 10.1007/s41133-016-0003-x
Marina Cidota, Stephan Lukosch, Dragos Datcu, Heide Lukosch

In many fields of activity, working in teams is necessary for completing tasks in a proper manner and often requires visual context-related information to be exchanged between team members. In such a collaborative environment, awareness of other people’s activity is an important feature of shared-workspace collaboration. We have developed an augmented reality framework for virtual colocation that supports visual communication between two people who are in different physical locations. We address these people as the remote user, who uses a laptop and the local user, who wears a head-mounted display with an RGB camera. The remote user can assist the local user in solving a spatial problem, by providing instructions in form of virtual objects in the view of the local user. For annotating the shared workspace, we use the state-of-the-art algorithm for localization and mapping without markers that provides “anchors” in the 3D space for placing virtual content. In this paper, we report on a user study that explores on how automatic audio and visual notifications about the remote user’s activities affect the local user’s workspace awareness. We used an existing game to research virtual colocation, addressing a spatial challenge on increasing levels of task complexity. The results of the user study show that participants clearly preferred visual notifications over audio or no notifications, no matter the level of the difficulty of the task.

在许多活动领域中,团队合作对于以适当的方式完成任务是必要的,并且通常需要在团队成员之间交换与上下文相关的可视化信息。在这样的协作环境中,了解其他人的活动是共享工作空间协作的一个重要特征。我们已经为虚拟托管开发了一个增强现实框架,支持位于不同物理位置的两个人之间的视觉交流。我们将这些人称为使用笔记本电脑的远程用户和佩戴带有RGB摄像头的头戴式显示器的本地用户。远程用户可以通过在本地用户视图中以虚拟对象的形式提供指令,帮助本地用户解决空间问题。为了标注共享工作空间,我们使用最先进的算法进行定位和映射,而不需要在3D空间中提供“锚”来放置虚拟内容的标记。在本文中,我们报告了一项用户研究,该研究探讨了关于远程用户活动的自动音频和视觉通知如何影响本地用户的工作空间意识。我们使用一个现有的游戏来研究虚拟主机托管,解决了任务复杂性不断增加的空间挑战。用户研究的结果表明,无论任务的难度如何,参与者显然更喜欢视觉通知,而不是音频通知或没有通知。
{"title":"Comparing the Effect of Audio and Visual Notifications on Workspace Awareness Using Head-Mounted Displays for Remote Collaboration in Augmented Reality","authors":"Marina Cidota,&nbsp;Stephan Lukosch,&nbsp;Dragos Datcu,&nbsp;Heide Lukosch","doi":"10.1007/s41133-016-0003-x","DOIUrl":"10.1007/s41133-016-0003-x","url":null,"abstract":"<div><p>In many fields of activity, working in teams is necessary for completing tasks in a proper manner and often requires visual context-related information to be exchanged between team members. In such a collaborative environment, awareness of other people’s activity is an important feature of shared-workspace collaboration. We have developed an augmented reality framework for virtual colocation that supports visual communication between two people who are in different physical locations. We address these people as the remote user, who uses a laptop and the local user, who wears a head-mounted display with an RGB camera. The remote user can assist the local user in solving a spatial problem, by providing instructions in form of virtual objects in the view of the local user. For annotating the shared workspace, we use the state-of-the-art algorithm for localization and mapping without markers that provides “anchors” in the 3D space for placing virtual content. In this paper, we report on a user study that explores on how automatic audio and visual notifications about the remote user’s activities affect the local user’s workspace awareness. We used an existing game to research virtual colocation, addressing a spatial challenge on increasing levels of task complexity. The results of the user study show that participants clearly preferred visual notifications over audio or no notifications, no matter the level of the difficulty of the task.</p></div>","PeriodicalId":100147,"journal":{"name":"Augmented Human Research","volume":"1 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2016-10-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1007/s41133-016-0003-x","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"50018469","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 24
Gender-Impression Modification Enhances the Effect of Mediated Social Touch Between Persons of the Same Gender 性别印象修正增强同性间社会接触中介效应
Pub Date : 2016-10-10 DOI: 10.1007/s41133-016-0002-y
Keita Suzuki, Masanori Yokoyama, Yuki Kionshita, Takayoshi Mochizuki, Tomohiro Yamada, Sho Sakurai, Takuji Narumi, Tomohiro Tanikawa, Michitaka Hirose

The main contribution of this study is realization of a method that enhances the effect of touch in remote communication between persons of the same gender by changing the gender impression with a voice changer during telecommunication. Although psychological studies have revealed that touch has various positive effects such as triggering altruistic behavior and persuading others, these effects are restrained in some cases, especially in same-gender communication, because a touch between persons of the same gender tends to cause unpleasant feelings. However, “Transcendent Telepresence,” which enhances positive psychological effects and suppresses negative effects by modifying the information transmitted via telecommunication, enables us to overcome this problem. We hypothesized that telepresence that modifies people’s gender impression reduces this unpleasantness and enhances the effect of touch. We tested the effectiveness of this method in a situation in which a male operator asked male participants to perform a monotonous task. The results showed that a touch by a male operator whose voice was changed to female-like could reduce the boredom of the task and improve the friendliness toward the operator. We believe this method realizes effective communication in various fields including telemedicine, crowdsourcing, and remote education.

本研究的主要贡献是实现了一种通过在通信过程中使用变音器改变性别印象来增强触摸在同性远程通信中的效果的方法。尽管心理学研究表明,触摸有各种积极的影响,比如引发利他行为和说服他人,但这些影响在某些情况下是有限的,尤其是在同性交流中,因为同性之间的触摸往往会引起不愉快的感觉。然而,“超验网真”通过修改通过电信传递的信息,增强积极的心理效应,抑制消极影响,使我们能够克服这个问题。我们假设,远程呈现改变了人们的性别印象,减少了这种不愉快,增强了触摸的效果。我们在一种情况下测试了这种方法的有效性,即男性操作员要求男性参与者执行单调的任务。结果表明,由男性操作员将声音变为女性的触摸可以减少任务的无聊感,并提高对操作员的友好度。我们相信这种方法可以在远程医疗、众包、远程教育等各个领域实现有效的沟通。
{"title":"Gender-Impression Modification Enhances the Effect of Mediated Social Touch Between Persons of the Same Gender","authors":"Keita Suzuki,&nbsp;Masanori Yokoyama,&nbsp;Yuki Kionshita,&nbsp;Takayoshi Mochizuki,&nbsp;Tomohiro Yamada,&nbsp;Sho Sakurai,&nbsp;Takuji Narumi,&nbsp;Tomohiro Tanikawa,&nbsp;Michitaka Hirose","doi":"10.1007/s41133-016-0002-y","DOIUrl":"10.1007/s41133-016-0002-y","url":null,"abstract":"<div><p>The main contribution of this study is realization of a method that enhances the effect of touch in remote communication between persons of the same gender by changing the gender impression with a voice changer during telecommunication. Although psychological studies have revealed that touch has various positive effects such as triggering altruistic behavior and persuading others, these effects are restrained in some cases, especially in same-gender communication, because a touch between persons of the same gender tends to cause unpleasant feelings. However, “Transcendent Telepresence,” which enhances positive psychological effects and suppresses negative effects by modifying the information transmitted via telecommunication, enables us to overcome this problem. We hypothesized that telepresence that modifies people’s gender impression reduces this unpleasantness and enhances the effect of touch. We tested the effectiveness of this method in a situation in which a male operator asked male participants to perform a monotonous task. The results showed that a touch by a male operator whose voice was changed to female-like could reduce the boredom of the task and improve the friendliness toward the operator. We believe this method realizes effective communication in various fields including telemedicine, crowdsourcing, and remote education.</p></div>","PeriodicalId":100147,"journal":{"name":"Augmented Human Research","volume":"1 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2016-10-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1007/s41133-016-0002-y","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"50018548","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 9
A Communication Paradigm Using Subvocalized Speech: Translating Brain Signals into Speech 使用隐性语音的交流范式:将大脑信号转化为语音
Pub Date : 2016-10-10 DOI: 10.1007/s41133-016-0001-z
Kusuma Mohanchandra, Snehanshu Saha

Recent science and technology studies in neuroscience, rehabilitation, and machine learning have focused attention on the EEG-based brain–computer interface (BCI) as an exciting field of research. Though the primary goal of the BCI has been to restore communication in the severely paralyzed, BCI for speech communication has acquired recognition in a variety of non-medical fields. These fields include silent speech communication, cognitive biometrics, and synthetic telepathy, to name a few. Though potentially a very sensitive issue on various counts, it is likely to revolutionize the whole system of communication. Considering the wide range of application, this paper presents innovative research on BCI for speech communication. Since imagined speech suffers from quite a few factors, we have chosen to focus on subvocalized speech for the current work. The current work is considered to be the first to utilize the subvocal verbalization for EEG-based BCI in speech communication. The electrical signals generated by the human brain during subvocalized speech are captured, analyzed, and interpreted as speech. Further, the processed EEG signals are used to drive a speech synthesizer, enabling communication and acoustical feedback for the user. We attempt to demonstrate and justify that the BCI is capable of providing good results. The basis of this effort is the presumption that, whether the speech is overt or covert, it always originates in the mind. The scalp maps provide evidence that subvocal speech prediction, from the neurological signals, is achievable. The statistical results obtained from the current study demonstrate that speech prediction is possible. EEG signals suffer from the curse of dimensionality due to the intrinsic biological and electromagnetic complexities. Therefore, in the current work, the subset selection method, using pairwise cross-correlation, is proposed to reduce the size of the data while minimizing loss of information. The prominent variances obtained from the SSM, based on principal representative features, were deployed to analyze multiclass EEG signals. A multiclass support vector machine is used for the classification of EEG signals of five subvocalized words extracted from scalp electrodes. Though the current work identifies many challenges, the promise of this technology is exhibited.

近年来,神经科学、康复和机器学习等领域的科学技术研究都将基于脑电图的脑机接口(BCI)作为一个令人兴奋的研究领域。虽然脑机接口的主要目的是恢复重度瘫痪患者的交流,但脑机接口在言语交流方面的应用已在各种非医学领域得到认可。这些领域包括无声语言交流,认知生物识别和合成心灵感应,仅举几例。尽管从各个方面来看,这都是一个非常敏感的问题,但它可能会彻底改变整个通信系统。鉴于脑机接口在语音通信中的广泛应用,本文提出了脑机接口在语音通信中的创新研究。由于想象语音受到很多因素的影响,因此我们选择在当前的工作中重点研究次发声语音。本研究被认为是首次将声下言语化应用于基于脑电图的脑机接口语言交流。人脑在默语过程中产生的电信号被捕捉、分析并解释为语音。此外,处理后的脑电图信号用于驱动语音合成器,为用户实现通信和声学反馈。我们试图证明并证明BCI能够提供良好的结果。这种努力的基础是这样一种假设,即无论言语是公开的还是隐蔽的,它总是源于心灵。头皮图提供的证据表明,从神经信号中预测语音是可以实现的。本研究的统计结果表明,语音预测是可能的。脑电图信号由于其固有的生物复杂性和电磁复杂性而受到维数诅咒。因此,在当前的工作中,我们提出了使用成对相互关联的子集选择方法,以减少数据的大小,同时最大限度地减少信息的损失。基于主代表特征,利用SSM得到的显著方差分析多类脑电信号。利用多类支持向量机对头皮电极提取的5个次发声词的脑电信号进行分类。尽管目前的工作发现了许多挑战,但这项技术的前景已经展现出来。
{"title":"A Communication Paradigm Using Subvocalized Speech: Translating Brain Signals into Speech","authors":"Kusuma Mohanchandra,&nbsp;Snehanshu Saha","doi":"10.1007/s41133-016-0001-z","DOIUrl":"10.1007/s41133-016-0001-z","url":null,"abstract":"<div><p>Recent science and technology studies in neuroscience, rehabilitation, and machine learning have focused attention on the EEG-based brain–computer interface (BCI) as an exciting field of research. Though the primary goal of the BCI has been to restore communication in the severely paralyzed, BCI for speech communication has acquired recognition in a variety of non-medical fields. These fields include silent speech communication, cognitive biometrics, and synthetic telepathy, to name a few. Though potentially a very sensitive issue on various counts, it is likely to revolutionize the whole system of communication. Considering the wide range of application, this paper presents innovative research on BCI for speech communication. Since imagined speech suffers from quite a few factors, we have chosen to focus on subvocalized speech for the current work. The current work is considered to be the first to utilize the subvocal verbalization for EEG-based BCI in speech communication. The electrical signals generated by the human brain during subvocalized speech are captured, analyzed, and interpreted as speech. Further, the processed EEG signals are used to drive a speech synthesizer, enabling communication and acoustical feedback for the user. We attempt to demonstrate and justify that the BCI is capable of providing good results. The basis of this effort is the presumption that, whether the speech is overt or covert, it always originates in the mind. The scalp maps provide evidence that subvocal speech prediction, from the neurological signals, is achievable. The statistical results obtained from the current study demonstrate that speech prediction is possible. EEG signals suffer from the curse of dimensionality due to the intrinsic biological and electromagnetic complexities. Therefore, in the current work, the subset selection method, using pairwise cross-correlation, is proposed to reduce the size of the data while minimizing loss of information. The prominent variances obtained from the SSM, based on principal representative features, were deployed to analyze multiclass EEG signals. A multiclass support vector machine is used for the classification of EEG signals of five subvocalized words extracted from scalp electrodes. Though the current work identifies many challenges, the promise of this technology is exhibited.</p></div>","PeriodicalId":100147,"journal":{"name":"Augmented Human Research","volume":"1 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2016-10-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1007/s41133-016-0001-z","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"50018468","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 24
期刊
Augmented Human Research
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1