Context Information Significantly Improves Brain Computer Interface Performance - a Case Study on Text Entry Using a Language Model Assisted BCI.

Umut Orhan, Deniz Erdogmus, Kenneth E Hild, Brian Roark, Barry Oken, Melanie Fried-Oken
{"title":"Context Information Significantly Improves Brain Computer Interface Performance - a Case Study on Text Entry Using a Language Model Assisted BCI.","authors":"Umut Orhan,&nbsp;Deniz Erdogmus,&nbsp;Kenneth E Hild,&nbsp;Brian Roark,&nbsp;Barry Oken,&nbsp;Melanie Fried-Oken","doi":"","DOIUrl":null,"url":null,"abstract":"<p><p>We present recent results on the design of the RSVP Keyboard - a brain computer interface (BCI) for expressive language generation for functionally locked-in individuals using rapid serial visual presentation of letters or other symbols such as icons. The proposed BCI design tightly incorporates probabilistic contextual information obtained from a language model into the single or multi-trial event related potential (ERP) decision mechanism. This tight fusion of contextual information with instantaneous and independent brain activity is demonstrated to potentially improve accuracy in a dramatic manner. Specifically, a simple regularized discriminant single-trial ERP classifier's performance can be increased from a naive baseline of 75% to 98% in a 28-symbol alphabet operating at 5% false ERP detection rate. We also demonstrate results which show that trained healthy subjects can achieve real-time typing accuracies over 90% mostly relying on single-trial ERP evidence when supplemented with a rudimentary n-gram language model. Further discussion and preliminary results include our initial efforts involving a locked-in individual and our efforts to train him to improve his skill in performing the task.</p>","PeriodicalId":72692,"journal":{"name":"Conference record. Asilomar Conference on Signals, Systems & Computers","volume":"45 ","pages":"132-136"},"PeriodicalIF":0.0000,"publicationDate":"2011-11-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4072332/pdf/nihms-494005.pdf","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Conference record. Asilomar Conference on Signals, Systems & Computers","FirstCategoryId":"1085","ListUrlMain":"","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

We present recent results on the design of the RSVP Keyboard - a brain computer interface (BCI) for expressive language generation for functionally locked-in individuals using rapid serial visual presentation of letters or other symbols such as icons. The proposed BCI design tightly incorporates probabilistic contextual information obtained from a language model into the single or multi-trial event related potential (ERP) decision mechanism. This tight fusion of contextual information with instantaneous and independent brain activity is demonstrated to potentially improve accuracy in a dramatic manner. Specifically, a simple regularized discriminant single-trial ERP classifier's performance can be increased from a naive baseline of 75% to 98% in a 28-symbol alphabet operating at 5% false ERP detection rate. We also demonstrate results which show that trained healthy subjects can achieve real-time typing accuracies over 90% mostly relying on single-trial ERP evidence when supplemented with a rudimentary n-gram language model. Further discussion and preliminary results include our initial efforts involving a locked-in individual and our efforts to train him to improve his skill in performing the task.

分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
上下文信息显著提高脑机接口性能——使用语言模型辅助脑机接口的文本输入案例研究。
我们介绍了RSVP键盘的最新设计成果,RSVP键盘是一种脑机接口(BCI),用于为功能锁定的个体提供表达性语言生成,使用快速串行视觉呈现字母或其他符号(如图标)。提出的脑机接口设计将从语言模型中获得的概率上下文信息紧密结合到单次或多次试验事件相关电位(ERP)决策机制中。这种上下文信息与瞬时和独立的大脑活动的紧密融合被证明可能以戏剧性的方式提高准确性。具体来说,一个简单的正则化判别单试验ERP分类器的性能可以在28个符号的字母表中从75%的初始基线提高到98%,在5%的错误ERP检测率下运行。我们还展示了训练有素的健康受试者在辅以基本n-gram语言模型的情况下,主要依靠单试验ERP证据,可以实现90%以上的实时打字准确率。进一步的讨论和初步结果包括我们对一个闭锁的人的初步努力,以及我们对他的训练,以提高他执行任务的技能。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
CiteScore
1.40
自引率
0.00%
发文量
0
期刊最新文献
A novel method for 12-lead ECG reconstruction. Multilevel State-Space Models Enable High Precision Event Related Potential Analysis. Topological Knowledge Distillation for Wearable Sensor Data. A Hybrid Scattering Transform for Signals with Isolated Singularities. A mechanistically interpretable model of the retinal neural code for natural scenes with multiscale adaptive dynamics.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1