用于自校准点-点击脑机接口的回顾性监督点击解码器校准

Beata Jarosiewicz , Anish A. Sarma , Jad Saab , Brian Franco , Sydney S. Cash , Emad N. Eskandar , Leigh R. Hochberg
{"title":"用于自校准点-点击脑机接口的回顾性监督点击解码器校准","authors":"Beata Jarosiewicz ,&nbsp;Anish A. Sarma ,&nbsp;Jad Saab ,&nbsp;Brian Franco ,&nbsp;Sydney S. Cash ,&nbsp;Emad N. Eskandar ,&nbsp;Leigh R. Hochberg","doi":"10.1016/j.jphysparis.2017.03.001","DOIUrl":null,"url":null,"abstract":"<div><p>Brain-computer interfaces (BCIs) aim to restore independence to people with severe motor disabilities by allowing control of a<!--> <!-->cursor on a computer screen or other effectors with neural activity. However, physiological and/or recording-related nonstationarities in neural signals can limit long-term decoding stability, and it would be tedious for users to pause use of the BCI whenever neural control degrades to perform decoder recalibration routines. We recently demonstrated that a kinematic decoder (i.e. a decoder that controls cursor movement) can be recalibrated using data acquired during practical point-and-click control of the BCI by retrospectively inferring users’ intended movement directions based on their subsequent selections. Here, we extend these methods to allow the <em>click</em> decoder to also be recalibrated using data acquired during practical BCI use. We retrospectively labeled neural data patterns as corresponding to “click” during all time bins in which the click log-likelihood (decoded using linear discriminant analysis, or LDA) had been above the click threshold that was used during real-time neural control. We labeled as “non-click” those periods that the kinematic decoder’s retrospective target inference (RTI) heuristics determined to be consistent with intended cursor movement. Once these neural activity patterns were labeled, the click decoder was calibrated using standard supervised classifier training methods. Combined with real-time bias correction and baseline firing rate tracking, this set of “retrospectively labeled” decoder calibration methods enabled a BrainGate participant with amyotrophic lateral sclerosis (T9) to type freely across 11 research sessions spanning 29<!--> <!-->days, maintaining high-performance neural control over cursor movement and click without needing to interrupt virtual keyboard use for explicit calibration tasks. By eliminating the need for tedious calibration tasks with prescribed targets and pre-specified click times, this approach advances the potential clinical utility of intracortical BCIs for individuals with severe motor disability.</p></div>","PeriodicalId":50087,"journal":{"name":"Journal of Physiology-Paris","volume":"110 4","pages":"Pages 382-391"},"PeriodicalIF":0.0000,"publicationDate":"2016-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1016/j.jphysparis.2017.03.001","citationCount":"13","resultStr":"{\"title\":\"Retrospectively supervised click decoder calibration for self-calibrating point-and-click brain–computer interfaces\",\"authors\":\"Beata Jarosiewicz ,&nbsp;Anish A. Sarma ,&nbsp;Jad Saab ,&nbsp;Brian Franco ,&nbsp;Sydney S. Cash ,&nbsp;Emad N. Eskandar ,&nbsp;Leigh R. Hochberg\",\"doi\":\"10.1016/j.jphysparis.2017.03.001\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><p>Brain-computer interfaces (BCIs) aim to restore independence to people with severe motor disabilities by allowing control of a<!--> <!-->cursor on a computer screen or other effectors with neural activity. However, physiological and/or recording-related nonstationarities in neural signals can limit long-term decoding stability, and it would be tedious for users to pause use of the BCI whenever neural control degrades to perform decoder recalibration routines. We recently demonstrated that a kinematic decoder (i.e. a decoder that controls cursor movement) can be recalibrated using data acquired during practical point-and-click control of the BCI by retrospectively inferring users’ intended movement directions based on their subsequent selections. Here, we extend these methods to allow the <em>click</em> decoder to also be recalibrated using data acquired during practical BCI use. We retrospectively labeled neural data patterns as corresponding to “click” during all time bins in which the click log-likelihood (decoded using linear discriminant analysis, or LDA) had been above the click threshold that was used during real-time neural control. We labeled as “non-click” those periods that the kinematic decoder’s retrospective target inference (RTI) heuristics determined to be consistent with intended cursor movement. Once these neural activity patterns were labeled, the click decoder was calibrated using standard supervised classifier training methods. Combined with real-time bias correction and baseline firing rate tracking, this set of “retrospectively labeled” decoder calibration methods enabled a BrainGate participant with amyotrophic lateral sclerosis (T9) to type freely across 11 research sessions spanning 29<!--> <!-->days, maintaining high-performance neural control over cursor movement and click without needing to interrupt virtual keyboard use for explicit calibration tasks. By eliminating the need for tedious calibration tasks with prescribed targets and pre-specified click times, this approach advances the potential clinical utility of intracortical BCIs for individuals with severe motor disability.</p></div>\",\"PeriodicalId\":50087,\"journal\":{\"name\":\"Journal of Physiology-Paris\",\"volume\":\"110 4\",\"pages\":\"Pages 382-391\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2016-11-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://sci-hub-pdf.com/10.1016/j.jphysparis.2017.03.001\",\"citationCount\":\"13\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of Physiology-Paris\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0928425717300104\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q\",\"JCRName\":\"Medicine\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Physiology-Paris","FirstCategoryId":"1085","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0928425717300104","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q","JCRName":"Medicine","Score":null,"Total":0}
引用次数: 13

摘要

脑机接口(bci)旨在通过控制电脑屏幕上的光标或其他具有神经活动的效应器,使患有严重运动障碍的人恢复独立。然而,神经信号的生理和/或记录相关的非平稳性会限制长期解码的稳定性,并且当神经控制退化到执行解码器重新校准程序时,用户暂停使用BCI将是乏味的。我们最近证明了一个运动学解码器(即控制光标移动的解码器)可以通过根据用户随后的选择回顾性地推断用户的预期移动方向,使用在BCI的实际点击控制过程中获得的数据来重新校准。在这里,我们扩展了这些方法,使点击解码器也可以使用在实际BCI使用过程中获得的数据进行重新校准。我们回顾性地将神经数据模式标记为在所有时间箱中对应的“点击”,其中点击对数似然(使用线性判别分析或LDA解码)高于实时神经控制中使用的点击阈值。我们将那些运动解码器的回顾性目标推断(RTI)启发式确定与预期光标移动一致的周期标记为“非点击”。一旦这些神经活动模式被标记,点击解码器使用标准监督分类器训练方法进行校准。结合实时偏差校正和基线触发率跟踪,这组“回顾性标记”解码器校准方法使患有肌萎缩性侧索硬化症(T9)的BrainGate参与者能够在29天的11次研究会议中自由打字,保持对光标移动和点击的高性能神经控制,而无需中断虚拟键盘的使用来进行明确的校准任务。通过消除繁琐的校准任务和预先指定的点击时间,该方法提高了皮质内脑机接口在严重运动障碍患者中的潜在临床应用。
本文章由计算机程序翻译,如有差异,请以英文原文为准。

摘要图片

摘要图片

摘要图片

查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
Retrospectively supervised click decoder calibration for self-calibrating point-and-click brain–computer interfaces

Brain-computer interfaces (BCIs) aim to restore independence to people with severe motor disabilities by allowing control of a cursor on a computer screen or other effectors with neural activity. However, physiological and/or recording-related nonstationarities in neural signals can limit long-term decoding stability, and it would be tedious for users to pause use of the BCI whenever neural control degrades to perform decoder recalibration routines. We recently demonstrated that a kinematic decoder (i.e. a decoder that controls cursor movement) can be recalibrated using data acquired during practical point-and-click control of the BCI by retrospectively inferring users’ intended movement directions based on their subsequent selections. Here, we extend these methods to allow the click decoder to also be recalibrated using data acquired during practical BCI use. We retrospectively labeled neural data patterns as corresponding to “click” during all time bins in which the click log-likelihood (decoded using linear discriminant analysis, or LDA) had been above the click threshold that was used during real-time neural control. We labeled as “non-click” those periods that the kinematic decoder’s retrospective target inference (RTI) heuristics determined to be consistent with intended cursor movement. Once these neural activity patterns were labeled, the click decoder was calibrated using standard supervised classifier training methods. Combined with real-time bias correction and baseline firing rate tracking, this set of “retrospectively labeled” decoder calibration methods enabled a BrainGate participant with amyotrophic lateral sclerosis (T9) to type freely across 11 research sessions spanning 29 days, maintaining high-performance neural control over cursor movement and click without needing to interrupt virtual keyboard use for explicit calibration tasks. By eliminating the need for tedious calibration tasks with prescribed targets and pre-specified click times, this approach advances the potential clinical utility of intracortical BCIs for individuals with severe motor disability.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Journal of Physiology-Paris
Journal of Physiology-Paris 医学-神经科学
CiteScore
2.02
自引率
0.00%
发文量
0
审稿时长
>12 weeks
期刊介绍: Each issue of the Journal of Physiology (Paris) is specially commissioned, and provides an overview of one important area of neuroscience, delivering review and research papers from leading researchers in that field. The content will interest both those specializing in the experimental study of the brain and those working in interdisciplinary fields linking theory and biological data, including cellular neuroscience, mathematical analysis of brain function, computational neuroscience, biophysics of brain imaging and cognitive psychology.
期刊最新文献
Editorial Automated detection of high-frequency oscillations in electrophysiological signals: Methodological advances Digital hardware implementation of a stochastic two-dimensional neuron model Recent progress in multi-electrode spike sorting methods Retrospectively supervised click decoder calibration for self-calibrating point-and-click brain–computer interfaces
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1