Beata Jarosiewicz , Anish A. Sarma , Jad Saab , Brian Franco , Sydney S. Cash , Emad N. Eskandar , Leigh R. Hochberg
{"title":"用于自校准点-点击脑机接口的回顾性监督点击解码器校准","authors":"Beata Jarosiewicz , Anish A. Sarma , Jad Saab , Brian Franco , Sydney S. Cash , Emad N. Eskandar , Leigh R. Hochberg","doi":"10.1016/j.jphysparis.2017.03.001","DOIUrl":null,"url":null,"abstract":"<div><p>Brain-computer interfaces (BCIs) aim to restore independence to people with severe motor disabilities by allowing control of a<!--> <!-->cursor on a computer screen or other effectors with neural activity. However, physiological and/or recording-related nonstationarities in neural signals can limit long-term decoding stability, and it would be tedious for users to pause use of the BCI whenever neural control degrades to perform decoder recalibration routines. We recently demonstrated that a kinematic decoder (i.e. a decoder that controls cursor movement) can be recalibrated using data acquired during practical point-and-click control of the BCI by retrospectively inferring users’ intended movement directions based on their subsequent selections. Here, we extend these methods to allow the <em>click</em> decoder to also be recalibrated using data acquired during practical BCI use. We retrospectively labeled neural data patterns as corresponding to “click” during all time bins in which the click log-likelihood (decoded using linear discriminant analysis, or LDA) had been above the click threshold that was used during real-time neural control. We labeled as “non-click” those periods that the kinematic decoder’s retrospective target inference (RTI) heuristics determined to be consistent with intended cursor movement. Once these neural activity patterns were labeled, the click decoder was calibrated using standard supervised classifier training methods. Combined with real-time bias correction and baseline firing rate tracking, this set of “retrospectively labeled” decoder calibration methods enabled a BrainGate participant with amyotrophic lateral sclerosis (T9) to type freely across 11 research sessions spanning 29<!--> <!-->days, maintaining high-performance neural control over cursor movement and click without needing to interrupt virtual keyboard use for explicit calibration tasks. By eliminating the need for tedious calibration tasks with prescribed targets and pre-specified click times, this approach advances the potential clinical utility of intracortical BCIs for individuals with severe motor disability.</p></div>","PeriodicalId":50087,"journal":{"name":"Journal of Physiology-Paris","volume":"110 4","pages":"Pages 382-391"},"PeriodicalIF":0.0000,"publicationDate":"2016-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1016/j.jphysparis.2017.03.001","citationCount":"13","resultStr":"{\"title\":\"Retrospectively supervised click decoder calibration for self-calibrating point-and-click brain–computer interfaces\",\"authors\":\"Beata Jarosiewicz , Anish A. Sarma , Jad Saab , Brian Franco , Sydney S. Cash , Emad N. Eskandar , Leigh R. Hochberg\",\"doi\":\"10.1016/j.jphysparis.2017.03.001\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><p>Brain-computer interfaces (BCIs) aim to restore independence to people with severe motor disabilities by allowing control of a<!--> <!-->cursor on a computer screen or other effectors with neural activity. However, physiological and/or recording-related nonstationarities in neural signals can limit long-term decoding stability, and it would be tedious for users to pause use of the BCI whenever neural control degrades to perform decoder recalibration routines. We recently demonstrated that a kinematic decoder (i.e. a decoder that controls cursor movement) can be recalibrated using data acquired during practical point-and-click control of the BCI by retrospectively inferring users’ intended movement directions based on their subsequent selections. Here, we extend these methods to allow the <em>click</em> decoder to also be recalibrated using data acquired during practical BCI use. We retrospectively labeled neural data patterns as corresponding to “click” during all time bins in which the click log-likelihood (decoded using linear discriminant analysis, or LDA) had been above the click threshold that was used during real-time neural control. We labeled as “non-click” those periods that the kinematic decoder’s retrospective target inference (RTI) heuristics determined to be consistent with intended cursor movement. Once these neural activity patterns were labeled, the click decoder was calibrated using standard supervised classifier training methods. Combined with real-time bias correction and baseline firing rate tracking, this set of “retrospectively labeled” decoder calibration methods enabled a BrainGate participant with amyotrophic lateral sclerosis (T9) to type freely across 11 research sessions spanning 29<!--> <!-->days, maintaining high-performance neural control over cursor movement and click without needing to interrupt virtual keyboard use for explicit calibration tasks. By eliminating the need for tedious calibration tasks with prescribed targets and pre-specified click times, this approach advances the potential clinical utility of intracortical BCIs for individuals with severe motor disability.</p></div>\",\"PeriodicalId\":50087,\"journal\":{\"name\":\"Journal of Physiology-Paris\",\"volume\":\"110 4\",\"pages\":\"Pages 382-391\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2016-11-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://sci-hub-pdf.com/10.1016/j.jphysparis.2017.03.001\",\"citationCount\":\"13\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of Physiology-Paris\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0928425717300104\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q\",\"JCRName\":\"Medicine\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Physiology-Paris","FirstCategoryId":"1085","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0928425717300104","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q","JCRName":"Medicine","Score":null,"Total":0}
Retrospectively supervised click decoder calibration for self-calibrating point-and-click brain–computer interfaces
Brain-computer interfaces (BCIs) aim to restore independence to people with severe motor disabilities by allowing control of a cursor on a computer screen or other effectors with neural activity. However, physiological and/or recording-related nonstationarities in neural signals can limit long-term decoding stability, and it would be tedious for users to pause use of the BCI whenever neural control degrades to perform decoder recalibration routines. We recently demonstrated that a kinematic decoder (i.e. a decoder that controls cursor movement) can be recalibrated using data acquired during practical point-and-click control of the BCI by retrospectively inferring users’ intended movement directions based on their subsequent selections. Here, we extend these methods to allow the click decoder to also be recalibrated using data acquired during practical BCI use. We retrospectively labeled neural data patterns as corresponding to “click” during all time bins in which the click log-likelihood (decoded using linear discriminant analysis, or LDA) had been above the click threshold that was used during real-time neural control. We labeled as “non-click” those periods that the kinematic decoder’s retrospective target inference (RTI) heuristics determined to be consistent with intended cursor movement. Once these neural activity patterns were labeled, the click decoder was calibrated using standard supervised classifier training methods. Combined with real-time bias correction and baseline firing rate tracking, this set of “retrospectively labeled” decoder calibration methods enabled a BrainGate participant with amyotrophic lateral sclerosis (T9) to type freely across 11 research sessions spanning 29 days, maintaining high-performance neural control over cursor movement and click without needing to interrupt virtual keyboard use for explicit calibration tasks. By eliminating the need for tedious calibration tasks with prescribed targets and pre-specified click times, this approach advances the potential clinical utility of intracortical BCIs for individuals with severe motor disability.
期刊介绍:
Each issue of the Journal of Physiology (Paris) is specially commissioned, and provides an overview of one important area of neuroscience, delivering review and research papers from leading researchers in that field. The content will interest both those specializing in the experimental study of the brain and those working in interdisciplinary fields linking theory and biological data, including cellular neuroscience, mathematical analysis of brain function, computational neuroscience, biophysics of brain imaging and cognitive psychology.