基于神经流形的脉冲神经网络增强脑机接口数据

Shengjie Zheng, Wenyi Li, Lang Qian, Che He, Xiaojian Li
{"title":"基于神经流形的脉冲神经网络增强脑机接口数据","authors":"Shengjie Zheng, Wenyi Li, Lang Qian, Che He, Xiaojian Li","doi":"10.48550/arXiv.2204.05132","DOIUrl":null,"url":null,"abstract":"ql20@mails.tsinghua.edu.cn Abstract. Brain-computer interfaces (BCIs), transform neural signals in the brain into instructions to control external devices. However, obtaining sufficient training data is difficult as well as limited. With the advent of advanced machine learning methods, the capability of brain-computer interfaces has been enhanced like never before, however, these methods require a large amount of data for training and thus require data augmentation of the limited data available. Here, we use spiking neural networks (SNN) as data generators. It is touted as the next-generation neural network and is considered as one of the algorithms oriented to general artificial intelligence because it borrows the neural information processing from biological neurons. We use the SNN to generate neural spike information that is bio-interpretable and conforms to the intrinsic patterns in the original neural data. Experiments show that the model can direct-ly synthesize new spike trains, which in turn improves the generalization ability of the BCI decoder. Both the input and output of the spiking neural model are spike information, which is a brain-inspired intelligence approach that can be better integrated with BCI in the specific patterns of neural population activity rather than on individual neurons[4]. The neural population dynamics exist in low-dimensional neural manifolds in a high-dimensional neural space[5]. Here, we employ a bio-interpretive SNN that mimics the neural information generation as well as the com-munication of biological neural populations. We analyze motor cortical neural population data recorded from monkeys to derive motor-related neural population dynamics. The neural spike properties of the SNN itself allow the direct generation of biologically meaningful spike trains that match the activity of real biological neural populations. We explored the interaction between the spike train synthesizer and the BCI decoder. Our results show that based on a small amount of training data as a template, data conforming to the dynamics of neural populations are generated, thus enhancing the decoding ability of the BCI decoder.","PeriodicalId":93416,"journal":{"name":"Artificial neural networks, ICANN : international conference ... proceedings. International Conference on Artificial Neural Networks (European Neural Network Society)","volume":"11 1","pages":"519-530"},"PeriodicalIF":0.0000,"publicationDate":"2022-03-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":"{\"title\":\"A Spiking Neural Network based on Neural Manifold for Augmenting Intracortical Brain-Computer Interface Data\",\"authors\":\"Shengjie Zheng, Wenyi Li, Lang Qian, Che He, Xiaojian Li\",\"doi\":\"10.48550/arXiv.2204.05132\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"ql20@mails.tsinghua.edu.cn Abstract. Brain-computer interfaces (BCIs), transform neural signals in the brain into instructions to control external devices. However, obtaining sufficient training data is difficult as well as limited. With the advent of advanced machine learning methods, the capability of brain-computer interfaces has been enhanced like never before, however, these methods require a large amount of data for training and thus require data augmentation of the limited data available. Here, we use spiking neural networks (SNN) as data generators. It is touted as the next-generation neural network and is considered as one of the algorithms oriented to general artificial intelligence because it borrows the neural information processing from biological neurons. We use the SNN to generate neural spike information that is bio-interpretable and conforms to the intrinsic patterns in the original neural data. Experiments show that the model can direct-ly synthesize new spike trains, which in turn improves the generalization ability of the BCI decoder. Both the input and output of the spiking neural model are spike information, which is a brain-inspired intelligence approach that can be better integrated with BCI in the specific patterns of neural population activity rather than on individual neurons[4]. The neural population dynamics exist in low-dimensional neural manifolds in a high-dimensional neural space[5]. Here, we employ a bio-interpretive SNN that mimics the neural information generation as well as the com-munication of biological neural populations. We analyze motor cortical neural population data recorded from monkeys to derive motor-related neural population dynamics. The neural spike properties of the SNN itself allow the direct generation of biologically meaningful spike trains that match the activity of real biological neural populations. We explored the interaction between the spike train synthesizer and the BCI decoder. Our results show that based on a small amount of training data as a template, data conforming to the dynamics of neural populations are generated, thus enhancing the decoding ability of the BCI decoder.\",\"PeriodicalId\":93416,\"journal\":{\"name\":\"Artificial neural networks, ICANN : international conference ... proceedings. International Conference on Artificial Neural Networks (European Neural Network Society)\",\"volume\":\"11 1\",\"pages\":\"519-530\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2022-03-26\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"1\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Artificial neural networks, ICANN : international conference ... proceedings. International Conference on Artificial Neural Networks (European Neural Network Society)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.48550/arXiv.2204.05132\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Artificial neural networks, ICANN : international conference ... proceedings. International Conference on Artificial Neural Networks (European Neural Network Society)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.48550/arXiv.2204.05132","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 1

摘要

ql20@mails.tsinghua.edu.cn抽象。脑机接口(bci),将大脑中的神经信号转换为控制外部设备的指令。然而,获得足够的训练数据是困难的,也是有限的。随着先进的机器学习方法的出现,脑机接口的能力得到了前所未有的增强,然而,这些方法需要大量的数据进行训练,因此需要对有限的可用数据进行数据扩充。在这里,我们使用尖峰神经网络(SNN)作为数据生成器。它借鉴了生物神经元的神经信息处理,被誉为下一代神经网络,被认为是面向通用人工智能的算法之一。我们使用SNN生成生物可解释的神经尖峰信息,并符合原始神经数据中的固有模式。实验表明,该模型可以直接合成新的尖峰序列,从而提高了BCI解码器的泛化能力。尖峰神经模型的输入和输出都是尖峰信息,这是一种大脑启发的智能方法,可以在神经群体活动的特定模式中更好地与BCI集成,而不是在单个神经元上[4]。神经种群动态存在于高维神经空间中的低维神经流形中[5]。在这里,我们采用了一种生物解释SNN,它模拟了神经信息的生成以及生物神经群体的交流。我们分析了从猴子记录的运动皮质神经种群数据,得出运动相关的神经种群动态。SNN本身的神经尖峰特性允许直接产生与真实生物神经群的活动相匹配的具有生物学意义的尖峰序列。我们探索了尖峰串合成器和BCI解码器之间的相互作用。我们的研究结果表明,以少量的训练数据为模板,生成符合神经种群动态的数据,从而增强了BCI解码器的解码能力。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
A Spiking Neural Network based on Neural Manifold for Augmenting Intracortical Brain-Computer Interface Data
ql20@mails.tsinghua.edu.cn Abstract. Brain-computer interfaces (BCIs), transform neural signals in the brain into instructions to control external devices. However, obtaining sufficient training data is difficult as well as limited. With the advent of advanced machine learning methods, the capability of brain-computer interfaces has been enhanced like never before, however, these methods require a large amount of data for training and thus require data augmentation of the limited data available. Here, we use spiking neural networks (SNN) as data generators. It is touted as the next-generation neural network and is considered as one of the algorithms oriented to general artificial intelligence because it borrows the neural information processing from biological neurons. We use the SNN to generate neural spike information that is bio-interpretable and conforms to the intrinsic patterns in the original neural data. Experiments show that the model can direct-ly synthesize new spike trains, which in turn improves the generalization ability of the BCI decoder. Both the input and output of the spiking neural model are spike information, which is a brain-inspired intelligence approach that can be better integrated with BCI in the specific patterns of neural population activity rather than on individual neurons[4]. The neural population dynamics exist in low-dimensional neural manifolds in a high-dimensional neural space[5]. Here, we employ a bio-interpretive SNN that mimics the neural information generation as well as the com-munication of biological neural populations. We analyze motor cortical neural population data recorded from monkeys to derive motor-related neural population dynamics. The neural spike properties of the SNN itself allow the direct generation of biologically meaningful spike trains that match the activity of real biological neural populations. We explored the interaction between the spike train synthesizer and the BCI decoder. Our results show that based on a small amount of training data as a template, data conforming to the dynamics of neural populations are generated, thus enhancing the decoding ability of the BCI decoder.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
期刊最新文献
Dual Branch Network Towards Accurate Printed Mathematical Expression Recognition PE-YOLO: Pyramid Enhancement Network for Dark Object Detection Variational Autoencoders for Anomaly Detection in Respiratory Sounds Deep Feature Learning for Medical Acoustics Time Series Forecasting Models Copy the Past: How to Mitigate
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1