Alexandru Vasilache, Jann Krausse, Klaus Knobloch, Juergen Becker
{"title":"Hybrid Spiking Neural Networks for Low-Power Intra-Cortical Brain-Machine Interfaces","authors":"Alexandru Vasilache, Jann Krausse, Klaus Knobloch, Juergen Becker","doi":"arxiv-2409.04428","DOIUrl":null,"url":null,"abstract":"Intra-cortical brain-machine interfaces (iBMIs) have the potential to\ndramatically improve the lives of people with paraplegia by restoring their\nability to perform daily activities. However, current iBMIs suffer from\nscalability and mobility limitations due to bulky hardware and wiring. Wireless\niBMIs offer a solution but are constrained by a limited data rate. To overcome\nthis challenge, we are investigating hybrid spiking neural networks for\nembedded neural decoding in wireless iBMIs. The networks consist of a temporal\nconvolution-based compression followed by recurrent processing and a final\ninterpolation back to the original sequence length. As recurrent units, we\nexplore gated recurrent units (GRUs), leaky integrate-and-fire (LIF) neurons,\nand a combination of both - spiking GRUs (sGRUs) and analyze their differences\nin terms of accuracy, footprint, and activation sparsity. To that end, we train\ndecoders on the \"Nonhuman Primate Reaching with Multichannel Sensorimotor\nCortex Electrophysiology\" dataset and evaluate it using the NeuroBench\nframework, targeting both tracks of the IEEE BioCAS Grand Challenge on Neural\nDecoding. Our approach achieves high accuracy in predicting velocities of\nprimate reaching movements from multichannel primary motor cortex recordings\nwhile maintaining a low number of synaptic operations, surpassing the current\nbaseline models in the NeuroBench framework. This work highlights the potential\nof hybrid neural networks to facilitate wireless iBMIs with high decoding\nprecision and a substantial increase in the number of monitored neurons, paving\nthe way toward more advanced neuroprosthetic technologies.","PeriodicalId":501517,"journal":{"name":"arXiv - QuanBio - Neurons and Cognition","volume":"7 1","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2024-09-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"arXiv - QuanBio - Neurons and Cognition","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/arxiv-2409.04428","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
Abstract
Intra-cortical brain-machine interfaces (iBMIs) have the potential to
dramatically improve the lives of people with paraplegia by restoring their
ability to perform daily activities. However, current iBMIs suffer from
scalability and mobility limitations due to bulky hardware and wiring. Wireless
iBMIs offer a solution but are constrained by a limited data rate. To overcome
this challenge, we are investigating hybrid spiking neural networks for
embedded neural decoding in wireless iBMIs. The networks consist of a temporal
convolution-based compression followed by recurrent processing and a final
interpolation back to the original sequence length. As recurrent units, we
explore gated recurrent units (GRUs), leaky integrate-and-fire (LIF) neurons,
and a combination of both - spiking GRUs (sGRUs) and analyze their differences
in terms of accuracy, footprint, and activation sparsity. To that end, we train
decoders on the "Nonhuman Primate Reaching with Multichannel Sensorimotor
Cortex Electrophysiology" dataset and evaluate it using the NeuroBench
framework, targeting both tracks of the IEEE BioCAS Grand Challenge on Neural
Decoding. Our approach achieves high accuracy in predicting velocities of
primate reaching movements from multichannel primary motor cortex recordings
while maintaining a low number of synaptic operations, surpassing the current
baseline models in the NeuroBench framework. This work highlights the potential
of hybrid neural networks to facilitate wireless iBMIs with high decoding
precision and a substantial increase in the number of monitored neurons, paving
the way toward more advanced neuroprosthetic technologies.