Ying Liu , Xiaoling Luo , Ya Zhang , Yun Zhang , Wei Zhang , Hong Qu
{"title":"Spike-VisNet: A novel framework for visual recognition with FocusLayer-STDP learning","authors":"Ying Liu , Xiaoling Luo , Ya Zhang , Yun Zhang , Wei Zhang , Hong Qu","doi":"10.1016/j.neunet.2024.106918","DOIUrl":null,"url":null,"abstract":"<div><div>Current vision-inspired spiking neural networks (SNNs) face key challenges due to their model structures typically focusing on single mechanisms and neglecting the integration of multiple biological features. These limitations, coupled with limited synaptic plasticity, hinder their ability to implement biologically realistic visual processing. To address these issues, we propose Spike-VisNet, a novel retina-inspired framework designed to enhance visual recognition capabilities. This framework simulates both the functional and layered structure of the retina. To further enhance this architecture, we integrate the FocusLayer-STDP learning rule, allowing Spike-VisNet to dynamically adjust synaptic weights in response to varying visual stimuli. This rule combines channel attention, inhibition mechanisms, and competitive mechanisms with spike-timing-dependent plasticity (STDP), significantly improving synaptic adaptability and visual recognition performance. Comprehensive evaluations on benchmark datasets demonstrate that Spike-VisNet outperforms other STDP-based SNNs, achieving precision scores of 98.6% on MNIST, 93.29% on ETH-80, and 86.27% on CIFAR-10. These results highlight its effectiveness and robustness, showcasing Spike-VisNet’s potential to simulate human visual processing and its applicability to complex real-world visual challenges.</div></div>","PeriodicalId":49763,"journal":{"name":"Neural Networks","volume":"182 ","pages":"Article 106918"},"PeriodicalIF":6.3000,"publicationDate":"2025-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Neural Networks","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0893608024008475","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2024/11/26 0:00:00","PubModel":"Epub","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0
Abstract
Current vision-inspired spiking neural networks (SNNs) face key challenges due to their model structures typically focusing on single mechanisms and neglecting the integration of multiple biological features. These limitations, coupled with limited synaptic plasticity, hinder their ability to implement biologically realistic visual processing. To address these issues, we propose Spike-VisNet, a novel retina-inspired framework designed to enhance visual recognition capabilities. This framework simulates both the functional and layered structure of the retina. To further enhance this architecture, we integrate the FocusLayer-STDP learning rule, allowing Spike-VisNet to dynamically adjust synaptic weights in response to varying visual stimuli. This rule combines channel attention, inhibition mechanisms, and competitive mechanisms with spike-timing-dependent plasticity (STDP), significantly improving synaptic adaptability and visual recognition performance. Comprehensive evaluations on benchmark datasets demonstrate that Spike-VisNet outperforms other STDP-based SNNs, achieving precision scores of 98.6% on MNIST, 93.29% on ETH-80, and 86.27% on CIFAR-10. These results highlight its effectiveness and robustness, showcasing Spike-VisNet’s potential to simulate human visual processing and its applicability to complex real-world visual challenges.
当前的视觉激发的脉冲神经网络(snn)由于其模型结构通常侧重于单一机制,而忽视了多种生物特征的整合,面临着关键的挑战。这些限制,加上有限的突触可塑性,阻碍了他们实现生物学上真实的视觉处理的能力。为了解决这些问题,我们提出了Spike-VisNet,这是一种新颖的视网膜启发框架,旨在增强视觉识别能力。这个框架模拟了视网膜的功能和分层结构。为了进一步增强这种架构,我们集成了FocusLayer-STDP学习规则,允许Spike-VisNet根据不同的视觉刺激动态调整突触权重。该规则将通道注意、抑制机制、竞争机制与spike- time -dependent plasticity (STDP)相结合,显著提高了突触的适应性和视觉识别性能。对基准数据集的综合评估表明,Spike-VisNet优于其他基于stp的snn,在MNIST上的准确率为98.6%,在ETH-80上的准确率为93.29%,在CIFAR-10上的准确率为86.27%。这些结果突出了它的有效性和鲁棒性,展示了Spike-VisNet模拟人类视觉处理的潜力及其对复杂的现实世界视觉挑战的适用性。
期刊介绍:
Neural Networks is a platform that aims to foster an international community of scholars and practitioners interested in neural networks, deep learning, and other approaches to artificial intelligence and machine learning. Our journal invites submissions covering various aspects of neural networks research, from computational neuroscience and cognitive modeling to mathematical analyses and engineering applications. By providing a forum for interdisciplinary discussions between biology and technology, we aim to encourage the development of biologically-inspired artificial intelligence.