连通度控制着随机布尔网络水库设计的难度

IF 2.1 4区 医学 Q2 MATHEMATICAL & COMPUTATIONAL BIOLOGY Frontiers in Computational Neuroscience Pub Date : 2024-02-16 DOI:10.3389/fncom.2024.1348138
Emmanuel Calvet, Bertrand Reulet, Jean Rouat
{"title":"连通度控制着随机布尔网络水库设计的难度","authors":"Emmanuel Calvet, Bertrand Reulet, Jean Rouat","doi":"10.3389/fncom.2024.1348138","DOIUrl":null,"url":null,"abstract":"<p>Reservoir Computing (RC) is a paradigm in artificial intelligence where a recurrent neural network (RNN) is used to process temporal data, leveraging the inherent dynamical properties of the reservoir to perform complex computations. In the realm of RC, the excitatory-inhibitory balance <italic>b</italic> has been shown to be pivotal for driving the dynamics and performance of Echo State Networks (ESN) and, more recently, Random Boolean Network (RBN). However, the relationship between <italic>b</italic> and other parameters of the network is still poorly understood. This article explores how the interplay of the balance <italic>b</italic>, the connectivity degree <italic>K</italic> (i.e., the number of synapses per neuron) and the size of the network (i.e., the number of neurons <italic>N</italic>) influences the dynamics and performance (memory and prediction) of an RBN reservoir. Our findings reveal that <italic>K</italic> and <italic>b</italic> are strongly tied in optimal reservoirs. Reservoirs with high <italic>K</italic> have two optimal balances, one for globally inhibitory networks (<italic>b</italic> &lt; 0), and the other one for excitatory networks (<italic>b</italic> &gt; 0). Both show asymmetric performances about a zero balance. In contrast, for moderate <italic>K</italic>, the optimal value being <italic>K</italic> = 4, best reservoirs are obtained when excitation and inhibition almost, but not exactly, balance each other. For almost all <italic>K</italic>, the influence of the size is such that increasing <italic>N</italic> leads to better performance, even with very large values of <italic>N</italic>. Our investigation provides clear directions to generate optimal reservoirs or reservoirs with constraints on size or connectivity.</p>","PeriodicalId":12363,"journal":{"name":"Frontiers in Computational Neuroscience","volume":null,"pages":null},"PeriodicalIF":2.1000,"publicationDate":"2024-02-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"The connectivity degree controls the difficulty in reservoir design of random boolean networks\",\"authors\":\"Emmanuel Calvet, Bertrand Reulet, Jean Rouat\",\"doi\":\"10.3389/fncom.2024.1348138\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p>Reservoir Computing (RC) is a paradigm in artificial intelligence where a recurrent neural network (RNN) is used to process temporal data, leveraging the inherent dynamical properties of the reservoir to perform complex computations. In the realm of RC, the excitatory-inhibitory balance <italic>b</italic> has been shown to be pivotal for driving the dynamics and performance of Echo State Networks (ESN) and, more recently, Random Boolean Network (RBN). However, the relationship between <italic>b</italic> and other parameters of the network is still poorly understood. This article explores how the interplay of the balance <italic>b</italic>, the connectivity degree <italic>K</italic> (i.e., the number of synapses per neuron) and the size of the network (i.e., the number of neurons <italic>N</italic>) influences the dynamics and performance (memory and prediction) of an RBN reservoir. Our findings reveal that <italic>K</italic> and <italic>b</italic> are strongly tied in optimal reservoirs. Reservoirs with high <italic>K</italic> have two optimal balances, one for globally inhibitory networks (<italic>b</italic> &lt; 0), and the other one for excitatory networks (<italic>b</italic> &gt; 0). Both show asymmetric performances about a zero balance. In contrast, for moderate <italic>K</italic>, the optimal value being <italic>K</italic> = 4, best reservoirs are obtained when excitation and inhibition almost, but not exactly, balance each other. For almost all <italic>K</italic>, the influence of the size is such that increasing <italic>N</italic> leads to better performance, even with very large values of <italic>N</italic>. Our investigation provides clear directions to generate optimal reservoirs or reservoirs with constraints on size or connectivity.</p>\",\"PeriodicalId\":12363,\"journal\":{\"name\":\"Frontiers in Computational Neuroscience\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":2.1000,\"publicationDate\":\"2024-02-16\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Frontiers in Computational Neuroscience\",\"FirstCategoryId\":\"3\",\"ListUrlMain\":\"https://doi.org/10.3389/fncom.2024.1348138\",\"RegionNum\":4,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"MATHEMATICAL & COMPUTATIONAL BIOLOGY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Frontiers in Computational Neuroscience","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.3389/fncom.2024.1348138","RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"MATHEMATICAL & COMPUTATIONAL BIOLOGY","Score":null,"Total":0}
引用次数: 0

摘要

蓄水池计算(Reservoir Computing,RC)是人工智能领域的一种范式,利用蓄水池固有的动态特性来执行复杂的计算,从而使用循环神经网络(RNN)来处理时间数据。在 RC 领域,兴奋-抑制平衡 b 已被证明是驱动回声状态网络(ESN)以及最近的随机布尔网络(RBN)的动态和性能的关键。然而,人们对 b 与网络其他参数之间的关系仍然知之甚少。本文探讨了平衡 b、连通度 K(即每个神经元的突触数)和网络大小(即神经元数 N)之间的相互作用如何影响 RBN 储库的动态和性能(记忆和预测)。我们的研究结果表明,K 和 b 在最佳蓄水池中密切相关。高 K 值水库有两个最佳平衡点,一个是全局抑制性网络(b <0),另一个是兴奋性网络(b >0)。两者在零平衡时表现不对称。相反,对于中等 K(最佳值为 K = 4),当兴奋和抑制几乎(但不是完全)相互平衡时,就会获得最佳蓄水池。对于几乎所有的 K,大小的影响是增加 N 会带来更好的性能,即使 N 的值非常大。我们的研究为生成最佳水库或对大小或连接性有限制的水库提供了明确的方向。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
The connectivity degree controls the difficulty in reservoir design of random boolean networks

Reservoir Computing (RC) is a paradigm in artificial intelligence where a recurrent neural network (RNN) is used to process temporal data, leveraging the inherent dynamical properties of the reservoir to perform complex computations. In the realm of RC, the excitatory-inhibitory balance b has been shown to be pivotal for driving the dynamics and performance of Echo State Networks (ESN) and, more recently, Random Boolean Network (RBN). However, the relationship between b and other parameters of the network is still poorly understood. This article explores how the interplay of the balance b, the connectivity degree K (i.e., the number of synapses per neuron) and the size of the network (i.e., the number of neurons N) influences the dynamics and performance (memory and prediction) of an RBN reservoir. Our findings reveal that K and b are strongly tied in optimal reservoirs. Reservoirs with high K have two optimal balances, one for globally inhibitory networks (b < 0), and the other one for excitatory networks (b > 0). Both show asymmetric performances about a zero balance. In contrast, for moderate K, the optimal value being K = 4, best reservoirs are obtained when excitation and inhibition almost, but not exactly, balance each other. For almost all K, the influence of the size is such that increasing N leads to better performance, even with very large values of N. Our investigation provides clear directions to generate optimal reservoirs or reservoirs with constraints on size or connectivity.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Frontiers in Computational Neuroscience
Frontiers in Computational Neuroscience MATHEMATICAL & COMPUTATIONAL BIOLOGY-NEUROSCIENCES
CiteScore
5.30
自引率
3.10%
发文量
166
审稿时长
6-12 weeks
期刊介绍: Frontiers in Computational Neuroscience is a first-tier electronic journal devoted to promoting theoretical modeling of brain function and fostering interdisciplinary interactions between theoretical and experimental neuroscience. Progress in understanding the amazing capabilities of the brain is still limited, and we believe that it will only come with deep theoretical thinking and mutually stimulating cooperation between different disciplines and approaches. We therefore invite original contributions on a wide range of topics that present the fruits of such cooperation, or provide stimuli for future alliances. We aim to provide an interactive forum for cutting-edge theoretical studies of the nervous system, and for promulgating the best theoretical research to the broader neuroscience community. Models of all styles and at all levels are welcome, from biophysically motivated realistic simulations of neurons and synapses to high-level abstract models of inference and decision making. While the journal is primarily focused on theoretically based and driven research, we welcome experimental studies that validate and test theoretical conclusions. Also: comp neuro
期刊最新文献
A combinatorial deep learning method for Alzheimer's disease classification-based merging pretrained networks. Multi-scale asynchronous correlation and 2D convolutional autoencoder for adolescent health risk prediction with limited fMRI data. Decoding the application of deep learning in neuroscience: a bibliometric analysis. Optimizing extubation success: a comparative analysis of time series algorithms and activation functions. Editorial: Understanding and bridging the gap between neuromorphic computing and machine learning, volume II.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1