环形模型的状态滤波

Jing Yan, Yunxuan Feng, Wei Dai, Yaoyu Zhang
{"title":"环形模型的状态滤波","authors":"Jing Yan, Yunxuan Feng, Wei Dai, Yaoyu Zhang","doi":"arxiv-2408.01817","DOIUrl":null,"url":null,"abstract":"Robustness is a measure of functional reliability of a system against\nperturbations. To achieve a good and robust performance, a system must filter\nout external perturbations by its internal priors. These priors are usually\ndistilled in the structure and the states of the system. Biophysical neural\nnetwork are known to be robust but the exact mechanisms are still elusive. In\nthis paper, we probe how orientation-selective neurons organized on a 1-D ring\nnetwork respond to perturbations in the hope of gaining some insights on the\nrobustness of visual system in brain. We analyze the steady-state of the\nrate-based network and prove that the activation state of neurons, rather than\ntheir firing rates, determines how the model respond to perturbations. We then\nidentify specific perturbation patterns that induce the largest responses for\ndifferent configurations of activation states, and find them to be sinusoidal\nor sinusoidal-like while other patterns are largely attenuated. Similar results\nare observed in a spiking ring model. Finally, we remap the perturbations in\norientation back into the 2-D image space using Gabor functions. The resulted\noptimal perturbation patterns mirror adversarial attacks in deep learning that\nexploit the priors of the system. Our results suggest that based on different\nstate configurations, these priors could underlie some of the illusionary\nexperiences as the cost of visual robustness.","PeriodicalId":501517,"journal":{"name":"arXiv - QuanBio - Neurons and Cognition","volume":"49 1","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2024-08-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"State-dependent Filtering of the Ring Model\",\"authors\":\"Jing Yan, Yunxuan Feng, Wei Dai, Yaoyu Zhang\",\"doi\":\"arxiv-2408.01817\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Robustness is a measure of functional reliability of a system against\\nperturbations. To achieve a good and robust performance, a system must filter\\nout external perturbations by its internal priors. These priors are usually\\ndistilled in the structure and the states of the system. Biophysical neural\\nnetwork are known to be robust but the exact mechanisms are still elusive. In\\nthis paper, we probe how orientation-selective neurons organized on a 1-D ring\\nnetwork respond to perturbations in the hope of gaining some insights on the\\nrobustness of visual system in brain. We analyze the steady-state of the\\nrate-based network and prove that the activation state of neurons, rather than\\ntheir firing rates, determines how the model respond to perturbations. We then\\nidentify specific perturbation patterns that induce the largest responses for\\ndifferent configurations of activation states, and find them to be sinusoidal\\nor sinusoidal-like while other patterns are largely attenuated. Similar results\\nare observed in a spiking ring model. Finally, we remap the perturbations in\\norientation back into the 2-D image space using Gabor functions. The resulted\\noptimal perturbation patterns mirror adversarial attacks in deep learning that\\nexploit the priors of the system. Our results suggest that based on different\\nstate configurations, these priors could underlie some of the illusionary\\nexperiences as the cost of visual robustness.\",\"PeriodicalId\":501517,\"journal\":{\"name\":\"arXiv - QuanBio - Neurons and Cognition\",\"volume\":\"49 1\",\"pages\":\"\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2024-08-03\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"arXiv - QuanBio - Neurons and Cognition\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/arxiv-2408.01817\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"arXiv - QuanBio - Neurons and Cognition","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/arxiv-2408.01817","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

鲁棒性是衡量一个系统抵御扰动的功能可靠性。要实现良好的鲁棒性能,系统必须通过其内部先验过滤掉外部扰动。这些先验通常体现在系统的结构和状态中。众所周知,生物物理神经网络具有鲁棒性,但其确切机制仍难以捉摸。在本文中,我们探究了组织在一维环状网络上的方向选择性神经元如何对扰动做出反应,希望能对大脑视觉系统的鲁棒性有一些启发。我们分析了基于神经元网络的稳态,证明神经元的激活状态而非其发射率决定了模型对扰动的响应。然后,我们确定了特定的扰动模式,这些模式在不同的激活状态配置下会引起最大的响应,并发现它们是正弦或类似正弦的,而其他模式在很大程度上会减弱。在尖峰环模型中也观察到了类似的结果。最后,我们使用 Gabor 函数将方向扰动重映射回二维图像空间。最终得出的最优扰动模式反映了深度学习中利用系统先验的对抗性攻击。我们的研究结果表明,基于不同的状态配置,这些先验可能是一些幻觉体验的基础,也是视觉鲁棒性的代价。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
State-dependent Filtering of the Ring Model
Robustness is a measure of functional reliability of a system against perturbations. To achieve a good and robust performance, a system must filter out external perturbations by its internal priors. These priors are usually distilled in the structure and the states of the system. Biophysical neural network are known to be robust but the exact mechanisms are still elusive. In this paper, we probe how orientation-selective neurons organized on a 1-D ring network respond to perturbations in the hope of gaining some insights on the robustness of visual system in brain. We analyze the steady-state of the rate-based network and prove that the activation state of neurons, rather than their firing rates, determines how the model respond to perturbations. We then identify specific perturbation patterns that induce the largest responses for different configurations of activation states, and find them to be sinusoidal or sinusoidal-like while other patterns are largely attenuated. Similar results are observed in a spiking ring model. Finally, we remap the perturbations in orientation back into the 2-D image space using Gabor functions. The resulted optimal perturbation patterns mirror adversarial attacks in deep learning that exploit the priors of the system. Our results suggest that based on different state configurations, these priors could underlie some of the illusionary experiences as the cost of visual robustness.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
期刊最新文献
Early reduced dopaminergic tone mediated by D3 receptor and dopamine transporter in absence epileptogenesis Contrasformer: A Brain Network Contrastive Transformer for Neurodegenerative Condition Identification Identifying Influential nodes in Brain Networks via Self-Supervised Graph-Transformer Contrastive Learning in Memristor-based Neuromorphic Systems Self-Attention Limits Working Memory Capacity of Transformer-Based Models
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1