Think Fast: Time Control in Varying Paradigms of Spiking Neural Networks

Steven C. Nesbit, Andrew O'Brien, Jocelyn Rego, Gavin Parpart, Carlos Gonzalez, Garrett T. Kenyon, Edward Kim, T. Stewart, Y. Watkins
{"title":"Think Fast: Time Control in Varying Paradigms of Spiking Neural Networks","authors":"Steven C. Nesbit, Andrew O'Brien, Jocelyn Rego, Gavin Parpart, Carlos Gonzalez, Garrett T. Kenyon, Edward Kim, T. Stewart, Y. Watkins","doi":"10.1145/3546790.3546814","DOIUrl":null,"url":null,"abstract":"The state-of-the-art in machine learning has been achieved primarily by deep learning artificial neural networks. These networks are powerful but biologically implausible and energy intensive. In parallel, a new paradigm of neural network is being researched that can alleviate some of the computational and energy issues. These networks, spiking neural networks (SNNs), have transformative potential if the community is able to bridge the gap between deep learning and SNNs. However, SNNs are notoriously difficult to train and lack precision in their communication. In an effort to overcome these limitations and retain the benefits of the learning process in deep learning, we investigate novel ways to translate between them. We construct several network designs with varying degrees of biological plausibility. We then test our designs on an image classification task and demonstrate our designs allow for a customized tradeoff between biological plausibility, power efficiency, inference time, and accuracy.","PeriodicalId":104528,"journal":{"name":"Proceedings of the International Conference on Neuromorphic Systems 2022","volume":"1 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-07-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Proceedings of the International Conference on Neuromorphic Systems 2022","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1145/3546790.3546814","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

The state-of-the-art in machine learning has been achieved primarily by deep learning artificial neural networks. These networks are powerful but biologically implausible and energy intensive. In parallel, a new paradigm of neural network is being researched that can alleviate some of the computational and energy issues. These networks, spiking neural networks (SNNs), have transformative potential if the community is able to bridge the gap between deep learning and SNNs. However, SNNs are notoriously difficult to train and lack precision in their communication. In an effort to overcome these limitations and retain the benefits of the learning process in deep learning, we investigate novel ways to translate between them. We construct several network designs with varying degrees of biological plausibility. We then test our designs on an image classification task and demonstrate our designs allow for a customized tradeoff between biological plausibility, power efficiency, inference time, and accuracy.
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
快速思考:脉冲神经网络变化范式中的时间控制
机器学习的最新技术主要是通过深度学习人工神经网络实现的。这些网络很强大,但从生物学角度来说是不合理的,而且是能源密集型的。与此同时,人们正在研究一种新的神经网络范式,它可以减轻一些计算和能量问题。如果社区能够弥合深度学习和snn之间的差距,这些网络,即尖峰神经网络(snn),将具有变革潜力。然而,snn是出了名的难以训练和缺乏通信精度。为了克服这些限制并保留深度学习中学习过程的好处,我们研究了在它们之间进行转换的新方法。我们构建了几种具有不同程度生物学合理性的网络设计。然后,我们在图像分类任务上测试我们的设计,并证明我们的设计允许在生物合理性、功率效率、推理时间和准确性之间进行定制权衡。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
自引率
0.00%
发文量
0
期刊最新文献
Semi-Supervised Graph Structure Learning on Neuromorphic Computers A Neuromorphic Algorithm for Radiation Anomaly Detection Optimizing Recurrent Spiking Neural Networks with Small Time Constants for Temporal Tasks LODeNNS: A Linearly-approximated and Optimized Dendrocentric Nearest Neighbor STDP Apples-to-spikes: The first detailed comparison of LASSO solutions generated by a spiking neuromorphic processor
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1