利用尖峰神经网络实现面向工业场景的端到端轴承故障诊断

Yongqi Ding, Lin Zuo, Mengmeng Jing, Kunshan Yang, Biao Chen, Yunqian Yu
{"title":"利用尖峰神经网络实现面向工业场景的端到端轴承故障诊断","authors":"Yongqi Ding, Lin Zuo, Mengmeng Jing, Kunshan Yang, Biao Chen, Yunqian Yu","doi":"arxiv-2408.11067","DOIUrl":null,"url":null,"abstract":"Spiking neural networks (SNNs) transmit information via low-power binary\nspikes and have received widespread attention in areas such as computer vision\nand reinforcement learning. However, there have been very few explorations of\nSNNs in more practical industrial scenarios. In this paper, we focus on the\napplication of SNNs in bearing fault diagnosis to facilitate the integration of\nhigh-performance AI algorithms and real-world industries. In particular, we\nidentify two key limitations of existing SNN fault diagnosis methods:\ninadequate encoding capacity that necessitates cumbersome data preprocessing,\nand non-spike-oriented architectures that constrain the performance of SNNs. To\nalleviate these problems, we propose a Multi-scale Residual Attention SNN\n(MRA-SNN) to simultaneously improve the efficiency, performance, and robustness\nof SNN methods. By incorporating a lightweight attention mechanism, we have\ndesigned a multi-scale attention encoding module to extract multiscale fault\nfeatures from vibration signals and encode them as spatio-temporal spikes,\neliminating the need for complicated preprocessing. Then, the spike residual\nattention block extracts high-dimensional fault features and enhances the\nexpressiveness of sparse spikes with the attention mechanism for end-to-end\ndiagnosis. In addition, the performance and robustness of MRA-SNN is further\nenhanced by introducing the lightweight attention mechanism within the spiking\nneurons to simulate the biological dendritic filtering effect. Extensive\nexperiments on MFPT and JNU benchmark datasets demonstrate that MRA-SNN\nsignificantly outperforms existing methods in terms of accuracy, energy\nconsumption and noise robustness, and is more feasible for deployment in\nreal-world industrial scenarios.","PeriodicalId":501347,"journal":{"name":"arXiv - CS - Neural and Evolutionary Computing","volume":"37 1","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2024-08-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Toward End-to-End Bearing Fault Diagnosis for Industrial Scenarios with Spiking Neural Networks\",\"authors\":\"Yongqi Ding, Lin Zuo, Mengmeng Jing, Kunshan Yang, Biao Chen, Yunqian Yu\",\"doi\":\"arxiv-2408.11067\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Spiking neural networks (SNNs) transmit information via low-power binary\\nspikes and have received widespread attention in areas such as computer vision\\nand reinforcement learning. However, there have been very few explorations of\\nSNNs in more practical industrial scenarios. In this paper, we focus on the\\napplication of SNNs in bearing fault diagnosis to facilitate the integration of\\nhigh-performance AI algorithms and real-world industries. In particular, we\\nidentify two key limitations of existing SNN fault diagnosis methods:\\ninadequate encoding capacity that necessitates cumbersome data preprocessing,\\nand non-spike-oriented architectures that constrain the performance of SNNs. To\\nalleviate these problems, we propose a Multi-scale Residual Attention SNN\\n(MRA-SNN) to simultaneously improve the efficiency, performance, and robustness\\nof SNN methods. By incorporating a lightweight attention mechanism, we have\\ndesigned a multi-scale attention encoding module to extract multiscale fault\\nfeatures from vibration signals and encode them as spatio-temporal spikes,\\neliminating the need for complicated preprocessing. Then, the spike residual\\nattention block extracts high-dimensional fault features and enhances the\\nexpressiveness of sparse spikes with the attention mechanism for end-to-end\\ndiagnosis. In addition, the performance and robustness of MRA-SNN is further\\nenhanced by introducing the lightweight attention mechanism within the spiking\\nneurons to simulate the biological dendritic filtering effect. Extensive\\nexperiments on MFPT and JNU benchmark datasets demonstrate that MRA-SNN\\nsignificantly outperforms existing methods in terms of accuracy, energy\\nconsumption and noise robustness, and is more feasible for deployment in\\nreal-world industrial scenarios.\",\"PeriodicalId\":501347,\"journal\":{\"name\":\"arXiv - CS - Neural and Evolutionary Computing\",\"volume\":\"37 1\",\"pages\":\"\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2024-08-17\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"arXiv - CS - Neural and Evolutionary Computing\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/arxiv-2408.11067\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"arXiv - CS - Neural and Evolutionary Computing","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/arxiv-2408.11067","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

尖峰神经网络(SNN)通过低功耗二进制尖峰传递信息,在计算机视觉和强化学习等领域受到广泛关注。然而,在更实际的工业场景中,对 SNN 的探索却寥寥无几。在本文中,我们将重点讨论 SNN 在轴承故障诊断中的应用,以促进高性能人工智能算法与现实世界工业的融合。我们特别指出了现有 SNN 故障诊断方法的两个主要局限性:编码能力不足导致必须进行繁琐的数据预处理,以及非尖峰导向架构限制了 SNN 的性能。为了解决这些问题,我们提出了多尺度残差注意 SNN(MRA-SNN),以同时提高 SNN 方法的效率、性能和鲁棒性。通过采用轻量级注意机制,我们设计了一个多尺度注意编码模块,从振动信号中提取多尺度故障特征,并将其编码为时空尖峰,从而省去了复杂的预处理。然后,尖峰残差注意模块提取高维故障特征,并利用注意机制增强稀疏尖峰的可表达性,从而实现端到端诊断。此外,通过在尖峰神经元中引入轻量级注意机制来模拟生物树突过滤效应,进一步提高了 MRA-SNN 的性能和鲁棒性。在 MFPT 和 JNU 基准数据集上进行的广泛实验表明,MRA-SNN 在准确性、能耗和噪声鲁棒性方面明显优于现有方法,而且更适合部署在现实世界的工业场景中。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
Toward End-to-End Bearing Fault Diagnosis for Industrial Scenarios with Spiking Neural Networks
Spiking neural networks (SNNs) transmit information via low-power binary spikes and have received widespread attention in areas such as computer vision and reinforcement learning. However, there have been very few explorations of SNNs in more practical industrial scenarios. In this paper, we focus on the application of SNNs in bearing fault diagnosis to facilitate the integration of high-performance AI algorithms and real-world industries. In particular, we identify two key limitations of existing SNN fault diagnosis methods: inadequate encoding capacity that necessitates cumbersome data preprocessing, and non-spike-oriented architectures that constrain the performance of SNNs. To alleviate these problems, we propose a Multi-scale Residual Attention SNN (MRA-SNN) to simultaneously improve the efficiency, performance, and robustness of SNN methods. By incorporating a lightweight attention mechanism, we have designed a multi-scale attention encoding module to extract multiscale fault features from vibration signals and encode them as spatio-temporal spikes, eliminating the need for complicated preprocessing. Then, the spike residual attention block extracts high-dimensional fault features and enhances the expressiveness of sparse spikes with the attention mechanism for end-to-end diagnosis. In addition, the performance and robustness of MRA-SNN is further enhanced by introducing the lightweight attention mechanism within the spiking neurons to simulate the biological dendritic filtering effect. Extensive experiments on MFPT and JNU benchmark datasets demonstrate that MRA-SNN significantly outperforms existing methods in terms of accuracy, energy consumption and noise robustness, and is more feasible for deployment in real-world industrial scenarios.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
期刊最新文献
Hardware-Friendly Implementation of Physical Reservoir Computing with CMOS-based Time-domain Analog Spiking Neurons Self-Contrastive Forward-Forward Algorithm Bio-Inspired Mamba: Temporal Locality and Bioplausible Learning in Selective State Space Models PReLU: Yet Another Single-Layer Solution to the XOR Problem Inferno: An Extensible Framework for Spiking Neural Networks
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1