{"title":"Toward End-to-End Bearing Fault Diagnosis for Industrial Scenarios with Spiking Neural Networks","authors":"Yongqi Ding, Lin Zuo, Mengmeng Jing, Kunshan Yang, Biao Chen, Yunqian Yu","doi":"arxiv-2408.11067","DOIUrl":null,"url":null,"abstract":"Spiking neural networks (SNNs) transmit information via low-power binary\nspikes and have received widespread attention in areas such as computer vision\nand reinforcement learning. However, there have been very few explorations of\nSNNs in more practical industrial scenarios. In this paper, we focus on the\napplication of SNNs in bearing fault diagnosis to facilitate the integration of\nhigh-performance AI algorithms and real-world industries. In particular, we\nidentify two key limitations of existing SNN fault diagnosis methods:\ninadequate encoding capacity that necessitates cumbersome data preprocessing,\nand non-spike-oriented architectures that constrain the performance of SNNs. To\nalleviate these problems, we propose a Multi-scale Residual Attention SNN\n(MRA-SNN) to simultaneously improve the efficiency, performance, and robustness\nof SNN methods. By incorporating a lightweight attention mechanism, we have\ndesigned a multi-scale attention encoding module to extract multiscale fault\nfeatures from vibration signals and encode them as spatio-temporal spikes,\neliminating the need for complicated preprocessing. Then, the spike residual\nattention block extracts high-dimensional fault features and enhances the\nexpressiveness of sparse spikes with the attention mechanism for end-to-end\ndiagnosis. In addition, the performance and robustness of MRA-SNN is further\nenhanced by introducing the lightweight attention mechanism within the spiking\nneurons to simulate the biological dendritic filtering effect. Extensive\nexperiments on MFPT and JNU benchmark datasets demonstrate that MRA-SNN\nsignificantly outperforms existing methods in terms of accuracy, energy\nconsumption and noise robustness, and is more feasible for deployment in\nreal-world industrial scenarios.","PeriodicalId":501347,"journal":{"name":"arXiv - CS - Neural and Evolutionary Computing","volume":"37 1","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2024-08-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"arXiv - CS - Neural and Evolutionary Computing","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/arxiv-2408.11067","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
Abstract
Spiking neural networks (SNNs) transmit information via low-power binary
spikes and have received widespread attention in areas such as computer vision
and reinforcement learning. However, there have been very few explorations of
SNNs in more practical industrial scenarios. In this paper, we focus on the
application of SNNs in bearing fault diagnosis to facilitate the integration of
high-performance AI algorithms and real-world industries. In particular, we
identify two key limitations of existing SNN fault diagnosis methods:
inadequate encoding capacity that necessitates cumbersome data preprocessing,
and non-spike-oriented architectures that constrain the performance of SNNs. To
alleviate these problems, we propose a Multi-scale Residual Attention SNN
(MRA-SNN) to simultaneously improve the efficiency, performance, and robustness
of SNN methods. By incorporating a lightweight attention mechanism, we have
designed a multi-scale attention encoding module to extract multiscale fault
features from vibration signals and encode them as spatio-temporal spikes,
eliminating the need for complicated preprocessing. Then, the spike residual
attention block extracts high-dimensional fault features and enhances the
expressiveness of sparse spikes with the attention mechanism for end-to-end
diagnosis. In addition, the performance and robustness of MRA-SNN is further
enhanced by introducing the lightweight attention mechanism within the spiking
neurons to simulate the biological dendritic filtering effect. Extensive
experiments on MFPT and JNU benchmark datasets demonstrate that MRA-SNN
significantly outperforms existing methods in terms of accuracy, energy
consumption and noise robustness, and is more feasible for deployment in
real-world industrial scenarios.