{"title":"用于旋转机械多传感器故障诊断的合作卷积神经网络框架","authors":"Tianzhuang Yu;Zeyu Jiang;Zhaohui Ren;Yongchao Zhang;Shihua Zhou;Xin Zhou","doi":"10.1109/JSEN.2024.3468631","DOIUrl":null,"url":null,"abstract":"Multisensor data fusion techniques and advanced convolutional neural network (CNN) have contributed significantly to the development of intelligent fault diagnosis. However, few studies consider the information interactions between different sensor data, which limits the performance of diagnosis frameworks. This article introduces the novel convolution concept and the cross attention mechanism, proposing a cross attention fusion CNN (CAFCNN) diagnostic framework to improve the multisensor collaborative diagnostic technique. Specifically, a global correlation matrix is first developed to encode signals as images, highlighting the correlations between different points in the time-series data. Then, an attention mechanism called global spatial (GS) attention is proposed for extracting positional and spatial information in images. Finally, the developed interactive fusion module (IFM) utilizes cross attention to achieve information interaction of features from different sensors. The created gear dataset and the publicly available bearing dataset validate the effectiveness and generalization of the proposed methods. Moreover, the information interaction capability of CAFCNN is explained by visualizing the features.","PeriodicalId":447,"journal":{"name":"IEEE Sensors Journal","volume":"24 22","pages":"38309-38317"},"PeriodicalIF":4.3000,"publicationDate":"2024-10-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"A Cooperative Convolutional Neural Network Framework for Multisensor Fault Diagnosis of Rotating Machinery\",\"authors\":\"Tianzhuang Yu;Zeyu Jiang;Zhaohui Ren;Yongchao Zhang;Shihua Zhou;Xin Zhou\",\"doi\":\"10.1109/JSEN.2024.3468631\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Multisensor data fusion techniques and advanced convolutional neural network (CNN) have contributed significantly to the development of intelligent fault diagnosis. However, few studies consider the information interactions between different sensor data, which limits the performance of diagnosis frameworks. This article introduces the novel convolution concept and the cross attention mechanism, proposing a cross attention fusion CNN (CAFCNN) diagnostic framework to improve the multisensor collaborative diagnostic technique. Specifically, a global correlation matrix is first developed to encode signals as images, highlighting the correlations between different points in the time-series data. Then, an attention mechanism called global spatial (GS) attention is proposed for extracting positional and spatial information in images. Finally, the developed interactive fusion module (IFM) utilizes cross attention to achieve information interaction of features from different sensors. The created gear dataset and the publicly available bearing dataset validate the effectiveness and generalization of the proposed methods. Moreover, the information interaction capability of CAFCNN is explained by visualizing the features.\",\"PeriodicalId\":447,\"journal\":{\"name\":\"IEEE Sensors Journal\",\"volume\":\"24 22\",\"pages\":\"38309-38317\"},\"PeriodicalIF\":4.3000,\"publicationDate\":\"2024-10-02\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Sensors Journal\",\"FirstCategoryId\":\"103\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10704564/\",\"RegionNum\":2,\"RegionCategory\":\"综合性期刊\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENGINEERING, ELECTRICAL & ELECTRONIC\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Sensors Journal","FirstCategoryId":"103","ListUrlMain":"https://ieeexplore.ieee.org/document/10704564/","RegionNum":2,"RegionCategory":"综合性期刊","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
A Cooperative Convolutional Neural Network Framework for Multisensor Fault Diagnosis of Rotating Machinery
Multisensor data fusion techniques and advanced convolutional neural network (CNN) have contributed significantly to the development of intelligent fault diagnosis. However, few studies consider the information interactions between different sensor data, which limits the performance of diagnosis frameworks. This article introduces the novel convolution concept and the cross attention mechanism, proposing a cross attention fusion CNN (CAFCNN) diagnostic framework to improve the multisensor collaborative diagnostic technique. Specifically, a global correlation matrix is first developed to encode signals as images, highlighting the correlations between different points in the time-series data. Then, an attention mechanism called global spatial (GS) attention is proposed for extracting positional and spatial information in images. Finally, the developed interactive fusion module (IFM) utilizes cross attention to achieve information interaction of features from different sensors. The created gear dataset and the publicly available bearing dataset validate the effectiveness and generalization of the proposed methods. Moreover, the information interaction capability of CAFCNN is explained by visualizing the features.
期刊介绍:
The fields of interest of the IEEE Sensors Journal are the theory, design , fabrication, manufacturing and applications of devices for sensing and transducing physical, chemical and biological phenomena, with emphasis on the electronics and physics aspect of sensors and integrated sensors-actuators. IEEE Sensors Journal deals with the following:
-Sensor Phenomenology, Modelling, and Evaluation
-Sensor Materials, Processing, and Fabrication
-Chemical and Gas Sensors
-Microfluidics and Biosensors
-Optical Sensors
-Physical Sensors: Temperature, Mechanical, Magnetic, and others
-Acoustic and Ultrasonic Sensors
-Sensor Packaging
-Sensor Networks
-Sensor Applications
-Sensor Systems: Signals, Processing, and Interfaces
-Actuators and Sensor Power Systems
-Sensor Signal Processing for high precision and stability (amplification, filtering, linearization, modulation/demodulation) and under harsh conditions (EMC, radiation, humidity, temperature); energy consumption/harvesting
-Sensor Data Processing (soft computing with sensor data, e.g., pattern recognition, machine learning, evolutionary computation; sensor data fusion, processing of wave e.g., electromagnetic and acoustic; and non-wave, e.g., chemical, gravity, particle, thermal, radiative and non-radiative sensor data, detection, estimation and classification based on sensor data)
-Sensors in Industrial Practice