Danya Xu;Yi Liu;Guanghui Wen;Yaochu Jin;Tianyou Chai;Tao Yang
{"title":"DeFedTL: A Decentralized Federated Transfer Learning Method for Fault Diagnosis","authors":"Danya Xu;Yi Liu;Guanghui Wen;Yaochu Jin;Tianyou Chai;Tao Yang","doi":"10.1109/TII.2024.3485801","DOIUrl":null,"url":null,"abstract":"Deep learning has become increasingly important in fault diagnosis, but it relies on a large amount of high-quality labeled data. Collecting data from distributed machines can expand the dataset, but it usually leads to privacy concerns. Moreover, since the operating conditions are complex in real-world applications, the collected training data and the test data often have different distributions. Therefore, a well-trained model on the training data may not be suitable for test data due to the domain shift. To preserve privacy and to mitigate the domain shift, in existing federated transfer learning fault diagnosis methods, distributed machines exchange model parameters and features rather than raw data with the central server. However, such methods suffer from a single point of failure and high communication burden. To address these issues, we propose a fully decentralized federated transfer learning fault diagnosis method. More specifically, the proposed method obtains a pretrained model among source nodes with labeled training data where each source node exchanges model parameters with its neighboring source nodes. Moreover, a novel transfer learning strategy is proposed, which aligns features of test data at the target node with features of training data at its connected source nodes to mitigate misclassifications resulting from the domain shift. The effectiveness of the proposed method is verified by various experiments on two public bearing datasets.","PeriodicalId":13301,"journal":{"name":"IEEE Transactions on Industrial Informatics","volume":"21 2","pages":"1704-1713"},"PeriodicalIF":9.9000,"publicationDate":"2024-11-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Industrial Informatics","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/10750038/","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"AUTOMATION & CONTROL SYSTEMS","Score":null,"Total":0}
引用次数: 0
Abstract
Deep learning has become increasingly important in fault diagnosis, but it relies on a large amount of high-quality labeled data. Collecting data from distributed machines can expand the dataset, but it usually leads to privacy concerns. Moreover, since the operating conditions are complex in real-world applications, the collected training data and the test data often have different distributions. Therefore, a well-trained model on the training data may not be suitable for test data due to the domain shift. To preserve privacy and to mitigate the domain shift, in existing federated transfer learning fault diagnosis methods, distributed machines exchange model parameters and features rather than raw data with the central server. However, such methods suffer from a single point of failure and high communication burden. To address these issues, we propose a fully decentralized federated transfer learning fault diagnosis method. More specifically, the proposed method obtains a pretrained model among source nodes with labeled training data where each source node exchanges model parameters with its neighboring source nodes. Moreover, a novel transfer learning strategy is proposed, which aligns features of test data at the target node with features of training data at its connected source nodes to mitigate misclassifications resulting from the domain shift. The effectiveness of the proposed method is verified by various experiments on two public bearing datasets.
期刊介绍:
The IEEE Transactions on Industrial Informatics is a multidisciplinary journal dedicated to publishing technical papers that connect theory with practical applications of informatics in industrial settings. It focuses on the utilization of information in intelligent, distributed, and agile industrial automation and control systems. The scope includes topics such as knowledge-based and AI-enhanced automation, intelligent computer control systems, flexible and collaborative manufacturing, industrial informatics in software-defined vehicles and robotics, computer vision, industrial cyber-physical and industrial IoT systems, real-time and networked embedded systems, security in industrial processes, industrial communications, systems interoperability, and human-machine interaction.