A source free robust domain adaptation approach with pseudo-labels uncertainty estimation for rolling bearing fault diagnosis under limited sample conditions
{"title":"A source free robust domain adaptation approach with pseudo-labels uncertainty estimation for rolling bearing fault diagnosis under limited sample conditions","authors":"","doi":"10.1016/j.knosys.2024.112443","DOIUrl":null,"url":null,"abstract":"<div><p>As essential components of machinery equipment, rolling bearings directly affect the safety of the machinery equipment. The timely diagnosis of bearing faults can effectively prevent equipment lapses. However, bearings are often inconsistently distributed. This has resulted in a significant decrease in their availability. Moreover, the performances of traditional models are poor when fault samples are scarce. The unsupervised domain adaptation (UDA) model based on the transfer learning theory can solve the above problems in static scenarios. However, source domain data are often not directly accessible for privacy protection. Therefore, achieving the robustness of UDA models is significantly challenging. Source-free UDA can achieve a positive transfer from the source domain to the target domain based only on a pretrained source-domain model and unlabeled target-domain data. In this study, we built a source-free robust UDA approach with pseudo-label uncertainty estimation (SFRDA-PLUE) for diagnosing bearing faults using a limited number of samples. First, we designed a robust feature extractor (SANet) and proposed a novel binary soft-constrained information entropy. This was applied to solve the problem that standard information entropy cannot effectively estimate the uncertainty of pseudo-labels. In addition, we constructed a weighted comparison filter strategy to smoothen the fuzzy samples. Finally, we introduced an information-maximizing loss strategy to optimize the performance of the source domain classifier and the pseudo-label estimator. Thus, the robustness of the pseudo-label uncertainty estimation was significantly improved. The experimental results validated that the SFRDA-PLUE approach can achieve excellent diagnostic performance under a limited number of samples.</p></div>","PeriodicalId":49939,"journal":{"name":"Knowledge-Based Systems","volume":null,"pages":null},"PeriodicalIF":7.2000,"publicationDate":"2024-08-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Knowledge-Based Systems","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0950705124010773","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0
Abstract
As essential components of machinery equipment, rolling bearings directly affect the safety of the machinery equipment. The timely diagnosis of bearing faults can effectively prevent equipment lapses. However, bearings are often inconsistently distributed. This has resulted in a significant decrease in their availability. Moreover, the performances of traditional models are poor when fault samples are scarce. The unsupervised domain adaptation (UDA) model based on the transfer learning theory can solve the above problems in static scenarios. However, source domain data are often not directly accessible for privacy protection. Therefore, achieving the robustness of UDA models is significantly challenging. Source-free UDA can achieve a positive transfer from the source domain to the target domain based only on a pretrained source-domain model and unlabeled target-domain data. In this study, we built a source-free robust UDA approach with pseudo-label uncertainty estimation (SFRDA-PLUE) for diagnosing bearing faults using a limited number of samples. First, we designed a robust feature extractor (SANet) and proposed a novel binary soft-constrained information entropy. This was applied to solve the problem that standard information entropy cannot effectively estimate the uncertainty of pseudo-labels. In addition, we constructed a weighted comparison filter strategy to smoothen the fuzzy samples. Finally, we introduced an information-maximizing loss strategy to optimize the performance of the source domain classifier and the pseudo-label estimator. Thus, the robustness of the pseudo-label uncertainty estimation was significantly improved. The experimental results validated that the SFRDA-PLUE approach can achieve excellent diagnostic performance under a limited number of samples.
期刊介绍:
Knowledge-Based Systems, an international and interdisciplinary journal in artificial intelligence, publishes original, innovative, and creative research results in the field. It focuses on knowledge-based and other artificial intelligence techniques-based systems. The journal aims to support human prediction and decision-making through data science and computation techniques, provide a balanced coverage of theory and practical study, and encourage the development and implementation of knowledge-based intelligence models, methods, systems, and software tools. Applications in business, government, education, engineering, and healthcare are emphasized.