A two-stage learning framework for imbalanced semi-supervised domain generalization fault diagnosis under unknown operating conditions

IF 8 1区 工程技术 Q1 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Advanced Engineering Informatics Pub Date : 2024-10-01 DOI:10.1016/j.aei.2024.102878
Chuanxia Jian, Heen Chen, Yinhui Ao, Xiaobo Zhang
{"title":"A two-stage learning framework for imbalanced semi-supervised domain generalization fault diagnosis under unknown operating conditions","authors":"Chuanxia Jian,&nbsp;Heen Chen,&nbsp;Yinhui Ao,&nbsp;Xiaobo Zhang","doi":"10.1016/j.aei.2024.102878","DOIUrl":null,"url":null,"abstract":"<div><div>The diagnosis of mechanical faults under unknown operating conditions has been extensively investigated. In real industrial scenarios, fault diagnosis often faces challenges such as class imbalance, scarcity of class labels, and domain shifts. Existing methods cannot simultaneously address these issues. Therefore, this study proposes an imbalanced semi-supervised domain generalization-based fault diagnosis (ISDGFD) learning paradigm and develops a two-stage learning framework to tackle these issues. In the first stage, labeled data is preprocessed to address class imbalance, key features are extracted using a multi-scale convolutional neural network with a self-attention mechanism, and domain-invariant and class-aware features are initially learned through multi-domain adversarial learning and supervised learning, respectively. In the second stage, reliable pseudo-labeled samples are selected and a weighted pseudo-labeled loss is used to retrain the model, further enhancing generalization capability. Extensive experiments were conducted on the CWRU and HUST datasets. The proposed method achieved average scores of 0.85 in <em>Recall</em>, 0.87 in <em>F-score</em>, and 0.92 in <em>Accuracy</em> on the CWRU dataset, and 0.8052 in <em>Recall</em>, 0.7747 in <em>F-score</em>, and 0.8398 in <em>Accuracy</em> on the HUST dataset. These results outperform those of existing state-of-the-art semi-supervised Domain Generalization-based Fault Diagnosis (DGFD) methods and are comparable to the results of fully-supervised imbalanced DGFD methods, demonstrating its effectiveness for ISDGFD under unknown operating conditions.</div></div>","PeriodicalId":50941,"journal":{"name":"Advanced Engineering Informatics","volume":"62 ","pages":"Article 102878"},"PeriodicalIF":8.0000,"publicationDate":"2024-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Advanced Engineering Informatics","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1474034624005263","RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0

Abstract

The diagnosis of mechanical faults under unknown operating conditions has been extensively investigated. In real industrial scenarios, fault diagnosis often faces challenges such as class imbalance, scarcity of class labels, and domain shifts. Existing methods cannot simultaneously address these issues. Therefore, this study proposes an imbalanced semi-supervised domain generalization-based fault diagnosis (ISDGFD) learning paradigm and develops a two-stage learning framework to tackle these issues. In the first stage, labeled data is preprocessed to address class imbalance, key features are extracted using a multi-scale convolutional neural network with a self-attention mechanism, and domain-invariant and class-aware features are initially learned through multi-domain adversarial learning and supervised learning, respectively. In the second stage, reliable pseudo-labeled samples are selected and a weighted pseudo-labeled loss is used to retrain the model, further enhancing generalization capability. Extensive experiments were conducted on the CWRU and HUST datasets. The proposed method achieved average scores of 0.85 in Recall, 0.87 in F-score, and 0.92 in Accuracy on the CWRU dataset, and 0.8052 in Recall, 0.7747 in F-score, and 0.8398 in Accuracy on the HUST dataset. These results outperform those of existing state-of-the-art semi-supervised Domain Generalization-based Fault Diagnosis (DGFD) methods and are comparable to the results of fully-supervised imbalanced DGFD methods, demonstrating its effectiveness for ISDGFD under unknown operating conditions.
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
用于未知运行条件下不平衡半监督领域泛化故障诊断的两阶段学习框架
人们对未知运行条件下的机械故障诊断进行了广泛研究。在实际工业场景中,故障诊断往往面临类别不平衡、类别标签稀缺和领域偏移等挑战。现有方法无法同时解决这些问题。因此,本研究提出了一种基于不平衡半监督领域泛化的故障诊断(ISDGFD)学习范式,并开发了一个两阶段学习框架来解决这些问题。在第一阶段,对标记数据进行预处理以解决类不平衡问题,使用具有自注意机制的多尺度卷积神经网络提取关键特征,并分别通过多域对抗学习和监督学习初步学习域不变特征和类感知特征。在第二阶段,选择可靠的伪标记样本,利用加权伪标记损失对模型进行再训练,进一步提高泛化能力。在 CWRU 和 HUST 数据集上进行了广泛的实验。所提方法在 CWRU 数据集上的平均召回率为 0.85,F-score 为 0.87,准确率为 0.92;在 HUST 数据集上的平均召回率为 0.8052,F-score 为 0.7747,准确率为 0.8398。这些结果优于现有最先进的基于领域泛化的半监督故障诊断(DGFD)方法,并与全监督不平衡 DGFD 方法的结果相当,证明了它在未知运行条件下进行 ISDGFD 的有效性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
Advanced Engineering Informatics
Advanced Engineering Informatics 工程技术-工程:综合
CiteScore
12.40
自引率
18.20%
发文量
292
审稿时长
45 days
期刊介绍: Advanced Engineering Informatics is an international Journal that solicits research papers with an emphasis on 'knowledge' and 'engineering applications'. The Journal seeks original papers that report progress in applying methods of engineering informatics. These papers should have engineering relevance and help provide a scientific base for more reliable, spontaneous, and creative engineering decision-making. Additionally, papers should demonstrate the science of supporting knowledge-intensive engineering tasks and validate the generality, power, and scalability of new methods through rigorous evaluation, preferably both qualitatively and quantitatively. Abstracting and indexing for Advanced Engineering Informatics include Science Citation Index Expanded, Scopus and INSPEC.
期刊最新文献
A method for constructing an ergonomics evaluation indicator system for community aging services based on Kano-Delphi-CFA: A case study in China A temperature-sensitive points selection method for machine tool based on rough set and multi-objective adaptive hybrid evolutionary algorithm Enhancing EEG artifact removal through neural architecture search with large kernels Optimal design of an integrated inspection scheme with two adjustable sampling mechanisms for lot disposition A novel product shape design method integrating Kansei engineering and whale optimization algorithm
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1