A supervised contrastive learning method based on online complement strategy for long-tailed fine-grained fault diagnosis

IF 9.9 1区 工程技术 Q1 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Advanced Engineering Informatics Pub Date : 2025-01-04 DOI:10.1016/j.aei.2024.103079
Zhiqian Zhao , Yinghou Jiao , Yeyin Xu , Runchao Zhao
{"title":"A supervised contrastive learning method based on online complement strategy for long-tailed fine-grained fault diagnosis","authors":"Zhiqian Zhao ,&nbsp;Yinghou Jiao ,&nbsp;Yeyin Xu ,&nbsp;Runchao Zhao","doi":"10.1016/j.aei.2024.103079","DOIUrl":null,"url":null,"abstract":"<div><div>As industrial automation and intelligence advance, equipment complexity rises, leading to diverse fault patterns. In fine-grained fault diagnosis, sample scarcity causes a significant long-tail effect, where main fault categories dominate. High intra-class variance and inter-class similarity in fine-grained categories impede the performance of traditional supervised contrastive learning, particularly for underrepresented tail categories in feature space. To address the above problems, a novel supervised contrast learning method for long-tailed fine-grained fault diagnosis, OC-SupCon, is proposed to improve the feature representations through the online complement strategy. Supervised contrastive learning is used as the model framework to ensure that each batch contains the inherent features of all fine-grained categories by introducing a class-centered prototype. Then, data augmentation is dynamically complemented by assessing the neighborhood sparsity of the samples to reduce the unfavorable influence on the features of the tail categories. Finally, the dominance of the head category is mitigated by balancing the gradient contributions of different fine-grained categories. In addition, Logit compensation technique is used in the classifier branch to adjust the category boundaries, and the class center prototypes are dynamically updated during the training process. The experimental results show that the proposed method exhibits significant performance in long-tailed fine-grained fault diagnosis tasks compared to existing state-of-the-art methods. The code is available from <span><span>https://github.com/zhiqan/OC-Supcon</span><svg><path></path></svg></span>.</div></div>","PeriodicalId":50941,"journal":{"name":"Advanced Engineering Informatics","volume":"64 ","pages":"Article 103079"},"PeriodicalIF":9.9000,"publicationDate":"2025-01-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Advanced Engineering Informatics","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1474034624007304","RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0

Abstract

As industrial automation and intelligence advance, equipment complexity rises, leading to diverse fault patterns. In fine-grained fault diagnosis, sample scarcity causes a significant long-tail effect, where main fault categories dominate. High intra-class variance and inter-class similarity in fine-grained categories impede the performance of traditional supervised contrastive learning, particularly for underrepresented tail categories in feature space. To address the above problems, a novel supervised contrast learning method for long-tailed fine-grained fault diagnosis, OC-SupCon, is proposed to improve the feature representations through the online complement strategy. Supervised contrastive learning is used as the model framework to ensure that each batch contains the inherent features of all fine-grained categories by introducing a class-centered prototype. Then, data augmentation is dynamically complemented by assessing the neighborhood sparsity of the samples to reduce the unfavorable influence on the features of the tail categories. Finally, the dominance of the head category is mitigated by balancing the gradient contributions of different fine-grained categories. In addition, Logit compensation technique is used in the classifier branch to adjust the category boundaries, and the class center prototypes are dynamically updated during the training process. The experimental results show that the proposed method exhibits significant performance in long-tailed fine-grained fault diagnosis tasks compared to existing state-of-the-art methods. The code is available from https://github.com/zhiqan/OC-Supcon.
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
基于在线互补策略的监督对比学习方法用于长尾细粒度故障诊断
随着工业自动化和智能化的发展,设备的复杂性不断提高,导致故障模式的多样化。在细粒度故障诊断中,样本稀缺性会产生显著的长尾效应,主要故障类别占主导地位。细粒度类别的高类内方差和类间相似性阻碍了传统监督对比学习的性能,特别是对于特征空间中代表性不足的尾部类别。针对上述问题,提出了一种新的长尾细粒度故障诊断的监督对比学习方法OC-SupCon,通过在线互补策略改进特征表示。采用监督对比学习作为模型框架,通过引入以类为中心的原型,确保每批都包含所有细粒度类别的固有特征。然后,通过评估样本的邻域稀疏度来动态补充数据增强,以减少对尾部类别特征的不利影响。最后,通过平衡不同细粒度类别的梯度贡献来减轻头部类别的优势。此外,在分类器分支中采用Logit补偿技术调整分类边界,并在训练过程中动态更新类中心原型。实验结果表明,与现有的先进方法相比,该方法在长尾细粒度故障诊断任务中表现出显著的性能。该代码可从https://github.com/zhiqan/OC-Supcon获得。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
Advanced Engineering Informatics
Advanced Engineering Informatics 工程技术-工程:综合
CiteScore
12.40
自引率
18.20%
发文量
292
审稿时长
45 days
期刊介绍: Advanced Engineering Informatics is an international Journal that solicits research papers with an emphasis on 'knowledge' and 'engineering applications'. The Journal seeks original papers that report progress in applying methods of engineering informatics. These papers should have engineering relevance and help provide a scientific base for more reliable, spontaneous, and creative engineering decision-making. Additionally, papers should demonstrate the science of supporting knowledge-intensive engineering tasks and validate the generality, power, and scalability of new methods through rigorous evaluation, preferably both qualitatively and quantitatively. Abstracting and indexing for Advanced Engineering Informatics include Science Citation Index Expanded, Scopus and INSPEC.
期刊最新文献
IDS-Net: A novel framework for few-shot photovoltaic power prediction with interpretable dynamic selection and feature information fusion How does contextual fidelity impact how we think, talk, and act in AI-assisted engineering design? An improved penalty kriging method for mixed qualitative and quantitative factors Hybrid-sequence self-learning model: Unsupervised anomaly detection and localization in multivariate time series Fractional-order derivative polynomial grey particle filtering for milling tool remaining useful life prediction
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1