{"title":"A supervised contrastive learning method based on online complement strategy for long-tailed fine-grained fault diagnosis","authors":"Zhiqian Zhao , Yinghou Jiao , Yeyin Xu , Runchao Zhao","doi":"10.1016/j.aei.2024.103079","DOIUrl":null,"url":null,"abstract":"<div><div>As industrial automation and intelligence advance, equipment complexity rises, leading to diverse fault patterns. In fine-grained fault diagnosis, sample scarcity causes a significant long-tail effect, where main fault categories dominate. High intra-class variance and inter-class similarity in fine-grained categories impede the performance of traditional supervised contrastive learning, particularly for underrepresented tail categories in feature space. To address the above problems, a novel supervised contrast learning method for long-tailed fine-grained fault diagnosis, OC-SupCon, is proposed to improve the feature representations through the online complement strategy. Supervised contrastive learning is used as the model framework to ensure that each batch contains the inherent features of all fine-grained categories by introducing a class-centered prototype. Then, data augmentation is dynamically complemented by assessing the neighborhood sparsity of the samples to reduce the unfavorable influence on the features of the tail categories. Finally, the dominance of the head category is mitigated by balancing the gradient contributions of different fine-grained categories. In addition, Logit compensation technique is used in the classifier branch to adjust the category boundaries, and the class center prototypes are dynamically updated during the training process. The experimental results show that the proposed method exhibits significant performance in long-tailed fine-grained fault diagnosis tasks compared to existing state-of-the-art methods. The code is available from <span><span>https://github.com/zhiqan/OC-Supcon</span><svg><path></path></svg></span>.</div></div>","PeriodicalId":50941,"journal":{"name":"Advanced Engineering Informatics","volume":"64 ","pages":"Article 103079"},"PeriodicalIF":8.0000,"publicationDate":"2025-01-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Advanced Engineering Informatics","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1474034624007304","RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0
Abstract
As industrial automation and intelligence advance, equipment complexity rises, leading to diverse fault patterns. In fine-grained fault diagnosis, sample scarcity causes a significant long-tail effect, where main fault categories dominate. High intra-class variance and inter-class similarity in fine-grained categories impede the performance of traditional supervised contrastive learning, particularly for underrepresented tail categories in feature space. To address the above problems, a novel supervised contrast learning method for long-tailed fine-grained fault diagnosis, OC-SupCon, is proposed to improve the feature representations through the online complement strategy. Supervised contrastive learning is used as the model framework to ensure that each batch contains the inherent features of all fine-grained categories by introducing a class-centered prototype. Then, data augmentation is dynamically complemented by assessing the neighborhood sparsity of the samples to reduce the unfavorable influence on the features of the tail categories. Finally, the dominance of the head category is mitigated by balancing the gradient contributions of different fine-grained categories. In addition, Logit compensation technique is used in the classifier branch to adjust the category boundaries, and the class center prototypes are dynamically updated during the training process. The experimental results show that the proposed method exhibits significant performance in long-tailed fine-grained fault diagnosis tasks compared to existing state-of-the-art methods. The code is available from https://github.com/zhiqan/OC-Supcon.
期刊介绍:
Advanced Engineering Informatics is an international Journal that solicits research papers with an emphasis on 'knowledge' and 'engineering applications'. The Journal seeks original papers that report progress in applying methods of engineering informatics. These papers should have engineering relevance and help provide a scientific base for more reliable, spontaneous, and creative engineering decision-making. Additionally, papers should demonstrate the science of supporting knowledge-intensive engineering tasks and validate the generality, power, and scalability of new methods through rigorous evaluation, preferably both qualitatively and quantitatively. Abstracting and indexing for Advanced Engineering Informatics include Science Citation Index Expanded, Scopus and INSPEC.