Liu Cheng , Haochen Qi , Rongcai Ma , Xiangwei Kong , Yongchao Zhang , Yunpeng Zhu
{"title":"FS-PTL:用于有限数据情况下部分跨域故障诊断的统一少量部分转移学习框架","authors":"Liu Cheng , Haochen Qi , Rongcai Ma , Xiangwei Kong , Yongchao Zhang , Yunpeng Zhu","doi":"10.1016/j.knosys.2024.112658","DOIUrl":null,"url":null,"abstract":"<div><div>Traditional supervised learning-based fault-diagnosis models often encounter performance degradation when data distribution shifts occur. Although unsupervised transfer learning can address such issues, most existing methods face challenges arising from partial cross-domain diagnostic scenarios with limited training data. Therefore, this study introduces a unified few-shot partial-transfer learning framework, specifically designed to address the limitations of data scarcity and partial cross-domain diagnosis applicability. Our framework innovatively takes ridge regression-based feature reconstruction as a nexus to integrate episodic learning with an episodic pretext task and weighted feature alignment, thereby enhancing model adaptability across varying working conditions with minimal data. Specifically, the episodic pretext task enables the learned features with generalization abilities in a self-supervised manner to mitigate meta-overfitting. Weighted feature alignment is performed at the reconstructed feature level, allowing partial transfer with a significantly increased number of features, while further reducing overfitting. Experiments conducted on two distinct datasets revealed that the proposed method outperforms existing state-of-the-art approaches, demonstrating superior transfer performance and robustness under the conditions of limited fault samples.</div></div>","PeriodicalId":49939,"journal":{"name":"Knowledge-Based Systems","volume":"305 ","pages":"Article 112658"},"PeriodicalIF":7.2000,"publicationDate":"2024-10-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"FS-PTL: A unified few-shot partial transfer learning framework for partial cross-domain fault diagnosis under limited data scenarios\",\"authors\":\"Liu Cheng , Haochen Qi , Rongcai Ma , Xiangwei Kong , Yongchao Zhang , Yunpeng Zhu\",\"doi\":\"10.1016/j.knosys.2024.112658\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Traditional supervised learning-based fault-diagnosis models often encounter performance degradation when data distribution shifts occur. Although unsupervised transfer learning can address such issues, most existing methods face challenges arising from partial cross-domain diagnostic scenarios with limited training data. Therefore, this study introduces a unified few-shot partial-transfer learning framework, specifically designed to address the limitations of data scarcity and partial cross-domain diagnosis applicability. Our framework innovatively takes ridge regression-based feature reconstruction as a nexus to integrate episodic learning with an episodic pretext task and weighted feature alignment, thereby enhancing model adaptability across varying working conditions with minimal data. Specifically, the episodic pretext task enables the learned features with generalization abilities in a self-supervised manner to mitigate meta-overfitting. Weighted feature alignment is performed at the reconstructed feature level, allowing partial transfer with a significantly increased number of features, while further reducing overfitting. Experiments conducted on two distinct datasets revealed that the proposed method outperforms existing state-of-the-art approaches, demonstrating superior transfer performance and robustness under the conditions of limited fault samples.</div></div>\",\"PeriodicalId\":49939,\"journal\":{\"name\":\"Knowledge-Based Systems\",\"volume\":\"305 \",\"pages\":\"Article 112658\"},\"PeriodicalIF\":7.2000,\"publicationDate\":\"2024-10-28\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Knowledge-Based Systems\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0950705124012929\",\"RegionNum\":1,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Knowledge-Based Systems","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0950705124012929","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
FS-PTL: A unified few-shot partial transfer learning framework for partial cross-domain fault diagnosis under limited data scenarios
Traditional supervised learning-based fault-diagnosis models often encounter performance degradation when data distribution shifts occur. Although unsupervised transfer learning can address such issues, most existing methods face challenges arising from partial cross-domain diagnostic scenarios with limited training data. Therefore, this study introduces a unified few-shot partial-transfer learning framework, specifically designed to address the limitations of data scarcity and partial cross-domain diagnosis applicability. Our framework innovatively takes ridge regression-based feature reconstruction as a nexus to integrate episodic learning with an episodic pretext task and weighted feature alignment, thereby enhancing model adaptability across varying working conditions with minimal data. Specifically, the episodic pretext task enables the learned features with generalization abilities in a self-supervised manner to mitigate meta-overfitting. Weighted feature alignment is performed at the reconstructed feature level, allowing partial transfer with a significantly increased number of features, while further reducing overfitting. Experiments conducted on two distinct datasets revealed that the proposed method outperforms existing state-of-the-art approaches, demonstrating superior transfer performance and robustness under the conditions of limited fault samples.
期刊介绍:
Knowledge-Based Systems, an international and interdisciplinary journal in artificial intelligence, publishes original, innovative, and creative research results in the field. It focuses on knowledge-based and other artificial intelligence techniques-based systems. The journal aims to support human prediction and decision-making through data science and computation techniques, provide a balanced coverage of theory and practical study, and encourage the development and implementation of knowledge-based intelligence models, methods, systems, and software tools. Applications in business, government, education, engineering, and healthcare are emphasized.