Dexuan Zhao , Fan Yang , Taizhang Hu , Xing Wei , Chong Zhao , Yang Lu
{"title":"无监督域自适应的双级冗余消除","authors":"Dexuan Zhao , Fan Yang , Taizhang Hu , Xing Wei , Chong Zhao , Yang Lu","doi":"10.1016/j.eswa.2025.127090","DOIUrl":null,"url":null,"abstract":"<div><div>Unsupervised domain adaptation (UDA) methods for image classification have rapidly advanced in recent years. This advancement is attributed to their ability to address performance degradation caused by distributional differences between source and target domain images. However, previous methods often focus solely on sample-level relationships, neglecting the problem of redundancy within samples due to the same feature information being expressed repeatedly. This oversight can smooth critical discriminative features, ultimately reducing the model’s accuracy in image classification. To address this problem, we propose Dual-Level Redundancy Elimination for Unsupervised Domain Adaptation (DLRE), which aims to enhance UDA by reducing redundancy at both the sample feature and cluster levels. Specifically, we use feature mutual information to evaluate and reduce the feature-level redundancy of different dimensions, thereby ensuring the amount of discriminative information contained in the feature vector, and maximize the dimensional mutual information between pairs of positive samples to obtain a more unbiased feature representation. In addition, we propose a new clustering framework based on dictionary storage and mutual information weighting to reduce cluster-level redundancy and help improve the performance of classification tasks. We conduct extensive experiments on five widely used UDA vision benchmarks, and the results show that DLRE has good adaptability and effectiveness, significantly outperforms current domain adaptation methods.</div></div>","PeriodicalId":50461,"journal":{"name":"Expert Systems with Applications","volume":"276 ","pages":"Article 127090"},"PeriodicalIF":7.5000,"publicationDate":"2025-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Dual-Level Redundancy Elimination for Unsupervised Domain Adaptation\",\"authors\":\"Dexuan Zhao , Fan Yang , Taizhang Hu , Xing Wei , Chong Zhao , Yang Lu\",\"doi\":\"10.1016/j.eswa.2025.127090\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Unsupervised domain adaptation (UDA) methods for image classification have rapidly advanced in recent years. This advancement is attributed to their ability to address performance degradation caused by distributional differences between source and target domain images. However, previous methods often focus solely on sample-level relationships, neglecting the problem of redundancy within samples due to the same feature information being expressed repeatedly. This oversight can smooth critical discriminative features, ultimately reducing the model’s accuracy in image classification. To address this problem, we propose Dual-Level Redundancy Elimination for Unsupervised Domain Adaptation (DLRE), which aims to enhance UDA by reducing redundancy at both the sample feature and cluster levels. Specifically, we use feature mutual information to evaluate and reduce the feature-level redundancy of different dimensions, thereby ensuring the amount of discriminative information contained in the feature vector, and maximize the dimensional mutual information between pairs of positive samples to obtain a more unbiased feature representation. In addition, we propose a new clustering framework based on dictionary storage and mutual information weighting to reduce cluster-level redundancy and help improve the performance of classification tasks. We conduct extensive experiments on five widely used UDA vision benchmarks, and the results show that DLRE has good adaptability and effectiveness, significantly outperforms current domain adaptation methods.</div></div>\",\"PeriodicalId\":50461,\"journal\":{\"name\":\"Expert Systems with Applications\",\"volume\":\"276 \",\"pages\":\"Article 127090\"},\"PeriodicalIF\":7.5000,\"publicationDate\":\"2025-06-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Expert Systems with Applications\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0957417425007122\",\"RegionNum\":1,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"2025/3/11 0:00:00\",\"PubModel\":\"Epub\",\"JCR\":\"Q1\",\"JCRName\":\"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Expert Systems with Applications","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0957417425007122","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2025/3/11 0:00:00","PubModel":"Epub","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
Dual-Level Redundancy Elimination for Unsupervised Domain Adaptation
Unsupervised domain adaptation (UDA) methods for image classification have rapidly advanced in recent years. This advancement is attributed to their ability to address performance degradation caused by distributional differences between source and target domain images. However, previous methods often focus solely on sample-level relationships, neglecting the problem of redundancy within samples due to the same feature information being expressed repeatedly. This oversight can smooth critical discriminative features, ultimately reducing the model’s accuracy in image classification. To address this problem, we propose Dual-Level Redundancy Elimination for Unsupervised Domain Adaptation (DLRE), which aims to enhance UDA by reducing redundancy at both the sample feature and cluster levels. Specifically, we use feature mutual information to evaluate and reduce the feature-level redundancy of different dimensions, thereby ensuring the amount of discriminative information contained in the feature vector, and maximize the dimensional mutual information between pairs of positive samples to obtain a more unbiased feature representation. In addition, we propose a new clustering framework based on dictionary storage and mutual information weighting to reduce cluster-level redundancy and help improve the performance of classification tasks. We conduct extensive experiments on five widely used UDA vision benchmarks, and the results show that DLRE has good adaptability and effectiveness, significantly outperforms current domain adaptation methods.
期刊介绍:
Expert Systems With Applications is an international journal dedicated to the exchange of information on expert and intelligent systems used globally in industry, government, and universities. The journal emphasizes original papers covering the design, development, testing, implementation, and management of these systems, offering practical guidelines. It spans various sectors such as finance, engineering, marketing, law, project management, information management, medicine, and more. The journal also welcomes papers on multi-agent systems, knowledge management, neural networks, knowledge discovery, data mining, and other related areas, excluding applications to military/defense systems.