SS8: Source Data-free Domain Adaptation via Deep Clustering with Weighted Self-labelling

Zihao Song, Lijuan Chen, Han Sun, Guozhao Kou
{"title":"SS8: Source Data-free Domain Adaptation via Deep Clustering with Weighted Self-labelling","authors":"Zihao Song, Lijuan Chen, Han Sun, Guozhao Kou","doi":"10.1109/ICNSC55942.2022.10004109","DOIUrl":null,"url":null,"abstract":"As a new topic of transfer learning, source data-free domain adaptation (SFDA) is currently receiving a lot of attention due to the increasing demands on the safety and privacy. Due to that the dependence on the labelled source data is cut off by mining auxiliary information to regulate the self-training, the self-supervised learning becomes a promising SFDA solution. Among these proposed self-supervisions, the pseudo-label is a widely used and fundamental means to provide the supervision signal of category. However, the existing methods do not have a special strategy to mitigate the noise in the pseudo-labels well. This paper propose a deep clustering with weighted self-labelling (DC-WSL) approach to address the SFDA problem. Specifically, we first develop a low-entropy k-means method to generate more robust and credible clustering centers. And then, the pseudo-labels are assigned to all target data based on the distance from these centers, along with adaptive confidence scores as the weighted parameters. After that, based on these pseudo-labels with credible evaluation, we perform a self-training on the target domain under the regulation of deep clustering. The experimental results on two domain adaptation benchmarks confirm the effectiveness of the proposed method.","PeriodicalId":230499,"journal":{"name":"2022 IEEE International Conference on Networking, Sensing and Control (ICNSC)","volume":"8 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-12-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2022 IEEE International Conference on Networking, Sensing and Control (ICNSC)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ICNSC55942.2022.10004109","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 1

Abstract

As a new topic of transfer learning, source data-free domain adaptation (SFDA) is currently receiving a lot of attention due to the increasing demands on the safety and privacy. Due to that the dependence on the labelled source data is cut off by mining auxiliary information to regulate the self-training, the self-supervised learning becomes a promising SFDA solution. Among these proposed self-supervisions, the pseudo-label is a widely used and fundamental means to provide the supervision signal of category. However, the existing methods do not have a special strategy to mitigate the noise in the pseudo-labels well. This paper propose a deep clustering with weighted self-labelling (DC-WSL) approach to address the SFDA problem. Specifically, we first develop a low-entropy k-means method to generate more robust and credible clustering centers. And then, the pseudo-labels are assigned to all target data based on the distance from these centers, along with adaptive confidence scores as the weighted parameters. After that, based on these pseudo-labels with credible evaluation, we perform a self-training on the target domain under the regulation of deep clustering. The experimental results on two domain adaptation benchmarks confirm the effectiveness of the proposed method.
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
SS8:基于加权自标记深度聚类的无源数据域自适应
源无数据域自适应(SFDA)作为迁移学习的一个新课题,由于人们对安全性和隐私性的要求越来越高,目前受到了广泛的关注。由于通过挖掘辅助信息来调节自训练,切断了对标记源数据的依赖,因此自监督学习成为一种很有前途的SFDA解决方案。在这些提出的自我监管中,伪标签是一种广泛使用的、提供类别监管信号的基本手段。然而,现有的方法并没有一个特殊的策略来很好地消除伪标签中的噪声。本文提出了一种带有加权自标记的深度聚类(DC-WSL)方法来解决SFDA问题。具体来说,我们首先开发了一种低熵k-means方法来生成更鲁棒和可信的聚类中心。然后,根据与这些中心的距离为所有目标数据分配伪标签,并以自适应置信度作为加权参数。然后,基于这些具有可信评价的伪标签,在深度聚类的调控下对目标域进行自训练。在两个领域自适应基准上的实验结果验证了该方法的有效性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
自引率
0.00%
发文量
0
期刊最新文献
High-dimensional Feature Selection in Classification: A Length-Adaptive Evolutionary Approach SFME: Score Fusion from Multiple Experts for Long-tailed Recognition Attention and Cost-Sensitive Graph Neural Network for Imbalanced Node Classification Conditioning Customers' Product Reviews for Accurate Classification Performance Constraint Programming for Modeling and Solving a Hybrid Flow Shop Scheduling Problem
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1