通过具有特定任务一致性的对比学习实现时间序列的领域适应性

IF 3.4 2区 计算机科学 Q2 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Applied Intelligence Pub Date : 2024-09-20 DOI:10.1007/s10489-024-05799-y
Tao Wu, Qiushu Chen, Dongfang Zhao, Jinhua Wang, Linhua Jiang
{"title":"通过具有特定任务一致性的对比学习实现时间序列的领域适应性","authors":"Tao Wu,&nbsp;Qiushu Chen,&nbsp;Dongfang Zhao,&nbsp;Jinhua Wang,&nbsp;Linhua Jiang","doi":"10.1007/s10489-024-05799-y","DOIUrl":null,"url":null,"abstract":"<div><p>Unsupervised domain adaptation (UDA) for time series analysis remains challenging due to the lack of labeled data in target domains. Existing methods rely heavily on auxiliary data yet often fail to fully exploit the intrinsic task consistency between different domains. To address this limitation, we propose a novel time series UDA framework called CLTC that enhances feature transferability by capturing semantic context and reconstructing class-wise representations. Specifically, contrastive learning is first utilized to capture contextual representations that enable label transfer across domains. Dual reconstruction on samples from the same class then refines the task-specific features to improve consistency. To align the cross-domain distributions without target labels, we leverage Sinkhorn divergence which can handle non-overlapping supports. Consequently, our CLTC reduces the domain gap while retaining task-specific consistency for effective knowledge transfer. Extensive experiments on four time series benchmarks demonstrate state-of-the-art performance improvements of 0.7-3.6% over existing methods, and ablation study validates the efficacy of each component.</p></div>","PeriodicalId":8041,"journal":{"name":"Applied Intelligence","volume":"54 23","pages":"12576 - 12588"},"PeriodicalIF":3.4000,"publicationDate":"2024-09-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Domain adaptation of time series via contrastive learning with task-specific consistency\",\"authors\":\"Tao Wu,&nbsp;Qiushu Chen,&nbsp;Dongfang Zhao,&nbsp;Jinhua Wang,&nbsp;Linhua Jiang\",\"doi\":\"10.1007/s10489-024-05799-y\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><p>Unsupervised domain adaptation (UDA) for time series analysis remains challenging due to the lack of labeled data in target domains. Existing methods rely heavily on auxiliary data yet often fail to fully exploit the intrinsic task consistency between different domains. To address this limitation, we propose a novel time series UDA framework called CLTC that enhances feature transferability by capturing semantic context and reconstructing class-wise representations. Specifically, contrastive learning is first utilized to capture contextual representations that enable label transfer across domains. Dual reconstruction on samples from the same class then refines the task-specific features to improve consistency. To align the cross-domain distributions without target labels, we leverage Sinkhorn divergence which can handle non-overlapping supports. Consequently, our CLTC reduces the domain gap while retaining task-specific consistency for effective knowledge transfer. Extensive experiments on four time series benchmarks demonstrate state-of-the-art performance improvements of 0.7-3.6% over existing methods, and ablation study validates the efficacy of each component.</p></div>\",\"PeriodicalId\":8041,\"journal\":{\"name\":\"Applied Intelligence\",\"volume\":\"54 23\",\"pages\":\"12576 - 12588\"},\"PeriodicalIF\":3.4000,\"publicationDate\":\"2024-09-20\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Applied Intelligence\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://link.springer.com/article/10.1007/s10489-024-05799-y\",\"RegionNum\":2,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Applied Intelligence","FirstCategoryId":"94","ListUrlMain":"https://link.springer.com/article/10.1007/s10489-024-05799-y","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0

摘要

由于缺乏目标领域的标注数据,用于时间序列分析的无监督领域适应(UDA)仍然具有挑战性。现有方法严重依赖辅助数据,但往往无法充分利用不同领域之间任务的内在一致性。为了解决这一局限性,我们提出了一种名为 CLTC 的新型时间序列 UDA 框架,该框架通过捕捉语义上下文和重建类别表征来增强特征的可转移性。具体来说,首先利用对比学习来捕捉上下文表征,从而实现跨领域的标签转移。然后,对同一类别的样本进行双重重构,完善特定任务的特征,以提高一致性。为了对齐没有目标标签的跨域分布,我们利用了可以处理非重叠支持的 Sinkhorn 分歧。因此,我们的 CLTC 在减少领域差距的同时,还保持了特定任务的一致性,从而实现了有效的知识转移。在四种时间序列基准上进行的广泛实验表明,与现有方法相比,我们的 CLTC 性能提高了 0.7-3.6%,而消融研究则验证了每个组件的功效。
本文章由计算机程序翻译,如有差异,请以英文原文为准。

摘要图片

查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
Domain adaptation of time series via contrastive learning with task-specific consistency

Unsupervised domain adaptation (UDA) for time series analysis remains challenging due to the lack of labeled data in target domains. Existing methods rely heavily on auxiliary data yet often fail to fully exploit the intrinsic task consistency between different domains. To address this limitation, we propose a novel time series UDA framework called CLTC that enhances feature transferability by capturing semantic context and reconstructing class-wise representations. Specifically, contrastive learning is first utilized to capture contextual representations that enable label transfer across domains. Dual reconstruction on samples from the same class then refines the task-specific features to improve consistency. To align the cross-domain distributions without target labels, we leverage Sinkhorn divergence which can handle non-overlapping supports. Consequently, our CLTC reduces the domain gap while retaining task-specific consistency for effective knowledge transfer. Extensive experiments on four time series benchmarks demonstrate state-of-the-art performance improvements of 0.7-3.6% over existing methods, and ablation study validates the efficacy of each component.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Applied Intelligence
Applied Intelligence 工程技术-计算机:人工智能
CiteScore
6.60
自引率
20.80%
发文量
1361
审稿时长
5.9 months
期刊介绍: With a focus on research in artificial intelligence and neural networks, this journal addresses issues involving solutions of real-life manufacturing, defense, management, government and industrial problems which are too complex to be solved through conventional approaches and require the simulation of intelligent thought processes, heuristics, applications of knowledge, and distributed and parallel processing. The integration of these multiple approaches in solving complex problems is of particular importance. The journal presents new and original research and technological developments, addressing real and complex issues applicable to difficult problems. It provides a medium for exchanging scientific research and technological achievements accomplished by the international community.
期刊最新文献
ZPDSN: spatio-temporal meteorological forecasting with topological data analysis DTR4Rec: direct transition relationship for sequential recommendation Unsupervised anomaly detection and imputation in noisy time series data for enhancing load forecasting A prototype evolution network for relation extraction Highway spillage detection using an improved STPM anomaly detection network from a surveillance perspective
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1