基于风格转移的异构图像无监督变化检测

IF 7 2区 计算机科学 Q1 ENGINEERING, AEROSPACE IEEE Transactions on Aerospace and Electronic Systems Pub Date : 2025-01-14 DOI:10.1109/TAES.2025.3529431
Zuowei Zhang;Chuanqi Liu;Fan Hao;Zhunga Liu
{"title":"基于风格转移的异构图像无监督变化检测","authors":"Zuowei Zhang;Chuanqi Liu;Fan Hao;Zhunga Liu","doi":"10.1109/TAES.2025.3529431","DOIUrl":null,"url":null,"abstract":"Heterogeneous images are captured through different wavelength bands, providing rich and complementary information for change detection (CD), and domain transformation has emerged as a popular and effective solution. However, existing domain-transformation-based CD methods overly rely on the quality of reconstructed features, making them appear inadequate for practical complex scenarios. In this article, we propose a style-transfer-based CD (STCD) method through unsupervised learning. STCD improves the quality and enhances the robustness of the reconstructed images by simultaneously employing a cautious labeling strategy and classification. Specifically, we initially convert the two heterogeneous images provided into a shared domain by constructing a convolutional autoencoder based on adaptive instance normalization, which improves the quality of reconstructed features and mitigates data heterogeneity. Furthermore, we extract some significant pixel pairs based on fuzzy local information <inline-formula><tex-math>$c$</tex-math></inline-formula>-means to reduce the overreliance on reconstructed features. Then, we propose a dynamic superpixel-based label assignment rule to increase the reliable pseudo-labels employed in training a binary classifier. Finally, STCD achieves great CD results even with poor reconstruction quality. Experimental results conducted on four heterogeneous datasets demonstrate the effectiveness of STCD over other related CD methods.","PeriodicalId":13157,"journal":{"name":"IEEE Transactions on Aerospace and Electronic Systems","volume":"61 3","pages":"6537-6550"},"PeriodicalIF":7.0000,"publicationDate":"2025-01-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Style-Transfer-Based Unsupervised Change Detection From Heterogeneous Images\",\"authors\":\"Zuowei Zhang;Chuanqi Liu;Fan Hao;Zhunga Liu\",\"doi\":\"10.1109/TAES.2025.3529431\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Heterogeneous images are captured through different wavelength bands, providing rich and complementary information for change detection (CD), and domain transformation has emerged as a popular and effective solution. However, existing domain-transformation-based CD methods overly rely on the quality of reconstructed features, making them appear inadequate for practical complex scenarios. In this article, we propose a style-transfer-based CD (STCD) method through unsupervised learning. STCD improves the quality and enhances the robustness of the reconstructed images by simultaneously employing a cautious labeling strategy and classification. Specifically, we initially convert the two heterogeneous images provided into a shared domain by constructing a convolutional autoencoder based on adaptive instance normalization, which improves the quality of reconstructed features and mitigates data heterogeneity. Furthermore, we extract some significant pixel pairs based on fuzzy local information <inline-formula><tex-math>$c$</tex-math></inline-formula>-means to reduce the overreliance on reconstructed features. Then, we propose a dynamic superpixel-based label assignment rule to increase the reliable pseudo-labels employed in training a binary classifier. Finally, STCD achieves great CD results even with poor reconstruction quality. Experimental results conducted on four heterogeneous datasets demonstrate the effectiveness of STCD over other related CD methods.\",\"PeriodicalId\":13157,\"journal\":{\"name\":\"IEEE Transactions on Aerospace and Electronic Systems\",\"volume\":\"61 3\",\"pages\":\"6537-6550\"},\"PeriodicalIF\":7.0000,\"publicationDate\":\"2025-01-14\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Transactions on Aerospace and Electronic Systems\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10840257/\",\"RegionNum\":2,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENGINEERING, AEROSPACE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Aerospace and Electronic Systems","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/10840257/","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, AEROSPACE","Score":null,"Total":0}
引用次数: 0

摘要

在不同波长波段捕获异质图像,为变化检测提供了丰富的互补信息,域变换已成为一种流行而有效的解决方案。然而,现有的基于域转换的CD方法过于依赖重构特征的质量,使得它们在实际的复杂场景中显得不足。在本文中,我们提出了一种基于风格迁移的非监督学习方法。STCD通过同时采用谨慎的标记策略和分类,提高了重建图像的质量和鲁棒性。具体而言,我们首先通过构建基于自适应实例归一化的卷积自编码器将提供的两幅异构图像转换为共享域,从而提高了重构特征的质量并减轻了数据的异质性。此外,我们基于模糊局部信息$c$-means提取一些重要的像素对,以减少对重构特征的过度依赖。然后,我们提出了一种基于超像素的动态标签分配规则,以增加训练二值分类器时使用的伪标签的可靠性。最后,STCD在重建质量较差的情况下也能取得很好的CD效果。在四个异构数据集上进行的实验结果表明,STCD方法优于其他相关的CD方法。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
Style-Transfer-Based Unsupervised Change Detection From Heterogeneous Images
Heterogeneous images are captured through different wavelength bands, providing rich and complementary information for change detection (CD), and domain transformation has emerged as a popular and effective solution. However, existing domain-transformation-based CD methods overly rely on the quality of reconstructed features, making them appear inadequate for practical complex scenarios. In this article, we propose a style-transfer-based CD (STCD) method through unsupervised learning. STCD improves the quality and enhances the robustness of the reconstructed images by simultaneously employing a cautious labeling strategy and classification. Specifically, we initially convert the two heterogeneous images provided into a shared domain by constructing a convolutional autoencoder based on adaptive instance normalization, which improves the quality of reconstructed features and mitigates data heterogeneity. Furthermore, we extract some significant pixel pairs based on fuzzy local information $c$-means to reduce the overreliance on reconstructed features. Then, we propose a dynamic superpixel-based label assignment rule to increase the reliable pseudo-labels employed in training a binary classifier. Finally, STCD achieves great CD results even with poor reconstruction quality. Experimental results conducted on four heterogeneous datasets demonstrate the effectiveness of STCD over other related CD methods.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
CiteScore
7.80
自引率
13.60%
发文量
433
审稿时长
8.7 months
期刊介绍: IEEE Transactions on Aerospace and Electronic Systems focuses on the organization, design, development, integration, and operation of complex systems for space, air, ocean, or ground environment. These systems include, but are not limited to, navigation, avionics, spacecraft, aerospace power, radar, sonar, telemetry, defense, transportation, automated testing, and command and control.
期刊最新文献
A Heterogeneous Multi-Agent Reinforcement Learning Approach for Robust Uplink Beamforming in Maritime Satellite Communications Predictive Gimbal Control under Non-Gaussian Disturbances for Robust Aerial Inspection LEO Satellite Identification via Spatiotemporal Information Enhancement and Clustering for Opportunistic Navigation Hierarchical Multi-Agent Reinforcement Learning for Coordinated Docking Control in UAV Aerial Recovery Optimal Distributed Formation-Containment Control of Air-Ground Systems Using A Dual-Policy Iteration Switching Mechanism
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1