{"title":"基于风格转移的异构图像无监督变化检测","authors":"Zuowei Zhang;Chuanqi Liu;Fan Hao;Zhunga Liu","doi":"10.1109/TAES.2025.3529431","DOIUrl":null,"url":null,"abstract":"Heterogeneous images are captured through different wavelength bands, providing rich and complementary information for change detection (CD), and domain transformation has emerged as a popular and effective solution. However, existing domain-transformation-based CD methods overly rely on the quality of reconstructed features, making them appear inadequate for practical complex scenarios. In this article, we propose a style-transfer-based CD (STCD) method through unsupervised learning. STCD improves the quality and enhances the robustness of the reconstructed images by simultaneously employing a cautious labeling strategy and classification. Specifically, we initially convert the two heterogeneous images provided into a shared domain by constructing a convolutional autoencoder based on adaptive instance normalization, which improves the quality of reconstructed features and mitigates data heterogeneity. Furthermore, we extract some significant pixel pairs based on fuzzy local information <inline-formula><tex-math>$c$</tex-math></inline-formula>-means to reduce the overreliance on reconstructed features. Then, we propose a dynamic superpixel-based label assignment rule to increase the reliable pseudo-labels employed in training a binary classifier. Finally, STCD achieves great CD results even with poor reconstruction quality. Experimental results conducted on four heterogeneous datasets demonstrate the effectiveness of STCD over other related CD methods.","PeriodicalId":13157,"journal":{"name":"IEEE Transactions on Aerospace and Electronic Systems","volume":"61 3","pages":"6537-6550"},"PeriodicalIF":7.0000,"publicationDate":"2025-01-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Style-Transfer-Based Unsupervised Change Detection From Heterogeneous Images\",\"authors\":\"Zuowei Zhang;Chuanqi Liu;Fan Hao;Zhunga Liu\",\"doi\":\"10.1109/TAES.2025.3529431\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Heterogeneous images are captured through different wavelength bands, providing rich and complementary information for change detection (CD), and domain transformation has emerged as a popular and effective solution. However, existing domain-transformation-based CD methods overly rely on the quality of reconstructed features, making them appear inadequate for practical complex scenarios. In this article, we propose a style-transfer-based CD (STCD) method through unsupervised learning. STCD improves the quality and enhances the robustness of the reconstructed images by simultaneously employing a cautious labeling strategy and classification. Specifically, we initially convert the two heterogeneous images provided into a shared domain by constructing a convolutional autoencoder based on adaptive instance normalization, which improves the quality of reconstructed features and mitigates data heterogeneity. Furthermore, we extract some significant pixel pairs based on fuzzy local information <inline-formula><tex-math>$c$</tex-math></inline-formula>-means to reduce the overreliance on reconstructed features. Then, we propose a dynamic superpixel-based label assignment rule to increase the reliable pseudo-labels employed in training a binary classifier. Finally, STCD achieves great CD results even with poor reconstruction quality. Experimental results conducted on four heterogeneous datasets demonstrate the effectiveness of STCD over other related CD methods.\",\"PeriodicalId\":13157,\"journal\":{\"name\":\"IEEE Transactions on Aerospace and Electronic Systems\",\"volume\":\"61 3\",\"pages\":\"6537-6550\"},\"PeriodicalIF\":7.0000,\"publicationDate\":\"2025-01-14\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Transactions on Aerospace and Electronic Systems\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10840257/\",\"RegionNum\":2,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENGINEERING, AEROSPACE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Aerospace and Electronic Systems","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/10840257/","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, AEROSPACE","Score":null,"Total":0}
Style-Transfer-Based Unsupervised Change Detection From Heterogeneous Images
Heterogeneous images are captured through different wavelength bands, providing rich and complementary information for change detection (CD), and domain transformation has emerged as a popular and effective solution. However, existing domain-transformation-based CD methods overly rely on the quality of reconstructed features, making them appear inadequate for practical complex scenarios. In this article, we propose a style-transfer-based CD (STCD) method through unsupervised learning. STCD improves the quality and enhances the robustness of the reconstructed images by simultaneously employing a cautious labeling strategy and classification. Specifically, we initially convert the two heterogeneous images provided into a shared domain by constructing a convolutional autoencoder based on adaptive instance normalization, which improves the quality of reconstructed features and mitigates data heterogeneity. Furthermore, we extract some significant pixel pairs based on fuzzy local information $c$-means to reduce the overreliance on reconstructed features. Then, we propose a dynamic superpixel-based label assignment rule to increase the reliable pseudo-labels employed in training a binary classifier. Finally, STCD achieves great CD results even with poor reconstruction quality. Experimental results conducted on four heterogeneous datasets demonstrate the effectiveness of STCD over other related CD methods.
期刊介绍:
IEEE Transactions on Aerospace and Electronic Systems focuses on the organization, design, development, integration, and operation of complex systems for space, air, ocean, or ground environment. These systems include, but are not limited to, navigation, avionics, spacecraft, aerospace power, radar, sonar, telemetry, defense, transportation, automated testing, and command and control.