Inducing Causal Meta-Knowledge From Virtual Domain: Causal Meta-Generalization for Hyperspectral Domain Generalization

IF 8.6 1区 地球科学 Q1 ENGINEERING, ELECTRICAL & ELECTRONIC IEEE Transactions on Geoscience and Remote Sensing Pub Date : 2024-11-11 DOI:10.1109/TGRS.2024.3494796
Haoyu Wang;Xiaomin Liu;Zhenzhuang Qiao;Hanqing Tao
{"title":"Inducing Causal Meta-Knowledge From Virtual Domain: Causal Meta-Generalization for Hyperspectral Domain Generalization","authors":"Haoyu Wang;Xiaomin Liu;Zhenzhuang Qiao;Hanqing Tao","doi":"10.1109/TGRS.2024.3494796","DOIUrl":null,"url":null,"abstract":"Cross-domain hyperspectral image (HSI) classification can improve the model’s classification performance in the target domain by utilizing the rich knowledge from the source domain. However, existing cross-domain HSI classification methods mostly belong to transductive learning, which is difficult to apply to domain generalization tasks where the target domain is unseen during model learning. Inspired by human causal reasoning and knowledge induction mechanisms, this article develops an inductive learning-based framework for hyperspectral domain generalization: Causal meta-generalization. By simulating domain generalization scenarios, the framework helps the model induct domain-invariant causal meta-knowledge, thereby ensuring its strong generalization ability to unseen target domains. Specifically, we first propose a bottleneck variational auto-encoder (B-VAE) based on a forward–reverse information bottleneck, decoupling the domain distribution and class distribution of HSIs. By perturbing the domain distribution to generate virtual domains, we simulate potential domain distribution changes in the real world, providing a data basis for the induction of causal meta-knowledge. Second, in the process of simulating domain generalization scenarios, we establish a dual-layer optimization mechanism (DLOM) based on invariant-generalization risk minimization. In the inner layer optimization, by minimizing the model’s invariant causal effect loss (ICEL) in the virtual source domains, we guide the model to learn domain-invariant causal meta-knowledge. In the outer optimization, by minimizing the model’s generalization risk in the unseen virtual target domain, we enhance the applicability of causal meta-knowledge in domain generalization tasks. This proposed method has potential applications in remote sensing signal-processing tasks, such as the recognition of crop pests and diseases and the identification of minerals. The code can be accessed at \n<uri>https://github.com/wzr78998/CMG</uri>\n.","PeriodicalId":13213,"journal":{"name":"IEEE Transactions on Geoscience and Remote Sensing","volume":"62 ","pages":"1-16"},"PeriodicalIF":8.6000,"publicationDate":"2024-11-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Geoscience and Remote Sensing","FirstCategoryId":"5","ListUrlMain":"https://ieeexplore.ieee.org/document/10749976/","RegionNum":1,"RegionCategory":"地球科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0

Abstract

Cross-domain hyperspectral image (HSI) classification can improve the model’s classification performance in the target domain by utilizing the rich knowledge from the source domain. However, existing cross-domain HSI classification methods mostly belong to transductive learning, which is difficult to apply to domain generalization tasks where the target domain is unseen during model learning. Inspired by human causal reasoning and knowledge induction mechanisms, this article develops an inductive learning-based framework for hyperspectral domain generalization: Causal meta-generalization. By simulating domain generalization scenarios, the framework helps the model induct domain-invariant causal meta-knowledge, thereby ensuring its strong generalization ability to unseen target domains. Specifically, we first propose a bottleneck variational auto-encoder (B-VAE) based on a forward–reverse information bottleneck, decoupling the domain distribution and class distribution of HSIs. By perturbing the domain distribution to generate virtual domains, we simulate potential domain distribution changes in the real world, providing a data basis for the induction of causal meta-knowledge. Second, in the process of simulating domain generalization scenarios, we establish a dual-layer optimization mechanism (DLOM) based on invariant-generalization risk minimization. In the inner layer optimization, by minimizing the model’s invariant causal effect loss (ICEL) in the virtual source domains, we guide the model to learn domain-invariant causal meta-knowledge. In the outer optimization, by minimizing the model’s generalization risk in the unseen virtual target domain, we enhance the applicability of causal meta-knowledge in domain generalization tasks. This proposed method has potential applications in remote sensing signal-processing tasks, such as the recognition of crop pests and diseases and the identification of minerals. The code can be accessed at https://github.com/wzr78998/CMG .
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
从虚拟领域诱导因果元知识:高光谱领域泛化的因果元泛化
跨域高光谱图像(HSI)分类可以利用源域的丰富知识提高模型在目标域的分类性能。然而,现有的跨域高光谱图像分类方法大多属于归纳学习(transductive learning),难以应用于在模型学习过程中目标域未被观察到的领域泛化任务。受人类因果推理和知识归纳机制的启发,本文开发了一种基于归纳学习的高光谱领域泛化框架:因果元泛化。该框架通过模拟领域泛化场景,帮助模型归纳与领域无关的因果元知识,从而确保其对未知目标领域的强大泛化能力。具体来说,我们首先提出了一种基于正向-反向信息瓶颈的瓶颈变异自动编码器(B-VAE),解耦了恒星指数的领域分布和类别分布。通过扰动域分布生成虚拟域,我们模拟了现实世界中潜在的域分布变化,为因果元知识的归纳提供了数据基础。其次,在模拟领域泛化场景的过程中,我们建立了基于不变泛化风险最小化的双层优化机制(DLOM)。在内层优化中,通过最小化模型在虚拟源域中的不变因果效应损失(ICEL),引导模型学习域不变因果元知识。在外部优化中,通过最小化模型在未知虚拟目标域中的泛化风险,我们提高了因果元知识在领域泛化任务中的适用性。该方法有望应用于遥感信号处理任务,如农作物病虫害识别和矿物识别。代码见 https://github.com/wzr78998/CMG。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
IEEE Transactions on Geoscience and Remote Sensing
IEEE Transactions on Geoscience and Remote Sensing 工程技术-地球化学与地球物理
CiteScore
11.50
自引率
28.00%
发文量
1912
审稿时长
4.0 months
期刊介绍: IEEE Transactions on Geoscience and Remote Sensing (TGRS) is a monthly publication that focuses on the theory, concepts, and techniques of science and engineering as applied to sensing the land, oceans, atmosphere, and space; and the processing, interpretation, and dissemination of this information.
期刊最新文献
Near-Real-Time InSAR Phase Estimation for Large-Scale Surface Displacement Monitoring Wavelet Query multi-head attention Generative Adversarial Network for remote sensing image super-resolution reconstruction Extraction of Spectral Polarimetric Features with Weather Radar and Its Application in Vertical Wind Shear Identification Towards Robust Urban Region Representation Learning through Hierarchical Modeling for Modifiable Areal Unit Problem Mitigation Topology-Guided Boundary-Aware Feature Learning for Hyperspectral Image Classification with Dual Graph Networks
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1