Haoyu Wang;Xiaomin Liu;Zhenzhuang Qiao;Hanqing Tao
{"title":"Inducing Causal Meta-Knowledge From Virtual Domain: Causal Meta-Generalization for Hyperspectral Domain Generalization","authors":"Haoyu Wang;Xiaomin Liu;Zhenzhuang Qiao;Hanqing Tao","doi":"10.1109/TGRS.2024.3494796","DOIUrl":null,"url":null,"abstract":"Cross-domain hyperspectral image (HSI) classification can improve the model’s classification performance in the target domain by utilizing the rich knowledge from the source domain. However, existing cross-domain HSI classification methods mostly belong to transductive learning, which is difficult to apply to domain generalization tasks where the target domain is unseen during model learning. Inspired by human causal reasoning and knowledge induction mechanisms, this article develops an inductive learning-based framework for hyperspectral domain generalization: Causal meta-generalization. By simulating domain generalization scenarios, the framework helps the model induct domain-invariant causal meta-knowledge, thereby ensuring its strong generalization ability to unseen target domains. Specifically, we first propose a bottleneck variational auto-encoder (B-VAE) based on a forward–reverse information bottleneck, decoupling the domain distribution and class distribution of HSIs. By perturbing the domain distribution to generate virtual domains, we simulate potential domain distribution changes in the real world, providing a data basis for the induction of causal meta-knowledge. Second, in the process of simulating domain generalization scenarios, we establish a dual-layer optimization mechanism (DLOM) based on invariant-generalization risk minimization. In the inner layer optimization, by minimizing the model’s invariant causal effect loss (ICEL) in the virtual source domains, we guide the model to learn domain-invariant causal meta-knowledge. In the outer optimization, by minimizing the model’s generalization risk in the unseen virtual target domain, we enhance the applicability of causal meta-knowledge in domain generalization tasks. This proposed method has potential applications in remote sensing signal-processing tasks, such as the recognition of crop pests and diseases and the identification of minerals. The code can be accessed at \n<uri>https://github.com/wzr78998/CMG</uri>\n.","PeriodicalId":13213,"journal":{"name":"IEEE Transactions on Geoscience and Remote Sensing","volume":"62 ","pages":"1-16"},"PeriodicalIF":8.6000,"publicationDate":"2024-11-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Geoscience and Remote Sensing","FirstCategoryId":"5","ListUrlMain":"https://ieeexplore.ieee.org/document/10749976/","RegionNum":1,"RegionCategory":"地球科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0
Abstract
Cross-domain hyperspectral image (HSI) classification can improve the model’s classification performance in the target domain by utilizing the rich knowledge from the source domain. However, existing cross-domain HSI classification methods mostly belong to transductive learning, which is difficult to apply to domain generalization tasks where the target domain is unseen during model learning. Inspired by human causal reasoning and knowledge induction mechanisms, this article develops an inductive learning-based framework for hyperspectral domain generalization: Causal meta-generalization. By simulating domain generalization scenarios, the framework helps the model induct domain-invariant causal meta-knowledge, thereby ensuring its strong generalization ability to unseen target domains. Specifically, we first propose a bottleneck variational auto-encoder (B-VAE) based on a forward–reverse information bottleneck, decoupling the domain distribution and class distribution of HSIs. By perturbing the domain distribution to generate virtual domains, we simulate potential domain distribution changes in the real world, providing a data basis for the induction of causal meta-knowledge. Second, in the process of simulating domain generalization scenarios, we establish a dual-layer optimization mechanism (DLOM) based on invariant-generalization risk minimization. In the inner layer optimization, by minimizing the model’s invariant causal effect loss (ICEL) in the virtual source domains, we guide the model to learn domain-invariant causal meta-knowledge. In the outer optimization, by minimizing the model’s generalization risk in the unseen virtual target domain, we enhance the applicability of causal meta-knowledge in domain generalization tasks. This proposed method has potential applications in remote sensing signal-processing tasks, such as the recognition of crop pests and diseases and the identification of minerals. The code can be accessed at
https://github.com/wzr78998/CMG
.
期刊介绍:
IEEE Transactions on Geoscience and Remote Sensing (TGRS) is a monthly publication that focuses on the theory, concepts, and techniques of science and engineering as applied to sensing the land, oceans, atmosphere, and space; and the processing, interpretation, and dissemination of this information.