GASSM: Global attention and state space model based end-to-end hyperspectral change detection

IF 4.2 3区 计算机科学 Q2 AUTOMATION & CONTROL SYSTEMS Journal of The Franklin Institute-engineering and Applied Mathematics Pub Date : 2025-02-01 Epub Date: 2025-01-14 DOI:10.1016/j.jfranklin.2024.107424
Yinhe Li , Jinchang Ren , Hang Fu , Genyun Sun
{"title":"GASSM: Global attention and state space model based end-to-end hyperspectral change detection","authors":"Yinhe Li ,&nbsp;Jinchang Ren ,&nbsp;Hang Fu ,&nbsp;Genyun Sun","doi":"10.1016/j.jfranklin.2024.107424","DOIUrl":null,"url":null,"abstract":"<div><div>As an essential task to identify anomalies and monitor changes over time, change detection enables detailed earth observation in remote sensing. By combining both the rich spectral information and spatial image, hyperspectral images (HSI) have offered unique and significant advantages for change detection. However, traditional hyperspectral change detection (HCD) methods, predominantly based on convolutional neural networks (CNNs), struggle with capturing long-range spatial-spectral dependencies due to their limited receptive fields. Whilst transformers based HCD methods are capable of modeling such dependencies, they often suffer from quadratic growth of the computational complexity. Considering the unique capabilities in offering robust long-range sequence modeling yet with linear computational complexity, the emerging Mamba model has provided a promising alternative. Accordingly, we propose a novel approach that integrates the global attention (GA) and state space model (SSM) to form our GASSM network for HCD. The SSM based Mamba block has been introduced to model global spatial-spectral features, followed by a fully connected layer to perform binary classification of detected changes. To the best of our knowledge, this is the first to explore using the Mamba and SSM for HCD. Comprehensive experiments on two publicly available datasets, compared with eight state-of-the-art benchmarks, have validated the efficacy and efficiency of our GASSM model, demonstrating its superiority of high accuracy and stability in HCD.</div></div>","PeriodicalId":17283,"journal":{"name":"Journal of The Franklin Institute-engineering and Applied Mathematics","volume":"362 3","pages":"Article 107424"},"PeriodicalIF":4.2000,"publicationDate":"2025-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of The Franklin Institute-engineering and Applied Mathematics","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0016003224008457","RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2025/1/14 0:00:00","PubModel":"Epub","JCR":"Q2","JCRName":"AUTOMATION & CONTROL SYSTEMS","Score":null,"Total":0}
引用次数: 0

Abstract

As an essential task to identify anomalies and monitor changes over time, change detection enables detailed earth observation in remote sensing. By combining both the rich spectral information and spatial image, hyperspectral images (HSI) have offered unique and significant advantages for change detection. However, traditional hyperspectral change detection (HCD) methods, predominantly based on convolutional neural networks (CNNs), struggle with capturing long-range spatial-spectral dependencies due to their limited receptive fields. Whilst transformers based HCD methods are capable of modeling such dependencies, they often suffer from quadratic growth of the computational complexity. Considering the unique capabilities in offering robust long-range sequence modeling yet with linear computational complexity, the emerging Mamba model has provided a promising alternative. Accordingly, we propose a novel approach that integrates the global attention (GA) and state space model (SSM) to form our GASSM network for HCD. The SSM based Mamba block has been introduced to model global spatial-spectral features, followed by a fully connected layer to perform binary classification of detected changes. To the best of our knowledge, this is the first to explore using the Mamba and SSM for HCD. Comprehensive experiments on two publicly available datasets, compared with eight state-of-the-art benchmarks, have validated the efficacy and efficiency of our GASSM model, demonstrating its superiority of high accuracy and stability in HCD.
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
GASSM:基于全局关注和状态空间模型的端到端高光谱变化检测
变化探测是识别异常和监测随时间变化的一项重要任务,可以实现遥感对地的详细观测。高光谱图像将丰富的光谱信息与空间图像相结合,为变化检测提供了独特而显著的优势。然而,传统的高光谱变化检测(HCD)方法主要基于卷积神经网络(cnn),由于其有限的接受域,难以捕获远程空间光谱依赖性。虽然基于变压器的HCD方法能够对这种依赖关系进行建模,但它们的计算复杂性往往呈二次增长。考虑到其独特的能力,提供了强大的远程序列建模,但具有线性计算复杂性,新兴的Mamba模型提供了一个有前途的替代方案。因此,我们提出了一种新的方法,将全局注意力(GA)和状态空间模型(SSM)相结合,形成我们的HCD GASSM网络。基于SSM的Mamba区块被引入来模拟全球空间光谱特征,然后是一个完全连接的层,对检测到的变化进行二值分类。据我们所知,这是第一次探索使用曼巴和SSM的HCD。在两个公开的数据集上进行综合实验,并与8个最先进的基准进行比较,验证了我们的GASSM模型的有效性和效率,展示了其在HCD中高精度和稳定性的优势。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
CiteScore
7.30
自引率
14.60%
发文量
586
审稿时长
6.9 months
期刊介绍: The Journal of The Franklin Institute has an established reputation for publishing high-quality papers in the field of engineering and applied mathematics. Its current focus is on control systems, complex networks and dynamic systems, signal processing and communications and their applications. All submitted papers are peer-reviewed. The Journal will publish original research papers and research review papers of substance. Papers and special focus issues are judged upon possible lasting value, which has been and continues to be the strength of the Journal of The Franklin Institute.
期刊最新文献
Distributed online convex optimization under delayed feedback with edge-Based event-Triggered communication Switching threshold event-triggered adaptive NN fixed-time control of nonlinear CPSs with unknown FDI attacks and actuator faults Stabilization of multi-link hybrid stochastic coupled systems with pantograph delay based on aperiodically intermittent control Consensus of reaction-diffusion fractional-order multi-agent systems via adaptive event-triggered boundary control Neuroadaptive-based distributed asymmetric bipartite tracking control of uncertain networked Euler-Lagrange systems
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1