IGroupSS-Mamba: Interval Group Spatial–Spectral Mamba for Hyperspectral Image Classification

IF 7.5 1区 地球科学 Q1 ENGINEERING, ELECTRICAL & ELECTRONIC IEEE Transactions on Geoscience and Remote Sensing Pub Date : 2024-11-18 DOI:10.1109/TGRS.2024.3502055
Yan He;Bing Tu;Puzhao Jiang;Bo Liu;Jun Li;Antonio Plaza
{"title":"IGroupSS-Mamba: Interval Group Spatial–Spectral Mamba for Hyperspectral Image Classification","authors":"Yan He;Bing Tu;Puzhao Jiang;Bo Liu;Jun Li;Antonio Plaza","doi":"10.1109/TGRS.2024.3502055","DOIUrl":null,"url":null,"abstract":"Hyperspectral image (HSI) classification has garnered substantial attention in remote sensing fields. Recent mamba architectures built upon the selective state-space models (S6) have demonstrated enormous potential in long-range sequence modeling. However, the high dimensionality of hyperspectral data and information redundancy pose challenges to the application of S6 in HSI classification, suffering from suboptimal performance and computational efficiency. In light of this, this article investigates a lightweight interval group spatial-spectral mamba framework (IGroupSS-Mamba) for HSI classification, which allows for multidirectional and multiscale global spatial-spectral information extraction in a grouping and hierarchical manner. Technically, an interval group S6 mechanism (IGSM) is developed as the core component, which partitions high-dimensional features into multiple nonoverlapping groups at intervals, and then integrates a unidirectional S6 for each group with a specific scanning direction to achieve nonredundant sequence modeling. Compared with conventional applying multidirectional scanning to all bands, this grouping strategy leverages the complementary strengths of different scanning directions while decreasing computational costs. To adequately capture the spatial-spectral contextual information, an interval group spatial-spectral block (IGSSB) is introduced, in which two IGSM-based spatial and spectral operators are cascaded to characterize the global spatial-spectral relationship along the spatial and spectral dimensions, respectively. IGroupSS-Mamba is constructed as a hierarchical structure stacked by multiple IGSSB blocks, integrating a pixel aggregation-based downsampling strategy for multiscale spatial-spectral semantic learning from shallow to deep stages. Extensive experiments demonstrate that IGroupSS-Mamba significantly outperforms the state-of-the-art methods in classification accuracy and achieves lower model parameters and floating point operations (FLOPs). The code is available at \n<uri>https://github.com/IIP-Team/</uri>\n IGroupSS-Mamba.","PeriodicalId":13213,"journal":{"name":"IEEE Transactions on Geoscience and Remote Sensing","volume":"62 ","pages":"1-17"},"PeriodicalIF":7.5000,"publicationDate":"2024-11-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Geoscience and Remote Sensing","FirstCategoryId":"5","ListUrlMain":"https://ieeexplore.ieee.org/document/10756788/","RegionNum":1,"RegionCategory":"地球科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0

Abstract

Hyperspectral image (HSI) classification has garnered substantial attention in remote sensing fields. Recent mamba architectures built upon the selective state-space models (S6) have demonstrated enormous potential in long-range sequence modeling. However, the high dimensionality of hyperspectral data and information redundancy pose challenges to the application of S6 in HSI classification, suffering from suboptimal performance and computational efficiency. In light of this, this article investigates a lightweight interval group spatial-spectral mamba framework (IGroupSS-Mamba) for HSI classification, which allows for multidirectional and multiscale global spatial-spectral information extraction in a grouping and hierarchical manner. Technically, an interval group S6 mechanism (IGSM) is developed as the core component, which partitions high-dimensional features into multiple nonoverlapping groups at intervals, and then integrates a unidirectional S6 for each group with a specific scanning direction to achieve nonredundant sequence modeling. Compared with conventional applying multidirectional scanning to all bands, this grouping strategy leverages the complementary strengths of different scanning directions while decreasing computational costs. To adequately capture the spatial-spectral contextual information, an interval group spatial-spectral block (IGSSB) is introduced, in which two IGSM-based spatial and spectral operators are cascaded to characterize the global spatial-spectral relationship along the spatial and spectral dimensions, respectively. IGroupSS-Mamba is constructed as a hierarchical structure stacked by multiple IGSSB blocks, integrating a pixel aggregation-based downsampling strategy for multiscale spatial-spectral semantic learning from shallow to deep stages. Extensive experiments demonstrate that IGroupSS-Mamba significantly outperforms the state-of-the-art methods in classification accuracy and achieves lower model parameters and floating point operations (FLOPs). The code is available at https://github.com/IIP-Team/ IGroupSS-Mamba.
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
IGroupSS-Mamba:用于高光谱图像分类的区间组空间-光谱 Mamba
高光谱图像(HSI)分类在遥感领域备受关注。最近建立在选择性状态空间模型(S6)基础上的曼巴架构在长程序列建模方面展现出了巨大的潜力。然而,高光谱数据的高维度和信息冗余给 S6 在 HSI 分类中的应用带来了挑战,其性能和计算效率都不尽如人意。有鉴于此,本文研究了一种用于高光谱分类的轻量级区间组空间-光谱曼巴框架(IGroupSS-Mamba),该框架允许以分组和分层的方式进行多向、多尺度的全局空间-光谱信息提取。在技术上,以间隔组 S6 机制(IGSM)为核心组件,将高维特征按间隔划分为多个非重叠组,然后为每个组集成一个具有特定扫描方向的单向 S6,以实现非冗余序列建模。与传统的对所有波段进行多向扫描相比,这种分组策略充分利用了不同扫描方向的互补优势,同时降低了计算成本。为了充分捕捉空间-光谱上下文信息,引入了区间组空间-光谱块(IGSSB),其中两个基于 IGSM 的空间和光谱算子级联,分别沿着空间和光谱维度表征全局空间-光谱关系。IGroupSS-Mamba 是由多个 IGSSB 块堆叠而成的分层结构,集成了基于像素聚合的降采样策略,用于从浅层到深层的多尺度空间-光谱语义学习。大量实验证明,IGroupSS-Mamba 在分类准确性方面明显优于最先进的方法,而且模型参数和浮点运算(FLOPs)更低。代码可在 https://github.com/IIP-Team/ IGroupSS-Mamba 上获取。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
IEEE Transactions on Geoscience and Remote Sensing
IEEE Transactions on Geoscience and Remote Sensing 工程技术-地球化学与地球物理
CiteScore
11.50
自引率
28.00%
发文量
1912
审稿时长
4.0 months
期刊介绍: IEEE Transactions on Geoscience and Remote Sensing (TGRS) is a monthly publication that focuses on the theory, concepts, and techniques of science and engineering as applied to sensing the land, oceans, atmosphere, and space; and the processing, interpretation, and dissemination of this information.
期刊最新文献
MST-Net: A General Deep Learning Model for Thick Cloud Removal from Optical Images Spatial-Frequency Residual-guided Dynamic Perceptual Network for Remote Sensing Image Haze Removal Joint Classification of Hyperspectral Images and LiDAR Data Based on Candidate Pseudo Labels Pruning and Dual Mixture of Experts Scene Adaptive SAR Incremental Target Detection via Context-Aware Attention and Gaussian-Box Similarity Metric Multi-dimensional Remote Sensing Change Detection Based on Siamese Dual-Branch Networks
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1