用于轻量级、高效遥感图像变化检测的鲁棒特征聚合网络

IF 10.6 1区 地球科学 Q1 GEOGRAPHY, PHYSICAL ISPRS Journal of Photogrammetry and Remote Sensing Pub Date : 2024-07-02 DOI:10.1016/j.isprsjprs.2024.06.013
Zhi-Hui You, Si-Bao Chen, Jia-Xin Wang, Bin Luo
{"title":"用于轻量级、高效遥感图像变化检测的鲁棒特征聚合网络","authors":"Zhi-Hui You,&nbsp;Si-Bao Chen,&nbsp;Jia-Xin Wang,&nbsp;Bin Luo","doi":"10.1016/j.isprsjprs.2024.06.013","DOIUrl":null,"url":null,"abstract":"<div><p>In remote sensing (RS) image change detection (CD) task, many existing CD methods focus more on how to improve accuracy, but they usually have more parameters, higher computational costs, and heavier memory usage. Designing lightweight and performance-sustainable CD model that is more compatible with real-world applications is an urgent problem to be solved. Therefore, we propose a lightweight change detection network, called as robust feature aggregation network (RFANet). To improve representative capability of weaker features extracted from lightweight backbone, a feature reinforcement module (FRM) is proposed. FRM allows current level feature to densely interact and fuse with other level features, thus accomplishing the complementarity of fine-grained details and semantic information. Considering massive objects with rich correlations in RS images, we design semantic split-aggregation module (SSAM) to better capture global semantic information of changed objects. Besides, we present a lightweight decoder containing channel interaction module (CIM), which allows multi-level refined difference features to emphasize changed areas and suppress background and pseudo-changes. Extensive experiments carried out on four challenging RS image CD datasets illustrate that RFANet achieves competitive performance with fewer parameters and lower computational costs. The source code is available at <span>https://github.com/Youzhihui/RFANet</span><svg><path></path></svg>.</p></div>","PeriodicalId":50269,"journal":{"name":"ISPRS Journal of Photogrammetry and Remote Sensing","volume":null,"pages":null},"PeriodicalIF":10.6000,"publicationDate":"2024-07-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Robust feature aggregation network for lightweight and effective remote sensing image change detection\",\"authors\":\"Zhi-Hui You,&nbsp;Si-Bao Chen,&nbsp;Jia-Xin Wang,&nbsp;Bin Luo\",\"doi\":\"10.1016/j.isprsjprs.2024.06.013\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><p>In remote sensing (RS) image change detection (CD) task, many existing CD methods focus more on how to improve accuracy, but they usually have more parameters, higher computational costs, and heavier memory usage. Designing lightweight and performance-sustainable CD model that is more compatible with real-world applications is an urgent problem to be solved. Therefore, we propose a lightweight change detection network, called as robust feature aggregation network (RFANet). To improve representative capability of weaker features extracted from lightweight backbone, a feature reinforcement module (FRM) is proposed. FRM allows current level feature to densely interact and fuse with other level features, thus accomplishing the complementarity of fine-grained details and semantic information. Considering massive objects with rich correlations in RS images, we design semantic split-aggregation module (SSAM) to better capture global semantic information of changed objects. Besides, we present a lightweight decoder containing channel interaction module (CIM), which allows multi-level refined difference features to emphasize changed areas and suppress background and pseudo-changes. Extensive experiments carried out on four challenging RS image CD datasets illustrate that RFANet achieves competitive performance with fewer parameters and lower computational costs. The source code is available at <span>https://github.com/Youzhihui/RFANet</span><svg><path></path></svg>.</p></div>\",\"PeriodicalId\":50269,\"journal\":{\"name\":\"ISPRS Journal of Photogrammetry and Remote Sensing\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":10.6000,\"publicationDate\":\"2024-07-02\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"ISPRS Journal of Photogrammetry and Remote Sensing\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S092427162400251X\",\"RegionNum\":1,\"RegionCategory\":\"地球科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"GEOGRAPHY, PHYSICAL\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"ISPRS Journal of Photogrammetry and Remote Sensing","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S092427162400251X","RegionNum":1,"RegionCategory":"地球科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"GEOGRAPHY, PHYSICAL","Score":null,"Total":0}
引用次数: 0

摘要

在遥感(RS)图像变化检测(CD)任务中,许多现有的CD方法更侧重于如何提高精度,但它们通常参数较多、计算成本较高、内存占用较大。设计更符合实际应用的轻量级、性能可持续的 CD 模型是一个亟待解决的问题。因此,我们提出了一种轻量级变化检测网络,即鲁棒性特征聚合网络(RFANet)。为了提高从轻量级骨干网中提取的较弱特征的代表性,我们提出了一个特征增强模块(FRM)。FRM 允许当前级别的特征与其他级别的特征进行密集交互和融合,从而实现细粒度细节和语义信息的互补。考虑到 RS 图像中具有丰富相关性的海量对象,我们设计了语义分割聚合模块(SSAM),以更好地捕捉变化对象的全局语义信息。此外,我们还提出了一种包含信道交互模块(CIM)的轻量级解码器,该模块可提供多级精细差异特征,以强调变化区域,抑制背景和伪变化。在四个具有挑战性的 RS 图像 CD 数据集上进行的广泛实验表明,RFANet 以较少的参数和较低的计算成本实现了具有竞争力的性能。源代码见 https://github.com/Youzhihui/RFANet。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
Robust feature aggregation network for lightweight and effective remote sensing image change detection

In remote sensing (RS) image change detection (CD) task, many existing CD methods focus more on how to improve accuracy, but they usually have more parameters, higher computational costs, and heavier memory usage. Designing lightweight and performance-sustainable CD model that is more compatible with real-world applications is an urgent problem to be solved. Therefore, we propose a lightweight change detection network, called as robust feature aggregation network (RFANet). To improve representative capability of weaker features extracted from lightweight backbone, a feature reinforcement module (FRM) is proposed. FRM allows current level feature to densely interact and fuse with other level features, thus accomplishing the complementarity of fine-grained details and semantic information. Considering massive objects with rich correlations in RS images, we design semantic split-aggregation module (SSAM) to better capture global semantic information of changed objects. Besides, we present a lightweight decoder containing channel interaction module (CIM), which allows multi-level refined difference features to emphasize changed areas and suppress background and pseudo-changes. Extensive experiments carried out on four challenging RS image CD datasets illustrate that RFANet achieves competitive performance with fewer parameters and lower computational costs. The source code is available at https://github.com/Youzhihui/RFANet.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
ISPRS Journal of Photogrammetry and Remote Sensing
ISPRS Journal of Photogrammetry and Remote Sensing 工程技术-成像科学与照相技术
CiteScore
21.00
自引率
6.30%
发文量
273
审稿时长
40 days
期刊介绍: The ISPRS Journal of Photogrammetry and Remote Sensing (P&RS) serves as the official journal of the International Society for Photogrammetry and Remote Sensing (ISPRS). It acts as a platform for scientists and professionals worldwide who are involved in various disciplines that utilize photogrammetry, remote sensing, spatial information systems, computer vision, and related fields. The journal aims to facilitate communication and dissemination of advancements in these disciplines, while also acting as a comprehensive source of reference and archive. P&RS endeavors to publish high-quality, peer-reviewed research papers that are preferably original and have not been published before. These papers can cover scientific/research, technological development, or application/practical aspects. Additionally, the journal welcomes papers that are based on presentations from ISPRS meetings, as long as they are considered significant contributions to the aforementioned fields. In particular, P&RS encourages the submission of papers that are of broad scientific interest, showcase innovative applications (especially in emerging fields), have an interdisciplinary focus, discuss topics that have received limited attention in P&RS or related journals, or explore new directions in scientific or professional realms. It is preferred that theoretical papers include practical applications, while papers focusing on systems and applications should include a theoretical background.
期刊最新文献
Integrating synthetic datasets with CLIP semantic insights for single image localization advancements Selective weighted least square and piecewise bilinear transformation for accurate satellite DSM generation Word2Scene: Efficient remote sensing image scene generation with only one word via hybrid intelligence and low-rank representation A_OPTRAM-ET: An automatic optical trapezoid model for evapotranspiration estimation and its global-scale assessments Atmospheric correction of geostationary ocean color imager data over turbid coastal waters under high solar zenith angles
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1