{"title":"用于轻量级、高效遥感图像变化检测的鲁棒特征聚合网络","authors":"Zhi-Hui You, Si-Bao Chen, Jia-Xin Wang, Bin Luo","doi":"10.1016/j.isprsjprs.2024.06.013","DOIUrl":null,"url":null,"abstract":"<div><p>In remote sensing (RS) image change detection (CD) task, many existing CD methods focus more on how to improve accuracy, but they usually have more parameters, higher computational costs, and heavier memory usage. Designing lightweight and performance-sustainable CD model that is more compatible with real-world applications is an urgent problem to be solved. Therefore, we propose a lightweight change detection network, called as robust feature aggregation network (RFANet). To improve representative capability of weaker features extracted from lightweight backbone, a feature reinforcement module (FRM) is proposed. FRM allows current level feature to densely interact and fuse with other level features, thus accomplishing the complementarity of fine-grained details and semantic information. Considering massive objects with rich correlations in RS images, we design semantic split-aggregation module (SSAM) to better capture global semantic information of changed objects. Besides, we present a lightweight decoder containing channel interaction module (CIM), which allows multi-level refined difference features to emphasize changed areas and suppress background and pseudo-changes. Extensive experiments carried out on four challenging RS image CD datasets illustrate that RFANet achieves competitive performance with fewer parameters and lower computational costs. The source code is available at <span>https://github.com/Youzhihui/RFANet</span><svg><path></path></svg>.</p></div>","PeriodicalId":50269,"journal":{"name":"ISPRS Journal of Photogrammetry and Remote Sensing","volume":null,"pages":null},"PeriodicalIF":10.6000,"publicationDate":"2024-07-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Robust feature aggregation network for lightweight and effective remote sensing image change detection\",\"authors\":\"Zhi-Hui You, Si-Bao Chen, Jia-Xin Wang, Bin Luo\",\"doi\":\"10.1016/j.isprsjprs.2024.06.013\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><p>In remote sensing (RS) image change detection (CD) task, many existing CD methods focus more on how to improve accuracy, but they usually have more parameters, higher computational costs, and heavier memory usage. Designing lightweight and performance-sustainable CD model that is more compatible with real-world applications is an urgent problem to be solved. Therefore, we propose a lightweight change detection network, called as robust feature aggregation network (RFANet). To improve representative capability of weaker features extracted from lightweight backbone, a feature reinforcement module (FRM) is proposed. FRM allows current level feature to densely interact and fuse with other level features, thus accomplishing the complementarity of fine-grained details and semantic information. Considering massive objects with rich correlations in RS images, we design semantic split-aggregation module (SSAM) to better capture global semantic information of changed objects. Besides, we present a lightweight decoder containing channel interaction module (CIM), which allows multi-level refined difference features to emphasize changed areas and suppress background and pseudo-changes. Extensive experiments carried out on four challenging RS image CD datasets illustrate that RFANet achieves competitive performance with fewer parameters and lower computational costs. The source code is available at <span>https://github.com/Youzhihui/RFANet</span><svg><path></path></svg>.</p></div>\",\"PeriodicalId\":50269,\"journal\":{\"name\":\"ISPRS Journal of Photogrammetry and Remote Sensing\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":10.6000,\"publicationDate\":\"2024-07-02\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"ISPRS Journal of Photogrammetry and Remote Sensing\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S092427162400251X\",\"RegionNum\":1,\"RegionCategory\":\"地球科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"GEOGRAPHY, PHYSICAL\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"ISPRS Journal of Photogrammetry and Remote Sensing","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S092427162400251X","RegionNum":1,"RegionCategory":"地球科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"GEOGRAPHY, PHYSICAL","Score":null,"Total":0}
引用次数: 0
摘要
在遥感(RS)图像变化检测(CD)任务中,许多现有的CD方法更侧重于如何提高精度,但它们通常参数较多、计算成本较高、内存占用较大。设计更符合实际应用的轻量级、性能可持续的 CD 模型是一个亟待解决的问题。因此,我们提出了一种轻量级变化检测网络,即鲁棒性特征聚合网络(RFANet)。为了提高从轻量级骨干网中提取的较弱特征的代表性,我们提出了一个特征增强模块(FRM)。FRM 允许当前级别的特征与其他级别的特征进行密集交互和融合,从而实现细粒度细节和语义信息的互补。考虑到 RS 图像中具有丰富相关性的海量对象,我们设计了语义分割聚合模块(SSAM),以更好地捕捉变化对象的全局语义信息。此外,我们还提出了一种包含信道交互模块(CIM)的轻量级解码器,该模块可提供多级精细差异特征,以强调变化区域,抑制背景和伪变化。在四个具有挑战性的 RS 图像 CD 数据集上进行的广泛实验表明,RFANet 以较少的参数和较低的计算成本实现了具有竞争力的性能。源代码见 https://github.com/Youzhihui/RFANet。
Robust feature aggregation network for lightweight and effective remote sensing image change detection
In remote sensing (RS) image change detection (CD) task, many existing CD methods focus more on how to improve accuracy, but they usually have more parameters, higher computational costs, and heavier memory usage. Designing lightweight and performance-sustainable CD model that is more compatible with real-world applications is an urgent problem to be solved. Therefore, we propose a lightweight change detection network, called as robust feature aggregation network (RFANet). To improve representative capability of weaker features extracted from lightweight backbone, a feature reinforcement module (FRM) is proposed. FRM allows current level feature to densely interact and fuse with other level features, thus accomplishing the complementarity of fine-grained details and semantic information. Considering massive objects with rich correlations in RS images, we design semantic split-aggregation module (SSAM) to better capture global semantic information of changed objects. Besides, we present a lightweight decoder containing channel interaction module (CIM), which allows multi-level refined difference features to emphasize changed areas and suppress background and pseudo-changes. Extensive experiments carried out on four challenging RS image CD datasets illustrate that RFANet achieves competitive performance with fewer parameters and lower computational costs. The source code is available at https://github.com/Youzhihui/RFANet.
期刊介绍:
The ISPRS Journal of Photogrammetry and Remote Sensing (P&RS) serves as the official journal of the International Society for Photogrammetry and Remote Sensing (ISPRS). It acts as a platform for scientists and professionals worldwide who are involved in various disciplines that utilize photogrammetry, remote sensing, spatial information systems, computer vision, and related fields. The journal aims to facilitate communication and dissemination of advancements in these disciplines, while also acting as a comprehensive source of reference and archive.
P&RS endeavors to publish high-quality, peer-reviewed research papers that are preferably original and have not been published before. These papers can cover scientific/research, technological development, or application/practical aspects. Additionally, the journal welcomes papers that are based on presentations from ISPRS meetings, as long as they are considered significant contributions to the aforementioned fields.
In particular, P&RS encourages the submission of papers that are of broad scientific interest, showcase innovative applications (especially in emerging fields), have an interdisciplinary focus, discuss topics that have received limited attention in P&RS or related journals, or explore new directions in scientific or professional realms. It is preferred that theoretical papers include practical applications, while papers focusing on systems and applications should include a theoretical background.