DAM-Net:利用基于视觉变换器的微分注意指标从合成孔径雷达图像中检测洪水

IF 10.6 1区 地球科学 Q1 GEOGRAPHY, PHYSICAL ISPRS Journal of Photogrammetry and Remote Sensing Pub Date : 2024-05-20 DOI:10.1016/j.isprsjprs.2024.05.018
Tamer Saleh , Xingxing Weng , Shimaa Holail , Chen Hao , Gui-Song Xia
{"title":"DAM-Net:利用基于视觉变换器的微分注意指标从合成孔径雷达图像中检测洪水","authors":"Tamer Saleh ,&nbsp;Xingxing Weng ,&nbsp;Shimaa Holail ,&nbsp;Chen Hao ,&nbsp;Gui-Song Xia","doi":"10.1016/j.isprsjprs.2024.05.018","DOIUrl":null,"url":null,"abstract":"<div><p>Flood detection from synthetic aperture radar (SAR) imagery plays an important role in crisis and disaster management. Based on pre- and post-flood SAR images, flooded areas can be extracted by detecting changes of water bodies. Existing state-of-the-art change detection methods primarily target optical image pairs. The nature of SAR images, such as scarce visual information, similar backscatter signals, and ubiquitous speckle noise, pose great challenges to identifying water bodies and mining change features, thus resulting in unsatisfactory performance. Besides, the lack of large-scale annotated datasets hinders the development of accurate flood detection methods. In this paper, we focus on the difference between SAR image pairs and present a differential attention metric-based network (DAM-Net), to achieve flood detection. By introducing feature interaction during temporal-wise feature representation, we guide the model to focus on changes of interest rather than fully understanding the scene of the image. On the other hand, we devise a class token to capture high-level semantic information about water body changes, increasing the ability to distinguish water body changes and pseudo changes caused by similar signals or speckle noise. To better train and evaluate DAM-Net, we create a large-scale flood detection dataset using Sentinel-1 SAR imagery, namely <em>S1GFloods</em>. This dataset consists of 5,360 image pairs, covering 46 flood events during 2015–2022, and spanning 6 continents of the world. The experimental results on this dataset demonstrate that our method outperforms several advanced change detection methods. DAM-Net achieves 97.8% overall accuracy, 96.5% F1, and 93.2% IoU on the test set. Our dataset and code are available at <span>https://github.com/Tamer-Saleh/S1GFlood-Detection</span><svg><path></path></svg>.</p></div>","PeriodicalId":50269,"journal":{"name":"ISPRS Journal of Photogrammetry and Remote Sensing","volume":null,"pages":null},"PeriodicalIF":10.6000,"publicationDate":"2024-05-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"DAM-Net: Flood detection from SAR imagery using differential attention metric-based vision transformers\",\"authors\":\"Tamer Saleh ,&nbsp;Xingxing Weng ,&nbsp;Shimaa Holail ,&nbsp;Chen Hao ,&nbsp;Gui-Song Xia\",\"doi\":\"10.1016/j.isprsjprs.2024.05.018\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><p>Flood detection from synthetic aperture radar (SAR) imagery plays an important role in crisis and disaster management. Based on pre- and post-flood SAR images, flooded areas can be extracted by detecting changes of water bodies. Existing state-of-the-art change detection methods primarily target optical image pairs. The nature of SAR images, such as scarce visual information, similar backscatter signals, and ubiquitous speckle noise, pose great challenges to identifying water bodies and mining change features, thus resulting in unsatisfactory performance. Besides, the lack of large-scale annotated datasets hinders the development of accurate flood detection methods. In this paper, we focus on the difference between SAR image pairs and present a differential attention metric-based network (DAM-Net), to achieve flood detection. By introducing feature interaction during temporal-wise feature representation, we guide the model to focus on changes of interest rather than fully understanding the scene of the image. On the other hand, we devise a class token to capture high-level semantic information about water body changes, increasing the ability to distinguish water body changes and pseudo changes caused by similar signals or speckle noise. To better train and evaluate DAM-Net, we create a large-scale flood detection dataset using Sentinel-1 SAR imagery, namely <em>S1GFloods</em>. This dataset consists of 5,360 image pairs, covering 46 flood events during 2015–2022, and spanning 6 continents of the world. The experimental results on this dataset demonstrate that our method outperforms several advanced change detection methods. DAM-Net achieves 97.8% overall accuracy, 96.5% F1, and 93.2% IoU on the test set. Our dataset and code are available at <span>https://github.com/Tamer-Saleh/S1GFlood-Detection</span><svg><path></path></svg>.</p></div>\",\"PeriodicalId\":50269,\"journal\":{\"name\":\"ISPRS Journal of Photogrammetry and Remote Sensing\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":10.6000,\"publicationDate\":\"2024-05-20\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"ISPRS Journal of Photogrammetry and Remote Sensing\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0924271624002168\",\"RegionNum\":1,\"RegionCategory\":\"地球科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"GEOGRAPHY, PHYSICAL\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"ISPRS Journal of Photogrammetry and Remote Sensing","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0924271624002168","RegionNum":1,"RegionCategory":"地球科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"GEOGRAPHY, PHYSICAL","Score":null,"Total":0}
引用次数: 0

摘要

合成孔径雷达(SAR)图像的洪水探测在危机和灾害管理中发挥着重要作用。根据洪水前后的合成孔径雷达图像,可以通过检测水体的变化来提取洪水淹没区域。现有的先进变化检测方法主要针对光学图像对。由于合成孔径雷达图像的特性,如视觉信息稀少、相似的反向散射信号和无处不在的斑点噪声等,给识别水体和挖掘变化特征带来了巨大挑战,因此性能并不理想。此外,大规模注释数据集的缺乏也阻碍了精确洪水检测方法的发展。在本文中,我们聚焦于合成孔径雷达图像对之间的差异,提出了一种基于差异注意度量的网络(DAM-Net),以实现洪水检测。通过在时序特征表示过程中引入特征交互,我们引导模型关注感兴趣的变化,而不是完全理解图像的场景。另一方面,我们设计了一个类标记来捕捉水体变化的高级语义信息,从而提高了区分水体变化和由相似信号或斑点噪声引起的伪变化的能力。为了更好地训练和评估 DAM-Net,我们利用 Sentinel-1 SAR 图像创建了一个大规模洪水检测数据集,即 S1GFloods。该数据集由 5,360 对图像组成,涵盖 2015-2022 年间的 46 次洪水事件,横跨世界 6 大洲。该数据集的实验结果表明,我们的方法优于几种先进的变化检测方法。在测试集上,DAM-Net 的总体准确率达到 97.8%,F1 达到 96.5%,IoU 达到 93.2%。我们的数据集和代码见 https://github.com/Tamer-Saleh/S1GFlood-Detection。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
DAM-Net: Flood detection from SAR imagery using differential attention metric-based vision transformers

Flood detection from synthetic aperture radar (SAR) imagery plays an important role in crisis and disaster management. Based on pre- and post-flood SAR images, flooded areas can be extracted by detecting changes of water bodies. Existing state-of-the-art change detection methods primarily target optical image pairs. The nature of SAR images, such as scarce visual information, similar backscatter signals, and ubiquitous speckle noise, pose great challenges to identifying water bodies and mining change features, thus resulting in unsatisfactory performance. Besides, the lack of large-scale annotated datasets hinders the development of accurate flood detection methods. In this paper, we focus on the difference between SAR image pairs and present a differential attention metric-based network (DAM-Net), to achieve flood detection. By introducing feature interaction during temporal-wise feature representation, we guide the model to focus on changes of interest rather than fully understanding the scene of the image. On the other hand, we devise a class token to capture high-level semantic information about water body changes, increasing the ability to distinguish water body changes and pseudo changes caused by similar signals or speckle noise. To better train and evaluate DAM-Net, we create a large-scale flood detection dataset using Sentinel-1 SAR imagery, namely S1GFloods. This dataset consists of 5,360 image pairs, covering 46 flood events during 2015–2022, and spanning 6 continents of the world. The experimental results on this dataset demonstrate that our method outperforms several advanced change detection methods. DAM-Net achieves 97.8% overall accuracy, 96.5% F1, and 93.2% IoU on the test set. Our dataset and code are available at https://github.com/Tamer-Saleh/S1GFlood-Detection.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
ISPRS Journal of Photogrammetry and Remote Sensing
ISPRS Journal of Photogrammetry and Remote Sensing 工程技术-成像科学与照相技术
CiteScore
21.00
自引率
6.30%
发文量
273
审稿时长
40 days
期刊介绍: The ISPRS Journal of Photogrammetry and Remote Sensing (P&RS) serves as the official journal of the International Society for Photogrammetry and Remote Sensing (ISPRS). It acts as a platform for scientists and professionals worldwide who are involved in various disciplines that utilize photogrammetry, remote sensing, spatial information systems, computer vision, and related fields. The journal aims to facilitate communication and dissemination of advancements in these disciplines, while also acting as a comprehensive source of reference and archive. P&RS endeavors to publish high-quality, peer-reviewed research papers that are preferably original and have not been published before. These papers can cover scientific/research, technological development, or application/practical aspects. Additionally, the journal welcomes papers that are based on presentations from ISPRS meetings, as long as they are considered significant contributions to the aforementioned fields. In particular, P&RS encourages the submission of papers that are of broad scientific interest, showcase innovative applications (especially in emerging fields), have an interdisciplinary focus, discuss topics that have received limited attention in P&RS or related journals, or explore new directions in scientific or professional realms. It is preferred that theoretical papers include practical applications, while papers focusing on systems and applications should include a theoretical background.
期刊最新文献
Integrating synthetic datasets with CLIP semantic insights for single image localization advancements Selective weighted least square and piecewise bilinear transformation for accurate satellite DSM generation Word2Scene: Efficient remote sensing image scene generation with only one word via hybrid intelligence and low-rank representation A_OPTRAM-ET: An automatic optical trapezoid model for evapotranspiration estimation and its global-scale assessments Atmospheric correction of geostationary ocean color imager data over turbid coastal waters under high solar zenith angles
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1