DCEA:在合成孔径雷达图像中使用具有集中可变形注意力的 DETR 进行端对端船舶探测

IF 4.7 2区 地球科学 Q1 ENGINEERING, ELECTRICAL & ELECTRONIC IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing Pub Date : 2024-09-16 DOI:10.1109/JSTARS.2024.3461723
Hai Lin;Jin Liu;Xingye Li;Lai Wei;Yuxin Liu;Bing Han;Zhongdai Wu
{"title":"DCEA:在合成孔径雷达图像中使用具有集中可变形注意力的 DETR 进行端对端船舶探测","authors":"Hai Lin;Jin Liu;Xingye Li;Lai Wei;Yuxin Liu;Bing Han;Zhongdai Wu","doi":"10.1109/JSTARS.2024.3461723","DOIUrl":null,"url":null,"abstract":"Recently, significant advancements have been achieved in optimizing algorithms for synthetic aperture radar (SAR) ship detection. Nevertheless, two challenges still impede further research as follows. 1) Mainstream methods, whether anchor-free or anchor-based, adhere to a dense paradigm, leading to substantial redundancy and limited adaptability. 2) Ship targets in SAR images exhibit large shape variations and scale differences, making it difficult to efficiently extract key features from background clutter. To tackle the aforementioned problems, we propose DETR with Concentrated dEformable Attention (DCEA), a query-based method for end-to-end optimization of the current pipeline. First, for the irregular shapes and sparse distribution of ships, the concentrated deformable attention is introduced to model the spatial positions of targets, simulating their geometric transformations with precision. Second, an attentionwise propagation module is designed to integrate local fine-grained information with global semantic information, improving the detection performance for objects across diverse scales. Finally, due to the lack of information exchange between object queries, a dimensionwise information mixing module is employed to incorporate key information from various dimensions to enhance their representation capability. To validate the superior performance of DCEA, we conduct extensive experiments on multiple public datasets, achieving mean average precision scores of 0.991, 0.929, and 0.962 on the SSDD, HRSID, and SAR-Ship-Dataset, respectively, with a model size of only 14.34M parameters and 44.4 giga floating point operations.","PeriodicalId":13116,"journal":{"name":"IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing","volume":null,"pages":null},"PeriodicalIF":4.7000,"publicationDate":"2024-09-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10681295","citationCount":"0","resultStr":"{\"title\":\"DCEA: DETR With Concentrated Deformable Attention for End-to-End Ship Detection in SAR Images\",\"authors\":\"Hai Lin;Jin Liu;Xingye Li;Lai Wei;Yuxin Liu;Bing Han;Zhongdai Wu\",\"doi\":\"10.1109/JSTARS.2024.3461723\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Recently, significant advancements have been achieved in optimizing algorithms for synthetic aperture radar (SAR) ship detection. Nevertheless, two challenges still impede further research as follows. 1) Mainstream methods, whether anchor-free or anchor-based, adhere to a dense paradigm, leading to substantial redundancy and limited adaptability. 2) Ship targets in SAR images exhibit large shape variations and scale differences, making it difficult to efficiently extract key features from background clutter. To tackle the aforementioned problems, we propose DETR with Concentrated dEformable Attention (DCEA), a query-based method for end-to-end optimization of the current pipeline. First, for the irregular shapes and sparse distribution of ships, the concentrated deformable attention is introduced to model the spatial positions of targets, simulating their geometric transformations with precision. Second, an attentionwise propagation module is designed to integrate local fine-grained information with global semantic information, improving the detection performance for objects across diverse scales. Finally, due to the lack of information exchange between object queries, a dimensionwise information mixing module is employed to incorporate key information from various dimensions to enhance their representation capability. To validate the superior performance of DCEA, we conduct extensive experiments on multiple public datasets, achieving mean average precision scores of 0.991, 0.929, and 0.962 on the SSDD, HRSID, and SAR-Ship-Dataset, respectively, with a model size of only 14.34M parameters and 44.4 giga floating point operations.\",\"PeriodicalId\":13116,\"journal\":{\"name\":\"IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":4.7000,\"publicationDate\":\"2024-09-16\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10681295\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10681295/\",\"RegionNum\":2,\"RegionCategory\":\"地球科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENGINEERING, ELECTRICAL & ELECTRONIC\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing","FirstCategoryId":"5","ListUrlMain":"https://ieeexplore.ieee.org/document/10681295/","RegionNum":2,"RegionCategory":"地球科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0

摘要

最近,在优化合成孔径雷达(SAR)船舶探测算法方面取得了重大进展。然而,以下两个挑战仍然阻碍着进一步的研究。1) 无论是无锚还是基于锚的主流方法,都遵循密集模式,导致大量冗余和有限的适应性。2) 由于合成孔径雷达图像中的船舶目标具有较大的形状变化和尺度差异,因此很难从背景杂波中有效提取关键特征。针对上述问题,我们提出了 DETR with Concentrated dEformable Attention (DCEA),这是一种基于查询的方法,可对当前管道进行端到端优化。首先,针对船只的不规则形状和稀疏分布,我们引入了集中可变形注意力来模拟目标的空间位置,精确地模拟它们的几何变换。其次,设计了注意力传播模块,以整合局部细粒度信息和全局语义信息,提高不同尺度物体的检测性能。最后,由于对象查询之间缺乏信息交换,因此采用了维度信息混合模块,以整合来自不同维度的关键信息,从而增强其表示能力。为了验证 DCEA 的优越性能,我们在多个公共数据集上进行了广泛的实验,在 SSDD、HRSID 和 SAR-Ship-Dataset 数据集上的平均精度分别达到了 0.991、0.929 和 0.962,模型大小仅为 14.34M 参数和 44.4 千兆浮点运算。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
DCEA: DETR With Concentrated Deformable Attention for End-to-End Ship Detection in SAR Images
Recently, significant advancements have been achieved in optimizing algorithms for synthetic aperture radar (SAR) ship detection. Nevertheless, two challenges still impede further research as follows. 1) Mainstream methods, whether anchor-free or anchor-based, adhere to a dense paradigm, leading to substantial redundancy and limited adaptability. 2) Ship targets in SAR images exhibit large shape variations and scale differences, making it difficult to efficiently extract key features from background clutter. To tackle the aforementioned problems, we propose DETR with Concentrated dEformable Attention (DCEA), a query-based method for end-to-end optimization of the current pipeline. First, for the irregular shapes and sparse distribution of ships, the concentrated deformable attention is introduced to model the spatial positions of targets, simulating their geometric transformations with precision. Second, an attentionwise propagation module is designed to integrate local fine-grained information with global semantic information, improving the detection performance for objects across diverse scales. Finally, due to the lack of information exchange between object queries, a dimensionwise information mixing module is employed to incorporate key information from various dimensions to enhance their representation capability. To validate the superior performance of DCEA, we conduct extensive experiments on multiple public datasets, achieving mean average precision scores of 0.991, 0.929, and 0.962 on the SSDD, HRSID, and SAR-Ship-Dataset, respectively, with a model size of only 14.34M parameters and 44.4 giga floating point operations.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
CiteScore
9.30
自引率
10.90%
发文量
563
审稿时长
4.7 months
期刊介绍: The IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing addresses the growing field of applications in Earth observations and remote sensing, and also provides a venue for the rapidly expanding special issues that are being sponsored by the IEEE Geosciences and Remote Sensing Society. The journal draws upon the experience of the highly successful “IEEE Transactions on Geoscience and Remote Sensing” and provide a complementary medium for the wide range of topics in applied earth observations. The ‘Applications’ areas encompasses the societal benefit areas of the Global Earth Observations Systems of Systems (GEOSS) program. Through deliberations over two years, ministers from 50 countries agreed to identify nine areas where Earth observation could positively impact the quality of life and health of their respective countries. Some of these are areas not traditionally addressed in the IEEE context. These include biodiversity, health and climate. Yet it is the skill sets of IEEE members, in areas such as observations, communications, computers, signal processing, standards and ocean engineering, that form the technical underpinnings of GEOSS. Thus, the Journal attracts a broad range of interests that serves both present members in new ways and expands the IEEE visibility into new areas.
期刊最新文献
Kriging-Based Atmospheric Phase Screen Compensation Incorporating Time-Series Similarity in Ground-Based Radar Interferometry Profile Data Reconstruction for Deep Chl$a$ Maxima in Mediterranean Sea via Improved-MLP Networks Seasonal Dynamics in Land Surface Temperature in Response to Land Use Land Cover Changes Using Google Earth Engine DEPDet: A Cross-Spatial Multiscale Lightweight Network for Ship Detection of SAR Images in Complex Scenes Deep Learning for Mesoscale Eddy Detection With Feature Fusion of Multisatellite Observations
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1