DEPDet: A Cross-Spatial Multiscale Lightweight Network for Ship Detection of SAR Images in Complex Scenes

IF 4.7 2区 地球科学 Q1 ENGINEERING, ELECTRICAL & ELECTRONIC IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing Pub Date : 2024-09-26 DOI:10.1109/JSTARS.2024.3469209
Jing Zhang;Fan Deng;Yonghua Wang;Jie Gong;Ziyang Liu;Wenjun Liu;Yinmei Zeng;Zeqiang Chen
{"title":"DEPDet: A Cross-Spatial Multiscale Lightweight Network for Ship Detection of SAR Images in Complex Scenes","authors":"Jing Zhang;Fan Deng;Yonghua Wang;Jie Gong;Ziyang Liu;Wenjun Liu;Yinmei Zeng;Zeqiang Chen","doi":"10.1109/JSTARS.2024.3469209","DOIUrl":null,"url":null,"abstract":"Nowadays, the intricate nature of synthetic aperture radar (SAR) ship scenes, coupled with the presence of multiscale targets, poses a significant challenge in detection accuracy. Furthermore, to reduce the financial outlay on hardware, there is also a considerable challenge in lightweighting the model. In order to resolve the aforementioned concerns, we propose a cross-spatial multiscale lightweight network, designated as DEPDet. First, a new efficient multiscale detection backbone network DEMNet is redesigned. To improve the feature extraction capability of the network, a cross-spatial multiscale convolution (CSMSConv) is designed and a new CSMSConv module CSMSC2F is constructed. Meanwhile, we introduce an efficient multiscale attention module. DEMNet is capable of more effectively extracting information pertaining to multiscale ships. Moreover, to enhance the fusion of features at diverse scales, we design a new path aggregation feature pyramid network DEPAFPN, which combines deformable convolution and CSMSC2F. Finally, we introduce partial convolution to construct a lightweight detection head module PCHead, which can be employed to extract spatial features with greater efficiency. The publicly available SAR ship datasets, SAR Ship Detection Dataset and High-Resolution SAR Image Dataset, are employed for the purpose of conducting experiments. The mean average precision (mAP) obtained was 98.2% (+1.4%) and 91.6% (+1.6%), respectively. The F1 obtained 0.950 (+1.7%) and 0.871 (+1.4%), respectively. Concurrently, the Params decreased from 3.2M to 2.1M, a decrease of approximately 34%. The floating-point operations (FLOPs) decreased from 8.7G to 4.5G, a decrease of approximately 48%. The experimental results indicate that the network achieves an effective balance between detection accuracy and lightweight effect with good generalization and extensibility.","PeriodicalId":13116,"journal":{"name":"IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing","volume":null,"pages":null},"PeriodicalIF":4.7000,"publicationDate":"2024-09-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10695810","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing","FirstCategoryId":"5","ListUrlMain":"https://ieeexplore.ieee.org/document/10695810/","RegionNum":2,"RegionCategory":"地球科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0

Abstract

Nowadays, the intricate nature of synthetic aperture radar (SAR) ship scenes, coupled with the presence of multiscale targets, poses a significant challenge in detection accuracy. Furthermore, to reduce the financial outlay on hardware, there is also a considerable challenge in lightweighting the model. In order to resolve the aforementioned concerns, we propose a cross-spatial multiscale lightweight network, designated as DEPDet. First, a new efficient multiscale detection backbone network DEMNet is redesigned. To improve the feature extraction capability of the network, a cross-spatial multiscale convolution (CSMSConv) is designed and a new CSMSConv module CSMSC2F is constructed. Meanwhile, we introduce an efficient multiscale attention module. DEMNet is capable of more effectively extracting information pertaining to multiscale ships. Moreover, to enhance the fusion of features at diverse scales, we design a new path aggregation feature pyramid network DEPAFPN, which combines deformable convolution and CSMSC2F. Finally, we introduce partial convolution to construct a lightweight detection head module PCHead, which can be employed to extract spatial features with greater efficiency. The publicly available SAR ship datasets, SAR Ship Detection Dataset and High-Resolution SAR Image Dataset, are employed for the purpose of conducting experiments. The mean average precision (mAP) obtained was 98.2% (+1.4%) and 91.6% (+1.6%), respectively. The F1 obtained 0.950 (+1.7%) and 0.871 (+1.4%), respectively. Concurrently, the Params decreased from 3.2M to 2.1M, a decrease of approximately 34%. The floating-point operations (FLOPs) decreased from 8.7G to 4.5G, a decrease of approximately 48%. The experimental results indicate that the network achieves an effective balance between detection accuracy and lightweight effect with good generalization and extensibility.
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
DEPDet:用于复杂场景中 SAR 图像船舶检测的跨空间多尺度轻量级网络
如今,合成孔径雷达(SAR)舰船场景错综复杂,再加上多尺度目标的存在,给探测精度带来了巨大挑战。此外,为了减少硬件支出,模型轻量化也是一个相当大的挑战。为了解决上述问题,我们提出了一种跨空间多尺度轻量级网络,命名为 DEPDet。 首先,我们重新设计了一个新的高效多尺度检测骨干网络 DEMNet。为了提高网络的特征提取能力,我们设计了跨空间多尺度卷积(CSMSConv),并构建了新的 CSMSConv 模块 CSMSC2F。同时,我们还引入了高效的多尺度注意力模块。DEMNet 能够更有效地提取与多尺度船舶相关的信息。此外,为了加强不同尺度特征的融合,我们设计了一种新的路径聚合特征金字塔网络 DEPAFPN,它结合了可变形卷积和 CSMSC2F。最后,我们引入部分卷积来构建轻量级探测头模块 PCHead,从而可以更高效地提取空间特征。实验采用了公开的 SAR 船舶数据集,即 SAR 船舶检测数据集和高分辨率 SAR 图像数据集。获得的平均精度(mAP)分别为 98.2% (+1.4%) 和 91.6% (+1.6%)。F1 分别为 0.950 (+1.7%) 和 0.871 (+1.4%)。同时,Params 从 3.2M 降至 2.1M,降幅约为 34%。浮点运算 (FLOP) 从 8.7G 减少到 4.5G,减少了约 48%。实验结果表明,该网络在检测精度和轻量级效果之间实现了有效平衡,具有良好的通用性和可扩展性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
CiteScore
9.30
自引率
10.90%
发文量
563
审稿时长
4.7 months
期刊介绍: The IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing addresses the growing field of applications in Earth observations and remote sensing, and also provides a venue for the rapidly expanding special issues that are being sponsored by the IEEE Geosciences and Remote Sensing Society. The journal draws upon the experience of the highly successful “IEEE Transactions on Geoscience and Remote Sensing” and provide a complementary medium for the wide range of topics in applied earth observations. The ‘Applications’ areas encompasses the societal benefit areas of the Global Earth Observations Systems of Systems (GEOSS) program. Through deliberations over two years, ministers from 50 countries agreed to identify nine areas where Earth observation could positively impact the quality of life and health of their respective countries. Some of these are areas not traditionally addressed in the IEEE context. These include biodiversity, health and climate. Yet it is the skill sets of IEEE members, in areas such as observations, communications, computers, signal processing, standards and ocean engineering, that form the technical underpinnings of GEOSS. Thus, the Journal attracts a broad range of interests that serves both present members in new ways and expands the IEEE visibility into new areas.
期刊最新文献
Kriging-Based Atmospheric Phase Screen Compensation Incorporating Time-Series Similarity in Ground-Based Radar Interferometry Profile Data Reconstruction for Deep Chl$a$ Maxima in Mediterranean Sea via Improved-MLP Networks Seasonal Dynamics in Land Surface Temperature in Response to Land Use Land Cover Changes Using Google Earth Engine DEPDet: A Cross-Spatial Multiscale Lightweight Network for Ship Detection of SAR Images in Complex Scenes Deep Learning for Mesoscale Eddy Detection With Feature Fusion of Multisatellite Observations
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1