Research on Bidirectional Multi-Span Feature Pyramid and Key Feature Capture Object Detection Network

Drones Pub Date : 2024-05-09 DOI:10.3390/drones8050189
Heng Zhang, Faming Shao, Xiaohui He, Dewei Zhao, Zihan Zhang, Tao Zhang
{"title":"Research on Bidirectional Multi-Span Feature Pyramid and Key Feature Capture Object Detection Network","authors":"Heng Zhang, Faming Shao, Xiaohui He, Dewei Zhao, Zihan Zhang, Tao Zhang","doi":"10.3390/drones8050189","DOIUrl":null,"url":null,"abstract":"UAV remote sensing (RS) image object detection is a very valuable and challenging technology. This article discusses the importance of key features and proposes an object detection network (URSNet) based on a bidirectional multi-span feature pyramid and key feature capture mechanism. Firstly, a bidirectional multi-span feature pyramid (BMSFPN) is constructed. In the process of bidirectional sampling, bicubic interpolation and cross layer fusion are used to filter out image noise and enhance the details of object features. Secondly, the designed feature polarization module (FPM) uses the internal polarization attention mechanism to build a powerful feature representation for classification and regression tasks, making it easier for the network to capture the key object features with more semantic discrimination. In addition, the anchor rotation alignment module (ARAM) further refines the preset anchor frame based on the key regression features extracted by FPM to obtain high-quality rotation anchors with a high matching degree and rich positioning visual information. Finally, the dynamic anchor optimization module (DAOM) is used to improve the ability of feature alignment and positive and negative sample discrimination of the model so that the model can dynamically select the candidate anchor to capture the key regression features so as to further eliminate the deviation between the classification and regression. URSNet has conducted comprehensive ablation and SOTA comparative experiments on challenging RS datasets such as DOTA-V2.0, DIOR and RSOD. The optimal experimental results (87.19% mAP, 108.2 FPS) show that URSNet has efficient and reliable detection performance.","PeriodicalId":507567,"journal":{"name":"Drones","volume":"168 ","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2024-05-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Drones","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.3390/drones8050189","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

UAV remote sensing (RS) image object detection is a very valuable and challenging technology. This article discusses the importance of key features and proposes an object detection network (URSNet) based on a bidirectional multi-span feature pyramid and key feature capture mechanism. Firstly, a bidirectional multi-span feature pyramid (BMSFPN) is constructed. In the process of bidirectional sampling, bicubic interpolation and cross layer fusion are used to filter out image noise and enhance the details of object features. Secondly, the designed feature polarization module (FPM) uses the internal polarization attention mechanism to build a powerful feature representation for classification and regression tasks, making it easier for the network to capture the key object features with more semantic discrimination. In addition, the anchor rotation alignment module (ARAM) further refines the preset anchor frame based on the key regression features extracted by FPM to obtain high-quality rotation anchors with a high matching degree and rich positioning visual information. Finally, the dynamic anchor optimization module (DAOM) is used to improve the ability of feature alignment and positive and negative sample discrimination of the model so that the model can dynamically select the candidate anchor to capture the key regression features so as to further eliminate the deviation between the classification and regression. URSNet has conducted comprehensive ablation and SOTA comparative experiments on challenging RS datasets such as DOTA-V2.0, DIOR and RSOD. The optimal experimental results (87.19% mAP, 108.2 FPS) show that URSNet has efficient and reliable detection performance.
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
双向多跨度特征金字塔与关键特征捕捉物体检测网络研究
无人机遥感(RS)图像目标检测是一项非常有价值且极具挑战性的技术。本文讨论了关键特征的重要性,并提出了一种基于双向多跨度特征金字塔和关键特征捕捉机制的目标检测网络(URSNet)。首先,构建一个双向多跨度特征金字塔(BMSFPN)。在双向采样过程中,利用双三次插值和跨层融合来过滤图像噪声,增强物体特征的细节。其次,设计的特征极化模块(FPM)利用内部极化关注机制,为分类和回归任务构建了强大的特征表示,使网络更容易捕捉到语义辨别度更高的关键物体特征。此外,锚点旋转配准模块(ARAM)根据 FPM 提取的关键回归特征进一步完善预设锚点框架,从而获得匹配度高、定位视觉信息丰富的高质量旋转锚点。最后,利用动态锚优化模块(DAOM)提高模型的特征配准和正负样本判别能力,使模型能够动态选择捕捉关键回归特征的候选锚,从而进一步消除分类与回归之间的偏差。URSNet 在 DOTA-V2.0、DIOR 和 RSOD 等具有挑战性的 RS 数据集上进行了全面的消融和 SOTA 对比实验。最佳实验结果(87.19% mAP,108.2 FPS)表明 URSNet 具有高效可靠的检测性能。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
相关文献
Clinical significance of copy number variants involving KANK1 in patients with neurodevelopmental disorders
IF 1.9 4区 医学European journal of medical geneticsPub Date : 2019-01-01 DOI: 10.1016/j.ejmg.2018.04.012
Rena J. Vanzo , Hope Twede , Karen S. Ho , Aparna Prasad , Megan M. Martin , Sarah T. South , E. Robert Wassman
来源期刊
自引率
0.00%
发文量
0
期刊最新文献
Improved Nonlinear Model Predictive Control Based Fast Trajectory Tracking for a Quadrotor Unmanned Aerial Vehicle A General Method for Pre-Flight Preparation in Data Collection for Unmanned Aerial Vehicle-Based Bridge Inspection A Mission Planning Method for Long-Endurance Unmanned Aerial Vehicles: Integrating Heterogeneous Ground Control Resource Allocation Equivalent Spatial Plane-Based Relative Pose Estimation of UAVs Multi-Type Task Assignment Algorithm for Heterogeneous UAV Cluster Based on Improved NSGA-Ⅱ
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1