无人机视角下基于 YOLOv8 的小物体检测

IF 3.7 4区 计算机科学 Q2 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pattern Analysis and Applications Pub Date : 2024-08-18 DOI:10.1007/s10044-024-01323-7
Tao Ning, Wantong Wu, Jin Zhang
{"title":"无人机视角下基于 YOLOv8 的小物体检测","authors":"Tao Ning, Wantong Wu, Jin Zhang","doi":"10.1007/s10044-024-01323-7","DOIUrl":null,"url":null,"abstract":"<p>Unmanned aerial vehicle (UAV) image object detection is a challenging task, primarily due to various factors such as multi-scale objects, a high proportion of small objects, significant overlap between objects, poor image quality, and complex and dynamic scenes. To address these challenges, several improvements were made to the YOLOv8 model. Firstly, by pruning the feature mapping layers responsible for detecting large objects in the YOLOv8 model, significant reduction in computational resources was achieved, rendering the model more lightweight. Simultaneously, a detection head fused with self-attention was introduced simultaneously to enhance the detection capability for small objects. Secondly, the introduction of space depth convolution in place of the original convolutional striding and pooling operations facilitates more effective preservation of details in low-resolution images and small objects. Lastly, a multi-level feature fusion module was designed to merge feature maps from different network layers, enhancing the network's representation capability. Results on the Visdrone dataset demonstrate that the proposed model achieved a significant 4.7% improvement in mAP50 compared to YOLOv8, while reducing the parameter count to only 39% of the original model. Moreover, transfer experiments on the TT100k dataset showed a 3.2% increase in mAP50, validating the effectiveness of the improved model for small object detection tasks in UAV images. Our code is made available at https://github.com/Wtgonw/Imporved-yolov8.</p>","PeriodicalId":54639,"journal":{"name":"Pattern Analysis and Applications","volume":null,"pages":null},"PeriodicalIF":3.7000,"publicationDate":"2024-08-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Small object detection based on YOLOv8 in UAV perspective\",\"authors\":\"Tao Ning, Wantong Wu, Jin Zhang\",\"doi\":\"10.1007/s10044-024-01323-7\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p>Unmanned aerial vehicle (UAV) image object detection is a challenging task, primarily due to various factors such as multi-scale objects, a high proportion of small objects, significant overlap between objects, poor image quality, and complex and dynamic scenes. To address these challenges, several improvements were made to the YOLOv8 model. Firstly, by pruning the feature mapping layers responsible for detecting large objects in the YOLOv8 model, significant reduction in computational resources was achieved, rendering the model more lightweight. Simultaneously, a detection head fused with self-attention was introduced simultaneously to enhance the detection capability for small objects. Secondly, the introduction of space depth convolution in place of the original convolutional striding and pooling operations facilitates more effective preservation of details in low-resolution images and small objects. Lastly, a multi-level feature fusion module was designed to merge feature maps from different network layers, enhancing the network's representation capability. Results on the Visdrone dataset demonstrate that the proposed model achieved a significant 4.7% improvement in mAP50 compared to YOLOv8, while reducing the parameter count to only 39% of the original model. Moreover, transfer experiments on the TT100k dataset showed a 3.2% increase in mAP50, validating the effectiveness of the improved model for small object detection tasks in UAV images. Our code is made available at https://github.com/Wtgonw/Imporved-yolov8.</p>\",\"PeriodicalId\":54639,\"journal\":{\"name\":\"Pattern Analysis and Applications\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":3.7000,\"publicationDate\":\"2024-08-18\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Pattern Analysis and Applications\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://doi.org/10.1007/s10044-024-01323-7\",\"RegionNum\":4,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Pattern Analysis and Applications","FirstCategoryId":"94","ListUrlMain":"https://doi.org/10.1007/s10044-024-01323-7","RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0

摘要

无人飞行器(UAV)图像物体检测是一项极具挑战性的任务,这主要是由于多种因素造成的,例如多尺度物体、小物体比例高、物体间重叠严重、图像质量差以及复杂多变的场景。为了应对这些挑战,我们对 YOLOv8 模型进行了多项改进。首先,通过修剪 YOLOv8 模型中负责检测大型物体的特征映射层,显著减少了计算资源,使模型更加轻便。与此同时,还同时引入了融合自注意的检测头,以增强对小物体的检测能力。其次,引入空间深度卷积,取代原有的卷积跨步和池化操作,更有效地保留了低分辨率图像和小物体的细节。最后,设计了一个多层次特征融合模块,用于合并不同网络层的特征图,增强网络的表示能力。在 Visdrone 数据集上的结果表明,与 YOLOv8 相比,所提出的模型在 mAP50 方面取得了 4.7% 的显著改进,同时参数数量仅为原始模型的 39%。此外,在 TT100k 数据集上的转移实验表明,mAP50 提高了 3.2%,验证了改进模型在无人机图像中的小目标检测任务中的有效性。我们的代码可在 https://github.com/Wtgonw/Imporved-yolov8 上获取。
本文章由计算机程序翻译,如有差异,请以英文原文为准。

摘要图片

查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
Small object detection based on YOLOv8 in UAV perspective

Unmanned aerial vehicle (UAV) image object detection is a challenging task, primarily due to various factors such as multi-scale objects, a high proportion of small objects, significant overlap between objects, poor image quality, and complex and dynamic scenes. To address these challenges, several improvements were made to the YOLOv8 model. Firstly, by pruning the feature mapping layers responsible for detecting large objects in the YOLOv8 model, significant reduction in computational resources was achieved, rendering the model more lightweight. Simultaneously, a detection head fused with self-attention was introduced simultaneously to enhance the detection capability for small objects. Secondly, the introduction of space depth convolution in place of the original convolutional striding and pooling operations facilitates more effective preservation of details in low-resolution images and small objects. Lastly, a multi-level feature fusion module was designed to merge feature maps from different network layers, enhancing the network's representation capability. Results on the Visdrone dataset demonstrate that the proposed model achieved a significant 4.7% improvement in mAP50 compared to YOLOv8, while reducing the parameter count to only 39% of the original model. Moreover, transfer experiments on the TT100k dataset showed a 3.2% increase in mAP50, validating the effectiveness of the improved model for small object detection tasks in UAV images. Our code is made available at https://github.com/Wtgonw/Imporved-yolov8.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Pattern Analysis and Applications
Pattern Analysis and Applications 工程技术-计算机:人工智能
CiteScore
7.40
自引率
2.60%
发文量
76
审稿时长
13.5 months
期刊介绍: The journal publishes high quality articles in areas of fundamental research in intelligent pattern analysis and applications in computer science and engineering. It aims to provide a forum for original research which describes novel pattern analysis techniques and industrial applications of the current technology. In addition, the journal will also publish articles on pattern analysis applications in medical imaging. The journal solicits articles that detail new technology and methods for pattern recognition and analysis in applied domains including, but not limited to, computer vision and image processing, speech analysis, robotics, multimedia, document analysis, character recognition, knowledge engineering for pattern recognition, fractal analysis, and intelligent control. The journal publishes articles on the use of advanced pattern recognition and analysis methods including statistical techniques, neural networks, genetic algorithms, fuzzy pattern recognition, machine learning, and hardware implementations which are either relevant to the development of pattern analysis as a research area or detail novel pattern analysis applications. Papers proposing new classifier systems or their development, pattern analysis systems for real-time applications, fuzzy and temporal pattern recognition and uncertainty management in applied pattern recognition are particularly solicited.
期刊最新文献
K-BEST subspace clustering: kernel-friendly block-diagonal embedded and similarity-preserving transformed subspace clustering Research on decoupled adaptive graph convolution networks based on skeleton data for action recognition Hidden Markov models with multivariate bounded asymmetric student’s t-mixture model emissions YOLOv7-GCM: a detection algorithm for creek waste based on improved YOLOv7 model LDC-PP-YOLOE: a lightweight model for detecting and counting citrus fruit
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1