{"title":"AFMTD:多尺度目标检测的无锚框架","authors":"Xueting Liu, Jingrou Xu, Ruoxi Lin, Jinyang Pan, Junying Mao, Guangqiang Yin","doi":"10.1109/CCISP55629.2022.9974392","DOIUrl":null,"url":null,"abstract":"Target detection task plays the most fundamental and important role in computer vision. The appearance of deep learning method has produced a positive effect on target detection, but multi-scale target detection is poor. The reasons could be attributed to two aspects; the first one is that the small target tends to contain less semantic information, which leads algorithm be hard to detect it; the other is that the sample distribution in the practical application scenarios is random, and the different-scaled target features will interfere with each other, which poses negative effect on multi-scale target detection. Based on existing technical issues, we propose an anchor-free frame for the multi-scale target detection (AFMTD) algorithm as solution. First, from the direction of feature fusion, we propose a spatial attention fusion module (SAFM), which designs same scale transformation (SST) based on Bi-FPN, strengthens the valuable information between adjacent feature layers, and suppresses interference features, improving the detection accuracy and resolution ability of targets of different scales. Then, from the direction of anchor-free frame detection, the heatmap-based multi-scale detection module (HMDM) is proposed; by introducing a scale distribution mechanism (SDM) and Heatmap-IOU (HIOU) loss function, the module allocates different targets to different corresponding feature maps, which makes the model converge faster and more accurately. Through experiments on the MS COCO dataset, our approach achieved 40.5% average precision (AP), and the AP of large, medium, and small-scale targets is 24.5%, 44.1%, and 53.9%, respectively.","PeriodicalId":431851,"journal":{"name":"2022 7th International Conference on Communication, Image and Signal Processing (CCISP)","volume":"214 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"AFMTD: Anchor-free Frame for Multi-scale Target Detection\",\"authors\":\"Xueting Liu, Jingrou Xu, Ruoxi Lin, Jinyang Pan, Junying Mao, Guangqiang Yin\",\"doi\":\"10.1109/CCISP55629.2022.9974392\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Target detection task plays the most fundamental and important role in computer vision. The appearance of deep learning method has produced a positive effect on target detection, but multi-scale target detection is poor. The reasons could be attributed to two aspects; the first one is that the small target tends to contain less semantic information, which leads algorithm be hard to detect it; the other is that the sample distribution in the practical application scenarios is random, and the different-scaled target features will interfere with each other, which poses negative effect on multi-scale target detection. Based on existing technical issues, we propose an anchor-free frame for the multi-scale target detection (AFMTD) algorithm as solution. First, from the direction of feature fusion, we propose a spatial attention fusion module (SAFM), which designs same scale transformation (SST) based on Bi-FPN, strengthens the valuable information between adjacent feature layers, and suppresses interference features, improving the detection accuracy and resolution ability of targets of different scales. Then, from the direction of anchor-free frame detection, the heatmap-based multi-scale detection module (HMDM) is proposed; by introducing a scale distribution mechanism (SDM) and Heatmap-IOU (HIOU) loss function, the module allocates different targets to different corresponding feature maps, which makes the model converge faster and more accurately. Through experiments on the MS COCO dataset, our approach achieved 40.5% average precision (AP), and the AP of large, medium, and small-scale targets is 24.5%, 44.1%, and 53.9%, respectively.\",\"PeriodicalId\":431851,\"journal\":{\"name\":\"2022 7th International Conference on Communication, Image and Signal Processing (CCISP)\",\"volume\":\"214 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2022-11-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2022 7th International Conference on Communication, Image and Signal Processing (CCISP)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/CCISP55629.2022.9974392\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2022 7th International Conference on Communication, Image and Signal Processing (CCISP)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/CCISP55629.2022.9974392","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
摘要
目标检测任务是计算机视觉中最基础、最重要的任务。深度学习方法的出现对目标检测产生了积极的影响,但多尺度目标检测效果不佳。原因可以归结为两个方面;一是小目标往往包含较少的语义信息,导致算法难以检测到小目标;二是实际应用场景中的样本分布是随机的,不同尺度的目标特征会相互干扰,对多尺度目标检测产生不利影响。针对目前存在的技术问题,提出了一种无锚框架的多尺度目标检测算法作为解决方案。首先,从特征融合的方向,提出了空间注意融合模块(SAFM),该模块设计了基于Bi-FPN的同尺度变换(SST),增强了相邻特征层之间的有价值信息,抑制了干扰特征,提高了不同尺度目标的检测精度和分辨能力。然后,从无锚帧检测的方向,提出了基于热图的多尺度检测模块(HMDM);通过引入SDM (scale distribution mechanism)和HIOU (Heatmap-IOU)损失函数,将不同的目标分配到不同的对应特征映射中,使模型收敛更快、更准确。通过在MS COCO数据集上的实验,我们的方法达到了40.5%的平均精度(AP),大、中、小目标的平均精度分别为24.5%、44.1%和53.9%。
AFMTD: Anchor-free Frame for Multi-scale Target Detection
Target detection task plays the most fundamental and important role in computer vision. The appearance of deep learning method has produced a positive effect on target detection, but multi-scale target detection is poor. The reasons could be attributed to two aspects; the first one is that the small target tends to contain less semantic information, which leads algorithm be hard to detect it; the other is that the sample distribution in the practical application scenarios is random, and the different-scaled target features will interfere with each other, which poses negative effect on multi-scale target detection. Based on existing technical issues, we propose an anchor-free frame for the multi-scale target detection (AFMTD) algorithm as solution. First, from the direction of feature fusion, we propose a spatial attention fusion module (SAFM), which designs same scale transformation (SST) based on Bi-FPN, strengthens the valuable information between adjacent feature layers, and suppresses interference features, improving the detection accuracy and resolution ability of targets of different scales. Then, from the direction of anchor-free frame detection, the heatmap-based multi-scale detection module (HMDM) is proposed; by introducing a scale distribution mechanism (SDM) and Heatmap-IOU (HIOU) loss function, the module allocates different targets to different corresponding feature maps, which makes the model converge faster and more accurately. Through experiments on the MS COCO dataset, our approach achieved 40.5% average precision (AP), and the AP of large, medium, and small-scale targets is 24.5%, 44.1%, and 53.9%, respectively.