A Progressive-Assisted Object Detection Method Based on Instance Attention

Abstract

Overcoming the high cost of self-attention operation in Transformer-based object detection methods and improving the detection accuracy of small objects is one of the difficulties in the field of object detection research. This paper designs a progressive assisted object detection method PaoDet based on Transformer, which uses common feature extraction backbone such as Resnet and ViT to extract multi-scale features of the input image, and uses RPN(Region Proposal Network) to extract proposals of different scales; Subsequently, a progressive modeling approach was adopted to perform self-attention and cross-attention operations on proposals of different scales from large to small, achieving feature interaction between instances, ensuring high detection efficiency and low computational complexity. During the training process, each layer of the network has certain generalization ability for detecting adjacent scale objects under the supervision of a dynamic scale division method. Compared with state-of-the-art object detection methods on COCO and UAVDT datasets, the effectiveness and superiority of the proposed method were demonstrated.