WheatNet: Attentional Path Aggregation Feature Pyramid Network for Precise Detection and Counting of Dense and Arbitrary-Oriented Wheat Spikes

Abstract

Achieving the precise and real-time detection of wheat spikes play a crucial role in wheat growth monitoring for precision agriculture community. Machine-learning methods are commonly introduced to automatically detect and count the wheat spikes, which need carefully selected hand-crafted feature descriptors, leading to time-consuming and poor performance. The deep learning has become a promising technology for the accurate detection wheat spikes, owing to its powerful ability of feature extraction. However, the obtained wheat spike images from UAV still have serious overlap, dense distribution, various orientations, and large aspect ratios, leading to poor performance of recent wheat spike detection method. To address the demand of precise and fast detection and counting of wheat spike with dense distribution and arbitrary-orientation, a novel deep learning-based method, WheatNet, has been proposed. The attention mechanism has been introduced the process of feature fusing to highlight the important features of wheat spike as well as inhibit the useless information. Additionally, to optimize the parameters of the network, a loss function with soft dynamic label assignment is adopted to reduce the number of low-quality matches, which provides significant performance gains over other wheat spike detectors. Furthermore, to achieve the precise detection of wheat spike with multi-orientations, a large-scale oriented wheat spike dataset has been constructed, named RoWheat, including 900 images and 50419 annotations with dense distribution and various orientation. Experimental studies demonstrate that the proposed WheatNet achieves a recall of 99.7% and mAP of 91.8%, showing its promising performance gain compared to other state-of-the-art methods.