A Robust Method for Wheatear Detection Using UAV in Natural Scenes

Abstract

In recent years, deep learning has greatly improved the ability of wheatear detection. However, there are still three main problems in wheatear detection based on unmanned aerial vehicle (UAV) platforms. First, dense wheat plants often overlap, and the wind direction will blur the pictures, which obviously interferes with the detection of wheatears; second, due to the different maturity, color, genotype, and head orientation, the appearance will also be different; third, UAV needs to take images in the field and conduct real-time detection, which requires the embedded module to detect wheatears quickly and accurately. Given the above problems, we studied and improved YoloV4, and proposed a robust method for wheatear detection using UAV in natural scenes. For the first problem, we modified the network structure, deleted the feature map with a size of 19×19, and used k-means algorithm to re-cluster the anchors, and we proposed a method of prediction box fusion. For the second problem, we used the pseudo-labeling method and data augmentation methods to improve the generalization ability of the model. For the third problem, we simplified the network structure, replaced the original network convolution with the improved depthwise separable convolution, and proposed an adaptive ReLU activation function to reduce the amount of calculation and speed up the calculation. The experimental results showed that our method can effectively mark the bounding of wheatears. In test sets, our method achieves 96.71% in f1-score, which is 9.61% higher than the state of the art method, and the detection speed is 23% faster than the original method. It can be concluded that our method can effectively solve the problems of wheatear detection based on the UAV platform in natural scenes.

Keywords

• Wheatear detection
• improved YoloV4
• UAV
• object detection
• deep learning