Image segmentation for pest detection of crop leaves by improvement of regional convolutional neural network

Abstract

Abstract Pest detection is important for crop cultivation. Crop leaf is the main place of pest invasion. Current technologies to detect crop pests have constraints, such as low efficiency, storage demands and limited precision. Image segmentation is a fast and efficient computer-aided detection technology. High resolution image capture solidly supports the crucial processes in discerning pests from images. Study of analytical methods help parse information in the images. In this paper, a regional convolutional neural network (R-CNN) architecture is designed in combination with the radial bisymmetric divergence (RBD) method for enhancing the efficiency of image segmentation. As a special application of RBD, the hierarchical mask (HM) is produced to endorse detection and classification of the leaf-dwelling pests, offering enhanced efficiency and reduced storage requirements. Moreover, to deal with some mislabeled data, a threshold variable is introduced to adjust a fault-tolerant mechanism into HM, to generate a novel threshold-based hierarchical mask (TbHM). Consequently, the hierarchical mask R-CNN (HM-R-CNN) model and the threshold-based hierarchical mask R-CNN (TbHM-R-CNN) model are established to detect various types of healthy and pest-invasive crop leaves to select the regional image features that are rich in pest information. Then simple linear iterative clustering (SLIC) method is incorporation to finish the image segmentation for the classification of pest invasion. The models are tuned and optimized, then validated. The most optimized modeling results are from the TbHM-R-CNN model, with the classification accuracy of 96.2%, the recall of 97.5% and the F1 score of 0.982. Additionally, the HM-R-CNN model observed appreciable results second only to the best model. These results indicate that the proposed methodologies are well-suited for training and testing a dataset of plant diseases, offering heightened accuracy in pest classification. This study revealed that the proposed methods significantly outperform the existing techniques, marking a substantial improvement over current methods.

Keywords

• Pest detection
• Crop leaves
• Image segmentation
• Regional convolutional neural network (R-CNN)
• Hierarchical mask (HM)
• Threshold-based hierarchical mask (TbHM)