A growth posture identification method of immature peaches in natural environments

Abstract

The precise bagging of immature peaches by the fruit bagging robot requires the identification of the target young fruits as well as the acquisition of their growth angles. The network models employed in single detection algorithms exhibit complexity and pose challenges for deployment on mobile terminals as they heavily rely on the availability of labeled samples. A semi-supervised learning and lightweight strategy based on YOLOv8n-seg was proposed to identify the growth posture of immature peaches in the work. Firstly, the self-training method and data enhancement in semi-supervised learning were used to generate efficient pseudo-label data. A tremendous labeling workload was solved. Secondly, the YOLOv8n-seg backbone network was replaced with an improved MobileNetv3 structure for better real-time detection on MT to reduce network parameters and calculations. The model was easily deployed with improved detection speed. Meanwhile, the original upsampling module was replaced with the CARAFE module to enhance the recognition capability of global features, which considered the impact of immature peaches on the nearby color background. The CIOU loss function was ultimately substituted with the SIOU loss function to further optimize the boundary frame loss and target detection accuracy. The enhanced model could predict the coordinate information of immature peaches and calculate growth angles. The experimental results show that the improved peach seedling growth posture network model has a weight size of only 23.1% of the original model. Additionally, the algorithm achieved a remarkable rate of 87.8% in identifying young peach fruits, with an average error of ±3.3° in estimating the growth angle. It took an average of 31 ms to detect a 3024 × 4032 pixels image in the edge computing device JETSON AGX ORIN CLB development kits. The method could rapidly identify immature peaches and estimate the growth angle, which ensured accurate bagging.