Distinguishing Difficulty Imbalances in Strawberry Ripeness Instances in a Complex Farmland Environment

Abstract

The existing strawberry ripeness detection algorithm has the problems of a low precision and a high missing rate in real complex scenes. Therefore, we propose a novel model based on a hybrid attention mechanism. Firstly, a partial convolution-based compact inverted block is developed, which significantly enhances the feature extraction capability of the model. Secondly, an efficient partial hybrid attention mechanism is established, which realizes the remote dependence and accurate localization of strawberry fruit. Meanwhile, a multi-scale progressive feature pyramid network is constructed, and the fine-grained features of strawberry targets of different sizes are accurately extracted. Finally, a Focaler-shape-IoU loss function is proposed to effectively solve the problem of the difficulty imbalance between strawberry samples and the influence of the shape and size of the bounding box on the regression. The experimental results show that the model’s precision and mAP0.5 reach 92.1% and 92.7%, respectively, which are 2.0% and 1.7% higher than the baseline model. Additionally, our model is better in detection performance than most models with fewer parameters and lower FLOPs. In summary, the model can accurately identify the maturity of strawberry fruit under complex farmland environments and provide certain technical guidance for automated strawberry-picking robots.

Keywords

• strawberry ripeness
• object detection
• difficulty imbalance
• farmland environment