Enhancing rangeland weed detection through convolutional neural networks and transfer learning

Abstract

The detection of weed species in rangeland environments is a challenging task due to various factors such as dense, variable species vegetation, ocular occlusion, and a wide variety of plant morphology. Most research in weed detection, however, focuses on croplands. This research addresses the need for accurate rangeland weed detection models by leveraging convolutional neural network (CNN) models enhanced with transfer learning applied to the DeepWeeds data set taken in situ in regional North Eastern Australia. It investigates the effectiveness of transfer learning across seven popular models, utilizing data augmentation and fine-tuning. The performance of these models was evaluated using accuracy metrics and compared against each other. The results demonstrated that transfer learning, coupled with fine tuning, could be a viable solution for generating efficient weed plant detection models with lower demands on computational resources and smaller datasets, despite the challenging conditions of rangeland environments. EfficientNetV2B1 had the highest classification accuracy of 94.2 ​%, and lowest training times. Moreover, high levels of accuracy were also achieved using InceptionV3, VGG16, and Densenet121, albeit with a training time penalty. This research provides insights into the performance of CNN models in challenging rangeland environments, demonstrates the potential of using transfer learning to enhance weed detection models, and underscores the significance of model selection in agricultural applications of CNNs.

Keywords

• Convolutional neural network
• Transfer learning
• Deep learning
• Weed species detection
• Multiclass classification
• Computer vision