Plant Phenomics (Jan 2024)

CucumberAI: Cucumber Fruit Morphology Identification System Based on Artificial Intelligence

  • Wei Xue,
  • Haifeng Ding,
  • Tao Jin,
  • Jialing Meng,
  • Shiyou Wang,
  • Zuo Liu,
  • Xiupeng Ma,
  • Ji Li

DOI
https://doi.org/10.34133/plantphenomics.0193
Journal volume & issue
Vol. 6

Abstract

Read online

Cucumber is an important vegetable crop that has high nutritional and economic value and is thus favored by consumers worldwide. Exploring an accurate and fast technique for measuring the morphological traits of cucumber fruit could be helpful for improving its breeding efficiency and further refining the development models for pepo fruits. At present, several sets of measurement schemes and standards have been proposed and applied for the characterization of cucumber fruits; however, these manual methods are time-consuming and inefficient. Therefore, in this paper, we propose a cucumber fruit morphological trait identification framework and software called CucumberAI, which combines image processing techniques with deep learning models to efficiently identify up to 51 cucumber features, including 32 newly defined parameters. The proposed tool introduces an algorithm for performing cucumber contour extraction and fruit segmentation based on image processing techniques. The identification framework comprises 6 deep learning models that combine fruit feature recognition rules with MobileNetV2 to construct a decision tree for fruit shape recognition. Additionally, the framework employs U-Net segmentation models for fruit stripe and endocarp segmentation, a MobileNetV2 model for carpel classification, a ResNet50 model for stripe classification and a YOLOv5 model for tumor identification. The relationships between the image-based manual and algorithmic traits are highly correlated, and validation tests were conducted to perform correlation analyses of fruit surface smoothness and roughness, and a fruit appearance cluster analysis was also performed. In brief, CucumberAI offers an efficient approach for extracting and analyzing cucumber phenotypes and provides valuable information for future cucumber genetic improvements.