Three-Dimensional Phenotyping Pipeline of Potted Plants Based on Neural Radiation Fields and Path Segmentation

Abstract

Precise acquisition of potted plant traits has great theoretical significance and practical value for variety selection and guiding scientific cultivation practices. Although phenotypic analysis using two dimensional(2D) digital images is simple and efficient, leaf occlusion reduces the available phenotype information. To address the current challenge of acquiring sufficient non-destructive information from living potted plants, we proposed a three dimensional (3D) phenotyping pipeline that combines neural radiation field reconstruction with path analysis. An indoor collection system was constructed to obtain multi-view image sequences of potted plants. The structure from motion and neural radiance fields (SFM-NeRF) algorithm was then utilized to reconstruct 3D point clouds, which were subsequently denoised and calibrated. Geometric-feature-based path analysis was employed to separate stems from leaves, and density clustering methods were applied to segment the canopy leaves. Phenotypic parameters of potted plant organs were extracted, including height, stem thickness, leaf length, leaf width, and leaf area, and they were manually measured to obtain the true values. The results showed that the coefficient of determination (R2) values, indicating the correlation between the model traits and the true traits, ranged from 0.89 to 0.98, indicating a strong correlation. The reconstruction quality was good. Additionally, 22 potted plants were selected for exploratory experiments. The results indicated that the method was capable of reconstructing plants of various varieties, and the experiments identified key conditions essential for successful reconstruction. In summary, this study developed a low-cost and robust 3D phenotyping pipeline for the phenotype analysis of potted plants. This proposed pipeline not only meets daily production requirements but also advances the field of phenotype calculation for potted plants.

Keywords

• 3D reconstruction
• stem and leaf segmentation
• neural radiance fields
• structure from motion
• potted plant analysis
• plant digitization