Machine learning for automated oil palm fruit grading: The role of fuzzy C-means segmentation and textural features

Abstract

Oil palm fruit, a high-demand and economically valuable crop, faces grading challenges in Malaysia due to labour-intensive methods, resulting in unharvested ripe fruits and yield losses. Extensive research has been conducted on outdoor palm fruit classifiers, but most high-accuracy research in this field relies heavily on large image datasets. This creates a trade-off between employing more sophisticated deep-learning approaches that require extensive data and utilising traditional techniques that have lower data requirements. Therefore, the aim is to propose an outdoor image-based fresh fruit bunch (FFB) classification system, emphasising pre-processing technique and feature extraction techniques suitable for limited datasets. To achieve this, the FFB was localised within the original images using the YOLOv4-Tiny algorithm. Subsequently, a salient segmentation method utilising superpixel-based Fast Fuzzy C-means (FFCM) clustering is employed to remove the background from the images. Next, colour moment and opposite colour local binary pattern (OCLBP) features are extracted from the segmented images to capture important information for classification. Finally, the extracted features are fed into a Multilayer Perceptron (MLP) classifier, which enables the system to predict five classes: damaged, empty, unripe, ripe, and overripe. The developed system demonstrated a commendable performance in accurately classifying fruit bunches, achieving an accuracy of 93.68 %. In conclusion, the proposed system effectively addresses the issue of unripe fruit harvesting and contributes to the advancement of state-of-the-art methods in classifying outdoor FFB images.

Keywords

• Palm fruit grading
• Fuzzy C-means
• Opposite local binary pattern
• YOLOv4-Tiny