A New Approach for Fundus Lesions Instance Segmentation Based on Mask R-CNN X101-FPN Pre-Trained Architecture

Abstract

Diabetic retinopathy is one of the main causes of vision loss, and it can be identified through ophthalmological examinations that aim to locate the presence of retinal lesions such as Microaneurysms, Hemorrhages, Soft Exudates, and Hard Exudates. The development of computerized approaches to perform the instance segmentation of these lesions can help in the early diagnosis of the disease. However, the segmentation of instances of artifacts in the retina is a complex task due to factors such as object size and morphological characteristics. This article proposes a new approach based on a Mask Regions with Convolutional Neural Network features (Mask R-CNN) architecture to perform instance segmentation of lesions associated with diabetic retinopathy. The proposed approach was trained, adjusted, and tested using different public datasets of diabetic retinopathy, which were implemented with the Detectron2 libraries and OpenCV. The best result obtained by the proposed approach in the Dataset for Diabetic Retinopathy (DDR) was using Tilling and Adam optimizer, reaching a mean Average Precision ( $mAP$ ) of 0.2903 in the detection of fundus lesions for the limit of Intersection Over Union ( $IoU$ ) of 0.5 in the validation stage and an $mAP$ of 0.1670 in the detection of fundus lesions to the limit of $IoU$ of 0.5 in the test step. The results obtained in the experiments demonstrate that the proposed approach presented promising results in the instance segmentation of microaneurysms with an increase in precision, which in our case reaches approximately 16%.

Keywords

• Fundus image
• lesions detection
• instance segmentation
• mask R-CNN