Ophthalmology Science (Jan 2024)

Applications of Deep Learning

  • Jimmy S. Chen, MD,
  • Kyle V. Marra, MD, PhD,
  • Hailey K. Robles-Holmes, BS,
  • Kristine B. Ly, BS,
  • Joseph Miller, MS,
  • Guoqin Wei, PhD,
  • Edith Aguilar, MD,
  • Felicitas Bucher, MD, PhD,
  • Yoichi Ideguchi, BS,
  • Aaron S. Coyner, PhD,
  • Napoleone Ferrara, MD,
  • J. Peter Campbell, MD, MPH,
  • Martin Friedlander, MD, PhD,
  • Eric Nudleman, MD, PhD

Journal volume & issue
Vol. 4, no. 1
p. 100338

Abstract

Read online

Objective: To develop a generative adversarial network (GAN) to segment major blood vessels from retinal flat-mount images from oxygen-induced retinopathy (OIR) and demonstrate the utility of these GAN-generated vessel segmentations in quantifying vascular tortuosity. Design: Development and validation of GAN. Subjects: Three datasets containing 1084, 50, and 20 flat-mount mice retina images with various stains used and ages at sacrifice acquired from previously published manuscripts. Methods: Four graders manually segmented major blood vessels from flat-mount images of retinas from OIR mice. Pix2Pix, a high-resolution GAN, was trained on 984 pairs of raw flat-mount images and manual vessel segmentations and then tested on 100 and 50 image pairs from a held-out and external test set, respectively. GAN-generated and manual vessel segmentations were then used as an input into a previously published algorithm (iROP-Assist) to generate a vascular cumulative tortuosity index (CTI) for 20 image pairs containing mouse eyes treated with aflibercept versus control. Main Outcome Measures: Mean dice coefficients were used to compare segmentation accuracy between the GAN-generated and manually annotated segmentation maps. For the image pairs treated with aflibercept versus control, mean CTIs were also calculated for both GAN-generated and manual vessel maps. Statistical significance was evaluated using Wilcoxon signed-rank tests (P ≤ 0.05 threshold for significance). Results: The dice coefficient for the GAN-generated versus manual vessel segmentations was 0.75 ± 0.27 and 0.77 ± 0.17 for the held-out test set and external test set, respectively. The mean CTI generated from the GAN-generated and manual vessel segmentations was 1.12 ± 0.07 versus 1.03 ± 0.02 (P = 0.003) and 1.06 ± 0.04 versus 1.01 ± 0.01 (P < 0.001), respectively, for eyes treated with aflibercept versus control, demonstrating that vascular tortuosity was rescued by aflibercept when quantified by GAN-generated and manual vessel segmentations. Conclusions: GANs can be used to accurately generate vessel map segmentations from flat-mount images. These vessel maps may be used to evaluate novel metrics of vascular tortuosity in OIR, such as CTI, and have the potential to accelerate research in treatments for ischemic retinopathies. Financial Disclosure(s): The author(s) have no proprietary or commercial interest in any materials discussed in this article.

Keywords