Deep Learning Assisted Imaging Methods to Facilitate Access to Ophthalmic Telepathology

Andrew W. Browne, MD, PhD; Geunwoo Kim, MS; Anderson N. Vu, MD; Josiah K. To, MD; Don S. Minckler, MD; Maria Del Valle Estopinal, MD; Narsing A. Rao, MD; Christine A. Curcio, PhD; Pierre F. Baldi, PhD

Ophthalmology Science (May 2024)

Deep Learning Assisted Imaging Methods to Facilitate Access to Ophthalmic Telepathology

Andrew W. Browne, MD, PhD,
Geunwoo Kim, MS,
Anderson N. Vu, MD,
Josiah K. To, MD,
Don S. Minckler, MD,
Maria Del Valle Estopinal, MD,
Narsing A. Rao, MD,
Christine A. Curcio, PhD,
Pierre F. Baldi, PhD

Affiliations

Andrew W. Browne, MD, PhD: Department of Ophthalmology, Gavin Herbert Eye Institute, University of California, Irvine, California; Center for Translational Vision Research, University of California, Irvine, California; Department of Biomedical Engineering, University of California, Irvine, California
Geunwoo Kim, MS: School of Information and Computer Sciences, University of California, Irvine, California
Anderson N. Vu, MD: Center for Translational Vision Research, University of California, Irvine, California
Josiah K. To, MD: Center for Translational Vision Research, University of California, Irvine, California
Don S. Minckler, MD: Department of Ophthalmology, Gavin Herbert Eye Institute, University of California, Irvine, California; Department of Pathology, University of California, Irvine, California
Maria Del Valle Estopinal, MD: Department of Ophthalmology, Gavin Herbert Eye Institute, University of California, Irvine, California; Department of Pathology, University of California, Irvine, California
Narsing A. Rao, MD: Department of Ophthalmology, University of Southern California, Los Angeles, California
Christine A. Curcio, PhD: Department of Ophthalmology and Visual Sciences, University of Alabama at Birmingham Heersink School of Medicine, Birmingham, Alabama
Pierre F. Baldi, PhD: Department of Biomedical Engineering, University of California, Irvine, California; School of Information and Computer Sciences, University of California, Irvine, California; Correspondence: Pierre F. Baldi, PhD, Department of Biomedical Engineering, University of California, Suite 444, 302 Inner Ring Rd, Irvine, CA 92697.

Journal volume & issue: Vol. 4, no. 3
p. 100450

Abstract

Read online

Purpose: To investigate the use of super-resolution imaging techniques to enable telepathology using low-cost commercial cameras. Design: Experimental study. Participants: A total of 139 ophthalmic pathology slides obtained from the Ophthalmic Pathology service at the University of California, Irvine. Methods: Denoising Diffusion Probabilistic Model (DDPM) was developed to predict super-resolution pathology slide images from low-resolution inputs. The model was pretrained using 150 000 images randomly sampled from the ImageNet dataset. Patch aggregation was used to generate large images with DDPM. The performance of DDPM was evaluated against that of generative adversarial networks (GANs) and Robust UNet, which were also trained on the same dataset. Main Outcome Measures: The performance of models trained to generate super-resolution output images from low-resolution input images can be evaluated by using the mean squared error (MSE) and Structural Similarity Index Measure (SSIM), as well as subjective grades provided by expert pathologist graders. Results: In total, our study included 110 training images, 9 validation images, and 20 testing images. The objective performance scores were averaged over patches generated from 20 test images. The DDPM-based approach with pretraining produced the best results, with an MSE score of 1.35e-5 and an SSIM score of 0.8987. A qualitative analysis of super-resolution images was conducted by expert 3 pathologists and 1 expert ophthalmic microscopist, and the average accuracy of identifying the correct ground truth images ranged from 25% to 70% (with an average accuracy of 46.5%) for widefield images and 25% to 60% (with an average accuracy of 38.25%) for individual patches. Conclusions: The DDPM-based approach with pretraining is assessed to be effective at super-resolution prediction for ophthalmic pathology slides both in terms of objective and subjective measures. The proposed methodology is expected to decrease the reliance on costly slide scanners for acquiring high-quality pathology slide images, while also streamlining clinical workflow and expanding the scope of ophthalmic telepathology. Financial Disclosure(s): Proprietary or commercial disclosure may be found in the Footnotes and Disclosures at the end of this article.

Published in Ophthalmology Science

ISSN: 2666-9145 (Online)
Publisher: Elsevier
Country of publisher: United States
LCC subjects: Medicine: Ophthalmology
Website: https://www.journals.elsevier.com/ophthalmology-science/

About the journal

Abstract

Keywords