PLoS ONE (Jan 2021)

A deep transfer learning framework for the automated assessment of corneal inflammation on in vivo confocal microscopy images.

  • Fan Xu,
  • Yikun Qin,
  • Wenjing He,
  • Guangyi Huang,
  • Jian Lv,
  • Xinxin Xie,
  • Chunli Diao,
  • Fen Tang,
  • Li Jiang,
  • Rushi Lan,
  • Xiaohui Cheng,
  • Xiaolin Xiao,
  • Siming Zeng,
  • Qi Chen,
  • Ling Cui,
  • Min Li,
  • Ningning Tang

DOI
https://doi.org/10.1371/journal.pone.0252653
Journal volume & issue
Vol. 16, no. 6
p. e0252653

Abstract

Read online

PurposeInfiltration of activated dendritic cells and inflammatory cells in cornea represents an important marker for defining corneal inflammation. Deep transfer learning has presented a promising potential and is gaining more importance in computer assisted diagnosis. This study aimed to develop deep transfer learning models for automatic detection of activated dendritic cells and inflammatory cells using in vivo confocal microscopy images.MethodsA total of 3453 images was used to train the models. External validation was performed on an independent test set of 558 images. A ground-truth label was assigned to each image by a panel of cornea specialists. We constructed a deep transfer learning network that consisted of a pre-trained network and an adaptation layer. In this work, five pre-trained networks were considered, namely VGG-16, ResNet-101, Inception V3, Xception, and Inception-ResNet V2. The performance of each transfer network was evaluated by calculating the area under the curve (AUC) of receiver operating characteristic, accuracy, sensitivity, specificity, and G mean.ResultsThe best performance was achieved by Inception-ResNet V2 transfer model. In the validation set, the best transfer system achieved an AUC of 0.9646 (PConclusionsThe deep transfer learning models provide a completely automated analysis of corneal inflammatory cellular components with high accuracy. The implementation of such models would greatly benefit the management of corneal diseases and reduce workloads for ophthalmologists.