Reliability of Subjective Assessment of Spectral-Domain OCT Pathologic Features by Multiple Raters in Retinal Vein Occlusion

Sebastian Bemme, MD; Amelie Heins, DMD; Peer Lauermann, MD; Marcus Werner Storch, MD; Mohammed Haitham Khattab, MD; Hans Hoerauf, MD; Nicolas Feltgen, MD; Christian van Oterendorp, MD

Ophthalmology Science (Jun 2021)

Reliability of Subjective Assessment of Spectral-Domain OCT Pathologic Features by Multiple Raters in Retinal Vein Occlusion

Sebastian Bemme, MD,
Amelie Heins, DMD,
Peer Lauermann, MD,
Marcus Werner Storch, MD,
Mohammed Haitham Khattab, MD,
Hans Hoerauf, MD,
Nicolas Feltgen, MD,
Christian van Oterendorp, MD

Affiliations

Sebastian Bemme, MD: Correspondence: Sebastian Bemme, MD, Department of Ophthalmology, University Medical Center Göttingen, Robert-Koch-Str, 4037075 Göttingen, Germany.; Department of Ophthalmology, University Medical Center Göttingen, Göttingen, Germany
Amelie Heins, DMD: Department of Ophthalmology, University Medical Center Göttingen, Göttingen, Germany
Peer Lauermann, MD: Department of Ophthalmology, University Medical Center Göttingen, Göttingen, Germany
Marcus Werner Storch, MD: Department of Ophthalmology, University Medical Center Göttingen, Göttingen, Germany
Mohammed Haitham Khattab, MD: Department of Ophthalmology, University Medical Center Göttingen, Göttingen, Germany
Hans Hoerauf, MD: Department of Ophthalmology, University Medical Center Göttingen, Göttingen, Germany
Nicolas Feltgen, MD: Department of Ophthalmology, University Medical Center Göttingen, Göttingen, Germany
Christian van Oterendorp, MD: Department of Ophthalmology, University Medical Center Göttingen, Göttingen, Germany

Journal volume & issue: Vol. 1, no. 2
p. 100031

Abstract

Read online

Purpose: To examine the interrater and intrarater reliability of qualitatively and quantitatively assessed disorganization of retinal inner layers (DRIL) and disorganization of retinal outer layers (DROL) by multiple raters. Subjectively assessing these surrogate biomarkers can be challenging in daily routine, despite the high resolution of spectral-domain (SD) OCT scans. Design: Retrospective trial. Participants: Three hundred six pooled SD OCT scans of 34 patients treated for macular edema caused by retinal vein occlusion (RVO) between January 2016 and December 2017. Methods: SD OCT scans were assessed by 6 raters regarding presence of cystoid macular edema, subretinal fluid (SRF), vitreoretinal traction, and epiretinal membrane and extent of DRIL and DROL. Main Outcome Measures: Interrater and intrarater reliability were calculated applying κ statistics for qualitative assessment regarding each pathologic feature’s presence in all evaluated OCT scans, and for quantified horizontal DRIL and DROL extent within each OCT cross-section. Results: Cystoid macular edema and SRF assessments revealed excellent inter- and intrarater reliability with almost perfect strength of agreement, whereas subjective DRIL and DROL evaluations yielded low κ statistics with slight to moderate strength of agreement. Furthermore, the presence of SRF remarkably compromised the reliability of DROL detection. Conclusions: Our data highlight the limited subjective assessibility of DRIL and DROL, underscoring the need for automated image analysis to improve the reliability of OCT biomarkers for clinical studies and daily practice.

Published in Ophthalmology Science

ISSN: 2666-9145 (Online)
Publisher: Elsevier
Country of publisher: United States
LCC subjects: Medicine: Ophthalmology
Website: https://www.journals.elsevier.com/ophthalmology-science/

About the journal

Abstract

Keywords