Reticular Pseudodrusen: Interreader Agreement of Evaluation on OCT Imaging in Age-Related Macular Degeneration

Zhichao Wu, BAppSc(Optom), PhD; Steffen Schmitz-Valckenberg, MD; Barbara A. Blodi, MD; Frank G. Holz, MD; Glenn J. Jaffe, MD; Sandra Liakopoulos, MD; Srinivas R. Sadda, MD; Mari Bonse, BSc; Tyler Brown, COA; John Choong, BS; Bailey Clifton, COA; Giulia Corradetti, MD; Federico Corvi, MD; Andrew C. Dieu, MD; Vivienne Dooling, MD; Jeong W. Pak, PhD; Marlene Saßmannshausen, MD; Cindy Skalak, RN, COT; Sarah Thiele, MD; Robyn H. Guymer, MBBS, PhD

Ophthalmology Science (Dec 2023)

Reticular Pseudodrusen: Interreader Agreement of Evaluation on OCT Imaging in Age-Related Macular Degeneration

Zhichao Wu, BAppSc(Optom), PhD,
Steffen Schmitz-Valckenberg, MD,
Barbara A. Blodi, MD,
Frank G. Holz, MD,
Glenn J. Jaffe, MD,
Sandra Liakopoulos, MD,
Srinivas R. Sadda, MD,
Mari Bonse, BSc,
Tyler Brown, COA,
John Choong, BS,
Bailey Clifton, COA,
Giulia Corradetti, MD,
Federico Corvi, MD,
Andrew C. Dieu, MD,
Vivienne Dooling, MD,
Jeong W. Pak, PhD,
Marlene Saßmannshausen, MD,
Cindy Skalak, RN, COT,
Sarah Thiele, MD,
Robyn H. Guymer, MBBS, PhD

Affiliations

Zhichao Wu, BAppSc(Optom), PhD: Centre for Eye Research Australia, Royal Victorian Eye and Ear Hospital, East Melbourne, Australia; Ophthalmology, Department of Surgery, The University of Melbourne, Melbourne, Australia; Correspondence: Zhichao Wu, BAppSc(Optom), PhD, Centre for Eye Research Australia, Level 7, 32 Gisborne Street, East Melbourne, VIC 3002, Australia.
Steffen Schmitz-Valckenberg, MD: Department of Ophthalmology and GRADE Reading Center, University of Bonn, Bonn, Germany; Utah Retinal Reading Center (UREAD) John A. Moran Eye Center, University of Utah, Salt Lake City, Utah
Barbara A. Blodi, MD: Department of Ophthalmology and Visual Sciences, Wisconsin Reading Center (WRC), University of Wisconsin School of Medicine and Public Health, Madison, Wisconsin
Frank G. Holz, MD: Department of Ophthalmology and GRADE Reading Center, University of Bonn, Bonn, Germany
Glenn J. Jaffe, MD: Department of Ophthalmology, Duke University, Durham, North Carolina
Sandra Liakopoulos, MD: Cologne Image Reading Center and Laboratory (CIRCL) and Department of Ophthalmology, University of Cologne, Faculty of Medicine and University Hospital Cologne, Cologne, Germany; Department of Ophthalmology, Goethe-University Frankfurt, Germany
Srinivas R. Sadda, MD: Doheny Imaging Reading Center (DIRC) and Doheny Eye Institute, David Geffen School of Medicine, University of California, Los Angeles, California
Mari Bonse, BSc: Cologne Image Reading Center and Laboratory (CIRCL) and Department of Ophthalmology, University of Cologne, Faculty of Medicine and University Hospital Cologne, Cologne, Germany
Tyler Brown, COA: Utah Retinal Reading Center (UREAD) John A. Moran Eye Center, University of Utah, Salt Lake City, Utah
John Choong, BS: Department of Ophthalmology, Duke University, Durham, North Carolina
Bailey Clifton, COA: Utah Retinal Reading Center (UREAD) John A. Moran Eye Center, University of Utah, Salt Lake City, Utah
Giulia Corradetti, MD: Doheny Imaging Reading Center (DIRC) and Doheny Eye Institute, David Geffen School of Medicine, University of California, Los Angeles, California
Federico Corvi, MD: Doheny Imaging Reading Center (DIRC) and Doheny Eye Institute, David Geffen School of Medicine, University of California, Los Angeles, California
Andrew C. Dieu, MD: Department of Ophthalmology and Visual Sciences, Wisconsin Reading Center (WRC), University of Wisconsin School of Medicine and Public Health, Madison, Wisconsin
Vivienne Dooling, MD: Cologne Image Reading Center and Laboratory (CIRCL) and Department of Ophthalmology, University of Cologne, Faculty of Medicine and University Hospital Cologne, Cologne, Germany
Jeong W. Pak, PhD: Department of Ophthalmology and Visual Sciences, Wisconsin Reading Center (WRC), University of Wisconsin School of Medicine and Public Health, Madison, Wisconsin
Marlene Saßmannshausen, MD: Department of Ophthalmology and GRADE Reading Center, University of Bonn, Bonn, Germany
Cindy Skalak, RN, COT: Department of Ophthalmology, Duke University, Durham, North Carolina
Sarah Thiele, MD: Department of Ophthalmology and GRADE Reading Center, University of Bonn, Bonn, Germany
Robyn H. Guymer, MBBS, PhD: Centre for Eye Research Australia, Royal Victorian Eye and Ear Hospital, East Melbourne, Australia; Ophthalmology, Department of Surgery, The University of Melbourne, Melbourne, Australia

Journal volume & issue: Vol. 3, no. 4
p. 100325

Abstract

Read online

Purpose: To determine the interreader agreement for reticular pseudodrusen (RPD) assessment on combined infrared reflectance (IR) and OCT imaging in the early stages of age-related macular degeneration across a range of different criteria to define their presence. Design: Interreader agreement study. Participants: Twelve readers from 6 reading centers. Methods: All readers evaluated 100 eyes from individuals with bilateral large drusen for the following: (1) the presence of RPD across a range of different criteria and (2) the number of Stage 2 or 3 RPD lesions (from 0 to ≥ 5 lesions) on an entire OCT volume scan and on a selected OCT B-scan. Supportive information was available from the corresponding IR image. Main Outcome Measures: Interreader agreement, as assessed by Gwet’s first-order agreement coefficient (AC1). Results: When evaluating an entire OCT volume scan, there was substantial interreader agreement for the presence of any RPD, any or ≥ 5 Stage 2 or 3 lesions, and ≥ 5 definite lesions on en face IR images corresponding to Stage 2 or 3 lesions (AC1 = 0.60–0.72). On selected OCT B-scans, there was also moderate-to-substantial agreement for the presence of any RPD, any or ≥ 5 Stage 2 or 3 lesions (AC1 = 0.58–0.65) and increasing levels of agreement with increasing RPD stage (AC1 = 0.08, 0.56, 0.78, and 0.99 for the presence of any Stage 1, 2, 3, and 4 lesions, respectively). There was substantial agreement regarding the number of Stage 2 or 3 lesions on an entire OCT volume scan (AC1 = 0.68), but only fair agreement for this evaluation on selected B-scans (AC1 = 0.30). Conclusions: There was generally substantial or near-substantial—but not near-perfect—agreement for assessing the presence of RPD on entire OCT volume scans or selected B-scans across a range of differing RPD criteria. These findings underscore how interreader variability would likely contribute to the variability of findings related to the clinical associations of RPD. The low levels of agreement for assessing RPD number on OCT B-scans underscore the likely challenges of quantifying RPD extent with manual grading. Financial Disclosure(s): Proprietary or commercial disclosure may be found after the references.

Published in Ophthalmology Science

ISSN: 2666-9145 (Online)
Publisher: Elsevier
Country of publisher: United States
LCC subjects: Medicine: Ophthalmology
Website: https://www.journals.elsevier.com/ophthalmology-science/

About the journal

Abstract

Keywords