JSES International (Jan 2022)

Readability assessment of patient educational materials for shoulder arthroplasty from top academic orthopedic institutions

  • John W. Stelzer, MD, MS,
  • Ian J. Wellington, MD,
  • Maxwell T. Trudeau, BS,
  • Michael R. Mancini, BS,
  • Matthew R. LeVasseur, MD,
  • James C. Messina, MD,
  • Augustus D. Mazzocca, MS, MD

Journal volume & issue
Vol. 6, no. 1
pp. 44 – 48

Abstract

Read online

Background: Previous studies have demonstrated that online patient educational materials are written at reading levels too advanced for the average patient. The average American reads at the eighth-grade reading level. To date, the readability of online educational material of academic centers for shoulder arthroplasty has not been analyzed. Methods: Online patient educational materials from the top 25 orthopedic institutions, as ranked by U.S. News & World Report, were assessed utilizing the following readability assessments: Flesch-Kincaid (FK), Flesch Reading Ease, Gunning Fog Index, Coleman-Liau Index, Simple Measure of the Gobbledygook Index, Automated Readability Index, FORCAST, and the New Dale and Chall Readability. All of these scores, with the exception of the Flesch Reading Ease, provide an output indicating reading difficulty based on grade level. Correlations between academic institutional ranking and FK scores were evaluated using a Spearman regression. Lastly, additional factors including geographical location, private versus public institution, and use of concomitant multi-media modalities that may impact institutional readability scores (as determined by FK) were evaluated. Results: Only 16.0% of the top 25 institutions included online material at or below the eighth-grade reading level. Moreover, half of the online resources evaluated (those with FK score ≥9.3) were not at a suitable reading level for more than two-thirds of the general United States population (∼70%). Overall, the composite mean scores were 9.5 ± 2.1 for FK, 52.8 ± 9. for 4 Flesch Reading Ease, 12.2 ± 2.4 for Gunning Fog, 11.6 ± 1.8 for Coleman-Liau, 12.3 ± 1.7 for Simple Measure of the Gobbledygook Index, 9.6 ± 2.6 for Automated Readability, 11.1 ± 0.6 for FORCAST, and 5.9 ± 0.6 for New Dale and Chall. There was no correlation between institutional ranking and FK scores (ρ = −0.15; P = .946). Geographical location, private versus public institution, and use of concomitant multi-media modalities were not significantly associated with readability. Conclusion: Shoulder arthroplasty online patient educational material at top-ranked orthopedic institutions have poor readability and are likely not suitable for the majority of patients in the United States.

Keywords