Advances in Orthopedics (Jan 2025)

ChatGPT is an Unreliable Source of Peer-Reviewed Information for Common Total Knee and Hip Arthroplasty Patient Questions

  • Jonathan D. Schwartzman,
  • M. Kareem Shaath,
  • Matthew S. Kerr,
  • Cody C. Green,
  • George J. Haidukewych

DOI
https://doi.org/10.1155/aort/5534704
Journal volume & issue
Vol. 2025

Abstract

Read online

Conclusions: Investigation into ChatGPT’s response quality and use of peer-reviewed sources when prompted with archetypal pre-TKA and pre-THA questions found ChatGPT to provide mostly reliable responses based on fellowship-trained orthopedic surgeon review of 4.4/6 for accuracy and 1.92/3 for completeness despite a 64.22% rate of citing inaccurate references. This study suggests that until ChatGPT is proven to be a reliable source of valid information and references, patients must exercise extreme caution in directing their pre-TKA and THA questions to this medium.