Evaluation of the Quality of ChatGPT’s Responses to Top 20 Questions about Robotic Hip and Knee Arthroplasty: Findings, Perspectives and Critical Remarks on Healthcare Education

Abstract

Robotic-assisted hip and knee arthroplasty represents significant advancements in orthopedic surgery. Artificial intelligence (AI)-driven chatbots, such as ChatGPT, could play a significant role in healthcare education. This study aims to evaluate the quality of responses provided by ChatGPT to the top 20 questions concerning robotic-assisted hip and knee arthroplasty. We have asked ChatGPT to select the top 20 questions on Google concerning robotic hip and knee arthroplasty and to provide a detailed answer to each of them. The accuracy and completeness of the information provided were examined by three orthopedic surgeons with scientific and clinical experience in hip- and knee-replacement surgery. The accuracy was assessed through a 5-point Likert scale (from 1—completely incorrect to 5—correct); the completeness through a 4-point Likert scale (from 0—comprehensiveness not assessable for completely incorrect answers to 3—exhaustive information) on two different occasions to ensure the consistency of the assessment. Our analysis reveals that ChatGPT provides a relatively high degree of accuracy; moreover, the explanations can be considered satisfying, especially for factual questions. The findings suggest that ChatGPT can serve as a valuable initial resource for general information on robotic hip and knee arthroplasty but the integration with human expertise remains essential.

Keywords

• knee arthroplasty
• hip arthroplasty
• eHealth
• internet
• artificial intelligence
• patient education