Evaluating the performance of large language models in health education for patients with ankylosing spondylitis/spondyloarthritis: a cross-sectional, single-blind study in China
Yong Ren,
Yuanqing Li,
Jieruo Gu,
Qing Lv,
Wenqi Xia,
Jingyu Zhang,
Huifen Liu,
Ya Wen,
Liling Xu,
Yuling Chen,
Yue-ning Kang,
Shuang-yan Cao,
Fanxuan Meng,
Ruyi Liao,
Xiaomin Li,
Jiayun Wu,
Shenghui Wen
Affiliations
Yong Ren
2 The Seventh Affiliated Hospital of Sun Yat-sen University, Shenzhen, Guangdong, China
Yuanqing Li
4 School of Automation Science and Engineering, South China University of Technology, Guangzhou, China
Jieruo Gu
3 Department of Rheumatology, The Seventh Affiliated Hospital of Sun Yat-sen University, Shenzhen, Guangdong, China
Qing Lv
3 Department of Rheumatology, The Seventh Affiliated Hospital of Sun Yat-sen University, Shenzhen, Guangdong, China
Wenqi Xia
3 Department of Rheumatology, The Seventh Affiliated Hospital of Sun Yat-sen University, Shenzhen, Guangdong, China
Jingyu Zhang
3 Department of Rheumatology, The Seventh Affiliated Hospital of Sun Yat-sen University, Shenzhen, Guangdong, China
Huifen Liu
3 Department of Rheumatology, The Seventh Affiliated Hospital of Sun Yat-sen University, Shenzhen, Guangdong, China
Ya Wen
3 Department of Rheumatology, The Seventh Affiliated Hospital of Sun Yat-sen University, Shenzhen, Guangdong, China
Liling Xu
3 Department of Rheumatology, The Seventh Affiliated Hospital of Sun Yat-sen University, Shenzhen, Guangdong, China
Yuling Chen
3 Department of Rheumatology, The Seventh Affiliated Hospital of Sun Yat-sen University, Shenzhen, Guangdong, China
Yue-ning Kang
3 Department of Rheumatology, The Seventh Affiliated Hospital of Sun Yat-sen University, Shenzhen, Guangdong, China
Shuang-yan Cao
3 Department of Rheumatology, The Seventh Affiliated Hospital of Sun Yat-sen University, Shenzhen, Guangdong, China
Fanxuan Meng
3 Department of Rheumatology, The Seventh Affiliated Hospital of Sun Yat-sen University, Shenzhen, Guangdong, China
Ruyi Liao
3 Department of Rheumatology, The Seventh Affiliated Hospital of Sun Yat-sen University, Shenzhen, Guangdong, China
Xiaomin Li
3 Department of Rheumatology, The Seventh Affiliated Hospital of Sun Yat-sen University, Shenzhen, Guangdong, China
Jiayun Wu
3 Department of Rheumatology, The Seventh Affiliated Hospital of Sun Yat-sen University, Shenzhen, Guangdong, China
Shenghui Wen
3 Department of Rheumatology, The Seventh Affiliated Hospital of Sun Yat-sen University, Shenzhen, Guangdong, China
Objectives To evaluate the potential of large language models (LLMs) in health education for patients with ankylosing spondylitis (AS)/spondyloarthritis (SpA), focusing on the accuracy of information transmission, patient acceptance and performance differences between different models.Design Cross-sectional, single-blind study.Setting Multiple centres in China.Participants 182 volunteers, including 4 rheumatologists and 178 patients with AS/SpA.Primary and secondary outcome measures Scientificity, precision and accessibility of the content of the answers provided by LLMs; patient acceptance of the answers.Results LLMs performed well in terms of scientificity, precision and accessibility, with ChatGPT-4o and Kimi models outperforming traditional guidelines. Most patients with AS/SpA showed a higher level of understanding and acceptance of the responses from LLMs.Conclusions LLMs have significant potential in medical knowledge transmission and patient education, making them promising tools for future medical practice.
