International Journal of Cardiology Congenital Heart Disease (Dec 2024)

Comparative analysis of diagnostic accuracy in adult congenital heart disease: A study of three physician groups and ChatGPT

  • Edward Itelman,
  • Einat Birk,
  • Ayelet Machtei,
  • Rafael Hirsch,
  • Nili Schamroth Pravda

Journal volume & issue
Vol. 18
p. 100547

Abstract

Read online

This research letter evaluates the diagnostic accuracy of three physician groups—pediatric cardiologists, adult congenital heart disease (ACHD) specialists, and general cardiologists—and compares it to the performance of an AI (Artificial Intelligence) LLM model. Based on eight targeted questions in adult congenital heart disease, the analysis highlights significant disparities in correct answer rates, with congenital specialists achieving the highest accuracy and the AI model – the lowest.