Current Oncology (Jul 2024)

Quality of ChatGPT-Generated Therapy Recommendations for Breast Cancer Treatment in Gynecology

  • Jan Lennart Stalp,
  • Agnieszka Denecke,
  • Matthias Jentschke,
  • Peter Hillemanns,
  • Rüdiger Klapdor

DOI
https://doi.org/10.3390/curroncol31070284
Journal volume & issue
Vol. 31, no. 7
pp. 3845 – 3854

Abstract

Read online

Introduction: Artificial intelligence (AI) is revolutionizing medical workflows, with self-learning systems like ChatGPT showing promise in therapy recommendations. Our study evaluated ChatGPT’s performance in suggesting treatments for 30 breast cancer cases. AI’s role in healthcare is expanding, particularly with tools like ChatGPT becoming accessible. However, understanding its limitations is vital for safe implementation. Material and Methods: We used 30 breast cancer cases from our medical board, assessing ChatGPT’s suggestions. The input was standardized, incorporating relevant patient details and treatment options. ChatGPT’s output was evaluated by oncologists based on a given questionnaire. Results: Treatment recommendations by ChatGPT were overall rated sufficient with minor limitations by the oncologists. The HER2 treatment category was the best-rated therapy option, with the most accurate recommendations. Primary cases received more accurate recommendations, especially regarding chemotherapy. Conclusions: While ChatGPT demonstrated potential, difficulties were shown in intricate cases and postoperative scenarios. Challenges arose in offering chronological treatment sequences and partially lacked precision. Refining inputs, addressing ethical intricacies, and ensuring chronological treatment suggestions are essential. Ongoing research is vital to improving AI’s accuracy, balancing AI-driven suggestions with expert insights and ensuring safe and reliable AI integration into patient care.

Keywords