Accessibility settings

This paper is in the following e-collection/theme issue:

#xHealthInformatics (49) Computer-Aided Diagnosis (440) Generative Language Models Including ChatGPT (1635) AI Language Models in Health Care (830) Foundation Models and Their Applications in AI (125)

Published on in Vol 6 (2025)

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/74899, first published .
Doctors and AI robot examining a human heart diagram

Assessing the Limitations of Large Language Models in Clinical Practice Guideline–Concordant Treatment Decision-Making on Real-World Data: Retrospective Study

Assessing the Limitations of Large Language Models in Clinical Practice Guideline–Concordant Treatment Decision-Making on Real-World Data: Retrospective Study

Authors of this article:

Tobias Roeschl1, 2, 3, 4, 5 Author Orcid Image ;   Marie Hoffmann2, 4, 5 Author Orcid Image ;   Djawid Hashemi1, 2, 3, 4 Author Orcid Image ;   Felix Rarreck2, 5 Author Orcid Image ;   Nils Hinrichs2, 4, 5 Author Orcid Image ;   Tobias Daniel Trippel1, 2, 4 Author Orcid Image ;   Matthias I Gröschel2, 6 Author Orcid Image ;   Axel Unbehaun2, 5 Author Orcid Image ;   Christoph Klein2, 5 Author Orcid Image ;   Jörg Kempfert2, 5 Author Orcid Image ;   Henryk Dreger1, 2 Author Orcid Image ;   Benjamin O'Brien2, 7, 8 Author Orcid Image ;   Gerhard Hindricks1, 2 Author Orcid Image ;   Felix Balzer2, 9 Author Orcid Image ;   Volkmar Falk2, 4, 5, 10 Author Orcid Image ;   Alexander Meyer2, 4, 5, 11 Author Orcid Image
Article Authors Cited by (9) Tweetations Metrics

Journals

  1. Guiducci L, Saulle C, Dimitri G, Valli B, Alpini S, Tenti C, Rizzo A. Dialogical AI for Cognitive Bias Mitigation in Medical Diagnosis. Applied Sciences 2026;16(2):710 View
  2. Ekmekcioğlu A, Karaca B, Ülgen A. Performance of ChatGPT in dental implant treatment planning: evaluation using the modified DISCERN, Global Quality Score, and accuracy–safety score. BMC Oral Health 2026;26(1) View
  3. Khosravi M, Yousefi-Roobiyat M, Asghari Z, Nakhaei M, Khosravi F. Comparison of the performance of ChatGPT-5, Gemini 3, Copilot, Perplexity, and medical students in answering neurology questions: a cross-sectional study. Scientific Reports 2026;16(1) View
  4. Soerensen A, Froeslev-Friis C, Kjaergaard Andersen G, Bhavsar S, Quitzau L, Desurkar V, Rao A, Krishna S, Bhosale R, Bhavsar R. Artificial Intelligence for American Society of Anesthesiologists Physical Status Classification: Agreement with Clinician Consensus and Temporal Stability Analysis. Journal of Clinical Medicine 2026;15(10):3871 View
  5. Kang D, Zhao K, Cheng D, Yuan L, Sun W, Jin K. Evaluation of large language models and retrieval-augmented generation for clinical reasoning in pediatric myopia: a 50-case real-world study. Scientific Reports 2026;16(1) View
  6. Roeschl T, Hoffmann M, Unbehaun A, Dreger H, Hindricks G, Falk V, Balicer R, Tanacli R, Hohendanner F, Meyer A. Development of an LLM pipeline exceeding physician-documented cardiovascular risk scores under routine clinical conditions. European Heart Journal - Digital Health 2026;7(7) View
  7. Jungmann F, Hager P. Potenzial und Herausforderungen von Large Language Models in der klinischen Entscheidungsfindung. Journal für Gastroenterologische und Hepatologische Erkrankungen 2026;24(3):100 View

Books/Policy Documents

  1. Nag A, Chaudhuri D. AI Hallucination Management in the Enterprise Metaverse. View
  2. Chen L, Wang Y, Li C, Jin L, Zhang D, Liao H, Chen F, Meng Q. Medical Image Computing and Computer Assisted Intervention – MICCAI 2026. View