Accessibility settings

This paper is in the following e-collection/theme issue:

#xHealthInformatics (23) Computer-Aided Diagnosis (281) Generative Language Models Including ChatGPT (841) AI Language Models in Health Care (266) Foundation Models and Their Applications in AI (61)

Published on in Vol 6 (2025)

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/74899, first published .
Assessing the Limitations of Large Language Models in Clinical Practice Guideline–Concordant Treatment Decision-Making on Real-World Data: Retrospective Study

Assessing the Limitations of Large Language Models in Clinical Practice Guideline–Concordant Treatment Decision-Making on Real-World Data: Retrospective Study

Assessing the Limitations of Large Language Models in Clinical Practice Guideline–Concordant Treatment Decision-Making on Real-World Data: Retrospective Study

Authors of this article:

Tobias Roeschl1, 2, 3, 4, 5 Author Orcid Image ;   Marie Hoffmann2, 4, 5 Author Orcid Image ;   Djawid Hashemi1, 2, 3, 4 Author Orcid Image ;   Felix Rarreck2, 5 Author Orcid Image ;   Nils Hinrichs2, 4, 5 Author Orcid Image ;   Tobias Daniel Trippel1, 2, 4 Author Orcid Image ;   Matthias I Gröschel2, 6 Author Orcid Image ;   Axel Unbehaun2, 5 Author Orcid Image ;   Christoph Klein2, 5 Author Orcid Image ;   Jörg Kempfert2, 5 Author Orcid Image ;   Henryk Dreger1, 2 Author Orcid Image ;   Benjamin O'Brien2, 7, 8 Author Orcid Image ;   Gerhard Hindricks1, 2 Author Orcid Image ;   Felix Balzer2, 9 Author Orcid Image ;   Volkmar Falk2, 4, 5, 10 Author Orcid Image ;   Alexander Meyer2, 4, 5, 11 Author Orcid Image
Article Authors Cited by (3) Tweetations Metrics

Journals

  1. Guiducci L, Saulle C, Dimitri G, Valli B, Alpini S, Tenti C, Rizzo A. Dialogical AI for Cognitive Bias Mitigation in Medical Diagnosis. Applied Sciences 2026;16(2):710 View
  2. Ekmekcioğlu A, Karaca B, Ülgen A. Performance of ChatGPT in dental implant treatment planning: evaluation using the modified DISCERN, Global Quality Score, and accuracy–safety score. BMC Oral Health 2026 View
  3. Khosravi M, Yousefi-Roobiyat M, Asghari Z, Nakhaei M, Khosravi F. Comparison of the performance of ChatGPT-5, Gemini 3, Copilot, Perplexity, and medical students in answering neurology questions: a cross-sectional study. Scientific Reports 2026 View