Evaluating large language model workflows in clinical decision support for triage and referral and diagnosis

Авторлар

Кілт сөздер:

Medical diagnosis, Triage, Workflow, Referral, Decision support system, Health care, Clinical decision making, Clinical decision support system

Аңдатпа

Accurate medical decision-making is critical for both patients and clinicians. Patients often struggle to interpret their symptoms, determine their severity, and select the right specialist. Simultaneously, clinicians face challenges in integrating complex patient data to make timely, accurate diagnoses. Recent advances in large language models (LLMs) offer the potential to bridge this gap by supporting decision-making for both patients and healthcare providers. In this study, we benchmark multiple LLM versions and an LLM-based workflow incorporating retrieval-augmented generation (RAG) on a curated dataset of 2000 medical cases derived from the Medical Information Mart for Intensive Care database. Our findings show that these LLMs are capable of providing personalized insights into likely diagnoses, suggesting appropriate specialists, and assessing urgent care needs. These models may also support clinicians in refining diagnoses and decision-making, offering a promising approach to improving patient outcomes and streamlining healthcare delivery.

Source and licence. Open-access article originally published as “Evaluating large language model workflows in clinical decision support for triage and referral and diagnosis” in npj Digital Medicine, 2025. DOI: 10.1038/s41746-025-01684-1. © Farieda Gaber, Maqsood Shaik, Fabio Allega, Agnes Julia Bilecz, Felix Busch, Kelsey Goon, Vedran Franke, Altuna Akalin. Reproduced unchanged under the Creative Commons Attribution 4.0 licence.

Әдебиеттер тізімі

Goldberger, A., Amaral, L., Glass, L. et al. (2000). PhysioBank, PhysioToolkit, and PhysioNet. Circulation. https://doi.org/10.1161/01.cir.101.23.e215

Giray, L. (2023). Prompt Engineering with ChatGPT: A Guide for Academic Writers. Annals of Biomedical Engineering. https://doi.org/10.1007/s10439-023-03272-4

Eastman, A. (1994). Resources for optimal care of the injured patient--1993.. PubMed.

Chiang, C., Lee, H. (2023). Can Large Language Models Be an Alternative to Human Evaluations?. https://doi.org/10.18653/v1/2023.acl-long.870

Lupton, J., Davis-O’Reilly, C., Jungbauer, R. et al. (2022). Under-Triage and Over-Triage Using the Field Triage Guidelines for Injured Patients: A Systematic Review. Prehospital Emergency Care. https://doi.org/10.1080/10903127.2022.2043963

Daher, M., Koa, J., Boufadel, P. et al. (2023). Breaking barriers: can ChatGPT compete with a shoulder and elbow specialist in diagnosis and management?. JSES International. https://doi.org/10.1016/j.jseint.2023.07.018

Johnson, A., Bulgarelli, L., Shen, L. et al. (2023). MIMIC-IV, a freely accessible electronic health record dataset. Scientific Data. https://doi.org/10.1038/s41597-022-01899-x

Lewis, P., Perez, E., Piktus, A. et al. (2026). Affordance-Compiled Intelligence: Observable-Only Cognitive Impedance Matching for No-Meta LLM-Integrated Systems. arXiv (Cornell University). https://doi.org/10.5281/zenodo.20116149

Жарияланды

2026-08-22