Evaluating large language model workflows in clinical decision support for triage and referral and diagnosis

Авторы

Ключевые слова:

Medical diagnosis, Triage, Workflow, Referral, Decision support system, Health care, Clinical decision making, Clinical decision support system

Аннотация

Accurate medical decision-making is critical for both patients and clinicians. Patients often struggle to interpret their symptoms, determine their severity, and select the right specialist. Simultaneously, clinicians face challenges in integrating complex patient data to make timely, accurate diagnoses. Recent advances in large language models (LLMs) offer the potential to bridge this gap by supporting decision-making for both patients and healthcare providers. In this study, we benchmark multiple LLM versions and an LLM-based workflow incorporating retrieval-augmented generation (RAG) on a curated dataset of 2000 medical cases derived from the Medical Information Mart for Intensive Care database. Our findings show that these LLMs are capable of providing personalized insights into likely diagnoses, suggesting appropriate specialists, and assessing urgent care needs. These models may also support clinicians in refining diagnoses and decision-making, offering a promising approach to improving patient outcomes and streamlining healthcare delivery.

Источник и лицензия. Статья открытого доступа, впервые опубликована как «Evaluating large language model workflows in clinical decision support for triage and referral and diagnosis» в журнале npj Digital Medicine, 2025. DOI: 10.1038/s41746-025-01684-1. © Farieda Gaber, Maqsood Shaik, Fabio Allega, Agnes Julia Bilecz, Felix Busch, Kelsey Goon, Vedran Franke, Altuna Akalin. Воспроизведена без изменений по лицензии Creative Commons Attribution 4.0.

Библиографические ссылки

Goldberger, A., Amaral, L., Glass, L. et al. (2000). PhysioBank, PhysioToolkit, and PhysioNet. Circulation. https://doi.org/10.1161/01.cir.101.23.e215

Giray, L. (2023). Prompt Engineering with ChatGPT: A Guide for Academic Writers. Annals of Biomedical Engineering. https://doi.org/10.1007/s10439-023-03272-4

Eastman, A. (1994). Resources for optimal care of the injured patient--1993.. PubMed.

Chiang, C., Lee, H. (2023). Can Large Language Models Be an Alternative to Human Evaluations?. https://doi.org/10.18653/v1/2023.acl-long.870

Lupton, J., Davis-O’Reilly, C., Jungbauer, R. et al. (2022). Under-Triage and Over-Triage Using the Field Triage Guidelines for Injured Patients: A Systematic Review. Prehospital Emergency Care. https://doi.org/10.1080/10903127.2022.2043963

Daher, M., Koa, J., Boufadel, P. et al. (2023). Breaking barriers: can ChatGPT compete with a shoulder and elbow specialist in diagnosis and management?. JSES International. https://doi.org/10.1016/j.jseint.2023.07.018

Johnson, A., Bulgarelli, L., Shen, L. et al. (2023). MIMIC-IV, a freely accessible electronic health record dataset. Scientific Data. https://doi.org/10.1038/s41597-022-01899-x

Lewis, P., Perez, E., Piktus, A. et al. (2026). Affordance-Compiled Intelligence: Observable-Only Cognitive Impedance Matching for No-Meta LLM-Integrated Systems. arXiv (Cornell University). https://doi.org/10.5281/zenodo.20116149

Опубликован

2026-08-22

Как цитировать

Evaluating large language model workflows in clinical decision support for triage and referral and diagnosis. (2026). QAIRU Journal, 1(2). https://ojs.bbx.kz/journal/article/view/5