Streamlining evidence based clinical recommendations with large language models
Clinical evidence underpins informed healthcare decisions, yet integrating it into real-time practice remains challenging due to intensive workloads, complex procedures, and time constraints. This study presents Quicker, an LLM-powered system that automates evidence synthesis and generates clinical recommendations following standard guideline development workflows. Quicker delivers an end-to-end pipeline from clinical questions to recommendations and supports customized decision-making through integrated tools and interactive interfaces. To evaluate how closely Quicker can reproduce guideline development processes, we constructed Q2CRBench-3, a benchmark derived from guideline development records for three diseases. Experiments show that Quicker produces precise question decomposition, expert-aligned retrieval, and near-comprehensive screening. Quicker assistance improved the accuracy of extracted study data, and its recommendations were more comprehensive and coherent than clinician-written ones. In system-level testing, Quicker working with one participant reduced recommendation development to 20-40 min. Overall, the findings demonstrate Quicker's potential to enhance the speed and reliability of evidence-based clinical decision-making.
Authors
- Danyang Tong (ORCID: https://orcid.org/0000-0002-3745-9961)
- Xinping Tian (ORCID: https://orcid.org/0009-0008-4745-4495)
- Jingsong Li (ORCID: https://orcid.org/0000-0002-1064-637X)
- Dubai Li
- Nan Jiang (ORCID: https://orcid.org/0000-0003-4859-4226)
- Tianshu Zhou (ORCID: https://orcid.org/0000-0002-5858-6353)
- Qian Wang (ORCID: https://orcid.org/0000-0002-1687-519X)
- Yu Chen (ORCID: https://orcid.org/0000-0003-1348-8992)
- Hui Yu (ORCID: https://orcid.org/0000-0001-7420-897X)
- Kexin Huang (ORCID: https://orcid.org/0009-0001-5697-6710)
- Qiao Lin (ORCID: https://orcid.org/0000-0002-6040-2867)
- Shuyu Ouyang
- Xiaofeng Zeng
- Yu Tian (ORCID: https://orcid.org/0000-0003-4463-8690)
- Ruiqi Tu
Institutions
- Chinese Academy of Medical Sciences & Peking Union Medical College (CN)
- Peking Union Medical College Hospital (CN)
- Ministry of Education (ME)
- Zhejiang Lab (CN)
Publication Details
- Journal
- npj Digital Medicine
- Published
- 2025-12-22
- DOI
- https://doi.org/10.1038/s41746-025-02273-y
- Citations
- 1
- Primary Topic
- Artificial Intelligence in Healthcare and Education
- Type
- article
- Field-Weighted Citation Impact
- 0.65
Funders
- National Natural Science Foundation of China
- National Key Research and Development Program of China
- Fundamental Research Funds for the Central Universities