Enhancing Accuracy of LLM in Nursing Education Through RAG and Thought Chains.

The penetration of large language models (LLMs) into all walks of life requires finding effective ways to improve the accuracy of their practical application in nursing scenarios. This study investigates the potential of retrieval-augmented generation (RAG) technology and the chain of thought (CoT) reasoning process in addressing the limitations of LLMs in professional knowledge and complex problem reasoning. Leveraging a knowledge base derived from the Chinese National Nursing Licensure Examination question bank, researchers first evaluated the baseline performance of LLMs. Subsequently, the CoT reasoning process was systematically compared with official exam parsing methods to assess the model's ability to interpret nursing-related questions. Experimental results demonstrated that integrating the knowledge base significantly improved LLM accuracy from 84.58% to 93.33%. Furthermore, the CoT reasoning process achieved a 91.33% accuracy rate in parsing question options, highlighting its robust logical reasoning capabilities. These findings underscore that the synergistic integration of RAG and CoT enhances the precision of LLMs in knowledge retrieval and clinical reasoning, offering an innovative technical pathway for developing intelligent nursing education tools. The study not only validates the effectiveness of combining knowledge augmentation with advanced reasoning mechanisms but also provides methodological insights for improving the reliability of AI applications in health care.

Authors

Institutions

Publication Details

Journal
PubMed
Published
2025-12-23
DOI
https://doi.org/10.1097/cin.0000000000001409
Primary Topic
Artificial Intelligence in Healthcare and Education
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Enhancing Accuracy of LLM in Nursing Education Through RAG and Thought Chains.

J. Wang, Liang Zhang, Li Zhang, Fengrong Lu
PubMed
Artificial Intelligence in Healthcare and Education
article

Enhancing Accuracy of LLM in Nursing Education Through RAG and Thought Chains.

J. Wang, Liang Zhang, Li Zhang, Fengrong Lu
article en

Abstract

The penetration of large language models (LLMs) into all walks of life requires finding effective ways to improve the accuracy of their practical application in nursing scenarios. This study investigates the potential of retrieval-augmented generation (RAG) technology and the chain of thought (CoT) reasoning process in addressing the limitations of LLMs in professional knowledge and complex problem reasoning. Leveraging a knowledge base derived from the Chinese National Nursing Licensure Examination question bank, researchers first evaluated the baseline performance of LLMs. Subsequently, the CoT reasoning process was systematically compared with official exam parsing methods to assess the model's ability to interpret nursing-related questions. Experimental results demonstrated that integrating the knowledge base significantly improved LLM accuracy from 84.58% to 93.33%. Furthermore, the CoT reasoning process achieved a 91.33% accuracy rate in parsing question options, highlighting its robust logical reasoning capabilities. These findings underscore that the synergistic integration of RAG and CoT enhances the precision of LLMs in knowledge retrieval and clinical reasoning, offering an innovative technical pathway for developing intelligent nursing education tools. The study not only validates the effectiveness of combining knowledge augmentation with advanced reasoning mechanisms but also provides methodological insights for improving the reliability of AI applications in health care.

PubMed
Huazhong University of Science and Technology (CN), Wuhan Sports University (CN)
Openalex Percentile: Top 40%
Artificial Intelligence in Healthcare and Education
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.