Assessing the adherence of large language models to clinical practice guidelines in Chinese medicine: a content analysis
LLMs showed varying degrees of potential for acquiring CM knowledge. The performance of DeepSeek-v3 and DeepSeek-r1 is satisfactory. Optimizing LLMs to become effective tools for disseminating CM information is an important direction for future development.
Authors
- Yaolong Chen (ORCID: https://orcid.org/0000-0002-7338-4418)
- Janne Estill (ORCID: https://orcid.org/0000-0001-9544-1447)
- Hongcai Shang
- Jiayi Liu (ORCID: https://orcid.org/0009-0002-4448-7781)
- Jiajie Huang (ORCID: https://orcid.org/0000-0001-7458-0990)
- Bei Pan
- Jie Liu (ORCID: https://orcid.org/0000-0001-8976-2332)
- Nannan Shi (ORCID: https://orcid.org/0000-0003-0278-1608)
- Yinghui Jin (ORCID: https://orcid.org/0009-0005-7181-3337)
- Honghao Lai (ORCID: https://orcid.org/0000-0001-7913-6207)
- Jianping Liu (ORCID: https://orcid.org/0000-0002-0320-061X)
- Jianing Liu (ORCID: https://orcid.org/0000-0001-5048-4566)
- Weilong Zhao (ORCID: https://orcid.org/0000-0001-8909-5322)
- Chunyang Bai
- Long Ge (ORCID: https://orcid.org/0000-0002-3555-1107)
- Danni Xia (ORCID: https://orcid.org/0009-0004-2226-6923)
Institutions
- University of Geneva (CH)
- Beijing University of Chinese Medicine (CN)
- Chinese Academy of Medical Sciences & Peking Union Medical College (CN)
- Wuhan University (CN)
- Gansu University of Traditional Chinese Medicine (CN)
- Zhongnan Hospital of Wuhan University (CN)
- Guang’anmen Hospital (CN)
- Southern Medical University (CN)
- Lanzhou University (CN)
Publication Details
- Journal
- Frontiers in Pharmacology
- Published
- 2025-07-25
- DOI
- https://doi.org/10.3389/fphar.2025.1649041
- Citations
- 3
- Primary Topic
- Text Readability and Simplification
- Type
- article
- Field-Weighted Citation Impact
- 7.44
Funders
- National Natural Science Foundation of China
- China Academy of Chinese Medical Sciences