Performance Assessment of ChatGPT-4.0 and ChatGLM Series in Traditional Chinese Medicine for Metabolic Associated Fatty Liver Disease: Comparative Study
Our study results demonstrated that real-time internet connectivity played a critical role in LLM-assisted TCM diagnosis and treatment, while offline models showed significantly reduced performance in clinical decision support. Furthermore, pretraining LLMs with TCM-specific knowledge bases while maintaining internet search capabilities substantially enhanced their diagnostic and therapeutic performance in TCM applications. Importantly, general-purpose LLMs required both domain-specific medical fine-tuning and culturally sensitive adaptation to meet the rigorous standards of TCM clinical practice.
Authors
- Changquan Ling (ORCID: https://orcid.org/0000-0002-0037-4059)
- X Wang
- Zhong Pei (ORCID: https://orcid.org/0000-0002-8425-2867)
- Kexin Meng
- Tianheng Zheng
- Bo Liu (ORCID: https://orcid.org/0009-0002-2960-4046)
Institutions
- Shanghai University of Traditional Chinese Medicine (CN)
- People's Liberation Army 401 Hospital (CN)
- Shanghai Traditional Chinese Medicine Hospital (CN)
Publication Details
- Journal
- JMIR Formative Research
- Published
- 2025-08-25
- DOI
- https://doi.org/10.2196/66503
- Citations
- 1
- Primary Topic
- Liver Disease Diagnosis and Treatment
- Type
- article
- Field-Weighted Citation Impact
- 1.35