Performance Assessment of ChatGPT-4.0 and ChatGLM Series in Traditional Chinese Medicine for Metabolic Associated Fatty Liver Disease: Comparative Study

Our study results demonstrated that real-time internet connectivity played a critical role in LLM-assisted TCM diagnosis and treatment, while offline models showed significantly reduced performance in clinical decision support. Furthermore, pretraining LLMs with TCM-specific knowledge bases while maintaining internet search capabilities substantially enhanced their diagnostic and therapeutic performance in TCM applications. Importantly, general-purpose LLMs required both domain-specific medical fine-tuning and culturally sensitive adaptation to meet the rigorous standards of TCM clinical practice.

Authors

Institutions

Publication Details

Journal
JMIR Formative Research
Published
2025-08-25
DOI
https://doi.org/10.2196/66503
Citations
1
Primary Topic
Liver Disease Diagnosis and Treatment
Type
article
Field-Weighted Citation Impact
1.35
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Performance Assessment of ChatGPT-4.0 and ChatGLM Series in Traditional Chinese Medicine for Metabolic Associated Fatty Liver Disease: Comparative Study

Changquan Ling, X Wang, Zhong Pei, Kexin Meng et al.
1 citations
JMIR Formative Research
Liver Disease Diagnosis and Treatment
1.35
article

Performance Assessment of ChatGPT-4.0 and ChatGLM Series in Traditional Chinese Medicine for Metabolic Associated Fatty Liver Disease: Comparative Study

Changquan Ling, X Wang, Zhong Pei, Kexin Meng, Tianheng Zheng, Bo Liu
article en
1 citations

Abstract

Our study results demonstrated that real-time internet connectivity played a critical role in LLM-assisted TCM diagnosis and treatment, while offline models showed significantly reduced performance in clinical decision support. Furthermore, pretraining LLMs with TCM-specific knowledge bases while maintaining internet search capabilities substantially enhanced their diagnostic and therapeutic performance in TCM applications. Importantly, general-purpose LLMs required both domain-specific medical fine-tuning and culturally sensitive adaptation to meet the rigorous standards of TCM clinical practice.

JMIR Formative ResearchVol. 9
Shanghai University of Traditional Chinese Medicine (CN), People's Liberation Army 401 Hospital (CN), Shanghai Traditional Chinese Medicine Hospital (CN)
Openalex Percentile: Top 16%
Liver Disease Diagnosis and Treatment
1.35
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.