MLSDET: Multi-LLM Statistical Deep Ensemble for Chinese AI-Generated Text Detection
With the rapid advancements in pre-trained large language models like ChatGPT, the surge of AI-generated text, particularly in Chinese, has presented significant challenges to existing detection systems due to its increasing realism and complexity. To address this, we introduce MLSDET: a groundbreaking Multi-LLM Statistical Deep Ensemble framework designed for high-precision detection of AI-generated Chinese text. MLSDET uniquely integrates a Mixture of Experts (MoE) architecture with a novel cross-entropy metric, setting a new benchmark for robustness and generalization. By employing a diverse ensemble of large language models (LLMs), including Qwen, Wenzhong-GPT2, and LLaMA, our approach extracts intricate features such as log-rank, entropy, log-likelihood, and the newly introduced LLMs-crossEntropy, accurately capturing both model consensus and the statistical distribution differences between AI-generated and human-authored text. Experimental results on the HC3-Chinese dataset show that MLSDET surpasses traditional zero-shot methods like CLTR by 15.94% in F1 score and competes effectively with existing methods, offering a scalable solution for real-world applications.
Authors
- Denghui Zhang (ORCID: https://orcid.org/0009-0004-2606-3234)
- Dianhui Mao (ORCID: https://orcid.org/0000-0001-9171-548X)
- Ao Zhang (ORCID: https://orcid.org/0000-0002-4521-5561)
- Zhihua Zhao (ORCID: https://orcid.org/0000-0001-5275-0979)
Institutions
- China University of Political Science and Law (CN)
- Beijing Technology and Business University (CN)
Publication Details
- Published
- 2025-03-12
- DOI
- https://doi.org/10.1109/icassp49660.2025.10888686
- Citations
- 3
- Primary Topic
- Natural Language Processing Techniques
- Type
- article
- Field-Weighted Citation Impact
- 7.44
Funders
- Beijing Municipal Natural Science Foundation