LMAT-ND: A Meta-Attention-Enhanced Llama-7B Model for AI-Generated News Detection
This study introduces LMAT-ND (Llama-7B Enhanced Meta-Attention Transformer for News Detection) to distinguish AI-generated from human-authored news by integrating a Meta-Attention Mechanism and Dynamic Multi-Head Attention to capture linguistic distinctions, alongside a Dual-Classification Layer for optimized classification. LMAT-ND leverages Meta-Attention to dynamically adjust attention distribution, enhancing context-aware feature extraction, while the Dynamic Multi-Head Attention refines classification by emphasizing context-sensitive features. Additionally, the Dual-Classification Layer employs a two-stage strategy, integrating semantic and linguistic details to improve predictions. Experiments demonstrate that LMAT-ND outperforms GPT-3 and Llama-7B in accuracy, recall, and F1-score, with ablation studies confirming the Meta-Attention Mechanism and Dual-Classification Layer's impact. Performance remains strong across COCO and FakeImage datasets, validating its effectiveness in AI-generated content detection. Future work will focus on refining borderline case handling and extending applicability to broader AI-generated content detection tasks, further enhancing adaptability and robustness.
Authors
- Chenxi Jiang (ORCID: https://orcid.org/0009-0004-8718-9439)
- Tianle Zhang (ORCID: https://orcid.org/0000-0002-0779-5905)
- Jing Cao (ORCID: https://orcid.org/0000-0002-4961-0577)
- Hairu Wen
- Zichang Liu (ORCID: https://orcid.org/0000-0002-5556-8117)
- Yicong Li (ORCID: https://orcid.org/0000-0002-5659-793X)
Institutions
- University of California, Riverside (US)
- University of Southern California (US)
- Northeastern University (US)
- University of California, Irvine (US)
- Bellevue Hospital Center (US)
- Seattle University (US)
- Columbia University (US)
Publication Details
- Published
- 2025-02-28
- DOI
- https://doi.org/10.1109/iccece65250.2025.10985603
- Primary Topic
- Topic Modeling
- Type
- article
- Field-Weighted Citation Impact
- 0.00