LMAT-ND: A Meta-Attention-Enhanced Llama-7B Model for AI-Generated News Detection

This study introduces LMAT-ND (Llama-7B Enhanced Meta-Attention Transformer for News Detection) to distinguish AI-generated from human-authored news by integrating a Meta-Attention Mechanism and Dynamic Multi-Head Attention to capture linguistic distinctions, alongside a Dual-Classification Layer for optimized classification. LMAT-ND leverages Meta-Attention to dynamically adjust attention distribution, enhancing context-aware feature extraction, while the Dynamic Multi-Head Attention refines classification by emphasizing context-sensitive features. Additionally, the Dual-Classification Layer employs a two-stage strategy, integrating semantic and linguistic details to improve predictions. Experiments demonstrate that LMAT-ND outperforms GPT-3 and Llama-7B in accuracy, recall, and F1-score, with ablation studies confirming the Meta-Attention Mechanism and Dual-Classification Layer's impact. Performance remains strong across COCO and FakeImage datasets, validating its effectiveness in AI-generated content detection. Future work will focus on refining borderline case handling and extending applicability to broader AI-generated content detection tasks, further enhancing adaptability and robustness.

Authors

Institutions

Publication Details

Published
2025-02-28
DOI
https://doi.org/10.1109/iccece65250.2025.10985603
Primary Topic
Topic Modeling
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

LMAT-ND: A Meta-Attention-Enhanced Llama-7B Model for AI-Generated News Detection

Chenxi Jiang, Tianle Zhang, Jing Cao, Hairu Wen et al.
Topic Modeling
article

LMAT-ND: A Meta-Attention-Enhanced Llama-7B Model for AI-Generated News Detection

Chenxi Jiang, Tianle Zhang, Jing Cao, Hairu Wen, Zichang Liu, Yicong Li
article en

Abstract

This study introduces LMAT-ND (Llama-7B Enhanced Meta-Attention Transformer for News Detection) to distinguish AI-generated from human-authored news by integrating a Meta-Attention Mechanism and Dynamic Multi-Head Attention to capture linguistic distinctions, alongside a Dual-Classification Layer for optimized classification. LMAT-ND leverages Meta-Attention to dynamically adjust attention distribution, enhancing context-aware feature extraction, while the Dynamic Multi-Head Attention refines classification by emphasizing context-sensitive features. Additionally, the Dual-Classification Layer employs a two-stage strategy, integrating semantic and linguistic details to improve predictions. Experiments demonstrate that LMAT-ND outperforms GPT-3 and Llama-7B in accuracy, recall, and F1-score, with ablation studies confirming the Meta-Attention Mechanism and Dual-Classification Layer's impact. Performance remains strong across COCO and FakeImage datasets, validating its effectiveness in AI-generated content detection. Future work will focus on refining borderline case handling and extending applicability to broader AI-generated content detection tasks, further enhancing adaptability and robustness.

University of California, Riverside (US), University of Southern California (US), Northeastern University (US), University of California, Irvine (US), Bellevue Hospital Center (US), Seattle University (US), Columbia University (US)
Openalex Percentile: Top 95%
Topic Modeling
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.