A Dual-Branch Cross-Attention PhoBERT Architecture with Explainable AI and Active Continual Learning for Vietnamese Fake News Detection

ABSTRACT: The exponential proliferation of digital misinformation across Vietnamese online media platforms poses substantial challenges to information integrity, public safety, and institutional trust. Traditional text classification paradigms utilizing Pretrained Language Models (PLMs) conventionally process input by concatenating headlines and body texts into a single monolithic sequence. This design fails to capture the subtle inter-textual semantic dissonance characteristic of sensational clickbait and deceptive realism, where fabricated headlines deliberately diverge from or contradict body contexts. Furthermore, conventional static deployment settings remain incapable of handling continuous distribution shifts as deception tactics dynamically evolve. To address these limitations, we propose an end-to-end framework integrating a Dual-Branch Cross-Attention PhoBERT architecture, a Faithfulness-Verified Explainable AI (XAI) mechanism via Local Interpretable Model-agnostic Explanations (LIME), and an Active Continual Learning pipeline with experience replay. Rather than treating input as an aggregated flat sequence, our dual-branch encoder extracts contextual representations for headlines () and body texts () asynchronously, explicitly modeling cross-modal semantic discrepancies via Multi-Head Cross-Attention. Extensive experiments on a standardized Vietnamese benchmark dataset demonstrate that our proposed model achieves an Accuracy of 94.41%, a Precision of 89.74%, an outstanding Recall of 98.59%, and an F1-Score of 93.96%, suppressing false positives by 0.99% over traditional baselines while effectively mitigating false-negative omissions on malicious content and maintaining competitive performance against standard single-branch models. Furthermore, quantitative deletion faithfulness evaluation () validates that model decisions are strictly governed by genuine linguistic markers, exhibiting a monotonic confidence degradation on the misinformation class from () down to (), successfully triggering a decision-flip at . Coupled with an uncertainty-driven active replay buffer and a tri-state client-side verification engine, the proposed framework provides an accurate, transparent, and continuously adaptive paradigm for digital misinformation mitigation Keywords: Fake News Detection, PhoBERT, Multi-Head Cross-Attention, Explainable AI, Deletion Faithfulness, Active Continual Learning, Vietnamese NLP

Authors

Institutions

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-09-04
DOI
https://doi.org/10.5281/zenodo.22292949
Primary Topic
Misinformation and Its Impacts
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A Dual-Branch Cross-Attention PhoBERT Architecture with Explainable AI and Active Continual Learning for Vietnamese Fake News Detection

Luong Truong An, Vu Thanh Nhan
Zenodo (CERN European Organization for Nuclear Research)
Misinformation and Its Impacts
article

A Dual-Branch Cross-Attention PhoBERT Architecture with Explainable AI and Active Continual Learning for Vietnamese Fake News Detection

Luong Truong An, Vu Thanh Nhan
article en

Abstract

ABSTRACT: The exponential proliferation of digital misinformation across Vietnamese online media platforms poses substantial challenges to information integrity, public safety, and institutional trust. Traditional text classification paradigms utilizing Pretrained Language Models (PLMs) conventionally process input by concatenating headlines and body texts into a single monolithic sequence. This design fails to capture the subtle inter-textual semantic dissonance characteristic of sensational clickbait and deceptive realism, where fabricated headlines deliberately diverge from or contradict body contexts. Furthermore, conventional static deployment settings remain incapable of handling continuous distribution shifts as deception tactics dynamically evolve. To address these limitations, we propose an end-to-end framework integrating a Dual-Branch Cross-Attention PhoBERT architecture, a Faithfulness-Verified Explainable AI (XAI) mechanism via Local Interpretable Model-agnostic Explanations (LIME), and an Active Continual Learning pipeline with experience replay. Rather than treating input as an aggregated flat sequence, our dual-branch encoder extracts contextual representations for headlines () and body texts () asynchronously, explicitly modeling cross-modal semantic discrepancies via Multi-Head Cross-Attention. Extensive experiments on a standardized Vietnamese benchmark dataset demonstrate that our proposed model achieves an Accuracy of 94.41%, a Precision of 89.74%, an outstanding Recall of 98.59%, and an F1-Score of 93.96%, suppressing false positives by 0.99% over traditional baselines while effectively mitigating false-negative omissions on malicious content and maintaining competitive performance against standard single-branch models. Furthermore, quantitative deletion faithfulness evaluation () validates that model decisions are strictly governed by genuine linguistic markers, exhibiting a monotonic confidence degradation on the misinformation class from () down to (), successfully triggering a decision-flip at . Coupled with an uncertainty-driven active replay buffer and a tri-state client-side verification engine, the proposed framework provides an accurate, transparent, and continuously adaptive paradigm for digital misinformation mitigation Keywords: Fake News Detection, PhoBERT, Multi-Head Cross-Attention, Explainable AI, Deletion Faithfulness, Active Continual Learning, Vietnamese NLP

Zenodo (CERN European Organization for Nuclear Research)
Trường ĐH Nguyễn Tất Thành (VN)
Peace, Justice and strong institutions
Openalex Percentile: Top 4%
Misinformation and Its Impacts
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.