Dual-Stream Transformer with LLM-Empowered Symbol Drift Modeling for Health Misinformation Detection
In the era of big-data-driven multi-platform and multimodal health information dissemination, the rapid spread of false and misleading content poses a critical threat to public health awareness and decision making. To address this issue, a dual-stream Transformer-based multimodal health misinformation detection framework is presented, incorporating a symbol drift detection module, a symbol-aware text graph neural network, and a crossmodal alignment fusion module. The framework enables precise identification of implicit misleading health-related symbols, comprehensive modeling of textual dependency structures, and robust detection of crossmodal semantic conflicts. A domain-specific health-symbol-sensitive lexicon is constructed, and contextual drift intensity is quantitatively measured and embedded as explicit features into the text GNN. Bidirectional cross-attention and contrastive learning are further employed to enhance crossmodal semantic alignment. Extensive experiments on a large-scale real-world multimodal health information dataset, encompassing heterogeneous data sources typical of big data environments, demonstrate that the proposed method consistently outperforms state-of-the-art baselines in CTR prediction, multimodal recommendation, and ranking tasks. The results indicate substantial improvements in both accuracy and ranking quality, while ablation studies further verify the contributions of symbol drift modeling, graph-structured representation, and crossmodal fusion. Overall, the proposed approach advances big data analytics for multimodal misinformation detection and provides an interpretable and scalable solution for public health communication governance.
Authors
- Manzhou Li (ORCID: https://orcid.org/0000-0001-9349-545X)
- Yan Zhang (ORCID: https://orcid.org/0000-0002-2428-9211)
- Caina Jiang
- Zhitao Fu (ORCID: https://orcid.org/0000-0002-4150-4104)
- Jingsheng Wang (ORCID: https://orcid.org/0000-0003-2814-0796)
Institutions
- Peking University (CN)
- Northwest University (CN)
- Beijing Academy of Artificial Intelligence (CN)
- China Agricultural University (CN)
Publication Details
- Journal
- Applied Sciences
- Published
- 2025-09-12
- DOI
- https://doi.org/10.3390/app15189992
- Primary Topic
- Misinformation and Its Impacts
- Type
- article
- Field-Weighted Citation Impact
- 0.00