An Explainable Hybrid Framework for Multimodal Misinformation Detection Using BERT and Spiking Neural Networks

The rapid proliferation of misinformation across social media platforms has emerged as a critical challenge, necessitating intelligent and interpretable detection mechanisms. Although transformer-based models such as BERT achieve high accuracy in textual analysis, they lack transparency and fail to capture temporal propagation dynamics. To address these limitations, this paper proposes a hybrid explainable framework that integrates Bidirectional Encoder Representations from Transformers (BERT) for semantic feature extraction with Spiking Neural Networks (SNNs) for modeling temporal engagement patterns. The proposed approach leverages the event-driven nature of SNNs to efficiently capture time-dependent user interaction signals, while SHAP-based explainability provides interpretable insights into both textual and temporal contributions. Experiments conducted on the FakeNewsNet dataset demonstrate that the proposed model outperforms baseline approaches, achieving an F1-score of 0.94 while maintaining improved computational efficiency. The results highlight the effectiveness of combining semantic understanding, temporal modeling, and explainability in a unified framework for reliable misinformation detection.

Authors

Institutions

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-04-03
DOI
https://doi.org/10.5281/zenodo.19403816
Primary Topic
Misinformation and Its Impacts
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

An Explainable Hybrid Framework for Multimodal Misinformation Detection Using BERT and Spiking Neural Networks

Shreya Wankhade, Tanvi S. Zode, Prof. N. E. Karale, Shambhavi L. Asole et al.
Zenodo (CERN European Organization for Nuclear Research)
Misinformation and Its Impacts
article

An Explainable Hybrid Framework for Multimodal Misinformation Detection Using BERT and Spiking Neural Networks

Shreya Wankhade, Tanvi S. Zode, Prof. N. E. Karale, Shambhavi L. Asole, Srushti R. Butale, Jagruti A. Shende
article en

Abstract

The rapid proliferation of misinformation across social media platforms has emerged as a critical challenge, necessitating intelligent and interpretable detection mechanisms. Although transformer-based models such as BERT achieve high accuracy in textual analysis, they lack transparency and fail to capture temporal propagation dynamics. To address these limitations, this paper proposes a hybrid explainable framework that integrates Bidirectional Encoder Representations from Transformers (BERT) for semantic feature extraction with Spiking Neural Networks (SNNs) for modeling temporal engagement patterns. The proposed approach leverages the event-driven nature of SNNs to efficiently capture time-dependent user interaction signals, while SHAP-based explainability provides interpretable insights into both textual and temporal contributions. Experiments conducted on the FakeNewsNet dataset demonstrate that the proposed model outperforms baseline approaches, achieving an F1-score of 0.94 while maintaining improved computational efficiency. The results highlight the effectiveness of combining semantic understanding, temporal modeling, and explainability in a unified framework for reliable misinformation detection.

Zenodo (CERN European Organization for Nuclear Research)
Sant Gadge Baba Amravati University (IN)
Openalex Percentile: Top 3%
Misinformation and Its Impacts
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.