MOSAIC: a structurally robust multimodal framework for fine-grained fake news detection via optimal transport and adaptive expert routing

Purpose Fine-grained multimodal fake news detection requires reasoning over text–image semantic inconsistency and heterogeneous inputs. Existing methods often strengthen fusion or add contextual information but rarely use cross-modal conflict to control multiple inference stages. This study examines whether token-to-patch discrepancy can guide expert processing, contextual interaction and progressive fusion. Design/methodology/approach Multimodal optimal transport semantic alignment with integrated conflict-aware experts (MOSAIC) is a conflict-aware framework. It uses Sinkhorn-regularized optimal transport to estimate token-to-patch mismatch, derive conflict cues for expert processing and fusion, and adaptively route heterogeneous inputs. The same architecture is evaluated on complementary benchmarks FineFake and AMG; dataset-specific choices are limited to preprocessing, class-imbalance handling and auxiliary-context availability. Findings MOSAIC achieves the strongest performance among the compared methods on both benchmarks, improving Macro-F1 by +1.44 points over LLM-MFEFND on FineFake and +2.00 points over MGCA on AMG. Ablation analysis shows a complementary specialization pattern: optimal transport-based conflict modeling contributes most under attribution-level conflict pressure on AMG, whereas adaptive expert routing is most critical under platform-heterogeneous inputs on FineFake. Multi-seed evaluation further confirms stable performance across both settings. Originality/value This study introduces cross-modal semantic conflict as a reusable architectural control signal rather than a local alignment cue. MOSAIC integrates optimal transport-based conflict modeling, adaptive expert routing and conflict-aware progressive fusion into a unified framework, advancing fine-grained multimodal fake news detection through controlled conflict regulation rather than representation augmentation alone.

Authors

Institutions

Publication Details

Journal
Data Technologies and Applications
Published
2026-08-14
DOI
https://doi.org/10.1108/dta-07-2026-0792
Primary Topic
Misinformation and Its Impacts
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

MOSAIC: a structurally robust multimodal framework for fine-grained fake news detection via optimal transport and adaptive expert routing

Thien Khai Tran, Tran Tri Dang, Hao Luu Van Nhat
Data Technologies and Applications
Misinformation and Its Impacts
article

MOSAIC: a structurally robust multimodal framework for fine-grained fake news detection via optimal transport and adaptive expert routing

Thien Khai Tran, Tran Tri Dang, Hao Luu Van Nhat
article en

Abstract

Purpose Fine-grained multimodal fake news detection requires reasoning over text–image semantic inconsistency and heterogeneous inputs. Existing methods often strengthen fusion or add contextual information but rarely use cross-modal conflict to control multiple inference stages. This study examines whether token-to-patch discrepancy can guide expert processing, contextual interaction and progressive fusion. Design/methodology/approach Multimodal optimal transport semantic alignment with integrated conflict-aware experts (MOSAIC) is a conflict-aware framework. It uses Sinkhorn-regularized optimal transport to estimate token-to-patch mismatch, derive conflict cues for expert processing and fusion, and adaptively route heterogeneous inputs. The same architecture is evaluated on complementary benchmarks FineFake and AMG; dataset-specific choices are limited to preprocessing, class-imbalance handling and auxiliary-context availability. Findings MOSAIC achieves the strongest performance among the compared methods on both benchmarks, improving Macro-F1 by +1.44 points over LLM-MFEFND on FineFake and +2.00 points over MGCA on AMG. Ablation analysis shows a complementary specialization pattern: optimal transport-based conflict modeling contributes most under attribution-level conflict pressure on AMG, whereas adaptive expert routing is most critical under platform-heterogeneous inputs on FineFake. Multi-seed evaluation further confirms stable performance across both settings. Originality/value This study introduces cross-modal semantic conflict as a reusable architectural control signal rather than a local alignment cue. MOSAIC integrates optimal transport-based conflict modeling, adaptive expert routing and conflict-aware progressive fusion into a unified framework, advancing fine-grained multimodal fake news detection through controlled conflict regulation rather than representation augmentation alone.

Data Technologies and Applications
RMIT Vietnam (VN), Ho Chi Minh City University of Foreign Languages and Information Technology (VN), Ho Chi Minh City University of Industry and Trade (VN), University Of Information Technology (MM)
Peace, Justice and strong institutions
Openalex Percentile: Top 4%
Misinformation and Its Impacts
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.