VTL-FND: A Variational Topic Latent Modeling Algorithm for Fine-grained Neural Discrepancy Learning
Fine-grained neural discrepancy learning is an important problem in multimodal representation learning because heterogeneous modalities often contain partially aligned, weakly correlated, or locally contradictory semantic information. Existing multimodal learning methods mainly rely on deterministic feature fusion or cross-modal attention, but they often fail to model hidden topic-level uncertainty and fine-grained discrepancy between textual, visual, and auxiliary representations. To address this problem, this paper proposes VTL-FND, a Variational Topic Latent Modeling Algorithm for Finegrained Neural Discrepancy Learning. VTL-FND first encodes textual, visual, and metadata information into a shared representation space, then infers a latent topic variable through variational inference, and finally combines topic-level semantic abstraction with contradiction-aware multimodal evidence for semantic discrepancy prediction. The proposed framework integrates ELBO-based latent regularization, cross-modal consistency learning, and supervised classification into a unified optimization objective. Experiments on multiple multimodal semantic consistency benchmarks show that VTL-FND consistently outperforms representative baselines in Accuracy, Precision, Recall, F1-score, and AUC. The results demonstrate that latent topic modeling and contradiction-aware learning provide robust and interpretable improvements for fine-grained multimodal discrepancy learning.
Authors
- Dajun Liu
- Shiyu Wang (ORCID: https://orcid.org/0009-0001-6993-8844)
Institutions
- Twitter (United States) (US)
Publication Details
- Journal
- International Journal of Pattern Recognition and Artificial Intelligence
- Published
- 2026-08-18
- DOI
- https://doi.org/10.1142/s0218001426510146
- Primary Topic
- Multimodal Machine Learning Applications
- Type
- article
- Field-Weighted Citation Impact
- 0.00