VTL-FND: A Variational Topic Latent Modeling Algorithm for Fine-grained Neural Discrepancy Learning

Fine-grained neural discrepancy learning is an important problem in multimodal representation learning because heterogeneous modalities often contain partially aligned, weakly correlated, or locally contradictory semantic information. Existing multimodal learning methods mainly rely on deterministic feature fusion or cross-modal attention, but they often fail to model hidden topic-level uncertainty and fine-grained discrepancy between textual, visual, and auxiliary representations. To address this problem, this paper proposes VTL-FND, a Variational Topic Latent Modeling Algorithm for Finegrained Neural Discrepancy Learning. VTL-FND first encodes textual, visual, and metadata information into a shared representation space, then infers a latent topic variable through variational inference, and finally combines topic-level semantic abstraction with contradiction-aware multimodal evidence for semantic discrepancy prediction. The proposed framework integrates ELBO-based latent regularization, cross-modal consistency learning, and supervised classification into a unified optimization objective. Experiments on multiple multimodal semantic consistency benchmarks show that VTL-FND consistently outperforms representative baselines in Accuracy, Precision, Recall, F1-score, and AUC. The results demonstrate that latent topic modeling and contradiction-aware learning provide robust and interpretable improvements for fine-grained multimodal discrepancy learning.

Authors

Institutions

Publication Details

Journal
International Journal of Pattern Recognition and Artificial Intelligence
Published
2026-08-18
DOI
https://doi.org/10.1142/s0218001426510146
Primary Topic
Multimodal Machine Learning Applications
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

VTL-FND: A Variational Topic Latent Modeling Algorithm for Fine-grained Neural Discrepancy Learning

Dajun Liu, Shiyu Wang
International Journal of Pattern Recognition and Artificial Intelligence
Multimodal Machine Learning Applications
article

VTL-FND: A Variational Topic Latent Modeling Algorithm for Fine-grained Neural Discrepancy Learning

Dajun Liu, Shiyu Wang
article en

Abstract

Fine-grained neural discrepancy learning is an important problem in multimodal representation learning because heterogeneous modalities often contain partially aligned, weakly correlated, or locally contradictory semantic information. Existing multimodal learning methods mainly rely on deterministic feature fusion or cross-modal attention, but they often fail to model hidden topic-level uncertainty and fine-grained discrepancy between textual, visual, and auxiliary representations. To address this problem, this paper proposes VTL-FND, a Variational Topic Latent Modeling Algorithm for Finegrained Neural Discrepancy Learning. VTL-FND first encodes textual, visual, and metadata information into a shared representation space, then infers a latent topic variable through variational inference, and finally combines topic-level semantic abstraction with contradiction-aware multimodal evidence for semantic discrepancy prediction. The proposed framework integrates ELBO-based latent regularization, cross-modal consistency learning, and supervised classification into a unified optimization objective. Experiments on multiple multimodal semantic consistency benchmarks show that VTL-FND consistently outperforms representative baselines in Accuracy, Precision, Recall, F1-score, and AUC. The results demonstrate that latent topic modeling and contradiction-aware learning provide robust and interpretable improvements for fine-grained multimodal discrepancy learning.

International Journal of Pattern Recognition and Artificial Intelligence
Twitter (United States) (US)
Quality Education
Openalex Percentile: Top 11%
Multimodal Machine Learning Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

VTL-FND: A Variational Topic Latent Modeling Algorithm for Fine-grained Neural Discrepancy Learning — Dajun Liu, Shiyu Wang · International Journal of Pattern Recognition and Artificial Intelligence (2026) | TGRS Research Map | TGRS