Learning across modalities: a systematic survey of multimodal models for financial analysis

• Taxonomy for multimodal forecasting by modality, model, fusion type, and task. • Review of 35 papers (2018–2025) analyzed through the proposed unified taxonomy. • Challenges: misalignment, modality imbalance, noisy inputs and generalization. • Trends: adaptive fusion, missing modality learning, LLMs, temporal GNN models. Multimodal learning has recently emerged as a powerful paradigm for financial forecasting, enabling the integration of heterogeneous data sources such as market time series, textual news, and relational graphs. This survey presents a unified taxonomy for multimodal financial forecasting models, structured along four key dimensions: input modalities, modelling architectures, fusion strategies, and predictive tasks. Using this taxonomy, we conduct a systematic review of 35 representative works published between 2018 and 2025, highlighting methodological trends, design choices, and performance patterns. Our analysis identifies persistent challenges, including temporal misalignment, modality imbalance, missing or noisy data, and limited cross-market generalization. We also discuss emerging trends and promising research directions, such as adaptive fusion, incomplete modality learning, and the integration of large language models and temporal graph neural networks, and analyse how architectural and fusion design choices impact practical considerations such as interpretability and deployability, aiming to bridge methodological innovation with domain-specific requirements.

Authors

Institutions

Publication Details

Journal
Information Fusion
Published
2026-02-24
DOI
https://doi.org/10.1016/j.inffus.2026.104249
Primary Topic
Stock Market Forecasting Methods
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Learning across modalities: a systematic survey of multimodal models for financial analysis

Carmine Ventre, Navid Nobani, Fabio Mercorio, Giancarlo Sperlí et al.
Information Fusion
Stock Market Forecasting Methods
article

Learning across modalities: a systematic survey of multimodal models for financial analysis

Carmine Ventre, Navid Nobani, Fabio Mercorio, Giancarlo Sperlí, Simone D’Amico
article en

Abstract

• Taxonomy for multimodal forecasting by modality, model, fusion type, and task. • Review of 35 papers (2018–2025) analyzed through the proposed unified taxonomy. • Challenges: misalignment, modality imbalance, noisy inputs and generalization. • Trends: adaptive fusion, missing modality learning, LLMs, temporal GNN models. Multimodal learning has recently emerged as a powerful paradigm for financial forecasting, enabling the integration of heterogeneous data sources such as market time series, textual news, and relational graphs. This survey presents a unified taxonomy for multimodal financial forecasting models, structured along four key dimensions: input modalities, modelling architectures, fusion strategies, and predictive tasks. Using this taxonomy, we conduct a systematic review of 35 representative works published between 2018 and 2025, highlighting methodological trends, design choices, and performance patterns. Our analysis identifies persistent challenges, including temporal misalignment, modality imbalance, missing or noisy data, and limited cross-market generalization. We also discuss emerging trends and promising research directions, such as adaptive fusion, incomplete modality learning, and the integration of large language models and temporal graph neural networks, and analyse how architectural and fusion design choices impact practical considerations such as interpretability and deployability, aiming to bridge methodological innovation with domain-specific requirements.

Information FusionVol. 133
King's College London (GB), King's College School (GB), University of Milano-Bicocca (IT), University of Naples Federico II (IT)
Decent work and economic growth
Openalex Percentile: Top 51%
Stock Market Forecasting Methods
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.