From Logs to Language and Vision: A Review on Integrating Multimodal Data into Predictive Process Monitoring

Predictive Process Monitoring (PPM) forecasts future outcomes of business processes based on event logs. However, current approaches often overlook rich multimodal data – such as text, audio, video, and sensor inputs – that are increasingly generated in real-world settings. This paper presents a systematic literature review of 89 studies on multimodal data integration in PPM and related BPM tasks. We identify dominant modalities (e.g., sensor and text), methodological trends, and application domains, along with key challenges such as data fusion complexity, scarcity of labeled datasets, and model interpretability. At the same time, we highlight opportunities, including context-aware prediction, synthetic data augmentation, and real-time decision support. We propose future research directions which lay the foundation for advancing multimodal, intelligent BPM systems in complex environments.

Authors

Publication Details

Journal
ScholarSpace (University of Hawaii at Manoa)
Published
2025-12-23
Primary Topic
Business Process Modeling and Analysis
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

From Logs to Language and Vision: A Review on Integrating Multimodal Data into Predictive Process Monitoring

Holger Wittges, Alina Hafner, Noah Kim
ScholarSpace (University of Hawaii at Manoa)
Business Process Modeling and Analysis
article

From Logs to Language and Vision: A Review on Integrating Multimodal Data into Predictive Process Monitoring

Holger Wittges, Alina Hafner, Noah Kim
article en

Abstract

Predictive Process Monitoring (PPM) forecasts future outcomes of business processes based on event logs. However, current approaches often overlook rich multimodal data – such as text, audio, video, and sensor inputs – that are increasingly generated in real-world settings. This paper presents a systematic literature review of 89 studies on multimodal data integration in PPM and related BPM tasks. We identify dominant modalities (e.g., sensor and text), methodological trends, and application domains, along with key challenges such as data fusion complexity, scarcity of labeled datasets, and model interpretability. At the same time, we highlight opportunities, including context-aware prediction, synthetic data augmentation, and real-time decision support. We propose future research directions which lay the foundation for advancing multimodal, intelligent BPM systems in complex environments.

ScholarSpace (University of Hawaii at Manoa)
Openalex Percentile: Top 25%
Business Process Modeling and Analysis
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.