A Multimodal Time-Series Forecasting Framework Integrating Wavelet Transform and Semantic Embedding for Intelligent Monitoring Systems

Intelligent monitoring systems in domains such as renewable energy, electrical grid management, and environmental sensing continuously generate high-dimensional multivariate time-series data characterized by non-stationarity and multi-scale temporal dependencies. Accurate long-term forecasting of system parameters is essential for proactive maintenance, operational scheduling, and cost reduction, yet many existing models rely solely on numerical sequences and lack mechanisms to incorporate higher-level contextual information. This study proposes a multimodal long-term forecasting framework that integrates frequency-aware signal decomposition with semantic-enhanced representation learning. The framework comprises four components: (1) a wavelet-based feature extraction module that captures multi-scale periodic patterns through energy-guided frequency selection; (2) a semantic feature extraction module that encodes statistical summaries of the input into language embeddings via a pretrained language model; (3) a cross-attention fusion module that dynamically aligns temporal and semantic representations; and (4) a multi-scale MLP ensemble for robust prediction. Experiments on three benchmark datasets—Solar Power, ETTh1, and Weather—show that the framework achieves competitive accuracy against strong baselines, including PatchTST and iTransformer, with its strongest results on data exhibiting complex multi-scale seasonal structure, where it attains the second-best mean squared error on the Weather dataset. A controlled ablation isolating the pretrained embedding from a direct numerical encoding of the same statistics indicates a small, dataset-specific benefit that is comparable in magnitude to seed-to-seed variation. Overall, the proposed framework provides a modular and interpretable architecture combining frequency-aware and semantic-aware processing for intelligent system management.

Authors

Institutions

Publication Details

Journal
Applied System Innovation
Published
2026-08-28
DOI
https://doi.org/10.3390/asi9090178
Primary Topic
Traffic Prediction and Management Techniques
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A Multimodal Time-Series Forecasting Framework Integrating Wavelet Transform and Semantic Embedding for Intelligent Monitoring Systems

Sheng-Tzong Cheng, Jun-Ting Lin, Tzu-Yi Chiu
Applied System Innovation
Traffic Prediction and Management Techniques
article

A Multimodal Time-Series Forecasting Framework Integrating Wavelet Transform and Semantic Embedding for Intelligent Monitoring Systems

Sheng-Tzong Cheng, Jun-Ting Lin, Tzu-Yi Chiu
article en

Abstract

Intelligent monitoring systems in domains such as renewable energy, electrical grid management, and environmental sensing continuously generate high-dimensional multivariate time-series data characterized by non-stationarity and multi-scale temporal dependencies. Accurate long-term forecasting of system parameters is essential for proactive maintenance, operational scheduling, and cost reduction, yet many existing models rely solely on numerical sequences and lack mechanisms to incorporate higher-level contextual information. This study proposes a multimodal long-term forecasting framework that integrates frequency-aware signal decomposition with semantic-enhanced representation learning. The framework comprises four components: (1) a wavelet-based feature extraction module that captures multi-scale periodic patterns through energy-guided frequency selection; (2) a semantic feature extraction module that encodes statistical summaries of the input into language embeddings via a pretrained language model; (3) a cross-attention fusion module that dynamically aligns temporal and semantic representations; and (4) a multi-scale MLP ensemble for robust prediction. Experiments on three benchmark datasets—Solar Power, ETTh1, and Weather—show that the framework achieves competitive accuracy against strong baselines, including PatchTST and iTransformer, with its strongest results on data exhibiting complex multi-scale seasonal structure, where it attains the second-best mean squared error on the Weather dataset. A controlled ablation isolating the pretrained embedding from a direct numerical encoding of the same statistics indicates a small, dataset-specific benefit that is comparable in magnitude to seed-to-seed variation. Overall, the proposed framework provides a modular and interpretable architecture combining frequency-aware and semantic-aware processing for intelligent system management.

Applied System InnovationVol. 9(9)
National Taitung University (TW), National Cheng Kung University (TW)
Affordable and clean energy
Openalex Percentile: Top 13%
Traffic Prediction and Management Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.