Hierarchical Multimodal LLMs with Semantic Space Alignment for Enhanced Time Series Classification

Time series classification plays a fundamental role in a wide range of real-world applications. Recently, large language models (LLMs) have demonstrated strong generalization and reasoning capacities, but directly applying them to time series classification remains non-trivial due to the representation gap between numerical sequences and linguistic semantics. In this paper, we propose HiTime, a hierarchical LLM-based framework for multimodal time series classification that bridges structured temporal representations with semantic reasoning in a generative paradigm. Specifically, we design a hierarchical sequence feature encoding module composed of a data-specific encoder and a task-specific encoder to extract complementary temporal features. To mitigate the embedding gap between time series representations and textual semantics, we further introduce a semantic space alignment module that jointly performs coarse-grained global modeling and fine-grained cross-modal correspondence. Building upon the above representations, we employ a parameter-efficient supervised fine-tuning strategy to activate the generative classification capability of the algined LLMs, thereby transforming conventional discriminative time series classification into a generative task. Extensive experiments on multiple benchmarks demonstrate that the proposed framework consistently outperforms state-of-the-art baselines 1 .

Authors

Institutions

Publication Details

Journal
ACM Transactions on Intelligent Systems and Technology
Published
2025-12-30
DOI
https://doi.org/10.1145/3785505
Citations
1
Primary Topic
Time Series Analysis and Forecasting
Type
article
Field-Weighted Citation Impact
1.49
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Hierarchical Multimodal LLMs with Semantic Space Alignment for Enhanced Time Series Classification

Yucong Luo, Xiaoyu Tao, Mingyue Cheng, Enhong Chen Enhong Chen et al.
1 citations
ACM Transactions on Intelligent Systems and Technology
Time Series Analysis and Forecasting
1.49
article

Hierarchical Multimodal LLMs with Semantic Space Alignment for Enhanced Time Series Classification

Yucong Luo, Xiaoyu Tao, Mingyue Cheng, Enhong Chen Enhong Chen, Tingyue Pan, Qi Liu
article en
1 citations

Abstract

Time series classification plays a fundamental role in a wide range of real-world applications. Recently, large language models (LLMs) have demonstrated strong generalization and reasoning capacities, but directly applying them to time series classification remains non-trivial due to the representation gap between numerical sequences and linguistic semantics. In this paper, we propose HiTime, a hierarchical LLM-based framework for multimodal time series classification that bridges structured temporal representations with semantic reasoning in a generative paradigm. Specifically, we design a hierarchical sequence feature encoding module composed of a data-specific encoder and a task-specific encoder to extract complementary temporal features. To mitigate the embedding gap between time series representations and textual semantics, we further introduce a semantic space alignment module that jointly performs coarse-grained global modeling and fine-grained cross-modal correspondence. Building upon the above representations, we employ a parameter-efficient supervised fine-tuning strategy to activate the generative classification capability of the algined LLMs, thereby transforming conventional discriminative time series classification into a generative task. Extensive experiments on multiple benchmarks demonstrate that the proposed framework consistently outperforms state-of-the-art baselines 1 .

ACM Transactions on Intelligent Systems and Technology
University of Science and Technology of China (CN)
Reduced inequalities
Openalex Percentile: Top 12%
Time Series Analysis and Forecasting
1.49
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Hierarchical Multimodal LLMs with Semantic Space Alignment for Enhanced Time Series Classification — Yucong Luo, Xiaoyu Tao, et al. · ACM Transactions on Intelligent Systems and Technology (2025) | TGRS Research Map | TGRS