A Deep Learning Framework for Sequence Mining with Bidirectional LSTM and Multi-Scale Attention

This article addresses the challenges of exploring potential patterns and modeling contextual dependencies in complex sequence data. By integrating short-term bidirectional memory (BiLSTM) with a multi-scale attention mechanism, a sequential pattern extraction algorithm has been proposed. BiLSTM sequentially captures forward and backward dependencies, improving the model's ability to perceive the structure of the overall context. At the same time, the Multi-Scale Attention Module assigns adaptive weights to key areas under different window sizes. This improves the model's responsiveness to important local and global information. In-depth experiments were conducted on publicly accessible multivariate time series data sets. The proposed model was compared to several common methods of sequence modeling. The results show that it outperforms existing models in terms of accuracy and recall. This confirms the efficiency and robustness of the proposed architecture in complex mode recognition tasks. Further ablation studies and sensitivity analyses were performed to study the effect of attention force tables and length of input sequences on model performance. These results provide empirical support for structural optimization of the model.

Authors

Institutions

Publication Details

Published
2025-04-18
DOI
https://doi.org/10.1145/3745676.3745751
Citations
7
Primary Topic
Data Mining Algorithms and Applications
Type
article
Field-Weighted Citation Impact
22.72
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A Deep Learning Framework for Sequence Mining with Bidirectional LSTM and Multi-Scale Attention

Minggu Wei, Honghui Xin, Yiting Ren, Yujia Lou et al.
7 citations
Data Mining Algorithms and Applications
22.72
article

A Deep Learning Framework for Sequence Mining with Bidirectional LSTM and Multi-Scale Attention

Minggu Wei, Honghui Xin, Yiting Ren, Yujia Lou, Tao Yang, Yu Cheng
article en
7 citations

Abstract

This article addresses the challenges of exploring potential patterns and modeling contextual dependencies in complex sequence data. By integrating short-term bidirectional memory (BiLSTM) with a multi-scale attention mechanism, a sequential pattern extraction algorithm has been proposed. BiLSTM sequentially captures forward and backward dependencies, improving the model's ability to perceive the structure of the overall context. At the same time, the Multi-Scale Attention Module assigns adaptive weights to key areas under different window sizes. This improves the model's responsiveness to important local and global information. In-depth experiments were conducted on publicly accessible multivariate time series data sets. The proposed model was compared to several common methods of sequence modeling. The results show that it outperforms existing models in terms of accuracy and recall. This confirms the efficiency and robustness of the proposed architecture in complex mode recognition tasks. Further ablation studies and sensitivity analyses were performed to study the effect of attention force tables and length of input sequences on model performance. These results provide empirical support for structural optimization of the model.

Northeastern University (US), Fordham University (US), City University of New York (US), Illinois Institute of Technology (US), University of Saskatchewan (CA), University of Rochester (US), Seattle University (US)
Openalex Percentile: Top 1%
Data Mining Algorithms and Applications
22.72
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

A Deep Learning Framework for Sequence Mining with Bidirectional LSTM and Multi-Scale Attention — Minggu Wei, Honghui Xin, et al. · (2025) | TGRS Research Map | TGRS