Adaptive multi-embedding fusion via denoising bidirectional mamba for sequential recommendation

Sequential recommendation aims to predict users’ next interactions based on their historical behavior. However, existing models suffer from three major limitations: (1) reliance solely on collaborative filtering signals while overlooking item semantic information; (2) vulnerability to high-frequency noise in behavior sequences, which interferes with representation learning; and (3) computational inefficiency in Transformer-based bidirectional architectures. To address these challenges, we propose AFNBM (Adaptive Fusion via Noise-filtered Bidirectional Mamba), a novel framework that introduces three key innovations. First, we develop an adaptive semantic-collaborative fusion module that leverages pre-trained language models to extract item semantic embeddings and integrates them with collaborative embeddings through learnable parameters $$\varvec{\alpha }$$ and $$\varvec{\beta }$$. This mechanism effectively mitigates data sparsity and cold-start problems. Second, we integrate selective frequency modulation (SFM) into a bidirectional Mamba encoder, making this the first work to combine frequency-domain adaptive denoising with state space models (SSMs) for sequential recommendation. The bidirectional encoder captures temporal dependencies in both directions during training while the Mamba blocks themselves maintain linear complexity $$\varvec{O(L)}$$. Each Mamba block incorporates an SFM layer with learnable parameter $$\varvec{\gamma }$$, enabling adaptive control over high-frequency component retention. The SFM operation introduces an $$\varvec{O(L \log L)}$$ factor, making the overall framework complexity $$\varvec{O(L \log L)}$$, which remains significantly more efficient than Transformer-based models with $$\varvec{O(L}^{\varvec{2}}\varvec{)}$$ complexity while simultaneously improving computational efficiency and noise robustness. Third, we construct a comprehensive end-to-end framework built upon the adaptive fusion and bidirectional Mamba-SFM architecture. For prediction, we employ a gated linear unit (GLU) to selectively enhance salient features, followed by a masked-terminal prediction layer. Extensive experiments validate the effectiveness of our design: ablation studies quantify each component’s contribution (e.g., GLU yields +2.2% to +5.2% gains across datasets), while AFNBM achieves 1.02%-11.76% improvements in Hit@10 and 2.84%-7.57% improvements in NDCG@10 over state-of-the-art baselines across four benchmark datasets, with particularly strong results on sparse and cold-start scenarios.

Authors

Institutions

Publication Details

Journal
Journal of King Saud University - Computer and Information Sciences
Published
2026-03-16
DOI
https://doi.org/10.1007/s44443-026-00562-4
Primary Topic
Recommender Systems and Techniques
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Adaptive multi-embedding fusion via denoising bidirectional mamba for sequential recommendation

Quan Wen, Yi Huang, Yang Hu, Cheng Wang et al.
Journal of King Saud University - Computer and Information Sciences
Recommender Systems and Techniques
article

Adaptive multi-embedding fusion via denoising bidirectional mamba for sequential recommendation

Quan Wen, Yi Huang, Yang Hu, Cheng Wang, Tongfei Zeng
article en

Abstract

Sequential recommendation aims to predict users’ next interactions based on their historical behavior. However, existing models suffer from three major limitations: (1) reliance solely on collaborative filtering signals while overlooking item semantic information; (2) vulnerability to high-frequency noise in behavior sequences, which interferes with representation learning; and (3) computational inefficiency in Transformer-based bidirectional architectures. To address these challenges, we propose AFNBM (Adaptive Fusion via Noise-filtered Bidirectional Mamba), a novel framework that introduces three key innovations. First, we develop an adaptive semantic-collaborative fusion module that leverages pre-trained language models to extract item semantic embeddings and integrates them with collaborative embeddings through learnable parameters $$\varvec{\alpha }$$ and $$\varvec{\beta }$$. This mechanism effectively mitigates data sparsity and cold-start problems. Second, we integrate selective frequency modulation (SFM) into a bidirectional Mamba encoder, making this the first work to combine frequency-domain adaptive denoising with state space models (SSMs) for sequential recommendation. The bidirectional encoder captures temporal dependencies in both directions during training while the Mamba blocks themselves maintain linear complexity $$\varvec{O(L)}$$. Each Mamba block incorporates an SFM layer with learnable parameter $$\varvec{\gamma }$$, enabling adaptive control over high-frequency component retention. The SFM operation introduces an $$\varvec{O(L \log L)}$$ factor, making the overall framework complexity $$\varvec{O(L \log L)}$$, which remains significantly more efficient than Transformer-based models with $$\varvec{O(L}^{\varvec{2}}\varvec{)}$$ complexity while simultaneously improving computational efficiency and noise robustness. Third, we construct a comprehensive end-to-end framework built upon the adaptive fusion and bidirectional Mamba-SFM architecture. For prediction, we employ a gated linear unit (GLU) to selectively enhance salient features, followed by a masked-terminal prediction layer. Extensive experiments validate the effectiveness of our design: ablation studies quantify each component’s contribution (e.g., GLU yields +2.2% to +5.2% gains across datasets), while AFNBM achieves 1.02%-11.76% improvements in Hit@10 and 2.84%-7.57% improvements in NDCG@10 over state-of-the-art baselines across four benchmark datasets, with particularly strong results on sparse and cold-start scenarios.

Journal of King Saud University - Computer and Information Sciences
Chengdu University of Technology (CN)
Openalex Percentile: Top 22%
Recommender Systems and Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.