Research on hybrid attention sequential recommendation model based on discrete cosine transform frequency enhancement

Abstract Sequential recommendation systems aim to capture both short-term and long-term user preferences by modeling temporal patterns in user behavior. Recently, frequency-domain models have gained attention for their ability to capture global patterns efficiently. However, most existing methods rely on Fourier transforms, which are prone to Gibbs phenomenon when processing non-periodic signals, introducing high-frequency noise, and incurring substantial computational overhead due to complex-number operations. To overcome these issues, we propose Discrete Cosine transform-enhanced Hybrid Frequency-Attention Network for Sequential Recommendation (DCAN-Rec), a hybrid frequency-attention model that combines frequency information with self-attention to improve recommendation accuracy and reduce computation costs. Instead of Fourier transforms, DCAN-Rec uses discrete cosine transforms to optimize frequency-domain representations, reduce computational overhead, and mitigate high-frequency noise interference. It employs a learnable filter-based multilayer perceptron to separately extract features from high- and low-frequency components of user behavior. Experiments on seven real-world datasets show that DCAN-Rec effectively captures both global trends and local patterns in user sequences, consistently outperforming state-of-the-art methods. On average, DCAN-Rec improves performance by 16.29% over SASRec (Self-Attentive Sequential Recommendation), and also surpasses FMLPRec (Filter-Enhanced MLP for Sequential Recommendation) by 8.96%, FEARec (Frequency-Enhanced Hybrid Attention Network for Sequential Recommendation) by 3.99%, and DuoRec (Contrastive Learning-Based Model for Alleviating Representation Degeneration in Sequential Recommendation) by 3.75%, demonstrating strong generalization and stability.

Authors

Institutions

Publication Details

Journal
The Computer Journal
Published
2026-01-05
DOI
https://doi.org/10.1093/comjnl/bxaf141
Primary Topic
Recommender Systems and Techniques
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Research on hybrid attention sequential recommendation model based on discrete cosine transform frequency enhancement

Weiwei Li, Yancong Zhou, Kaiyue Zeng, Yiman Li
The Computer Journal
Recommender Systems and Techniques
article

Research on hybrid attention sequential recommendation model based on discrete cosine transform frequency enhancement

Weiwei Li, Yancong Zhou, Kaiyue Zeng, Yiman Li
article en

Abstract

Abstract Sequential recommendation systems aim to capture both short-term and long-term user preferences by modeling temporal patterns in user behavior. Recently, frequency-domain models have gained attention for their ability to capture global patterns efficiently. However, most existing methods rely on Fourier transforms, which are prone to Gibbs phenomenon when processing non-periodic signals, introducing high-frequency noise, and incurring substantial computational overhead due to complex-number operations. To overcome these issues, we propose Discrete Cosine transform-enhanced Hybrid Frequency-Attention Network for Sequential Recommendation (DCAN-Rec), a hybrid frequency-attention model that combines frequency information with self-attention to improve recommendation accuracy and reduce computation costs. Instead of Fourier transforms, DCAN-Rec uses discrete cosine transforms to optimize frequency-domain representations, reduce computational overhead, and mitigate high-frequency noise interference. It employs a learnable filter-based multilayer perceptron to separately extract features from high- and low-frequency components of user behavior. Experiments on seven real-world datasets show that DCAN-Rec effectively captures both global trends and local patterns in user sequences, consistently outperforming state-of-the-art methods. On average, DCAN-Rec improves performance by 16.29% over SASRec (Self-Attentive Sequential Recommendation), and also surpasses FMLPRec (Filter-Enhanced MLP for Sequential Recommendation) by 8.96%, FEARec (Frequency-Enhanced Hybrid Attention Network for Sequential Recommendation) by 3.99%, and DuoRec (Contrastive Learning-Based Model for Alleviating Representation Degeneration in Sequential Recommendation) by 3.75%, demonstrating strong generalization and stability.

The Computer Journal
Tianjin University of Commerce (CN), Zhejiang University of Science and Technology (CN), Zhejiang University of Technology (CN), Zhejiang University (CN)
Openalex Percentile: Top 98%
Recommender Systems and Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.