Improved DeepCross AttentionNet for Recommendation Systems via Semantic Feature Transformation

The Deep & Cross Network (DCN) and its derivative models have become important paradigms for click-through rate (CTR) prediction due to their efficient and superior performance. CTR prediction is one of the core tasks in recommendation systems, as it directly impacts users' interest and engagement with recommended content. Existing DCN models rely on explicit feature interaction methods, which heavily depend on feature quality. However, in prediction tasks with low-quality features, especially those with large amounts of sparse input, these interactions often introduce significant noise and may not be efficient in learning all types of feature crosses.This paper proposes an improved Deep Cross Network, named DeepCross AttentionNet (DCAnet), which retains the advantages of the DCN model while introducing a novel attention-based cross network designed to more effectively learn specific feature interactions. In particular, DeepCross AttentionNet (DCAnet) enhances the representation of sparse features through semantic feature [3] transformation. By converting sparse features into more informative semantic features, this approach not only enables the model to more accurately capture complex feature relationships but also significantly improves the accuracy of CTR prediction. We evaluated the CTR model in practical applications for recommendation systems, and the experimental results demonstrate that our approach outperforms many competitive models in our real-world recommendation system.

Authors

Institutions

Publication Details

Published
2024-09-20
DOI
https://doi.org/10.1109/eit63098.2024.10762570
Primary Topic
Recommender Systems and Techniques
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Improved DeepCross AttentionNet for Recommendation Systems via Semantic Feature Transformation

Wei Dong, Guangjun Shi, Xiaohui Rong
Recommender Systems and Techniques
article

Improved DeepCross AttentionNet for Recommendation Systems via Semantic Feature Transformation

Wei Dong, Guangjun Shi, Xiaohui Rong
article en

Abstract

The Deep & Cross Network (DCN) and its derivative models have become important paradigms for click-through rate (CTR) prediction due to their efficient and superior performance. CTR prediction is one of the core tasks in recommendation systems, as it directly impacts users' interest and engagement with recommended content. Existing DCN models rely on explicit feature interaction methods, which heavily depend on feature quality. However, in prediction tasks with low-quality features, especially those with large amounts of sparse input, these interactions often introduce significant noise and may not be efficient in learning all types of feature crosses.This paper proposes an improved Deep Cross Network, named DeepCross AttentionNet (DCAnet), which retains the advantages of the DCN model while introducing a novel attention-based cross network designed to more effectively learn specific feature interactions. In particular, DeepCross AttentionNet (DCAnet) enhances the representation of sparse features through semantic feature [3] transformation. By converting sparse features into more informative semantic features, this approach not only enables the model to more accurately capture complex feature relationships but also significantly improves the accuracy of CTR prediction. We evaluated the CTR model in practical applications for recommendation systems, and the experimental results demonstrate that our approach outperforms many competitive models in our real-world recommendation system.

Chinese Academy of Sciences (CN), Computer Network Information Center (CN)
Chinese Academy of Sciences
Openalex Percentile: Top 60%
Recommender Systems and Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.