Evaluating Deep Learning and Traditional Approaches in Recommender Systems

Currently, Recommendation systems (RS) have a major role in the selection and presentation of content related to the needs and interests of users. Because of this, we have benchmarked five models: Bayesian Personalized Ranking (BPR), Item-based k-Nearest Neighbors (ItemKNN), Item Popularity (ItemPop), Neural Collaborative Filtering (NCF), and TensorFlow Recommenders (TFRS). Using the Hit Ratio (HR) and Normalized Discounted Cumulative Gain (NDCG) metrics, our benchmark experiment, conducted on the MovieLens 1M and Goodreads datasets, finds the TFRS model to demonstrate superior accuracy and ranking efficiency compared to other models. TFRS consistently achieved the highest HR@K and NDCG@K scores, making it the most effective in capturing the complex relationships between users and items. While the deep learning models capture user-item interactions more effectively of the user-item interaction—BPR, NCF, and TFRS— their counterparts, non-deep learning models—ItemKNN, ItemPop—are faster but less effective in personalization. These insights guide the selection of the most suitable system for enhancing user engagement.

Authors

Institutions

Publication Details

Published
2024-11-14
DOI
https://doi.org/10.1109/incit63192.2024.10810580
Primary Topic
Recommender Systems and Techniques
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Evaluating Deep Learning and Traditional Approaches in Recommender Systems

Karn Yongsiriwit, Kitsanachai Kairassamee
Recommender Systems and Techniques
article

Evaluating Deep Learning and Traditional Approaches in Recommender Systems

Karn Yongsiriwit, Kitsanachai Kairassamee
article en

Abstract

Currently, Recommendation systems (RS) have a major role in the selection and presentation of content related to the needs and interests of users. Because of this, we have benchmarked five models: Bayesian Personalized Ranking (BPR), Item-based k-Nearest Neighbors (ItemKNN), Item Popularity (ItemPop), Neural Collaborative Filtering (NCF), and TensorFlow Recommenders (TFRS). Using the Hit Ratio (HR) and Normalized Discounted Cumulative Gain (NDCG) metrics, our benchmark experiment, conducted on the MovieLens 1M and Goodreads datasets, finds the TFRS model to demonstrate superior accuracy and ranking efficiency compared to other models. TFRS consistently achieved the highest HR@K and NDCG@K scores, making it the most effective in capturing the complex relationships between users and items. While the deep learning models capture user-item interactions more effectively of the user-item interaction—BPR, NCF, and TFRS— their counterparts, non-deep learning models—ItemKNN, ItemPop—are faster but less effective in personalization. These insights guide the selection of the most suitable system for enhancing user engagement.

Rangsit University (TH)
Quality Education
Openalex Percentile: Top 61%
Recommender Systems and Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.