Development of a Web-Based Music Recommendation System Based on Facial Expression Using a Convolutional Neural Networks Model

This research presents the development of a web-based music recommendation system that uses facial expression recognition to match songs with users' emotional states. Real-time facial detection and expression classification are conducted in the browser using two CNN models implemented via the face-api.js library. Each classified expression is mapped to a specific music genre, and relevant songs are retrieved using the SoundCloud API. The system was evaluated through two aspects, accuracy and user satisfaction. Accuracy was measured using a dichotomous questionnaire, with results showing that 91% of users agreed that the recommended songs reflected their current emotions. User satisfaction was also assessed using a similar questionnaire and reached 86%, indicating a high level of comfort and relevance in the user experience. Compared to previous studies that used Likert scales, this study offers a different yet equally effective evaluation approach. The findings suggest that integrating facial expression recognition into music recommendation systems can provide a practical and user-friendly way to support emotional regulation through music.

Authors

Institutions

Publication Details

Journal
Journal of Electrical Technology UMY
Published
2025-06-30
DOI
https://doi.org/10.18196/jet.v9i1.27805
Primary Topic
Emotion and Mood Recognition
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Development of a Web-Based Music Recommendation System Based on Facial Expression Using a Convolutional Neural Networks Model

Fridy Mandita, Dimas Aditya Putra Wardhana, Muhammad Hidayat, Elvianto Dwi Hartono et al.
Journal of Electrical Technology UMY
Emotion and Mood Recognition
article

Development of a Web-Based Music Recommendation System Based on Facial Expression Using a Convolutional Neural Networks Model

Fridy Mandita, Dimas Aditya Putra Wardhana, Muhammad Hidayat, Elvianto Dwi Hartono, Dwi Hendra Rosli, Bima Putra Purnawirawan
article en

Abstract

This research presents the development of a web-based music recommendation system that uses facial expression recognition to match songs with users' emotional states. Real-time facial detection and expression classification are conducted in the browser using two CNN models implemented via the face-api.js library. Each classified expression is mapped to a specific music genre, and relevant songs are retrieved using the SoundCloud API. The system was evaluated through two aspects, accuracy and user satisfaction. Accuracy was measured using a dichotomous questionnaire, with results showing that 91% of users agreed that the recommended songs reflected their current emotions. User satisfaction was also assessed using a similar questionnaire and reached 86%, indicating a high level of comfort and relevance in the user experience. Compared to previous studies that used Likert scales, this study offers a different yet equally effective evaluation approach. The findings suggest that integrating facial expression recognition into music recommendation systems can provide a practical and user-friendly way to support emotional regulation through music.

Journal of Electrical Technology UMYVol. 9(1)
Universitas 17 Agustus 1945 Surabaya (ID)
Openalex Percentile: Top 77%
Emotion and Mood Recognition
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.