Syncing Music With Emotions Using Computer Vision

With more consumers turning to digital platforms to find new music, music recommendation engines have become popular in recent years. Nevertheless, most recommendation engines rely on collaborative filtering methods or a user's historical listening habits, which might not fully represent the user's emotional state or mood. This study suggests a music recommendation engine integrating emotion recognition to deliver more individualized recommendations. The proposed system analyzes the user's tone of voice and facial expressions using machine-learning algorithms to identify enthusiasm, rage, sadness, and happiness. A playlist is then generated by mapping the user's emotional state to a series of musical parameters, such as key, pace, and rhythm. When the system was tested with a dataset of user-generated music playlists, it could predict the user's emotional state with more than 60% accuracy. Additionally, consumers expressed a generally favorable opinion of the suggested playlists, saying they had been introduced to new music they enjoyed and that the playlists had appropriately mirrored their current emotional state. The future scope of this study is to cater to diverse audiences with varying tastes in music and language.

Authors

Publication Details

Published
2024-08-08
DOI
https://doi.org/10.1109/iccpct61902.2024.10672743
Primary Topic
Emotion and Mood Recognition
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Syncing Music With Emotions Using Computer Vision

J. Selvin Paul Peter, Sai Harshith Tedla, Raman Shekhawat, Priya Esther B
Emotion and Mood Recognition
article

Syncing Music With Emotions Using Computer Vision

J. Selvin Paul Peter, Sai Harshith Tedla, Raman Shekhawat, Priya Esther B
article en

Abstract

With more consumers turning to digital platforms to find new music, music recommendation engines have become popular in recent years. Nevertheless, most recommendation engines rely on collaborative filtering methods or a user's historical listening habits, which might not fully represent the user's emotional state or mood. This study suggests a music recommendation engine integrating emotion recognition to deliver more individualized recommendations. The proposed system analyzes the user's tone of voice and facial expressions using machine-learning algorithms to identify enthusiasm, rage, sadness, and happiness. A playlist is then generated by mapping the user's emotional state to a series of musical parameters, such as key, pace, and rhythm. When the system was tested with a dataset of user-generated music playlists, it could predict the user's emotional state with more than 60% accuracy. Additionally, consumers expressed a generally favorable opinion of the suggested playlists, saying they had been introduced to new music they enjoyed and that the playlists had appropriately mirrored their current emotional state. The future scope of this study is to cater to diverse audiences with varying tastes in music and language.

Vol. 7
Openalex Percentile: Top 80%
Emotion and Mood Recognition
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Syncing Music With Emotions Using Computer Vision — J. Selvin Paul Peter, Sai Harshith Tedla, et al. · (2024) | TGRS Research Map | TGRS