Integrating Facial Expression Recognition for Emotion Responsive Music Recommendations

Music has a profound impact on human emotions, enriching experiences and serving as a powerful means of expression. In contemporary times, the synergy between music and machine learning has revolutionized the way we engage with and explore musical experiences. This research delves into the intricate relationship between emotions and music, leveraging machine learning algorithms, culminating in an innovative emotion-based music recommendation system. This system employs facial emotion recognition (FER) as a key mechanism, harnessing the expressive canvas of the human face to decipher emotions accurately. The system integrates YOLOv4 for facial detection and the Humingbird library for emotion analysis. Leveraging a dataset comprising 278,000 Spotify songs labeled by emotion, the system recommends a Spotify song URL aligned with the user’s detected emotion. We also created a simple yet efficient interface for user interaction utilising streamlit web application tools. This system not only underscores the intricacies of emotional connections with music but also underscores the transformative potential of combining human expression with cutting-edge technology.

Authors

Institutions

Publication Details

Published
2024-11-23
DOI
https://doi.org/10.1109/icec59683.2024.10837091
Primary Topic
Music and Audio Processing
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Integrating Facial Expression Recognition for Emotion Responsive Music Recommendations

Ritu Rani, Garima Jaiswal, Arun Sharma, Anamika Kumari et al.
Music and Audio Processing
article

Integrating Facial Expression Recognition for Emotion Responsive Music Recommendations

Ritu Rani, Garima Jaiswal, Arun Sharma, Anamika Kumari, Aarushi Sahu, A. Goyal
article en

Abstract

Music has a profound impact on human emotions, enriching experiences and serving as a powerful means of expression. In contemporary times, the synergy between music and machine learning has revolutionized the way we engage with and explore musical experiences. This research delves into the intricate relationship between emotions and music, leveraging machine learning algorithms, culminating in an innovative emotion-based music recommendation system. This system employs facial emotion recognition (FER) as a key mechanism, harnessing the expressive canvas of the human face to decipher emotions accurately. The system integrates YOLOv4 for facial detection and the Humingbird library for emotion analysis. Leveraging a dataset comprising 278,000 Spotify songs labeled by emotion, the system recommends a Spotify song URL aligned with the user’s detected emotion. We also created a simple yet efficient interface for user interaction utilising streamlit web application tools. This system not only underscores the intricacies of emotional connections with music but also underscores the transformative potential of combining human expression with cutting-edge technology.

Ambedkar University Delhi (IN), Bennett University (IN), Indira Gandhi Delhi Technical University for Women (IN)
Reduced inequalities
Openalex Percentile: Top 72%
Music and Audio Processing
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Integrating Facial Expression Recognition for Emotion Responsive Music Recommendations — Ritu Rani, Garima Jaiswal, et al. · (2024) | TGRS Research Map | TGRS