Emotion-Driven Music Recommendation System Using Multimodal AI

Emotion plays a crucial role in influencing human preferences, particularly in music selection. This project presents an Emotion-Based Music Recommendation System that uses artificial intelligence to analyze a user’s emotional state and provide personalized music suggestions. The system supports text, voice, and video inputs, enabling multimodal emotion detection for improved accuracy. Text and voice inputs are processed using natural language processing and speech-to-text techniques (Whisper), while video inputs are analyzed using computer vision for facial emotion recognition. Based on the detected emotion, the system recommends suitable music tracks using Spotify and YouTube Music APIs. The application is developed using Streamlit, integrating deep learning models and external APIs to deliver an interactive and user-friendly experience. Overall, the system enhances personalization, user engagement, and emotional well-being, demonstrating the application of AI in affective computing and recommendation systems.

Authors

Publication Details

Journal
Iconic Research and Engineering Journals
Published
2026-03-26
DOI
https://doi.org/10.64388/irev9i9-1715489
Primary Topic
Music and Audio Processing
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Emotion-Driven Music Recommendation System Using Multimodal AI

Dr. S. Parthasarathy, Rahulraagav M R
Iconic Research and Engineering Journals
Music and Audio Processing
article

Emotion-Driven Music Recommendation System Using Multimodal AI

Dr. S. Parthasarathy, Rahulraagav M R
article en

Abstract

Emotion plays a crucial role in influencing human preferences, particularly in music selection. This project presents an Emotion-Based Music Recommendation System that uses artificial intelligence to analyze a user’s emotional state and provide personalized music suggestions. The system supports text, voice, and video inputs, enabling multimodal emotion detection for improved accuracy. Text and voice inputs are processed using natural language processing and speech-to-text techniques (Whisper), while video inputs are analyzed using computer vision for facial emotion recognition. Based on the detected emotion, the system recommends suitable music tracks using Spotify and YouTube Music APIs. The application is developed using Streamlit, integrating deep learning models and external APIs to deliver an interactive and user-friendly experience. Overall, the system enhances personalization, user engagement, and emotional well-being, demonstrating the application of AI in affective computing and recommendation systems.

Iconic Research and Engineering JournalsVol. 9(9)
Openalex Percentile: Top 6%
Music and Audio Processing
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.