Multimodal Sensing for Enhanced User Experience and Well-being

Explores a machine learning approach for emotion detection and music recommendation. The system leverages facial expressions to infer a user's emotional state and recommends music tailored to that emotion.The project involves:Data Acquisition and Preprocessing: Collecting and preparing a dataset of facial expressions with corresponding emotional labels.Convolutional Neural Network (CNN) Development: Training a CNN model to identify emotions from facial expressions captured through a webcam or video feed.Music Recommendation Model Development: Creating and training a model using music features (tempo, rhythm, melody) and corresponding emotional labels to recommend suitable music.Integration and Deployment: Deploying the emotion detection and music recommendation models into a software application. The application captures the user's facial expressions, detects emotions, and recommends music based on the detected emotion.Evaluation and Maintenance: Continuously monitoring the system's performance and retraining the models for improved accuracy over time.This work contributes to the development of affective computing applications by demonstrating the use of machine learning for emotion detection and personalized music recommendations.

Authors

Publication Details

Published
2025-04-23
DOI
https://doi.org/10.1109/raeeucci63961.2025.11048232
Primary Topic
Human-Automation Interaction and Safety
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Multimodal Sensing for Enhanced User Experience and Well-being

P.N. Ram Kumar, Karthik Pai B H, Vivek Kumar, Konwar Uttam et al.
1 links
Human-Automation Interaction and Safety
article

Multimodal Sensing for Enhanced User Experience and Well-being

P.N. Ram Kumar, Karthik Pai B H, Vivek Kumar, Konwar Uttam, Vinutha Shetty, Yash Raj Kanchiraya
article en

Abstract

Explores a machine learning approach for emotion detection and music recommendation. The system leverages facial expressions to infer a user's emotional state and recommends music tailored to that emotion.The project involves:Data Acquisition and Preprocessing: Collecting and preparing a dataset of facial expressions with corresponding emotional labels.Convolutional Neural Network (CNN) Development: Training a CNN model to identify emotions from facial expressions captured through a webcam or video feed.Music Recommendation Model Development: Creating and training a model using music features (tempo, rhythm, melody) and corresponding emotional labels to recommend suitable music.Integration and Deployment: Deploying the emotion detection and music recommendation models into a software application. The application captures the user's facial expressions, detects emotions, and recommends music based on the detected emotion.Evaluation and Maintenance: Continuously monitoring the system's performance and retraining the models for improved accuracy over time.This work contributes to the development of affective computing applications by demonstrating the use of machine learning for emotion detection and personalized music recommendations.

Openalex Percentile: Top 83%
Human-Automation Interaction and Safety
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.