MoodCam: Mood Prediction Through Smartphone-Based Facial Affect Analysis in Real-World Settings

MoodCam introduces a novel method for assessing mood by utilizing facial affect analysis through the front-facing camera of smartphones during everyday activities. We collected facial behavior primitives during 15,995 real-world phone interactions involving 25 participants over four weeks. We developed three models for timely intervention: momentary, daily average, and next day average. Notably, our models exhibit AUC scores ranging from 0.58 to 0.64 for Valence and 0.60 to 0.63 for Arousal. These scores are comparable to or better than those from some previous studies. This predictive ability suggests that MoodCam can effectively forecast mood trends, providing valuable insights for timely interventions and resource planning in mental health management. The results are promising as they demonstrate the viability of using real-time and predictive mood analysis to aid in mental health interventions and potentially offer preemptive support during critical periods identified through mood trend shifts.

Authors

Institutions

Publication Details

Published
2024-12-02
DOI
https://doi.org/10.1109/swc62898.2024.00112
Citations
3
Primary Topic
Emotion and Mood Recognition
Type
article
Field-Weighted Citation Impact
1.52
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

MoodCam: Mood Prediction Through Smartphone-Based Facial Affect Analysis in Real-World Settings

Tongze Zhang, Sang Won Bae, Rahul Islam
3 citations
Emotion and Mood Recognition
1.52
article

MoodCam: Mood Prediction Through Smartphone-Based Facial Affect Analysis in Real-World Settings

Tongze Zhang, Sang Won Bae, Rahul Islam
article en
3 citations

Abstract

MoodCam introduces a novel method for assessing mood by utilizing facial affect analysis through the front-facing camera of smartphones during everyday activities. We collected facial behavior primitives during 15,995 real-world phone interactions involving 25 participants over four weeks. We developed three models for timely intervention: momentary, daily average, and next day average. Notably, our models exhibit AUC scores ranging from 0.58 to 0.64 for Valence and 0.60 to 0.63 for Arousal. These scores are comparable to or better than those from some previous studies. This predictive ability suggests that MoodCam can effectively forecast mood trends, providing valuable insights for timely interventions and resource planning in mental health management. The results are promising as they demonstrate the viability of using real-time and predictive mood analysis to aid in mental health interventions and potentially offer preemptive support during critical periods identified through mood trend shifts.

Stevens Institute of Technology (US)
Openalex Percentile: Top 15%
Emotion and Mood Recognition
1.52
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

MoodCam: Mood Prediction Through Smartphone-Based Facial Affect Analysis in Real-World Settings — Tongze Zhang, Sang Won Bae, et al. · (2024) | TGRS Research Map | TGRS