MoodCam: Mood Prediction Through Smartphone-Based Facial Affect Analysis in Real-World Settings

Rahul Islam, Tongze Zhang, Sang Won Bae

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

MoodCam introduces a novel method for assessing mood by utilizing facial affect analysis through the front-facing camera of smartphones during everyday activities. We collected facial behavior primitives during 15,995 real-world phone interactions involving 25 participants over four weeks. We developed three models for timely intervention: momentary, daily average, and next day average. Notably, our models exhibit AUC scores ranging from 0.58 to 0.64 for Valence and 0.60 to 0.63 for Arousal. These scores are comparable to or better than those from some previous studies. This predictive ability suggests that MoodCam can effectively forecast mood trends, providing valuable insights for timely interventions and resource planning in mental health management. The results are promising as they demonstrate the viability of using real-time and predictive mood analysis to aid in mental health interventions and potentially offer preemptive support during critical periods identified through mood trend shifts.

Original languageEnglish
Title of host publicationProceedings - 2024 IEEE Smart World Congress, SWC 2024 - 2024 IEEE Ubiquitous Intelligence and Computing, Autonomous and Trusted Computing, Digital Twin, Metaverse, Privacy Computing and Data Security, Scalable Computing and Communications
Pages599-607
Number of pages9
ISBN (Electronic)9798331520861
DOIs
StatePublished - 2024
Event10th IEEE Smart World Congress, SWC 2024 - Nadi, Fiji
Duration: 2 Dec 20247 Dec 2024

Publication series

NameProceedings - 2024 IEEE Smart World Congress, SWC 2024 - 2024 IEEE Ubiquitous Intelligence and Computing, Autonomous and Trusted Computing, Digital Twin, Metaverse, Privacy Computing and Data Security, Scalable Computing and Communications

Conference

Conference10th IEEE Smart World Congress, SWC 2024
Country/TerritoryFiji
CityNadi
Period2/12/247/12/24

Keywords

  • Affective computing
  • Application Instrumentation
  • Empirical study that tells us about people
  • Field Study
  • Machine Learning
  • Mobile computing
  • Mood Detection
  • System

Fingerprint

Dive into the research topics of 'MoodCam: Mood Prediction Through Smartphone-Based Facial Affect Analysis in Real-World Settings'. Together they form a unique fingerprint.

Cite this