Computational Modeling of Mental Health Checkup with Response-Based Characterization Using a Smart Mirror

In this study, we developed a smart mirror device for continuous mental health checkup based on individual response characteristics through simple and short dialogue interaction on a daily basis. Early detection and intervention have a predominant impact on remission in many cases of mental illness, and daily monitoring is essential for early detection. However, existing methods require time-consuming and burdensome measurements and rely on information obtained from patients' experiences, communication, and physical findings for diagnosis. We propose a mental health checkup system that uses supervised learning to model physician's evaluation based on the response characteristics of individuals during short dialogue interaction with the smart mirror. A validation experiment with 10 participants was conducted for two weeks, and the results showed that mental health checkups by physician was successfully reproduced with the proposed algorithm. In conclusion, this study demonstrates the potential of Smart Mirror for mental health checkup in daily life. It provides a potentially more objective and non-invasive method for early detection and monitoring, which could contribute to gradual improvements in mental healthcare.