Implementing a mental health app intervention in a university setting: multi-methods evaluation study

Purpose The number of university students seeking mental health support is rapidly increasing. To provide additional psychological support to students accessing well-being services, this study aimed to pilot a mental health Web application (app) called Orpheus®. Design/methodology/approach Guided by student consultations, a multi-methods approach was adopted, including an examination of in-app data, chart reviews of routinely collected student information and interviews with mental health practitioners. Usage data were analysed descriptively. Changes in mental health outcomes were examined using means, standard deviations and reliable change indices for anxiety and depression scores. Inductive and deductive thematic analysis was conducted on qualitative data from staff interviews and student feedback. Findings A total of 26 students registered an account with 39 completed app visits. On 37 of the 39 (94.9%) occasions, students reported reductions in the intensity of unwanted negative emotions. Statistically significant reductions in the average pooled anxiety and depression scores were observed. Of the 15 students who completed pre- and post-routine outcome measures, between 20% and 60% showed reliable and meaningful symptom improvements. Students reported that the app was helpful and easy to set up and use, with no adverse events. Practitioners highlighted barriers and facilitators related to the technology features, situational contexts and individual differences. Originality/value Integrating Orpheus in real-world settings resulted in promising implementation processes, potential for future uptake and positive outcomes. However, ongoing research, staff training and app testing are needed to further improve the implementation processes for digital mental health interventions.