Factors Affecting Digital Tool Use in Client Interaction According to Mental Health Professionals: Interview Study

Measuring digital intervention user experience with a novel ecological momentary assessment (EMA) method, CORTO

Digital interventions often suffer from low usage, which may reflect insufficient attention to user experience. Moreover, the existing evaluation methods have limited applicability in the remote study of user experience of complex interventions that have expansive content and that are used over an extensive period of time. To alleviate these challenges, we describe here a novel qualitative Ecological Momentary Assessment (EMA) method: the CORTO method (Contextual, One-item, Repeated, Timely, Open-ended). We used it to gather digital intervention user experience data from Finnish adults (n = 184) who lived with interview-confirmed major depressive disorder (MDD) and took part in a randomized controlled trial (RCT) that studied the efficacy of a novel 12-week game-based digital intervention for depression. A second dataset on user experience was gathered with retrospective interviews (n = 22). We inductively coded the CORTO method and retrospective interview data, which led to four user experience categories: (1) contextual use, (2) interaction-elicited emotional experience, (3) usability, and (4) technical issues. Then, we used the created user experience categories and Template Analysis to analyze both datasets together, and reported the results qualitatively. Finally, we compared the two datasets with each other. We found that the data generated with the CORTO method offered more insights into usability and technical categories than the interview data that particularly illustrated the contextual use. The emotional valence of the interview data was more positive compared with the CORTO data. Both the CORTO and interview data detected 55 % of the micro-level categories; 20 % of micro-level categories were only detected by the CORTO data and 25 % only by the interview data. We found that the during-intervention user experience measurement with the CORTO method can provide intervention-specific insights, and thereby further the iterative user-centered intervention development. Overall, these findings highlight the impact of evaluation methods on the categories and qualities of insights acquired in intervention research.

Development, piloting and evaluation of an app-supported psychosocial prevention intervention to strengthen participation in working life: a study protocol of a mixed-methods approach

INTRODUCTION

Rates of incapacity to work due to mental disorders have increased in many European countries. The consequences of persistent stress can impact individuals' physical and psychological well-being and gradually develop into chronic stress. Mental disorders or symptoms of burn-out syndrome can have severe consequences. Mental disorders leading to work incapacity significantly burden the health system. Prevention interventions can protect against burn-out, depression, anxiety and other mental health disorders. Digital health is a promising approach to increase the utilisation of effective prevention interventions. This mixed-methods study evaluates a newly developed app-supported psychosocial prevention intervention called 'RV Fit Mental Health' to strengthen participation in working life.

METHODS AND ANALYSIS

The study uses a three-stage parallel mixed-methods design. This study accompanies the development (stage 1), piloting (stage 2) and evaluation (stage 3) of the new intervention. Within the stages, there is a quantitative as well as a qualitative research strand. Employed persons with an incipient mental disorder will be included. Additionally, experts within the project or connected areas will be included. Quantitative data will be analysed using multifactorial variance analyses in a pre-post design. Qualitative data will be analysed using qualitative content analysis. The study is a comprehensive research approach to investigate the development, piloting and evaluation of an app-supported psychosocial app-based prevention intervention. The rigour of the study will be achieved through data triangulation.

ETHICS AND DISSEMINATION

All participants will receive detailed study information and give written informed consent before data collection. Ethical approval was obtained from the Technical University of Munich Ethics Committee. All data collection will follow all legislative rules regarding data protection, also following the Declaration of Helsinki. The study results will be disseminated in peer-reviewed journals and presented at international conferences.

TRIAL REGISTRATION NUMBERS

DRKS00030818 and DRKS00033080.