An Initial Study of Practicing Psychologists' Views of the Utility of Ecological Momentary Assessment for Difficult Psychotherapy Cases

Implementation of an Ecological Momentary Assessment (EMA) in Naturalistic Psychotherapy Settings: Qualitative Insights from Patients, Therapists, and Supervisors Perspectives

Ecological momentary assessment (EMA) allows measuring intra-individual processes moment by moment, identifying and modeling, in a naturalistic way, individual levels and changes in different psychological processes. However, active EMA requires a high degree of adherence, as it implies a significant burden for patients. Moreover, there is still no consensus on standardized procedures for implementation. There have been few results in detecting desirable characteristics for the design and implementation of an EMA device. Studies that address these issues from the perspectives of participants in psychotherapeutic processes are needed. To analyze the perspectives of patients, therapists and supervisors on the implementation of an EMA device in a psychotherapeutic treatment for depression. The sample will include eight patients, eleven therapists and five supervisors, taken from a research project that implemented an EMA system for monitoring the dynamics of affectivity at the beginning of psychotherapies for depression. Semi-structured interviews specific to each group are being conducted and analyzed from a qualitative approach based on consensual qualitative research (CQR). Participants reported having a positive evaluation of the study's informational resources and implementation. Difficulties were expressed in responding in the morning hours and the importance of having a customized EMA that is tailored to the needs of the patients was expressed. Furthermore, patients and therapists agreed that the impact of the use of the monitoring system on treatment was neutral or positive. In contrast, patients considered the EMA to be positive for their daily life.

Using the experience sampling method to support clinical practice: An illustration with problematic cannabis use

The experience sampling method (ESM) has been frequently used in clinical research; however, there is low translational uptake in clinical practice. This may be due to challenges with interpreting individual-level data at granular intervals. We provide an illustrative example of how ESM can be leveraged to generate personalized cognitive-behavioral strategies for problematic cannabis use.

We conducted a descriptive case series analysis using ESM data from 30 individuals reporting on problematic cannabis use, craving, affect, and coping four times daily for 16-days (t = 64, T = 1,920).

Analyzing ESM data using descriptive statistics and visualizations from individuals with similar clinical and demographic profiles supported a diverse array of personalized clinical insights and recommendations for each case. These recommendations included psychoeducation regarding affect- and boredom-regulation strategies, functional analyses of occasions during which cannabis was not used, and discussions on how cannabis use intersects with one's personal values.

While many clinicians utilize measurement-based care, barriers have limited the incorporation of ESM towards personalized, data-informed approaches to treatment. We provide an illustrative example of how ESM data can be used to generate actionable treatment strategies for problematic cannabis use and highlight continued challenges with interpreting time-series data.

To Use or Not to Use: Exploring Therapists' Experiences with Pre-Treatment EMA-Based Personalized Feedback in the TheraNet Project

BACKGROUND

Using idiographic network models in psychotherapy has been a growing area of interest. However, little is known about the perceived clinical utility of network models. The present study aims to explore therapists' experiences with network model-based feedback within the context of the TheraNet Project.

METHODS

In total, 18 therapists who had received network-based feedback for at least 1 patient at least 2 months prior were invited to retrospective focus groups. The focus group questions related to how participation in the study influenced the therapeutic relationship, how the networks were used, and what might improve their clinical utility. The transcribed focus groups were analyzed descriptively using qualitative content analysis.

RESULTS

Most therapists mentioned using the feedback to support their existingtheir case concept, while fewer therapists discussed the feedback directly with the patients. Several barriers to using the feedback were discussed, as well as various suggestions for how to make it more clinically useful. Many therapists reported skepticism with regards to research in the outpatient training center in general, though they were also all pleasantly surprised by being involved, having their opinions heard, and showing a readiness to adapt research to their needs/abilities.

CONCLUSIONS

This study highlights the gap between researchers' and therapists' perceptions about what useful feedback should look like. The TheraNet therapists' interest in adapting the feedback and building more informative feedback systems signals a general openness to the implementation of clinically relevant research. We provide suggestions for future implementations of network-based feedback systems in the outpatient clinical training center setting.

Usability of the Experience Sampling Method in Specialized Mental Health Care: Pilot Evaluation Study

BACKGROUND

Mental health problems occur in interactions in daily life. Yet, it is challenging to bring contextual information into the therapy room. The experience sampling method (ESM) may facilitate this by assessing clients' thoughts, feelings, symptoms, and behaviors as they are experienced in everyday life. However, the ESM is still primarily used in research settings, with little uptake in clinical practice. One aspect that may facilitate clinical implementation concerns the use of ESM protocols, which involves providing practitioners with ready-to-use ESM questionnaires, sampling schemes, visualizations, and training.

OBJECTIVE

This pilot study's objective was to evaluate the usability of an ESM protocol for using the ESM in a specialized mental health care setting.

METHODS

We created the ESM protocol using the m-Path software platform and tested its usability in clinical practice. The ESM protocol consists of a dashboard for practitioners (ie, including the setup of the template and data visualizations) and an app for clients (ie, for completing the ESM questionnaires). A total of 8 practitioners and 17 clients used the ESM in practice between December 1, 2020, and July 31, 2021. Usability was assessed using questionnaires, ESM compliance rates, and semistructured interviews.

RESULTS

The usability was overall rated reasonable to good by practitioners (mean scores of usability items ranging from 5.33, SD 0.91, to 6.06, SD 0.73, on a scale ranging from 1 to 7). However, practitioners expressed difficulty in personalizing the template and reported insufficient guidelines on how to use the ESM in clinical practice. On average, clients completed 55% (SD 25%) of the ESM questionnaires. They rated the usability as reasonable to good, but their scores were slightly lower and more variable than those of the practitioners (mean scores of usability items ranging from 4.18, SD 1.70, to 5.94, SD 1.50 on a scale ranging from 1 to 7). Clients also voiced several concerns over the piloted ESM template, with some indicating no interest in the continued use of the ESM.

CONCLUSIONS

The findings suggest that using an ESM protocol may facilitate the implementation of the ESM as a mobile health assessment tool in psychiatry. However, additional adaptions should be made before further implementation. Adaptions include providing training on personalizing questionnaires, adding additional sampling scheme formats as well as an open-text field, and creating a dynamic data visualization interface. Future studies should also identify factors determining the suitability of the ESM for specific treatment goals among different client populations.

Clinician Opinions: Perceived Utility of and Barriers to Incorporating Pretreatment Ecological Momentary Assessment Into Clinical Care

Increasingly, clinicians have the option of including technological components into clinical care. However, little research has assessed clinicians' interest in utilizing technology in their clinical work. Here, clinicians reported their opinions related to using a mobile assessment platform (MAP) to collect ecological data from clients before providing clinical care. Practicing and training mental health clinicians (N = 221) reported demographics, characteristics of their clinical work, and confidence in their clinical skill. Participants then read a description of MAP and responded to questions about their perceived benefits of and barriers to its use. Last, participants rated their interest in using MAP in their clinical work. These perceptions were then factor-analyzed and the resulting factor scores were regressed onto clinician characteristics. Interest in using MAP was significantly lower for the group that endorsed a psychodynamic/psychoanalytic orientation and those with greater confidence in their clinical skills. Across scales, we found a pattern that participants who did not identify as male, those with a psychodynamic/psychoanalytic orientation, and those with greater confidence in their clinical skills tended to have lower ratings of the benefits of and higher ratings for the barriers to using MAP. Results revealed that significant differences in opinions about incorporating technology into clinical work exist between different groups of clinicians. This information may be useful in future work that attempts to implement technological tools into clinical settings.

Practitioner and researcher perspectives on the utility of ecological momentary assessment in mental health care: A survey study

BACKGROUND

Ecological momentary assessment (EMA) is a scientific self-monitoring method to capture individuals' daily life experiences. Early on, EMA has been suggested to have the potential to improve mental health care. However, it remains unclear if and how EMA should be implemented. This requires an in-depth investigation of how practitioners and researchers view the implementation of EMA.

OBJECTIVE

Explore the perspectives of mental health practitioners and EMA researchers on the utility of EMA for mental health care.

METHODS

Practitioners (n = 89; psychiatrists, psychologists, psychiatric nurses) and EMA researchers (n = 62) completed a survey about EMA in clinical practice. This survey addressed EMA goals for practitioner and patient, requirements regarding clinical use of EMA, and (dis)advantages of EMA compared to treatment-as-usual. t-Tests were used to determine agreement with each statement and whether practitioners' and researchers' views differed significantly. Linear regression was used to explore predictors of goals and preferences (e.g., EMA experience).

RESULTS

Practitioners and researchers considered EMA to be a useful clinical tool for diverse stages of care. They indicated EMA to be most useful for gaining insight into the context specificity of symptoms (55.0 %), whereas receiving alerts when symptoms increase was rated the least useful (11.3 %, alerts is in 95 % of bootstrap iterations between rank 8 and 10). Compared to treatment-as-usual, EMA was considered easier to use (M = 4.87, t = 5.30, p < .001) and interpret (M = 4.52, t = 3.61, p < .001), but also more burdensome for the patient (M = 4.48, t = 3.17, p < .001). Although participants preferred personalization of the EMA diary, they also suggested that EMA should cost practitioners and patients limited time. The preference for creating personalized EMA was related to the level of experience with EMA. Finally, they highlighted the need for practitioner training and patient full-time access to the EMA feedback.

CONCLUSIONS

This survey study demonstrated that practitioners and researchers expect EMA to have added value for mental health care. Concrete recommendations for implementation of EMA are formulated. This may inform the development of specific clinical applications and user-friendly EMA software.

A Web-Based Application for Personalized Ecological Momentary Assessment in Psychiatric Care: User-Centered Development of the PETRA Application

BACKGROUND

Smartphone self-monitoring of mood, symptoms, and contextual factors through ecological momentary assessment (EMA) provides insights into the daily lives of people undergoing psychiatric treatment. Therefore, EMA has the potential to improve their care. To integrate EMA into treatment, a clinical tool that helps clients and clinicians create personalized EMA diaries and interpret the gathered data is needed.

OBJECTIVE

This study aimed to develop a web-based application for personalized EMA in specialized psychiatric care in close collaboration with all stakeholders (ie, clients, clinicians, researchers, and software developers).

METHODS

The participants were 52 clients with mood, anxiety, and psychotic disorders and 45 clinicians (psychiatrists, psychologists, and psychiatric nurses). We engaged them in interviews, focus groups, and usability sessions to determine the requirements for an EMA web application and repeatedly obtained feedback on iteratively improved high-fidelity EMA web application prototypes. We used human-centered design principles to determine important requirements for the web application and designed high-fidelity prototypes that were continuously re-evaluated and adapted.

RESULTS

The iterative development process resulted in Personalized Treatment by Real-time Assessment (PETRA), which is a scientifically grounded web application for the integration of personalized EMA in Dutch clinical care. PETRA includes a decision aid to support clients and clinicians with constructing personalized EMA diaries, an EMA diary item repository, an SMS text message-based diary delivery system, and a feedback module for visualizing the gathered EMA data. PETRA is integrated into electronic health record systems to ensure ease of use and sustainable integration in clinical care and adheres to privacy regulations.

CONCLUSIONS

PETRA was built to fulfill the needs of clients and clinicians for a user-friendly and personalized EMA tool embedded in routine psychiatric care. PETRA is unique in this codevelopment process, its extensive but user-friendly personalization options, its integration into electronic health record systems, its transdiagnostic focus, and its strong scientific foundation in the design of EMA diaries and feedback. The clinical effectiveness of integrating personalized diaries via PETRA into care requires further research. As such, PETRA paves the way for a systematic investigation of the utility of personalized EMA for routine mental health care.

Remote Digital Psychiatry for Mobile Mental Health Assessment and Therapy: MindLogger Platform Development Study

Background

Universal access to assessment and treatment of mental health and learning disorders remains a significant and unmet need. There are many people without access to care because of economic, geographic, and cultural barriers, as well as the limited availability of clinical experts who could help advance our understanding and treatment of mental health.

Objective

This study aims to create an open, configurable software platform to build clinical measures, mobile assessments, tasks, and interventions without programming expertise. Specifically, our primary requirements include an administrator interface for creating and scheduling recurring and customized questionnaires where end users receive and respond to scheduled notifications via an iOS or Android app on a mobile device. Such a platform would help relieve overwhelmed health systems and empower remote and disadvantaged subgroups in need of accurate and effective information, assessment, and care. This platform has the potential to advance scientific research by supporting the collection of data with instruments tailored to specific scientific questions from large, distributed, and diverse populations.

Methods

We searched for products that satisfy these requirements. We designed and developed a new software platform called MindLogger, which exceeds the requirements. To demonstrate the platform’s configurability, we built multiple applets (collections of activities) within the MindLogger mobile app and deployed several of them, including a comprehensive set of assessments underway in a large-scale, longitudinal mental health study.

Results

Of the hundreds of products we researched, we found 10 that met our primary requirements with 4 that support end-to-end encryption, 2 that enable restricted access to individual users’ data, 1 that provides open-source software, and none that satisfy all three. We compared features related to information presentation and data capture capabilities; privacy and security; and access to the product, code, and data. We successfully built MindLogger mobile and web applications, as well as web browser–based tools for building and editing new applets and for administering them to end users. MindLogger has end-to-end encryption, enables restricted access, is open source, and supports a variety of data collection features. One applet is currently collecting data from children and adolescents in our mental health study, and other applets are in different stages of testing and deployment for use in clinical and research settings.

Conclusions

We demonstrated the flexibility and applicability of the MindLogger platform through its deployment in a large-scale, longitudinal, mobile mental health study and by building a variety of other mental health–related applets. With this release, we encourage a broad range of users to apply the MindLogger platform to create and test applets to advance health care and scientific research. We hope that increasing the availability of applets designed to assess and administer interventions will facilitate access to health care in the general population.

Positive and Negative Emotion Regulation in College Athletes: A Preliminary Exploration of Daily Savoring, Acceptance, and Cognitive Reappraisal

BACKGROUND

Despite increasing interest in positive psychological states, we know little about how regulatory responses to positive (savoring) compared to negative events (e.g. acceptance, cognitive reappraisal) influence emotional functioning. Savoring may be particularly helpful for athletes who are often trained to attend more to negative (e.g. rectifying weaknesses) compared to positive stimuli (e.g. enjoying progress).

METHODS

Sixty-seven college athletes completed a two-week daily diary study. Using multi-level modeling, we first explored whether various regulatory responses to daily negative events predicted unique variance in daily emotions (i.e. happy, content, grateful, sad, angry, annoyed). Next, we tested whether savoring positive events strengthened the association between event intensity and positive daily emotions. Finally, we tested whether regulatory responses to positive compared to negative events had stronger moderating (buffering) effects on the association between daily negative event intensity and daily emotions.

RESULTS

Based on 836 daily observations, reappraising and accepting negative events were the only strategies that predicted unique variance in daily emotions. Savoring enhanced positive emotions related to positive events. Reappraising negative events buffered associations between negative event intensity and decreased daily gratitude, while savoring positive events buffered associations between negative event intensity and increased anger, annoyance, and average negative emotions. Accepting negative events had similar effects.

CONCLUSIONS

Savoring positive events may be an underappreciated strategy for helping athletes regulate emotions related to negative events. Since our sample predominantly identified as white and female, further research is needed to understand savoring use and effectiveness among the full, diverse spectrum of college athletes.