Implementing Experience Sampling Technology for Functional Analysis in Family Medicine - A Design Thinking Approach

Usability of the Experience Sampling Method in Specialized Mental Health Care: Pilot Evaluation Study

BACKGROUND

Mental health problems occur in interactions in daily life. Yet, it is challenging to bring contextual information into the therapy room. The experience sampling method (ESM) may facilitate this by assessing clients' thoughts, feelings, symptoms, and behaviors as they are experienced in everyday life. However, the ESM is still primarily used in research settings, with little uptake in clinical practice. One aspect that may facilitate clinical implementation concerns the use of ESM protocols, which involves providing practitioners with ready-to-use ESM questionnaires, sampling schemes, visualizations, and training.

OBJECTIVE

This pilot study's objective was to evaluate the usability of an ESM protocol for using the ESM in a specialized mental health care setting.

METHODS

We created the ESM protocol using the m-Path software platform and tested its usability in clinical practice. The ESM protocol consists of a dashboard for practitioners (ie, including the setup of the template and data visualizations) and an app for clients (ie, for completing the ESM questionnaires). A total of 8 practitioners and 17 clients used the ESM in practice between December 1, 2020, and July 31, 2021. Usability was assessed using questionnaires, ESM compliance rates, and semistructured interviews.

RESULTS

The usability was overall rated reasonable to good by practitioners (mean scores of usability items ranging from 5.33, SD 0.91, to 6.06, SD 0.73, on a scale ranging from 1 to 7). However, practitioners expressed difficulty in personalizing the template and reported insufficient guidelines on how to use the ESM in clinical practice. On average, clients completed 55% (SD 25%) of the ESM questionnaires. They rated the usability as reasonable to good, but their scores were slightly lower and more variable than those of the practitioners (mean scores of usability items ranging from 4.18, SD 1.70, to 5.94, SD 1.50 on a scale ranging from 1 to 7). Clients also voiced several concerns over the piloted ESM template, with some indicating no interest in the continued use of the ESM.

CONCLUSIONS

The findings suggest that using an ESM protocol may facilitate the implementation of the ESM as a mobile health assessment tool in psychiatry. However, additional adaptions should be made before further implementation. Adaptions include providing training on personalizing questionnaires, adding additional sampling scheme formats as well as an open-text field, and creating a dynamic data visualization interface. Future studies should also identify factors determining the suitability of the ESM for specific treatment goals among different client populations.

Feedback based on experience sampling data: Examples of current approaches and considerations for future research

Methodologies such as the Experience Sampling Method (ESM) or Ecological Momentary Assessment allow the gathering of fine-graded, dynamic, personal data within a patient's daily life. Currently, it is studied whether feedback based on experience sampling data (ESM-based feedback) can be used as a clinical tool to inform shared decision-making in clinical practice. Although the potential of feedback is recognized, little is known on how to generate, use, and implement it. This article (i) presents n = 15 ongoing ESM projects within the Belgian-Dutch network for ESM research wherein ESM-based feedback is provided to various patient populations, and (ii) summarizes qualitative data on experiences with ESM-based feedback of researchers (n = 8) with extensive expertise with ESM (average of 10 years) involved in these ongoing studies. The following aspects appear to be of relevance when providing ESM-based feedback: training for healthcare professionals and researchers, the use of online interfaces and graphical visualizations to present data, and interacting with patients in a face-to-face setting when discussing the contextual relevance and potential implications. Prospectively, research may build on these aspects and create coherent consensus-based guidelines for the use of ESM-based feedback.

Practitioner and researcher perspectives on the utility of ecological momentary assessment in mental health care: A survey study

BACKGROUND

Ecological momentary assessment (EMA) is a scientific self-monitoring method to capture individuals' daily life experiences. Early on, EMA has been suggested to have the potential to improve mental health care. However, it remains unclear if and how EMA should be implemented. This requires an in-depth investigation of how practitioners and researchers view the implementation of EMA.

OBJECTIVE

Explore the perspectives of mental health practitioners and EMA researchers on the utility of EMA for mental health care.

METHODS

Practitioners (n = 89; psychiatrists, psychologists, psychiatric nurses) and EMA researchers (n = 62) completed a survey about EMA in clinical practice. This survey addressed EMA goals for practitioner and patient, requirements regarding clinical use of EMA, and (dis)advantages of EMA compared to treatment-as-usual. t-Tests were used to determine agreement with each statement and whether practitioners' and researchers' views differed significantly. Linear regression was used to explore predictors of goals and preferences (e.g., EMA experience).

RESULTS

Practitioners and researchers considered EMA to be a useful clinical tool for diverse stages of care. They indicated EMA to be most useful for gaining insight into the context specificity of symptoms (55.0 %), whereas receiving alerts when symptoms increase was rated the least useful (11.3 %, alerts is in 95 % of bootstrap iterations between rank 8 and 10). Compared to treatment-as-usual, EMA was considered easier to use (M = 4.87, t = 5.30, p < .001) and interpret (M = 4.52, t = 3.61, p < .001), but also more burdensome for the patient (M = 4.48, t = 3.17, p < .001). Although participants preferred personalization of the EMA diary, they also suggested that EMA should cost practitioners and patients limited time. The preference for creating personalized EMA was related to the level of experience with EMA. Finally, they highlighted the need for practitioner training and patient full-time access to the EMA feedback.

CONCLUSIONS

This survey study demonstrated that practitioners and researchers expect EMA to have added value for mental health care. Concrete recommendations for implementation of EMA are formulated. This may inform the development of specific clinical applications and user-friendly EMA software.

Do Men and Women Have a Different Association between Fear-Avoidance and Pain Intensity in Chronic Pain? An Experience Sampling Method Cohort-Study

Background: Fear-avoidance is one of the factors associated with chronic pain. However, it remains unclear whether the association between fear-avoidance and pain depends on sex. The present study aimed to investigate whether the association between fear-avoidance and pain intensity differed between men and women in chronic pain patients. Additionally, the potential confounding effect of affective experiences on the association between fear-avoidance and pain intensity was analyzed. Method: This cohort study included hospital referred chronic pain patients (n = 45). Short momentary assessment questions according to the experience sampling method (ESM) were used to repeatedly assess patients’ pain intensity, level of fear-avoidance and positive as well as negative affect during their daily life. Linear mixed-effects models were applied in the statistical analysis. Unadjusted and adjusted models were made, in which the latter corrected for statistically significant affective experiences and baseline variables, taking the Aikake Information Criterion into account to assess a better model of fit. Results: The results demonstrated an association between fear-avoidance and pain intensity that differed for men and women. In men (n = 13), no association between these variables was found (−0.04 (95% CI: −0.14, 0.06) with a p-value of 0.48), whereas in women (n = 32), an increase in fear-avoidance was associated with a (slight) increase in pain intensity (0.18 (95% CI 0.06, 0.30) with a p-value of 0.003). Affect did not confound the above-mentioned findings. Conclusion: Our data supports previous research highlighting the importance of sex differences in pain experience. These findings may be relevant for clinicians to consider more personalized (i.e., gender specific) pain management in chronic pain patients.

A Web-Based Application for Personalized Ecological Momentary Assessment in Psychiatric Care: User-Centered Development of the PETRA Application

BACKGROUND

Smartphone self-monitoring of mood, symptoms, and contextual factors through ecological momentary assessment (EMA) provides insights into the daily lives of people undergoing psychiatric treatment. Therefore, EMA has the potential to improve their care. To integrate EMA into treatment, a clinical tool that helps clients and clinicians create personalized EMA diaries and interpret the gathered data is needed.

OBJECTIVE

This study aimed to develop a web-based application for personalized EMA in specialized psychiatric care in close collaboration with all stakeholders (ie, clients, clinicians, researchers, and software developers).

METHODS

The participants were 52 clients with mood, anxiety, and psychotic disorders and 45 clinicians (psychiatrists, psychologists, and psychiatric nurses). We engaged them in interviews, focus groups, and usability sessions to determine the requirements for an EMA web application and repeatedly obtained feedback on iteratively improved high-fidelity EMA web application prototypes. We used human-centered design principles to determine important requirements for the web application and designed high-fidelity prototypes that were continuously re-evaluated and adapted.

RESULTS

The iterative development process resulted in Personalized Treatment by Real-time Assessment (PETRA), which is a scientifically grounded web application for the integration of personalized EMA in Dutch clinical care. PETRA includes a decision aid to support clients and clinicians with constructing personalized EMA diaries, an EMA diary item repository, an SMS text message-based diary delivery system, and a feedback module for visualizing the gathered EMA data. PETRA is integrated into electronic health record systems to ensure ease of use and sustainable integration in clinical care and adheres to privacy regulations.

CONCLUSIONS

PETRA was built to fulfill the needs of clients and clinicians for a user-friendly and personalized EMA tool embedded in routine psychiatric care. PETRA is unique in this codevelopment process, its extensive but user-friendly personalization options, its integration into electronic health record systems, its transdiagnostic focus, and its strong scientific foundation in the design of EMA diaries and feedback. The clinical effectiveness of integrating personalized diaries via PETRA into care requires further research. As such, PETRA paves the way for a systematic investigation of the utility of personalized EMA for routine mental health care.

An eCoach-Pain for Patients with Chronic Musculoskeletal Pain in Interdisciplinary Primary Care: A Feasibility Study

eHealth could support cost-effective interdisciplinary primary care for patients with chronic musculoskeletal pain. This study aims to explore the feasibility of the eCoach-Pain, comprising a tool measuring pain complexity, diaries, pain education sessions, monitoring options, and chat function. Feasibility was evaluated (June–December 2020) by assessing learnability, usability, desirability, adherence to the application, and experiences from patients and general practitioners, practice nurses mental health, and physiotherapists. Six primary healthcare professionals (PHCPs) from two settings participated in the study and recruited 29 patients (72% female, median age 50.0 years (IQR = 24.0)). PHCPs participated in a focus group. Patient data was collected by evaluation questionnaires, individual interviews, and eCoach-Pain-use registration. Patients used the eCoach during the entire treatment phase (on average 107.0 days (IQR = 46.0); 23 patients completed the pain complexity tool and used the educational sessions, and 12 patients the chat function. Patients were satisfied with the eCoach-Pain (median grade 7.0 (IQR = 2.8) on a 0–10 scale) and made some recommendations for better fit with patient-specific complaints. According to PHCPs, the eCoach-Pain is of added value to their treatment, and patients also see treatment benefits. However, the implementation strategy is important for successful use of the eCoach-Pain. It is recommended to improve this strategy and involve a case-manager per patient.

Factors That Influence the Use of Electronic Diaries in Health Care: Scoping Review

BACKGROUND

A large number of people suffer from psychosocial or physical problems. Adequate strategies to alleviate needs are scarce or lacking. Symptom variation can offer insights into personal profiles of coping and resilience (detailed functional analyses). Hence, diaries are used to report mood and behavior occurring in daily life. To reduce inaccuracies, biases, and noncompliance with paper diaries, a shift to electronic diaries has occurred. Although these diaries are increasingly used in health care, information is lacking about what determines their use.

OBJECTIVE

The aim of this study was to map the existing empirical knowledge and gaps concerning factors that influence the use of electronic diaries, defined as repeated recording of psychosocial or physical data lasting at least one week using a smartphone or a computer, in health care.

METHODS

A scoping review of the literature published between January 2000 and December 2018 was conducted using queries in PubMed and PsycInfo databases. English or Dutch publications based on empirical data about factors that influence the use of electronic diaries for psychosocial or physical purposes in health care were included. Both databases were screened, and findings were summarized using a directed content analysis organized by the Consolidated Framework for Implementation Research (CFIR).

RESULTS

Out of 3170 articles, 22 studies were selected for qualitative synthesis. Eleven themes were determined in the CFIR categories of intervention, user characteristics, and process. No information was found for the CFIR categories inner (eg, organizational resources, innovation climate) and outer (eg, external policies and incentives, pressure from competitors) settings. Reminders, attractive designs, tailored and clear data visualizations (intervention), smartphone experience, and intrinsic motivation to change behavior (user characteristics) could influence the use of electronic diaries. During the implementation process, attention should be paid to both theoretical and practical training.

CONCLUSIONS

Design aspects, user characteristics, and training and instructions determine the use of electronic diaries in health care. It is remarkable that there were no empirical data about factors related to embedding electronic diaries in daily clinical practice. More research is needed to better understand influencing factors for optimal electronic diary use.