Users' experiences of an online intervention for bipolar disorder: important lessons for design and evaluation

Barriers and Facilitators of User Engagement With Digital Mental Health Interventions for People With Psychosis or Bipolar Disorder: Systematic Review and Best-Fit Framework Synthesis

BACKGROUND

Digital mental health interventions (DMHIs) to monitor and improve the health of people with psychosis or bipolar disorder show promise; however, user engagement is variable, and integrated clinical use is low.

OBJECTIVE

This prospectively registered systematic review examined barriers and facilitators of clinician and patient engagement with DMHIs, to inform implementation within real-world settings.

METHODS

A systematic search of 7 databases identified empirical studies reporting qualitative or quantitative data about factors affecting staff or patient engagement with DMHIs aiming to monitor or improve the mental or physical health of people with psychosis or bipolar disorder. The Consolidated Framework for Implementation Research was used to synthesize data on barriers and facilitators, following a best-fit framework synthesis approach.

RESULTS

The review included 175 papers (150 studies; 11,446 participants) describing randomized controlled trials; surveys; qualitative interviews; and usability, cohort, and case studies. Samples included people with schizophrenia spectrum psychosis (98/150, 65.3% of studies), bipolar disorder (62/150, 41.3% of studies), and clinicians (26/150, 17.3% of studies). Key facilitators were a strong recognition of DMHIs' relative advantages, a clear link between intervention focus and specific patient needs, a simple, low-effort digital interface, human-supported delivery, and device provision where needed. Although staff thought patients would lose, damage, or sell devices, reviewed studies found only 11% device loss. Barriers included intervention complexity, perceived risks, user motivation, discomfort with self-reflection, digital poverty, symptoms of psychosis, poor compatibility with existing clinical workflows, staff and patient fears that DMHIs would replace traditional face-to-face care, infrastructure limitations, and limited financial support for delivery.

CONCLUSIONS

Identified barriers and facilitators highlight key considerations for DMHI development and implementation. As to broader implications, sustainable business models are needed to ensure that evidence-based DMHIs are maintained and deployed.

TRIAL REGISTRATION

PROSPERO CRD42021282871; https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=282871.

Active components and mechanisms of action of psychological interventions in bipolar disorder: A systematic literature review

OBJECTIVE

The efficacy of psychological interventions for bipolar disorder (BD) is well established, but much remains unknown about how change occurs. The primary objective of this exploratory study was to audit what is known about active components and mechanisms of action of psychological interventions for BD.

METHOD

We conducted a systematic review (PROSPERO CRD42022323276). Two independent reviewers screened references from four databases and extracted data from eligible studies.

RESULTS

We included four component studies, six studies with mediation analyses and 26 studies presenting subjective experiences of how psychological interventions bring change. Ten mediators were examined across six studies, with only one putative mediator, medication adherence, tested in more than one study. Some initial support for mediation of varied outcomes by control over thoughts, positive non-verbal behaviour, self-esteem, post-trauma growth and medication adherence. Some preliminary support was found in two components, human support and IPT. Studies exploring participant experiences of therapeutic change enumerated a range of potential active components, mechanisms of action and contextual factors potentially warranting investigation in future research. However, the evidence base for active components and mechanisms of action in psychological interventions for BD is unsatisfactory. Findings were inconsistent, studies homogenous with significant methodological limitations and statistical approaches failed to meet quality criteria.

CONCLUSIONS

Preliminary identification of potential components and mechanisms via qualitative analyses and the insights emerging from this review will inform future research aimed at investigating how psychological interventions work in BD.

Practical application of digital therapeutics in people with mood disorders

Digital therapeutics (DTx) offer evidence-based digitally-delivered high quality standards applications and/or softwares in the prevention, management and treatment of several medical conditions, including mood disorders. Nowadays, there are only three DTx officially approved by the Food and Drug Administration for mental conditions and there are still very few DTx developed in the context of mood disorders. The current comprehensive overview aims at providing a summary of currently published studies on DTx clinical applications in major depressive disorder (MDD), depressive symptomatology and bipolar disorder (BD), by using PubMed/MEDLINE and Scopus databases. Fifteen studies have been selected (10 on DTx in depressive symptomatology and/or MDD; 4 on BD; 1 on MDD and BD). Literature on DTx in mood disorders is still lacking, being mostly constituted by feasibility and acceptability rather than efficacy/effectiveness outcomes, particularly in BD. More studies focused on MDD compared to BD. Most DTx on MDD have been developed based on cognitive behaviour therapy interventions while on BD are based on psychoeducation. All studies assessing symptom severity improvement pre- vs. postinterventions demonstrated a significant postintervention improvement. Therefore, despite the preliminary encouraging results of studies here retrieved, their methodology is still too heterogeneous to allow comparisons and the generalizability of their findings. Further studies are warranted, in more larger samples involving multiple sites, including measures of both specific symptom effects as well as acceptability, feasibility and effectiveness in the real-world settings.

Using EMPOWER in daily life: a qualitative investigation of implementation experiences

BACKGROUND

Digital self-management tools blended with clinical triage and peer support have the potential to improve access to early warning signs (EWS) based relapse prevention in schizophrenia care. However, the implementation of digital interventions in psychosis can be poor. Traditionally, research focused on understanding how people implement interventions has focused on the perspectives of mental health staff. Digital interventions are becoming more commonly used by patients within the context of daily life, which means there is a need to understand implementation from the perspectives of patients and carers.

METHODS

Semi-structured one-on-one interviews with 16 patients who had access to the EMPOWER digital self-management intervention during their participation in a feasibility trial, six mental health staff members who supported the patients and were enrolled in the trial, and one carer participant. Interviews focused on understanding implementation, including barriers and facilitators. Data were coded using thematic analysis.

RESULTS

The intervention was well implemented, and EMPOWER was typically perceived positively by patients, mental health staff and the carer we spoke to. However, some patients reported negative views and reported ideas for intervention improvement. Patients reported valuing that the app afforded them access to things like information or increased social contact from peer support workers that went above and beyond that offered in routine care. Patients seemed motivated to continue implementing EMPOWER in daily life when they perceived it was creating positive change to their wellbeing, but seemed less motivated if this did not occur. Mental health staff and carer views suggest they developed increased confidence patients could self-manage and valued using the fact that people they support were using the EMPOWER intervention to open up conversations about self-management and wellbeing.

CONCLUSIONS

The findings from this study suggest peer worker supported digital self-management like EMPOWER has the potential to be implemented. Further evaluations of these interventions are warranted, and conducting qualitative research on the feasibility gives insight into implementation barriers and facilitators, improving the likelihood of interventions being usable. In particular, the views of patients who demonstrated low usage levels would be valuable.

Use of smartphone apps in bipolar disorder: An international web-based survey of feature preferences and privacy concerns

BACKGROUND

Smartphone apps have potential for delivering interventions and supporting self-management in bipolar disorder (BD), however clinical trials of mental health apps have high dropout rates and low sustained use in real-world contexts. To support the development of app-based interventions, we explored use of and attitudes towards apps amongst people with BD, specifically concerns about privacy and preferences for various app features.

METHODS

An international web-based survey was used to investigate concerns about privacy and the perceived importance of various app features among people with BD. Quantitative findings were summarised using descriptive statistics. Qualitative content analysis was used to investigate free-text responses.

RESULTS

A total of 919 people completed the survey; 97.5% reported using smartphone apps in general. Concerns regarding data security were prevalent. Commonly prioritised mHealth features included content quality/accuracy, ease and flexibility of use, cost, and data security. The ability to share data with others, rewards for use, inter-app connectivity, and peer support were endorsed as important by fewer than half of respondents. Qualitative findings suggested that sustained app use could be supported by novel and positive content, customisation, meaningful use of data, interactivity, and perceived real-world benefits.

CONCLUSIONS

The findings of the present study offer important design considerations for the development and evaluation of future app-based interventions for BD. Importantly, some features that have previously been suggested as clinically beneficial or likely to support engagement were perceived ambivalently, emphasising the need for in-depth consultation with potential end users during app development.

Ensuring patient and public involvement in the transition to AI-assisted mental health care: A systematic scoping review and agenda for design justice

BACKGROUND

Machine-learning algorithms and big data analytics, popularly known as 'artificial intelligence' (AI), are being developed and taken up globally. Patient and public involvement (PPI) in the transition to AI-assisted health care is essential for design justice based on diverse patient needs.

OBJECTIVE

To inform the future development of PPI in AI-assisted health care by exploring public engagement in the conceptualization, design, development, testing, implementation, use and evaluation of AI technologies for mental health.

METHODS

Systematic scoping review drawing on design justice principles, and (i) structured searches of Web of Science (all databases) and Ovid (MEDLINE, PsycINFO, Global Health and Embase); (ii) handsearching (reference and citation tracking); (iii) grey literature; and (iv) inductive thematic analysis, tested at a workshop with health researchers.

RESULTS

The review identified 144 articles that met inclusion criteria. Three main themes reflect the challenges and opportunities associated with PPI in AI-assisted mental health care: (a) applications of AI technologies in mental health care; (b) ethics of public engagement in AI-assisted care; and (c) public engagement in the planning, development, implementation, evaluation and diffusion of AI technologies.

CONCLUSION

The new data-rich health landscape creates multiple ethical issues and opportunities for the development of PPI in relation to AI technologies. Further research is needed to understand effective modes of public engagement in the context of AI technologies, to examine pressing ethical and safety issues and to develop new methods of PPI at every stage, from concept design to the final review of technology in practice. Principles of design justice can guide this agenda.

Barriers to and Facilitators of User Engagement With Digital Mental Health Interventions: Systematic Review

Background

Digital mental health interventions (DMHIs), which deliver mental health support via technologies such as mobile apps, can increase access to mental health support, and many studies have demonstrated their effectiveness in improving symptoms. However, user engagement varies, with regard to a user’s uptake and sustained interactions with these interventions.

Objective

This systematic review aims to identify common barriers and facilitators that influence user engagement with DMHIs.

Methods

A systematic search was conducted in the SCOPUS, PubMed, PsycINFO, Web of Science, and Cochrane Library databases. Empirical studies that report qualitative and/or quantitative data were included.

Results

A total of 208 articles met the inclusion criteria. The included articles used a variety of methodologies, including interviews, surveys, focus groups, workshops, field studies, and analysis of user reviews. Factors extracted for coding were related to the end user, the program or content offered by the intervention, and the technology and implementation environment. Common barriers included severe mental health issues that hampered engagement, technical issues, and a lack of personalization. Common facilitators were social connectedness facilitated by the intervention, increased insight into health, and a feeling of being in control of one’s own health.

Conclusions

Although previous research suggests that DMHIs can be useful in supporting mental health, contextual factors are important determinants of whether users actually engage with these interventions. The factors identified in this review can provide guidance when evaluating DMHIs to help explain and understand user engagement and can inform the design and development of new digital interventions.

Adaptive Elements in Internet-Delivered Psychological Treatment Systems: Systematic Review

BACKGROUND

Internet-delivered psychological treatments (IDPTs) are built on evidence-based psychological treatment models, such as cognitive behavioral therapy, and are adjusted for internet use. The use of internet technologies has the potential to increase access to evidence-based mental health services for a larger proportion of the population with the use of fewer resources. However, despite extensive evidence that internet interventions can be effective in the treatment of mental health disorders, user adherence to such internet intervention is suboptimal.

OBJECTIVE

This review aimed to (1) inspect and identify the adaptive elements of IDPT for mental health disorders, (2) examine how system adaptation influences the efficacy of IDPT on mental health treatments, (3) identify the information architecture, adaptive dimensions, and strategies for implementing these interventions for mental illness, and (4) use the findings to create a conceptual framework that provides better user adherence and adaptiveness in IDPT for mental health issues.

METHODS

The review followed the guidelines from Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA). The research databases Medline (PubMed), ACM Digital Library, PsycINFO, CINAHL, and Cochrane were searched for studies dating from January 2000 to January 2020. Based on predetermined selection criteria, data from eligible studies were analyzed.

RESULTS

A total of 3341 studies were initially identified based on the inclusion criteria. Following a review of the title, abstract, and full text, 31 studies that fulfilled the inclusion criteria were selected, most of which described attempts to tailor interventions for mental health disorders. The most common adaptive elements were feedback messages to patients from therapists and intervention content. However, how these elements contribute to the efficacy of IDPT in mental health were not reported. The most common information architecture used by studies was tunnel-based, although a number of studies did not report the choice of information architecture used. Rule-based strategies were the most common adaptive strategies used by these studies. All of the studies were broadly grouped into two adaptive dimensions based on user preferences or using performance measures, such as psychometric tests.

CONCLUSIONS

Several studies suggest that adaptive IDPT has the potential to enhance intervention outcomes and increase user adherence. There is a lack of studies reporting design elements, adaptive elements, and adaptive strategies in IDPT systems. Hence, focused research on adaptive IDPT systems and clinical trials to assess their effectiveness are needed.

Understanding Implementation of a Digital Self-Monitoring Intervention for Relapse Prevention in Psychosis: Protocol for a Mixed Method Process Evaluation

Background

Relapse is common in people who experience psychosis and is associated with many negative consequences, both societal and personal. People who relapse often exhibit changes (early warning signs [EWS]) in the period before relapse. Successful identification of EWS offers an opportunity for relapse prevention. However, several known barriers impede the use of EWS monitoring approaches. Early signs Monitoring to Prevent relapse in psychosis and prOmote Well-being, Engagement, and Recovery (EMPOWER) is a complex digital intervention that uses a mobile app to enhance the detection and management of self-reported changes in well-being. This is currently being tested in a pilot cluster randomized controlled trial. As digital interventions have not been widely used in relapse prevention, little is known about their implementation. Process evaluation studies run in parallel to clinical trials can provide valuable data on intervention feasibility.

Objective

This study aims to transparently describe the protocol for the process evaluation element of the EMPOWER trial. We will focus on the development of a process evaluation framework sensitive to the worldview of service users, mental health staff, and carers; the aims of the process evaluation itself; the proposed studies to address these aims; and a plan for integration of results from separate process evaluation studies into one overall report.

Methods

The overall process evaluation will utilize mixed methods across 6 substudies. Among them, 4 will use qualitative methodologies, 1 will use a mixed methods approach, and 1 will use quantitative methodologies.

Results

The results of all studies will be triangulated into an overall analysis and interpretation of key implementation lessons. EMPOWER was funded in 2016, recruitment finished in January 2018. Data analysis is currently under way and the first results are expected to be submitted for publication in December 2019.

Conclusions

The findings from this study will help identify implementation facilitators and barriers to EMPOWER. These insights will inform both upscaling decisions and optimization of a definitive trial.

Trial Registration

ISRCTN Registry ISRCTN99559262; http://www.isrctn.com/ISRCTN99559262

International Registered Report Identifier (IRRID)

DERR1-10.2196/15634

How Inclusive, User-Centered Design Research Can Improve Psychological Therapies for Psychosis: Development of SlowMo

BACKGROUND

Real-world implementation of psychological interventions for psychosis is poor. Barriers include therapy being insufficiently usable and useful for a diverse range of people. User-centered, inclusive design approaches could improve the usability of therapy, which may increase uptake, adherence, and effectiveness.

OBJECTIVE

This study aimed to optimize the usability of an existing psychological intervention, Thinking Well, which targets reasoning processes in paranoia using a basic digital interface.

METHODS

We conducted inclusive, user-centered design research characterized by purposive sampling of extreme users from the margins of groups, ethnographic investigation of the problem context, and iterative prototyping of solutions. The UK Design Council's double diamond method was used. This consisted of 4 phases: discover, including a case series of Thinking Well, stakeholder interviews, desk research, user profiling, system mapping, and a mood board; define, consisting of workshops to synthesize findings and generate the design brief; develop, involving concept workshops and prototype testing; and deliver, in which the final minimal viable product was storyboarded and iteratively coded.

RESULTS

Consistent with our previous work, the Thinking Well case series showed medium to large effects on paranoia and well-being and small effects on reasoning. These were maintained at follow-up despite some participants reporting difficulties with the therapy interface. Insights from the discover phase confirmed that usability was challenged by information complexity and poor accessibility. Participants were generally positive about the potential of technology to be enjoyable, help manage paranoia, and provide tailored interpersonal support from therapists and peers, although they reported privacy and security concerns. The define phase highlighted that the therapy redesign should support monitoring, simplify information processing, enhance enjoyment and trust, promote personalization and normalization, and offer flexible interpersonal support. During the develop phase over 60 concepts were created, with 2 key concepts of thoughts visualized as bubbles and therapy as a journey selected for storyboarding. The output of the deliver phase was a minimal viable product of an innovative digital therapy, SlowMo. SlowMo works by helping people to notice their worries and fast thinking habits, and encourages them to slow down for a moment to find ways of feeling safer. A Web app supports the delivery of 8 face-to-face sessions, which are synchronized to a native mobile app.

CONCLUSIONS

SlowMo makes use of personalization, ambient information, and visual metaphors to tailor the appeal, engagement, and memorability of therapy to a diversity of needs. Feasibility testing has been promising, and the efficacy of SlowMo therapy is now being tested in a multicentered randomized controlled trial. The study demonstrates that developments in psychological theory and techniques can be enhanced by improving the usability of the therapy interface to optimize its impact in daily life.