A Web-Based Intervention for Relatives of People Experiencing Psychosis or Bipolar Disorder: Design Study Using a User-Centered Approach

Designing and Evaluating IT Applications for Informal Caregivers: Scoping Review

BACKGROUND

Informal caregivers, often family members or friends, play a crucial role in supporting individuals with chronic illnesses, disabilities, or age-related needs. However, the demands of caregiving can be overwhelming, leading to stress, burnout, and negative impacts on caregivers' well-being. IT applications have emerged as potential solutions to support informal caregivers, but their design and evaluation often lack a comprehensive understanding of caregivers' needs and preferences. By understanding caregivers' perspectives on these issues, this review aimed to inform the development of more effective and user-centered IT solutions that truly support caregivers' needs.

OBJECTIVE

The purpose of this study was to conduct a scoping review to outline design recommendations for IT applications gathered from informal caregivers. In addition, this study presents evaluations of the use of IT applications by informal caregivers.

METHODS

A five-step scoping review methodology was used to map relevant literature in the following manner: (1) research question identification, (2) relevant study identification, (3) selection of pertinent studies for review, (4) data charting from the selected literature, and (5) summarization and reporting of results. A structured search was conducted across the PubMed, Scopus, IEEE Xplore Digital Library, Web of Science, and ACM Digital Library databases. In addition, reference list hand searches and keyword searches in Google Scholar were undertaken. The inclusion criteria comprised research articles (journal and conference) focusing on IT applications tailored for informal caregivers, primarily qualitative studies. Two reviewers independently identified articles for review and extracted the data. Conflicts were resolved through discussion, with a third reviewer consulted if consensus could not be attained. Thematic analysis was used to analyze the data.

RESULTS

A total of 82 articles were selected for the scoping review-44 (54%) related to design and 39 (48%) related to evaluation of IT applications. Six overarching themes emerged related to designing IT applications: information access, support systems, streamlining care-related tasks, fostering informal caregivers' well-being, communication with formal health care professionals, and task support. Furthermore, 3 broad themes emerged related to the evaluation of IT applications for informal caregivers: facilitators of using IT applications, barriers to using IT applications, and suggestions for improving IT applications for informal caregivers.

CONCLUSIONS

To our knowledge, this is the first study to map the literature on the design and evaluation of IT applications for informal caregivers. This scoping review outlines current practices and recommendations for designing and evaluating the use of IT applications for informal caregivers. It identifies 6 key design themes and 3 evaluation themes, offering valuable insights for future development in this field. These findings provide a road map for enhancing user-centric IT solutions in informal caregiver support technologies.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

RR2-10.2196/47650.

Family Intervention in Severe Mental Disorder: An Online Intervention Format in Psychosocial Rehabilitation Centers

The use of new technologies and online interventions with family members of people affected by severe mental disorders (SMD) seems to emerge as a promising complementary strategy to face-to-face care. The article presents a new online intervention format, aimed at relatives of people with SMD. A qualitative methodology sequenced in seven phases has been used. (1) The incorporation of relatives into the programme has allowed the intervention format to be adapted to the needs and opinions of the relatives themselves. (2) All the relatives were completely satisfied with the new online intervention format, and with how useful it had been for them. (1) The attention and support to family members of people with SMD through the Internet is a complementary intervention strategy to face-to-face care. (2) The online format of attention to family members can be incorporated into the usual practice of care services.

Supplementary Information

The online version contains supplementary material available at 10.1007/s40737-022-00310-7.

Human-Centered Design Approaches in Digital Mental Health Interventions: Exploratory Mapping Review

BACKGROUND

Digital mental health interventions have a great potential to alleviate mental illness and increase access to care. However, these technologies face significant challenges, especially in terms of user engagement and adoption. It has been suggested that this issue stems from a lack of user perspective in the development process; accordingly, several human-centered design approaches have been developed over the years to consider this important aspect. Yet, few human-centered design approaches to digital solutions exist in the field of mental health, and rarely are end users involved in their development.

OBJECTIVE

The main objective of this literature review is to understand how human-centered design is considered in e-mental health intervention research.

METHODS

An exploratory mapping review was conducted of mental health journals with the explicit scope of covering e-mental health technology. The human-centered design approaches reported and the core elements of design activity (ie, object, context, design process, and actors involved) were examined among the eligible studies.

RESULTS

A total of 30 studies met the inclusion criteria, of which 22 mentioned using human-centered design approaches or specific design methods in the development of an e-mental health solution. Reported approaches were classified as participatory design (11/27, 41%), codesign (6/27, 22%), user-centered design (5/27, 19%), or a specific design method (5/27, 19%). Just over half (15/27, 56%) of the approaches mentioned were supported by references. End users were involved in each study to some extent but not necessarily in designing. About 27% (8/30) of all the included studies explicitly mentioned the presence of designers on their team.

CONCLUSIONS

Our results show that some attempts have indeed been made to integrate human-centered design approaches into digital mental health technology development. However, these attempts rely very little on designers and design research. Researchers from other domains and technology developers would be wise to learn the underpinnings of human-centered design methods before selecting one over another. Inviting designers for assistance when implementing a particular approach would also be beneficial. To further motivate interest in and use of human-centered design principles in the world of e-mental health, we make nine suggestions for better reporting of human-centered design approaches in future research.

Digital smartphone intervention to recognise and manage early warning signs in schizophrenia to prevent relapse: the EMPOWER feasibility cluster RCT

BACKGROUND

Relapse is a major determinant of outcome for people with a diagnosis of schizophrenia. Early warning signs frequently precede relapse. A recent Cochrane Review found low-quality evidence to suggest a positive effect of early warning signs interventions on hospitalisation and relapse.

OBJECTIVE

How feasible is a study to investigate the clinical effectiveness and cost-effectiveness of a digital intervention to recognise and promptly manage early warning signs of relapse in schizophrenia with the aim of preventing relapse?

DESIGN

A multicentre, two-arm, parallel-group cluster randomised controlled trial involving eight community mental health services, with 12-month follow-up.

SETTINGS

Glasgow, UK, and Melbourne, Australia.

PARTICIPANTS

Service users were aged > 16 years and had a schizophrenia spectrum disorder with evidence of a relapse within the previous 2 years. Carers were eligible for inclusion if they were nominated by an eligible service user.

INTERVENTIONS

The Early signs Monitoring to Prevent relapse in psychosis and prOmote Wellbeing, Engagement, and Recovery (EMPOWER) intervention was designed to enable participants to monitor changes in their well-being daily using a mobile phone, blended with peer support. Clinical triage of changes in well-being that were suggestive of early signs of relapse was enabled through an algorithm that triggered a check-in prompt that informed a relapse prevention pathway, if warranted.

MAIN OUTCOME MEASURES

The main outcomes were feasibility of the trial and feasibility, acceptability and usability of the intervention, as well as safety and performance. Candidate co-primary outcomes were relapse and fear of relapse.

RESULTS

We recruited 86 service users, of whom 73 were randomised (42 to EMPOWER and 31 to treatment as usual). Primary outcome data were collected for 84% of participants at 12 months. Feasibility data for people using the smartphone application (app) suggested that the app was easy to use and had a positive impact on motivations and intentions in relation to mental health. Actual app usage was high, with 91% of users who completed the baseline period meeting our a priori criterion of acceptable engagement (> 33%). The median time to discontinuation of > 33% app usage was 32 weeks (95% confidence interval 14 weeks to ∞). There were 8 out of 33 (24%) relapses in the EMPOWER arm and 13 out of 28 (46%) in the treatment-as-usual arm. Fewer participants in the EMPOWER arm had a relapse (relative risk 0.50, 95% confidence interval 0.26 to 0.98), and time to first relapse (hazard ratio 0.32, 95% confidence interval 0.14 to 0.74) was longer in the EMPOWER arm than in the treatment-as-usual group. At 12 months, EMPOWER participants were less fearful of having a relapse than those in the treatment-as-usual arm (mean difference -4.29, 95% confidence interval -7.29 to -1.28). EMPOWER was more costly and more effective, resulting in an incremental cost-effectiveness ratio of £3041. This incremental cost-effectiveness ratio would be considered cost-effective when using the National Institute for Health and Care Excellence threshold of £20,000 per quality-adjusted life-year gained.

LIMITATIONS

This was a feasibility study and the outcomes detected cannot be taken as evidence of efficacy or effectiveness.

CONCLUSIONS

A trial of digital technology to monitor early warning signs that blended with peer support and clinical triage to detect and prevent relapse is feasible.

FUTURE WORK

A main trial with a sample size of 500 (assuming 90% power and 20% dropout) would detect a clinically meaningful reduction in relapse (relative risk 0.7) and improvement in other variables (effect sizes 0.3-0.4).

TRIAL REGISTRATION

This trial is registered as ISRCTN99559262.

FUNDING

This project was funded by the National Institute for Health and Care Research (NIHR) Health Technology Assessment programme and will be published in full in Health Technology Assessment; Vol. 26, No. 27. See the NIHR Journals Library website for further project information. Funding in Australia was provided by the National Health and Medical Research Council (APP1095879).

Detecting Mental Health Behaviors Using Mobile Interactions: Exploratory Study Focusing on Binge Eating

BACKGROUND

Binge eating is a subjective loss of control while eating, which leads to the consumption of large amounts of food. It can cause significant emotional distress and is often accompanied by purging behaviors (eg, meal skipping, overexercising, or vomiting).

OBJECTIVE

The aim of this study was to explore the potential of mobile sensing to detect indicators of binge-eating episodes, with a view toward informing the design of future context-aware mobile interventions.

METHODS

This study was conducted in 2 stages. The first involved the development of the DeMMI (Detecting Mental health behaviors using Mobile Interactions) app. As part of this, we conducted a consultation session to explore whether the types of sensor data we were proposing to capture were useful and appropriate, as well as to gather feedback on some specific app features relating to self-reporting. The second stage involved conducting a 6-week period of data collection with 10 participants experiencing binge eating (logging both their mood and episodes of binge eating) and 10 comparison participants (logging only mood). An optional interview was conducted after the study, which discussed their experience using the app, and 8 participants (n=3, 38% binge eating and n=5, 63% comparisons) consented.

RESULTS

The findings showed unique differences in the types of sensor data that were triangulated with the individuals' episodes (with nearby Bluetooth devices, screen and app use features, mobility features, and mood scores showing relevance). Participants had a largely positive opinion about the app, its unobtrusive role, and its ease of use. Interacting with the app increased participants' awareness of and reflection on their mood and phone usage patterns. Moreover, they expressed no privacy concerns as these were alleviated by the study information sheet.

CONCLUSIONS

This study contributes a series of recommendations for future studies wishing to scale our approach and for the design of bespoke mobile interventions to support this population.

Perceived Acceptability and Experiences of a Digital Psychoeducation and Peer Support Intervention (COPe-support): Interview Study With Carers Supporting Individuals With Psychosis

Background

Web-based mental health interventions offer a novel, accessible, and self-paced approach to care delivery to family carers (ie, relatives and close friends who support a loved one with psychosis). We coproduced COPe-support (Carers fOr People with Psychosis e-support), a psychoeducational intervention delivered via an enriched web-based learning environment with network support from professionals and peers. In addition to the rigorous investigation of the effectiveness of COPe-support on the well-being of carers and mental health outcomes, it is imperative to understand the experiences of using the web-based intervention by carers and its associated web-based implementation and facilitation strategies.

Objective

This study aims to explore the experiences of carers and perceived acceptability of COPe-support and its different components, how carers found engagement with COPe-support affected their own well-being and caregiving, and the ideas of carers for improving COPe-support and its delivery to inform any future wider implementation.

Methods

We conducted a qualitative study, individually interviewing 35 carers, following their use of COPe-support for 8 months through a web-based, randomized controlled trial across England. A semistructured guide with open-ended questions was used to explore the experiences of carers and perceived acceptability of the intervention and their ideas to improve the provision. All interviews were conducted remotely through mobile phones or internet communication media, audio recorded and transcribed verbatim. We used a thematic analysis framework to analyze the data.

Results

Three key themes were identified: remote, flexible, and personalized support; impacts on well-being and outlook on caregiving; and future implementation and integration with existing services. Overall, carers found COPe-support a flexible source of knowledge and support from professionals and peers that they could personalize to suit their own needs and convenience. Participants described gaining self-confidence, hope, and a sense of connectivity with others in a similar situation, which helped ameliorate isolation and perceived stigma. Most importantly, COPe-support promoted self-care among the carers themselves. Participants’ experiences, use, and activity on COPe-support varied greatly and differed among carers of various ages and levels of computer literacy.

Conclusions

Nearly all participants had a positive experience with COPe-support and supported its wider implementation as a beneficial adjunctive support resource for carers in the future. Any future scale-up of such an intervention needs to consider feedback from carers and suggestions for further improvement. These included having more graphics and audiovisual content materials, improving the navigation, and building in more interactional and customization options to suit various user styles, such as emoji reactions, live web-based chat, opting in and out of updates, and choosing the frequency of reminders. To ensure successful implementation, we should also consider factors pertinent to reaching more carers and integrating the web-based resources with other conventional services.

Trial Registration

International Standard Randomized Controlled Trial Number (ISRCTN) 89563420; https://www.isrctn.com/ISRCTN89563420

International Registered Report Identifier (IRRID)

RR2-10.1186/s12888-020-02528-w

Methods for Human-Centered eHealth Development: Narrative Scoping Review

Background

Thorough holistic development of eHealth can contribute to a good fit among the technology, its users, and the context. However, despite the availability of frameworks, not much is known about specific research activities for different aims, phases, and settings. This results in researchers having to reinvent the wheel. Consequently, there is a need to synthesize existing knowledge on research activities for participatory eHealth development processes.

Objective

The 3 main goals of this review are to create an overview of the development strategies used in studies based on the CeHRes (Center for eHealth Research) Roadmap, create an overview of the goals for which these methods can be used, and provide insight into the lessons learned about these methods.

Methods

We included eHealth development studies that were based on the phases and/or principles of the CeHRes Roadmap. This framework was selected because of its focus on participatory, iterative eHealth design in context and to limit the scope of this review. Data were extracted about the type of strategy used, rationale for using the strategy, research questions, and reported information on lessons learned. The most frequently mentioned lessons learned were summarized using a narrative, inductive approach.

Results

In the included 160 papers, a distinction was made between overarching development methods (n=10) and products (n=7). Methods are used to gather new data, whereas products can be used to synthesize previously collected data and support the collection of new data. The identified methods were focus groups, interviews, questionnaires, usability tests, literature studies, desk research, log data analyses, card sorting, Delphi studies, and experience sampling. The identified products were prototypes, requirements, stakeholder maps, values, behavior change strategies, personas, and business models. Examples of how these methods and products were applied in the development process and information about lessons learned were provided.

Conclusions

This study shows that there is a plethora of methods and products that can be used at different points in the development process and in different settings. To do justice to the complexity of eHealth development, it seems that multiple strategies should be combined. In addition, we found no evidence for an optimal single step-by-step approach to develop eHealth. Rather, researchers need to select the most suitable research methods for their research objectives, the context in which data are collected, and the characteristics of the participants. This study serves as a first step toward creating a toolkit to support researchers in applying the CeHRes Roadmap to practice. In this way, they can shape the most suitable and efficient eHealth development process.

The Session Wants and Need Outcome Measure: The Development of a Brief Outcome Measure for Single-Sessions of Web-Based Support

Single-session, brief interventions in therapy for young people make up a large proportion of service provision, including in digital mental health settings. Current nomothetic mental health measures are not specifically designed to capture the benefit or ‘change’ directly related to these brief interventions. As a consequence, we set out to design an outcome measure to concretely demonstrate the value of single-session interventions. The Session Wants and Needs Outcome Measure (SWAN-OM) aims to capture in-session goals and focuses on being user-centric, elements critical to the success of single-session and brief interventions which typically are asset-based and solution-focused. We describe the 4-stage process that was followed to develop this measure: (I) classical item generation and development, (II) content and (III) face validity pilot testing, and (IV) a user-experience approach with young people using framework analysis. This final stage was critical to ensure the integration of this outcome tool into a web-based digital therapy setting, a context which adds another layer of design complexity to item and measure development. This iterative methodology was used to overcome the challenges encountered and to place the needs of the young people and service practitioners at the centre of the design process, thus ensuring measure usability. To end, we highlight the main lessons learnt from engaging in this design process. Specifically, the needs of a measure for single-session interventions are considered, before outlining the learning associated with integrating the measure into a digital mental health platform. Both of these areas are emerging fields and, as such, this study contributes to our understanding of how an idiographic patient outcome theory driven measure can be created for use in a web-based digital mental health therapy service.

Designing Videos With and for Adults With ADHD for an Online Intervention: Participatory Design Study and Thematic Analysis of Evaluation

BACKGROUND

Adults with attention deficit hyperactivity disorder (ADHD) represent a heterogeneous group with both strengths and difficulties associated with the diagnosis. An online intervention attuned to their needs may improve their everyday functioning. When designing online interventions, it is important to adapt the therapeutic content to the values and needs of the target group.

OBJECTIVE

This paper describes and evaluates a participatory process used to produce content for an online intervention for adults with ADHD by producing video vignettes clarifying core training principles grounded in the participants' everyday experiences.

METHODS

We report on the qualitative data from 2 research phases: the design and evaluation of video vignettes for an online intervention. In the first phase, 12 adults with ADHD, 2 clinicians, and 2 research assistants participated in the production of video vignettes for the online intervention. In the second phase, participants (n=109) gave feedback on the videos as part of a clinical trial of the intervention. A subgroup (n=7) was interviewed in-depth regarding their experiences with the videos. The qualitative data were analyzed using thematic analysis.

RESULTS

In the first phase, the participants with ADHD contributed with experiences from challenging everyday situations. In the process, we navigated between therapeutic principles and the participants' experiential perspectives to create content relevant and consistent with the target group's values and experiences. In the second phase, we identified 3 themes related to the participants' experiences and interpretation of the video vignettes: (1) recognition of ADHD-related challenges, (2) connection with the characters and the situations, and (3) video protagonists as companions and role models for change.

CONCLUSIONS

A participatory design process for designing online mental health interventions can be used to probe and balance between the therapeutic principles defined by clinicians and the participants' experiences with mental health issues in the production of therapeutic content. In our study, the inclusion of video vignettes in an online intervention enabled a contextualized and relevant presentation of everyday experiences and psychosocial factors in the life of an adult with ADHD.

TRIAL REGISTRATION

ClinicalTrials.gov NCT04511169; https://clinicaltrials.gov/ct2/show/NCT04511169.

A web-based, peer-supported self-management intervention to reduce distress in relatives of people with psychosis or bipolar disorder: the REACT RCT

BACKGROUND

Relatives caring for people with severe mental health problems find information and emotional support hard to access. Online support for self-management offers a potential solution.

OBJECTIVE

The objective was to determine the clinical effectiveness and cost-effectiveness of an online supported self-management tool for relatives: the Relatives' Education And Coping Toolkit (REACT).

DESIGN AND SETTING

This was a primarily online (UK), single-blind, randomised controlled trial, comparing REACT plus a resource directory and treatment as usual with the resource directory and treatment as usual only, by measuring user distress and other well-being measures at baseline and at 12 and 24 weeks.

PARTICIPANTS

A total of 800 relatives of people with severe mental health problems across the UK took part; relatives who were aged ≥ 16 years, were experiencing high levels of distress, had access to the internet and were actively seeking help were recruited.

INTERVENTION

REACT comprised 12 psychoeducation modules, peer support through a group forum, confidential messaging and a comprehensive resource directory of national support. Trained relatives moderated the forum and responded to messages.

MAIN OUTCOME MEASURE

The main outcome was the level of participants' distress, as measured by the General Health Questionnaire-28 items.

RESULTS

Various online and offline strategies, including social media, directed potential participants to the website. Participants were randomised to one of two arms: REACT plus the resource directory (n = 399) or the resource directory only (n = 401). Retention at 24 weeks was 75% (REACT arm, n = 292; resource directory-only arm, n = 307). The mean scores for the General Health Questionnaire-28 items reduced substantially across both arms over 24 weeks, from 40.2 (standard deviation 14.3) to 30.5 (standard deviation 15.6), with no significant difference between arms (mean difference -1.39, 95% confidence interval -3.60 to 0.83; p = 0.22). At 12 weeks, the General Health Questionnaire-28 items scores were lower in the REACT arm than in the resource directory-only arm (-2.08, 95% confidence interval -4.14 to -0.03; p = 0.027), but this finding is likely to be of limited clinical significance. Accounting for missing data, which were associated with higher distress in the REACT arm (0.33, 95% confidence interval -0.27 to 0.93; p = 0.279), in a longitudinal model, there was no significant difference between arms over 24 weeks (-0.56, 95% confidence interval -2.34 to 1.22; p = 0.51). REACT cost £142.95 per participant to design and deliver (£62.27 for delivery only), compared with £0.84 for the resource directory only. A health economic analysis of NHS, health and Personal Social Services outcomes found that REACT has higher costs (£286.77), slightly better General Health Questionnaire-28 items scores (incremental General Health Questionnaire-28 items score adjusted for baseline, age and gender: -1.152, 95% confidence interval -3.370 to 1.065) and slightly lower quality-adjusted life-year gains than the resource directory only; none of these differences was statistically significant. The median time spent online was 50.8 minutes (interquartile range 12.4-172.1 minutes) for REACT, with no significant association with outcome. Participants reported finding REACT a safe, confidential environment (96%) and reported feeling supported by the forum (89%) and the REACT supporters (86%). No serious adverse events were reported.

LIMITATIONS

The sample comprised predominantly white British females, 25% of participants were lost to follow-up and dropout in the REACT arm was not random.

CONCLUSIONS

An online self-management support toolkit with a moderated group forum is acceptable to relatives and, compared with face-to-face programmes, offers inexpensive, safe delivery of National Institute for Health and Care Excellence-recommended support to engage relatives as peers in care delivery. However, currently, REACT plus the resource directory is no more effective at reducing relatives' distress than the resource directory only.

FUTURE WORK

Further research in improving the effectiveness of online carer support interventions is required.

TRIAL REGISTRATION

Current Controlled Trials ISRCTN72019945.

FUNDING

This project was funded by the National Institute for Health Research (NIHR) Health Technology Assessment programme and will be published in full in Health Technology Assessment; Vol. 24, No. 32. See the NIHR Journals Library website for further project information.

Design Considerations for the Integrated Delivery of Cognitive Behavioral Therapy for Depression: User-Centered Design Study

BACKGROUND

Adherence to computerized cognitive behavioral therapy (cCBT) programs in real-world settings can be poor, and in the absence of therapist support, effects are modest and short term. Moreover, because cCBT systems tend toward limited support and thus low-intensity treatment, they are typically most appropriate for people experiencing mild to moderate mental health difficulties. Blended therapy, that is, combining direct therapist contact with cCBT or psychoeducational materials, has been identified as one possible approach to address these limitations and widen access to individual CBT for depression. Building on the initial success of blended therapy, we explore an integrated approach that seeks to seamlessly combine face-to-face contact, electronic contact, and between-session activities. Integration also considers how the technology can support therapists' workflow and integrate with broader health care systems. The ultimate aim is to provide a structure within which therapists can deliver high-intensity treatments, while also greatly reducing face-to-face contact.

OBJECTIVE

The research aimed to explore patients' and therapists' views on using a system for the delivery of individual treatment for depression that integrates face-to-face therapist contact with access to online resources and with synchronous online therapy sessions that allow collaborative exercises, and to establish design requirements and thus key design considerations for integrated systems that more seamlessly combine different modes of communication.

METHODS

We conducted a series of four user-centered design studies. This included four design workshops and seven prototype testing sessions with 18 people who had received CBT for depression in the past, and 11 qualitative interviews and three role-play sessions with 12 CBT therapists experienced in the treatment of depression. Studies took place between July and December 2017 in Bristol, United Kingdom.

RESULTS

Workshops and prototyping sessions with people who had received CBT identified three important requirements for integrated platforms delivering CBT therapy for depression as follows: (1) features that help to overcome depression-related barriers, (2) features that support engagement, and (3) features that reinforce learning and support the development of new skills. Research with therapists highlighted the importance of the therapist and client working together, the impact of technology on therapists' workflow and workload, challenges and opportunities related to the use of online resources, and the potential of technology to support patient engagement. We use these findings to inform 12 design considerations for developing integrated therapy systems.

CONCLUSIONS

To meet clients' and therapists' needs, integrated systems need to help retain the personal connection, support both therapist- and patient-led activities, and provide access to materials and the ability to monitor progress. However, developers of such systems should be mindful of their capacity to disrupt current work practices and increase therapists' workload. Future research should evaluate the impact of integrated systems on patients and therapists in a real-world context.

An online supported self-management toolkit for relatives of people with psychosis or bipolar experiences: the IMPART multiple case study

Background

Digital health interventions have the potential to improve the delivery of psychoeducation to people with mental health problems and their relatives. Despite substantial investment in the development of digital health interventions, successful implementation into routine clinical practice is rare.

Objectives

Use the implementation of the Relatives’ Education And Coping Toolkit (REACT) for psychosis/bipolar disorder to identify critical factors affecting uptake and use, and develop an implementation plan to support the delivery of REACT.

Design

This was an implementation study using a mixed-methods, theory-driven, multiple case study approach. A study-specific implementation theory for REACT based on normalisation process theory was developed and tested, and iterations of an implementation plan to address the key factors affecting implementation were developed.

Setting

Early-intervention teams in six NHS mental health trusts in England (three in the north and three in the south).

Participants

In total, 281 staff accounts and 159 relatives’ accounts were created, 129 staff and 23 relatives took part in qualitative interviews about their experiences, and 132 relatives provided demographic data, 56 provided baseline data, 21 provided data at 12 weeks’ follow-up and 20 provided data at 24 weeks’ follow-up.

Interventions

REACT is an online supported self-management toolkit, offering 12 evidence-based psychoeducation modules and support via a forum, and a confidential direct messaging service for relatives of people with psychosis or bipolar disorder. The implementation intervention was developed with staff and iteratively adapted to address identified barriers. Adaptations included modifications to the toolkit and how it was delivered by teams.

Main outcome measures

The main outcome was factors affecting implementation of REACT, assessed primarily through in-depth interviews with staff and relatives. We also assessed quantitative measures of delivery (staff accounts and relatives’ invitations), use of REACT (relatives’ logins and time spent on the website) and the impact of REACT [relatives’ distress (General Health Questionnaire-28), and carer well-being and support (Carer Well-being and Support Scale questionnaire)].

Results

Staff and relatives were generally positive about the content of REACT, seeing it as a valuable resource that could help services improve support and meet clinical targets, but only within a comprehensive service that included face-to-face support, and with some additional content. Barriers to implementation included high staff caseloads and difficulties with prioritising supporting relatives; technical difficulties of using REACT; poor interoperability with trust information technology systems and care pathways; lack of access to mobile technology and information technology training; restricted forum populations leading to low levels of use; staff fears of managing risk, online trolling, or replacement by technology; and uncertainty around REACT’s long-term availability. There was no evidence that REACT would reduce staff time supporting relatives (which was already very low), and might increase it by facilitating communication. In all, 281 staff accounts were created, but only 57 staff sent relatives invitations. In total, 355 relatives’ invitations were sent to 310 unique relatives, leading to the creation of 159 relatives’ accounts. The mean number of logins for relatives was 3.78 (standard deviation 4.43), but with wide variation from 0 to 31 (median 2, interquartile range 1–8). The mean total time spent on the website was 40.6 minutes (standard deviation 54.54 minutes), with a range of 0–298 minutes (median 20.1 minutes, interquartile range 4.9–57.5 minutes). There was a pattern of declining mean scores for distress, social dysfunction, depression, anxiety and insomnia, and increases in relatives’ well-being and eHealth literacy, but no changes were statistically significant.

Conclusions

Digital health interventions, such as REACT, should be iteratively developed, evaluated, adapted and implemented, with staff and service user input, as part of a long-term strategy to develop integrated technology-enabled services. Implementation strategies must instil a sense of ownership for staff and ensure that they have adequate training, risk protocols and resources to deliver the technology. Cost-effectiveness and impact on workload and inequalities in accessing health care need further testing, along with the generalisability of our findings to other digital health interventions.

Limitations

REACT was offered by the same team running the IMPlementation of A Relatives’ Toolkit (IMPART) study, and was perceived by staff and relatives as a time-limited research study rather than ongoing clinical service, which affected engagement. Access to observational data was limited.

Trial registration

Current Controlled Trials ISRCTN16267685.

Funding

This project was funded by the National Institute for Health Research (NIHR) Health Services and Delivery Research programme and will be published in full in Health Services and Delivery Research; Vol. 8, No. 37. See the NIHR Journals Library website for further project information.

Methodological Challenges in Web-Based Trials: Update and Insights From the Relatives Education and Coping Toolkit Trial

RR2-10.1136/bmjopen-2017-016965.

Clinical effectiveness of a web-based peer-supported self-management intervention for relatives of people with psychosis or bipolar (REACT): online, observer-blind, randomised controlled superiority trial

BACKGROUND

The Relatives Education And Coping Toolkit (REACT) is an online supported self-management toolkit for relatives of people with psychosis or bipolar designed to improve access to NICE recommended information and emotional support.

AIMS

Our aim was to determine clinical and cost-effectiveness of REACT including a Resource Directory (RD), versus RD-only.

METHODS

A primarily online, observer-blind randomised controlled trial comparing REACT (including RD) with RD only (registration ISRCTN72019945). Participants were UK relatives aged > = 16, with high distress (assessed using the GHQ-28), and actively help-seeking, individually randomised, and assessed online. Primary outcome was relatives' distress (GHQ-28) at 24 weeks. Secondary outcomes were wellbeing, support, costs and user feedback.

RESULTS

We recruited 800 relatives (REACT = 399; RD only = 401) with high distress at baseline (GHQ-28 REACT mean 40.3, SD 14.6; RD only mean 40.0, SD 14.0). Median time spent online on REACT was 50.8 min (IQR 12.4-172.1) versus 0.5 min (IQR 0-1.6) on RD only. Retention to primary follow-up (24 weeks) was 75% (REACT n = 292 (73.2%); RD-only n = 307 (76.6%)). Distress decreased in both groups by 24 weeks, with no significant difference between the two groups (- 1.39, 95% CI -3.60, 0.83, p = 0.22). Estimated cost of delivering REACT was £62.27 per person and users reported finding it safe, acceptable and convenient. There were no adverse events or reported side effects.

CONCLUSIONS

REACT is an inexpensive, acceptable, and safe way to deliver NICE-recommended support for relatives. However, for highly distressed relatives it is no more effective in reducing distress (GHQ-28) than a comprehensive online resource directory.

TRIAL REGISTRATION

ISRCTN72019945 prospectively registered 19/11/2015.

IMPlementation of An online Relatives' Toolkit for psychosis or bipolar (IMPART study): iterative multiple case study to identify key factors impacting on staff uptake and use

BACKGROUND

Despite the potential of digital health interventions to improve the delivery of psychoeducation to people with mental health problems and their relatives, and substantial investment in their development, there is little evidence of successful implementation into clinical practice. We report the first implementation study of a digital health intervention: Relatives Education And Coping Toolkit (REACT), into routine mental healthcare. Our main aim was to identify critical factors affecting staff uptake and use of this online self-management tool for relatives of people with psychosis or bipolar.

METHODS

A mixed-methods, theory-driven (Normalisation Process Theory), iterative multiple case study approach using qualitative analysis of interviews with staff and quantitative reporting of uptake. Carer researchers were part of the research team.

RESULTS

In all, 281 staff and 159 relatives from Early Intervention teams across six catchment areas (cases) in England registered on REACT; 129 staff took part in qualitative interviews. Staff were positive about REACT helping services improve support and meet clinical targets. Implementation was hindered by: high staff caseloads and difficulties prioritising carers; perception of REACT implementation as research; technical difficulties using REACT; poor interoperability with trust computer systems and care pathways; lack of access to mobile technology and training; restricted forum populations; staff fears of risk, online trolling, and replacement by technology; and uncertainty around REACT's long-term availability.

CONCLUSIONS

Digital health interventions, such as REACT, should be iteratively developed, evaluated, adapted and implemented, in partnership with the services they aim to support, and as part of a long term national strategy to co-develop integrated technology-enabled mental healthcare. Implementation strategies must instil a sense of ownership for staff and ensure they have adequate IT training, appropriate governance protocols for online working, and adequate mobile technologies. Wider contextual factors including adequate funding for mental health services and prioritisation of carer support, also need to be addressed for successful implementation of carer focussed digital interventions.

TRIAL REGISTRATION

Study registration: ISCTRN 16267685.

Common themes and emerging trends for the use of technology to support mental health and psychosocial well-being in limited resource settings: A review of the literature

There are significant disparities in access to mental health care. With the burgeoning of technologies for health, digital tools have been leveraged within mental health and psychosocial support programming (eMental health). A review of the literature was conducted to understand and identify how eMental health has been used in resource-limited settings in general. PubMed, Ovid Medline and Web of Science were searched. Six-hundred and thirty full-text articles were identified and assessed for eligibility; of those, 67 articles met the inclusion criteria and were analyzed. The most common mental health use cases were for depression (n = 25) and general mental health and well-being (n = 21). Roughly one-third used a website or Internet-enabled intervention (n = 23) and nearly one-third used an SMS intervention (n = 22). Technology was applied to enhance service delivery (n = 32), behavior change communication (n = 26) and data collection (n = 8), and specifically dealt with adherence (n = 7), ecological momentary assessments (n = 7), well-being promotion (n = 5), education (n = 8), telemedicine (n = 28), machine learning (n = 5) and games (n = 2). Emerging trends identified wearables, predictive analytics, robots and virtual reality as promising areas. eMental health interventions that leverage low-tech tools can introduce, strengthen and expand mental health and psychosocial support services and can be a starting point for future, advanced tools.