Predicting engagement with an online psychosocial intervention for psychosis: Exploring individual- and intervention-level predictors

The role of motivation in clinical presentation, treatment engagement and response in schizophrenia-spectrum disorders: A systematic review

Schizophrenia, a debilitating psychiatric disorder, has a long-term impact on social and occupational functioning. While negative symptoms, notably amotivation, are recognized as poor prognostic factors, the positive force of patient motivation (autonomous motivation) remains underexplored. This systematic review, guided by Self-Determination Theory (SDT), investigated the impact of motivation on clinical presentation, and treatment engagement and response in schizophrenia-spectrum disorders. Fifty-five independent studies (N = 6897), using 23 different motivation scales, met inclusion criteria. Results were categorized into cross-sectional and longitudinal correlates of autonomous motivation, and the effects of motivational interventions. Cross-sectionally, autonomous motivation was positively associated with social/occupational functioning, and negatively associated with negative and positive symptom severity. In longitudinal studies, baseline autonomous motivation predicted engagement in and response to social/occupational treatments, with mixed results in cognitive interventions. In the 16 randomized controlled trials (RCTs), the most common motivational interventions were individualized goal setting and goal attainment support, followed by increasing sense of competence by challenging defeatist beliefs, and enhancing relatedness by increasing contact time. Motivational interventions consistently increased autonomous motivation, treatment engagement and response. More studies are needed, particularly studies that monitor motivation during treatment: proximal assessments could facilitate the identification of treatment elements that impact motivation and engagement and inform treatment modifications to enhance the patient experience and improve treatment efficacy.

Leveraging Personal Technologies in the Treatment of Schizophrenia Spectrum Disorders: Scoping Review

BACKGROUND

Digital mental health is a rapidly growing field with an increasing evidence base due to its potential scalability and impacts on access to mental health care. Further, within underfunded service systems, leveraging personal technologies to deliver or support specialized service delivery has garnered attention as a feasible and cost-effective means of improving access. Digital health relevance has also improved as technology ownership in individuals with schizophrenia has improved and is comparable to that of the general population. However, less digital health research has been conducted in groups with schizophrenia spectrum disorders compared to other mental health conditions, and overall feasibility, efficacy, and clinical integration remain largely unknown.

OBJECTIVE

This review aims to describe the available literature investigating the use of personal technologies (ie, phone, computer, tablet, and wearables) to deliver or support specialized care for schizophrenia and examine opportunities and barriers to integrating this technology into care.

METHODS

Given the size of this review, we used scoping review methods. We searched 3 major databases with search teams related to schizophrenia spectrum disorders, various personal technologies, and intervention outcomes related to recovery. We included studies from the full spectrum of methodologies, from development papers to implementation trials. Methods and reporting follow the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines.

RESULTS

This search resulted in 999 studies, which, through review by at least 2 reviewers, included 92 publications. Included studies were published from 2010 to 2023. Most studies examined multitechnology interventions (40/92, 43%) or smartphone apps (25/92, 27%), followed by SMS text messaging (16/92, 17%) and internet-based interventions (11/92, 12%). No studies used wearable technology on its own to deliver an intervention. Regarding the stage of research in the field, the largest number of publications were pilot studies (32/92, 35%), followed by randomized control trials (RCTs; 20/92, 22%), secondary analyses (16/92, 17%), RCT protocols (16/92, 17%), development papers (5/92, 5%), and nonrandomized or quasi-experimental trials (3/92, 3%). Most studies did not report on safety indices (55/92, 60%) or privacy precautions (64/92, 70%). Included studies tend to report consistent positive user feedback regarding the usability, acceptability, and satisfaction with technology; however, engagement metrics are highly variable and report mixed outcomes. Furthermore, efficacy at both the pilot and RCT levels report mixed findings on primary outcomes.

CONCLUSIONS

Overall, the findings of this review highlight the discrepancy between the high levels of acceptability and usability of these digital interventions, mixed efficacy results, and difficulties with sustained engagement. The discussion highlights common patterns that may underscore this observation in the field; however, as this was a scoping review, a more in-depth systematic review or meta-analysis may be required to better understand the trends outlined in this review.

Predictors, mediators, and moderators of response to digital interventions for eating disorders: A systematic review

OBJECTIVE

Digital interventions show promise as an effective prevention or self-management option for eating disorders (EDs). However, it remains unclear how, for whom, and through what mechanisms they work in this population, as a synthesis of outcome predictors, moderators, and mediators is lacking. This systematic review synthesized empirical research investigating predictors, mediators, and moderators of response to digital interventions for EDs.

METHOD

Six databases were searched (PROSPERO CRD42022295565) for studies that assessed predictors, moderators, or mediators of response (i.e., uptake, drop-out, engagement, and symptom level change) to a digital prevention or treatment program for EDs. Variables were grouped into several overarching categories (demographic, symptom severity, psychological, etc.) and were synthesized qualitatively across samples without a formally diagnosed ED (typically prevention-focused) and samples with a formally diagnosed ED (typically treatment-focused).

RESULTS

Eighty-six studies were included. For studies recruiting samples without a formal diagnosis (n = 70 studies), most predictors explored were statistically unrelated to outcome, although participant age, baseline symptom severity, confidence to change, motivation, and program engagement showed preliminary evidence of prognostic potential. No robust moderators or mediators were identified. Few studies recruiting samples with a formal diagnosis emerged (n = 16), of which no reliable predictors, moderators, or mediators were identified.

DISCUSSION

It remains unclear how, for whom, and under what circumstances digital programs targeting EDs work. We offer several recommendations for future research with the aim of advancing understanding of client characteristics and intervention elements that signal success from this intervention modality.

PUBLIC SIGNIFICANCE

Digital interventions have shown potential as an effective, scalable, and accessible intervention option for EDs. However, responsiveness varies, so advancing understanding of predictors, mediators, and moderators of outcome to digital interventions for EDs is needed. Such knowledge is important for enabling safe and efficient treatment matching, and for informing future development of effective digital interventions.

Perspective of patients with first-episode psychosis, their relatives, and mental health professionals on the design and usability of an app in clinical practice

AIM

Therapeutic non-compliance remains the main difficulty for people with psychotic disorders, standing around 50% in people with schizophrenia. Lack of treatment adherence, either partial or total, to medication has economic and clinical consequences. E-health technologies may be a promising therapeutic tool to improve adherence, with the subsequent reduction in clinical and economic burden. Our aims were to know the preferences on how technologies in mental health treatment should be for use in clinical practice, and to learn about the opinion and preferences on the use of technologies in mental health treatment from the perspectives of patients with FEP, their relatives, and mental health professionals.

METHODS

Forty-one patients with a diagnosis of first-episode psychosis (FEP), 18 relatives and 49 mental health professionals were included in the study. They completed an online survey related to the use, availability and user-skill of online platforms and apps created by a group of experts in psychosis and in the use of technologies. Data were summarized in frequencies, percentages, and means, and Chi-square tests were used to calculate differences between-groups.

RESULTS

An app directed to people with psychosis would be well received by users if it contains psychoeducational material, offers reminders for scheduled visits and treatment and allows online consultations.

CONCLUSIONS

Co-creating an app with users, their families and mental health professionals allows incorporating their preferences to increase its use, improve outpatient care and creating an app that is viable in clinical practice.

Dance/movement therapy for improving metabolic parameters in long-term veterans with schizophrenia

Accumulating evidence has supported the implementation of dance/movement therapy (DMT) as a promising intervention for patients with schizophrenia (SCZ). However, its effect on body weight and metabolic profile in SCZ remains unclear. This study aimed to evaluate the outcome of a 12-week DMT session on weight and lipid profile in patients with SCZ using a randomized, single-blinded, controlled trial design. This study encompassed two groups of long-term hospitalized patients with SCZ, who were randomly assigned to the DMT intervention (n = 30) or the treatment as usual (TAU) group (n = 30). Metabolic markers, including weight, body mass index (BMI), fasting glucose, triglycerides, and total cholesterol were measured in both groups at two measurement points (at baseline and the end of the 12-week treatment). We found that DMT intervention significantly decreased body weight (F = 5.5, p = 0.02) and BMI (F = 5.7, p = 0.02) as compared to the TAU group. However, no significance was observed in other metabolic markers, including fasting glucose, triglycerides, and total cholesterol after treatment (all p > 0.05). Our study indicates that a 12-week, 24-session DMT program may be effective in decreasing body weight and BMI in long-term hospitalized patients with SCZ. DMT intervention may be a promising treatment strategy for long-term inpatients in the psychiatric department.

Development of a digital intervention for psychedelic preparation (DIPP)

Psychedelic substances induce profound alterations in consciousness. Careful preparation is therefore essential to limit adverse reactions, enhance therapeutic benefits, and maintain user safety. This paper describes the development of a self-directed, digital intervention for psychedelic preparation. Drawing on elements from the UK Medical Research Council (MRC) framework for developing complex interventions, the design was informed by a four-factor model of psychedelic preparedness, using a person-centred approach. Our mixed-methods investigation consisted of two studies. The first involved interviews with 19 participants who had previously attended a 'high-dose' psilocybin retreat, systematically exploring their preparation behaviours and perspectives on the proposed intervention. The second study engaged 28 attendees of an ongoing psilocybin retreat in co-design workshops, refining the intervention protocol using insights from the initial interviews. The outcome is a co-produced 21-day digital course (Digital Intervention for Psychedelic Preparation (DIPP)), that is organised into four modules: Knowledge-Expectation, Psychophysical-Readiness, Safety-Planning, and Intention-Preparation. Fundamental components of the course include daily meditation practice, supplementary exercises tied to the weekly modules, and mood tracking. DIPP provides a comprehensive and scalable solution to enhance psychedelic preparedness, aligning with the broader shift towards digital mental health interventions.

Effectiveness of online mindfulness-based interventions for cancer patients: a systematic review and meta-analysis

PURPOSE

Cancer is the second leading cause of mortality worldwide. Cancer negatively affects individuals' quality of life and overall health. Mindfulness-based interventions appear to be promising in the reduction of cancer- and treatment-related symptoms. This review aimed to determine the effectiveness of online mindfulness-based interventions on distress, anxiety, depression, stress, mindfulness, sleep disturbance, quality of life, rumination, fear of cancer recurrence, fatigue and post-traumatic growth among adult cancer patients.

METHODS

A literature search was conducted across five electronic databases. Only randomized controlled trials were eligible. Two reviewers independently screened the studies, extracted data, and performed quality assessment using the Cochrane risk of bias assessment tool. Meta-analyses were conducted using review manager software, and standardized mean difference was used to determine intervention effects. Heterogeneity was examined using the I2 statistics.

RESULTS

Ten studies were included with a total of 962 participants. Analyses revealed that online mindfulness-based interventions was effective in reducing distress (I2 = 98%；standardized mean difference = -2.21，95% confidence interval: -3.84 to 0.57；P = 0.008)， depression (I2 = 45%；standardized mean difference = -0.33，95% confidence interval: -0.64 to -0.03；P = 0.03), stress (I2 = 97%；standardized mean difference = -2.14，95% confidence interval: -4.24 to -0.03；P = 0.05) and sleep disturbance (I2 = 54%；standardized mean difference = -0.30，95% confidence interval: -0.59 to -0.01；P = 0.04), and improving quality of life (I2 = 94%；standardized mean difference = 0.92，95% confidence interval: 0.09-1.76；P = 0.03). The online mindfulness-based interventions had no significant effects on anxiety, mindfulness, rumination, fear of cancer recurrence, fatigue and post-traumatic growth. Subgroup analyses revealed that online mindfulness-based interventions resulted in higher effect sizes for distress when delivered by website than application, significantly higher effect sizes were also found for online mindfulness-based interventions with guidance, but not on treatment or cancer type. For sleep disturbance, and quality of life, no significant differences between subgroups were found.

CONCLUSION

These results provide preliminary support that online mindfulness-based interventions may be feasible and acceptable, which can be used as an adjuvant therapy for the management of cancer-related symptoms among cancer patients.

Perinatal Women's Perspectives of, and Engagement in, Digital Emotional Well-Being Training: Mixed Methods Study

BACKGROUND

Psychological distress in the early postpartum period can have long-lasting deleterious effects on a mother's well-being and negatively affect her infant's development. Intervention approaches based in contemplative practices such as mindfulness and loving-kindness and compassion are intended to alleviate distress and cultivate well-being and can be delivered effectively as digital mental health interventions (DMHIs).

OBJECTIVE

To understand the feasibility of engaging perinatal women in digital interventions, this study aimed to document participants' experiences in the Mums Minds Matter (MMM) study, a pilot randomized controlled trial comparing mindfulness, loving-kindness and compassion, and progressive muscle relaxation training delivered in a digital format and undertaken during pregnancy. To assess the different stages of engagement during and after the intervention, we adapted the connect, attend, participate, enact (CAPE) framework that is based on the idea that individuals go through different stages of engagement before they are able to enact change.

METHODS

The MMM study was nested within a longitudinal birth cohort, The ORIGINS Project. We aimed to recruit 25 participants per randomization arm. Data were collected sequentially during the intervention through regular web-based surveys over 8 weeks, with opportunities to provide regular feedback. In the postintervention phase, qualitative data were collected through purposive sampling.

RESULTS

Of 310 eligible women, 84 (27.1% [connect rate]) enrolled to participate in MMM. Of the remaining 226 women who did not proceed to randomization, 223 (98.7%) failed to complete the baseline surveys and timed out of eligibility (after 30 weeks' gestation), and 3 (1.3%) displayed high psychological distress scores. Across all program groups, 17 (20% [attend rate]) of the 84 participants actively opted out, although more may have disengaged from the intervention but did not withdraw. The main reasons for withdrawal were busy life and other priorities. In this study, we assessed active engagement and ongoing skills use (participate and enact) through postintervention interviews. We undertook 15 participant interviews, conducted 1 month to 3 months after the intervention. Our results provide insights into participant barriers and enablers as well as app changes, such as the ability to choose topics, daily reminders, case studies, and diversity in sounds. Implementing a DMHI that is brief, includes frequent prompts or nudges, and is easily accessible is a key strategy to target perinatal women.

CONCLUSIONS

Our research will enable future app designs that are sufficiently nuanced to maximize the uptake, engagement, and application of mental health skills and contemplative practices in the perinatal period. Providing convenient access to engaging and effective prevention programs is critical and should be part of prenatal self-care. Our research underscores the appeal and feasibility of digital intervention approaches based in contemplative practices for perinatal women.

TRIAL REGISTRATION

Australian New Zealand Clinical Trials Registry (ANZCTR) 12620000672954p; https://anzctr.org.au/Trial/Registration/TrialReview.aspx?ACTRN=12620000672954p.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

RR2-10.2196/19803.

The engagement problem: A review of engagement with digital mental health interventions and recommendations for a path forward

Purpose of the review

Digital mental health interventions (DMHIs) are an effective and accessible means of addressing the unprecedented levels of mental illness worldwide. Currently, however, patient engagement with DMHIs in real-world settings is often insufficient to see clinical benefit. In order to realize the potential of DMHIs, there is a need to better understand what drives patient engagement.

Recent findings

We discuss takeaways from the existing literature related to patient engagement with DMHIs and highlight gaps to be addressed through further research. Findings suggest that engagement is influenced by patient-, intervention- and systems-level factors. At the patient-level, variables such as sex, education, personality traits, race, ethnicity, age and symptom severity appear to be associated with engagement. At the intervention-level, integrating human support, gamification, financial incentives and persuasive technology features may improve engagement. Finally, although systems-level factors have not been widely explored, the existing evidence suggests that achieving engagement will require addressing organizational and social barriers and drawing on the field of implementation science.

Summary

Future research clarifying the patient-, intervention- and systems-level factors that drive engagement will be essential. Additionally, to facilitate improved understanding of DMHI engagement, we propose the following: (a) widespread adoption of a minimum necessary 5-element engagement reporting framework; (b) broader application of alternative clinical trial designs; and (c) directed efforts to build upon an initial parsimonious conceptual model of DMHI engagement.

Predictors of initial engagement with an asynchronous cognitive behavioral stress management website among older women with nonmetastatic breast cancer

PURPOSE

Digital interventions, like websites, offer greater access to psychosocial treatments; however, engagement is often suboptimal. Initial use may be a target to "hook" participants. Few studies examine engagement with cognitive behavioral stress management (CBSM). We tested predictors of engagement in the first week of using a CBSM website among women with breast cancer (BC).

METHODS

Older women (≥ 50 years) with nonmetastatic BC enrolled in an on-going trial (8/2016-4/2022, #NCT03955991) and were randomized to receive 10 synchronous, virtual CBSM group sessions immediately (n = 41) or after a 6-month waitlist (n = 34). All received simultaneous access to an asynchronous website, where supplemental videos and resources were released weekly. Engagement was tracked via breadth (features used) and depth (clicks within content). Multilevel modeling tested predictors of engagement (i.e., time, condition, age, daily stress, depression, race, ethnicity, disease stage).

RESULTS

Breadth decreased over the first week of CBSM (b = -0.93, p < .01), and women with more advanced stage disease engaged with more breadth (b = 0.52, p < .01) and depth (b = 14.06, p < .01) than women with earlier stage disease. Non-Hispanic (b = -0.59, p = .03) and White (b = -0.97, p < .01) women engaged with more features. Cancer stage and intervention timing interacted. Women with more advanced cancer stage who received CBSM later engaged with the most depth (b = -11.73, p = .04). All other characteristics did not predict engagement.

CONCLUSIONS

Disease stage, race, ethnicity, and intervention timing predicted engagement with a CBSM website in older BC patients.

IMPLICATIONS FOR CANCER SURVIVORS

Delivering CBSM later in cancer treatment may mitigate competing demands. Fostering greater engagement in racial/ethnic minorities is needed.

Exploring engagement with the CBT-informed Actissist smartphone application for early psychosis

BACKGROUND

Individuals with psychosis report favourable attitudes towards psychological interventions delivered via smartphone apps. Evidence for acceptability, safety, feasibility and efficacy is promising but in-depth reporting of app engagement in trials is sparse.

AIMS

To examine how people with psychosis engaged with the cognitive behaviour therapy (CBT)-informed Actissist app over a 12-week intervention period, and to examine factors associated with app engagement.

METHODS

Secondary data from participants in the intervention arm (n = 24) of a proof-of-concept randomised controlled trial of the Actissist app were analysed. The app prompted participants to engage with app-based CBT-informed material in five domains (voices, socialization, cannabis use, paranoia, perceived criticism) at pseudo-random intervals (three notifications per day, six days per week). Participants could self-initiate use any time. App use was financially incentivised.

RESULTS

Participants responded to 47% of app notifications. Most app engagements (87%) were app-initiated rather than self-initiated. Participants engaged most with the voices domain, then paranoia. Age and employment status were significantly associated with overall app engagement.

CONCLUSION

Individuals with psychosis engaged well with Actissist, particularly with areas focussing on voice-hearing and paranoia. App-generated reminders successfully prompted app engagement. As financial incentives may have increased app engagement, future studies of non-incentivized engagement in larger samples are needed.

Measuring Engagement with Mental Health and Behavior Change Interventions: an Integrative Review of Methods and Instruments

BACKGROUND

Engagement is a complex construct consisting of behavioral, cognitive, and affective dimensions, making engagement a difficult construct to measure. This integrative review aims to (1) present a multidisciplinary overview of measurement methods that are currently used to measure engagement with adult mental health and behavior change interventions, delivered in-person, blended, or digitally, and (2) provide a set of recommendations and considerations for researchers wishing to study engagement.

METHODS

We used an integrative approach and identified original studies and reviews on engagement with mental health or behavior change interventions that were delivered in-person, digitally, or blended.

RESULTS

Forty articles were analyzed in this review. Common methods to assess engagement were through objective usage data, questionnaire-based data, and qualitative data, with objective usage data being used most frequently. Based on the synthesis of engagement measures, we advise researchers to (1) predefine the operationalization of engagement for their specific research context, (2) measure behavioral, cognitive, and affective dimensions of engagement in all cases, and (3) measure engagement over time.

CONCLUSIONS

Current literature shows a bias towards behavioral measures of engagement in research, as most studies measured engagement exclusively through objective usage data, without including cognitive and affective measures of engagement. We hope that our recommendations will help to reduce this bias and to steer engagement research towards an integrated approach.

Time-out for well-being: A mixed methods evaluation of attitudes and likelihood to engage in different types of online emotional well-being programmes in the perinatal period

BACKGROUND

Positive maternal mental health during the perinatal period contributes to general well-being and positive emotional bonds with the child, encouraging an optimal developmental trajectory. Online interventions to enhance maternal well-being and develop coping skills, such as meditation-based interventions, can be a low-cost way to improve mother and child outcomes. However, this depends on end-user engagement. To date, there is limited evidence about women's willingness to engage and preferences for online programmes.

OBJECTIVES

This study explored pregnant women's attitudes towards and likelihood to undertake minimal online well-being training programmes (mindfulness, self-compassion, or general relaxation), engagement barriers and enablers, and programme structure preferences.

DESIGN

A mixed methods triangulation design was undertaken using a validating quantitative model. Quantile regressions were applied to the quantitative data. Content analysis was undertaken for the qualitative data.

METHODS

Consenting pregnant women (n = 151) were randomized equally to read about three online programme types. Participants were sent an information leaflet, tested by a consumer panel prior to distribution.

RESULTS

Participants generally held positive attitudes about all three types of interventions, with no statistically significant differences in preferences between programme types. Participants appreciated the importance of mental health and were receptive to fostering skills to support their emotional well-being and stress management. The most frequent perceived barriers were lack of time, tiredness, and forgetfulness. Programme structure preferences indicated one to two modules per week, less than 15 min in duration, and over 4 weeks. Programme functionality, such as regular reminders and easy accessibility, is important to end users.

CONCLUSION

Our findings reinforce the importance of determining participant preferences in designing and communicating engaging interventions for perinatal women. This research contributes to the understanding of population-based interventions that can be provided as simple, scalable, cost-effective, and home-based activities in pregnancy for the benefit of individuals, their families, and society more broadly.

Factors associated with young adult engagement with a web-based sickle cell reproductive health intervention

Objective

To determine the factors predicting the engagement of young adults who have sickle cell disease (SCD) or sickle cell trait (SCT) with an online reproductive health education intervention and engagement effects on knowledge.

Methods

The cross-sectional study included 167 participants who completed the web-based intervention either face-to-face (F2F) or online delivery (OL). Measures include: time used relative to length of the intervention narration and media (engagement) and the SCKnowIQ questionnaire. Ordinal regression was conducted.

Results

The sample mean age was 26-years (SD=5), 68% were female, 54% had SCD, and 68% were in the F2F group. Adjusting for age, partner sickle cell status, marital status, and education, participants who were female (p=.003), had SCD (p=.018), or had F2F delivery (p < .001) were more likely to spend more time on the intervention. Adjusting for baseline knowledge and modality, more time spent on the intervention was associated with higher posttest knowledge (p=.006).

Conclusions

Future studies are necessary to understand reasons underpinning engagement and to investigate other unmeasured factors, such as intervention interactivity elements, that could also be associated with engagement.

Innovation

This study of young adults with SCD or SCT provides much needed insight about their engagement with online reproductive health education.

Do recovery-oriented messages improve self-efficacy and positive emotions amongst people with lived experience of psychosis? Experimental investigation

OBJECTIVES

Recovery-oriented perspectives have become accepted worldwide as an alternative to the biomedical approach to conceptualizing and managing severe mental health problems. It has been proposed that one advantage of this is to support self-efficacy amongst people with a lived experience of psychosis, especially when recovery messages are presented by lived experience peers. The aim of the present study was to investigate the proposed psychological benefits of the recovery paradigm, by testing for possible differential impacts of recovery versus biomedical messages on self-efficacy beliefs and positive emotional state amongst people with experience of psychosis. It was hypothesized that (1) recovery-oriented messages, when presented by lived experience peers, would generate improvements in self-efficacy and positive emotions relative to biomedical messages presented by a professional and (2) recovery-oriented messages delivered by a professional would generate improvements in self-efficacy and positive emotions relative to biomedical messages delivered by a professional. We also explored whether recovery-oriented messages were more impactful when delivered by a lived experience peer versus a professional.

DESIGN

Experimental design with three within-subject video-based conditions.

METHODS

Fifty-three participants with lived experience of psychosis viewed three videos: (i) people with lived experience sharing their experiences of recovery; (ii) mental health professionals presenting traditional biomedical conceptualizations of psychosis; and (iii) mental health professionals presenting recovery perspectives. Participants provided baseline clinical and demographic information, and post-viewing ratings of experienced changes in self-efficacy and emotional state.

RESULTS

Hypothesis 1 was supported: both self-efficacy and positive emotions were significantly increased by a video of peers sharing personal recovery stories relative to professionals presenting biomedical messages. Hypothesis 2 was partially supported: when comparing videos of recovery versus biomedical messages delivered by professionals, significant relative benefits were found for positive emotions, but not self-efficacy.

CONCLUSIONS

This experimental investigation generated a pattern of findings broadly supportive of the assumed psychological benefits of the recovery paradigm for people with lived experiences of psychosis. Findings must be interpreted with caution given the limitations of the present design, but encourage further experimental research to directly test the interpersonal impacts of the recovery paradigm.

Using a digital personal recovery resource in routine mental health practice: feasibility, acceptability and outcomes

BACKGROUND

Digital technologies enable the dissemination of multimedia resources to support adults with serious mental illness in their self-management and personal recovery. However, delivery needs to accommodate engagement and accessibility challenges.

AIMS

We examined how a digital resource, designed for mental health workers and consumers to use together in session, would be used in routine practice.

METHODS

Thirty consumers and their workers participated. The web-based resource, Self-Management And Recovery Technology (SMART), was available to use within and between sessions, for a 6-month period. Workers initiated in-session use where relevant. Feasibility was explored via uptake and usage data; and acceptability and impact via questionnaires. A pre-post design assessed recovery outcomes for consumers and relationship outcomes for consumers and workers.

RESULTS

In participating mental health practitioner-consumer dyads, consumers gave strong acceptability ratings, and reported improved working relationships. However, the resource was typically used in one-third or fewer appointments, with consumers expressing a desire for greater in-session use. Improvements in self-rated personal recovery were not observed, possibly contributed to by low usage.

CONCLUSIONS

In-session use was found helpful by consumers but may be constrained by other demands in mental health care delivery: collaborative use may require dedicated staff time or more formal implementation.

An Intervention to Connect Patients With Psychosis and Volunteers via Smartphone (the Phone Pal): Development Study

BACKGROUND

Intervention development is a critical stage. However, evidence indicates that the substandard reporting of intervention details is widespread.

OBJECTIVE

This study aimed to provide an overview of the guiding frameworks, methodology, and stages for the design and construction of a new complex intervention-the Phone Pal.

METHODS

The intervention development process followed the Medical Research Council framework for developing complex interventions as well as the person-based approach. The intervention was developed following the evidence synthesis of a literature review, a focus group study, and a survey after consultation and input from advisory groups with a range of stakeholders, including patients, volunteers, clinicians, and academics.

RESULTS

The developed logic model outlines the contextual factors, intervention, mechanisms of change, and short- and long-term outcomes. The operationalized intervention required matching 1 patient with 1 volunteer to communicate with each other through a smartphone via SMS text messages, WhatsApp messages or email, and audio or video calls. Each participant was encouraged to communicate with their match at least once per week for a 12-week period using informal conversation.

CONCLUSIONS

The systematic process and theoretically sound strategy through which this intervention was developed can provide insights to future researchers on the reality of developing and preparing the operationalization of a digital intervention using multiple components.

Digital smartphone intervention to recognise and manage early warning signs in schizophrenia to prevent relapse: the EMPOWER feasibility cluster RCT

BACKGROUND

Relapse is a major determinant of outcome for people with a diagnosis of schizophrenia. Early warning signs frequently precede relapse. A recent Cochrane Review found low-quality evidence to suggest a positive effect of early warning signs interventions on hospitalisation and relapse.

OBJECTIVE

How feasible is a study to investigate the clinical effectiveness and cost-effectiveness of a digital intervention to recognise and promptly manage early warning signs of relapse in schizophrenia with the aim of preventing relapse?

DESIGN

A multicentre, two-arm, parallel-group cluster randomised controlled trial involving eight community mental health services, with 12-month follow-up.

SETTINGS

Glasgow, UK, and Melbourne, Australia.

PARTICIPANTS

Service users were aged > 16 years and had a schizophrenia spectrum disorder with evidence of a relapse within the previous 2 years. Carers were eligible for inclusion if they were nominated by an eligible service user.

INTERVENTIONS

The Early signs Monitoring to Prevent relapse in psychosis and prOmote Wellbeing, Engagement, and Recovery (EMPOWER) intervention was designed to enable participants to monitor changes in their well-being daily using a mobile phone, blended with peer support. Clinical triage of changes in well-being that were suggestive of early signs of relapse was enabled through an algorithm that triggered a check-in prompt that informed a relapse prevention pathway, if warranted.

MAIN OUTCOME MEASURES

The main outcomes were feasibility of the trial and feasibility, acceptability and usability of the intervention, as well as safety and performance. Candidate co-primary outcomes were relapse and fear of relapse.

RESULTS

We recruited 86 service users, of whom 73 were randomised (42 to EMPOWER and 31 to treatment as usual). Primary outcome data were collected for 84% of participants at 12 months. Feasibility data for people using the smartphone application (app) suggested that the app was easy to use and had a positive impact on motivations and intentions in relation to mental health. Actual app usage was high, with 91% of users who completed the baseline period meeting our a priori criterion of acceptable engagement (> 33%). The median time to discontinuation of > 33% app usage was 32 weeks (95% confidence interval 14 weeks to ∞). There were 8 out of 33 (24%) relapses in the EMPOWER arm and 13 out of 28 (46%) in the treatment-as-usual arm. Fewer participants in the EMPOWER arm had a relapse (relative risk 0.50, 95% confidence interval 0.26 to 0.98), and time to first relapse (hazard ratio 0.32, 95% confidence interval 0.14 to 0.74) was longer in the EMPOWER arm than in the treatment-as-usual group. At 12 months, EMPOWER participants were less fearful of having a relapse than those in the treatment-as-usual arm (mean difference -4.29, 95% confidence interval -7.29 to -1.28). EMPOWER was more costly and more effective, resulting in an incremental cost-effectiveness ratio of £3041. This incremental cost-effectiveness ratio would be considered cost-effective when using the National Institute for Health and Care Excellence threshold of £20,000 per quality-adjusted life-year gained.

LIMITATIONS

This was a feasibility study and the outcomes detected cannot be taken as evidence of efficacy or effectiveness.

CONCLUSIONS

A trial of digital technology to monitor early warning signs that blended with peer support and clinical triage to detect and prevent relapse is feasible.

FUTURE WORK

A main trial with a sample size of 500 (assuming 90% power and 20% dropout) would detect a clinically meaningful reduction in relapse (relative risk 0.7) and improvement in other variables (effect sizes 0.3-0.4).

TRIAL REGISTRATION

This trial is registered as ISRCTN99559262.

FUNDING

This project was funded by the National Institute for Health and Care Research (NIHR) Health Technology Assessment programme and will be published in full in Health Technology Assessment; Vol. 26, No. 27. See the NIHR Journals Library website for further project information. Funding in Australia was provided by the National Health and Medical Research Council (APP1095879).

An examination of neurocognition and theory of mind as predictors of engagement with a tailored digital therapeutic in persons with serious mental illness

There is an increasing interest in the development and implementation of digital therapeutics (apps) in individuals with serious mental illness (SMI). However, there is limited understanding of the role of neurocognition and social cognition on engagement with apps. The present study is a secondary analysis of a pilot randomized controlled trial (N = 62) comparing a tailored digital intervention to treat tobacco use disorder in individuals with SMI to a standard of care digital intervention for the general population. The purpose of this study was to examine the impact of neurocognition, social cognition, and clinical characteristics on indices of app engagement in users of the tailored app compared to users of the standard of care app. Correlational analyses demonstrated that individuals with low levels of neurocognition and social cognition engaged more often and for longer duration with the tailored app compared to the standard of care app. In a series of multilevel zero-inflated negative binomial models, assignment to the tailored app remained the most robust predictor of app interactions (Risk Ratio [RR] = 1.72; p < .01), duration of app use (RR = 6.47; p < .01), and average length of interaction (RR = 2.70; p < .01), after adjusting for key demographic and clinical characteristics, and two measures of cognition. This is one of the first studies to demonstrate that digital therapeutics can be designed to mitigate the impact of neurocognition and social cognition on device engagement in SMI populations. Recommendations are made to advance the use of new analytic models to uncover patterns of engagement with digital therapeutics.

Can cognitive remediation therapy be delivered remotely? A review examining feasibility and acceptability of remote interventions

Cognitive remediation (CR) is an effective treatment for schizophrenia. However, issues such as motivational impairments, geographic limitations, and limited availability of specialized clinicians to deliver CR, can impede dissemination. Remote delivery of CR provides an opportunity to implement CR on a broader scale. While empirical support for the efficacy of in-person CR is robust, the evidence-base for virtual delivery of CR is limited. Thus, in this review we aimed to evaluate the feasibility and acceptability of remote CR interventions. Nine (n = 847) fully remote and one hybrid CR intervention were included in this review. Attrition rates for remote CR were generally high compared to control groups. Acceptability rates for remote CR interventions were high and responses from caregivers were positive. Further research using more methodologically rigorous designs is required to evaluate appropriate adaptations for remote treatment and determine which populations may benefit more from remote CR.

Understanding client engagement in digital mental health interventions: An investigation of the eTherapy Attitudes and Process Questionnaire

Aims

Digital mental health services may increase the accessibility and affordability of mental health treatments. However, client dropout a low use is often reported. The purpose of the current study was to investigate the structural validity of the e‐Therapy Attitudes and Process (eTAP) questionnaire, as a theoretically based (theory of planned behavior) tool for understanding ongoing client engagement intentions with digital mental health treatments. The possible role of eHealth literacy in predicting behavioral intentions to use digital mental health treatments was also examined.

Methods

Participants were 244 Australian‐based adults aged between 18 and 56 years, who were currently using a digital mental health tool. Data were collected via online survey.

Results

Confirmatory Factor Analysis was conducted, with good model fit obtained following two theoretically supported modifications. Moderated hierarchical regression supported the utility of the theory of planned behavior in predicting behavioral intentions, with attitudes emerging as a strong and consistent individual predictor. No support was found for the moderating role or individual significance of eHealth literacy.

Conclusions

These findings support the clinical and research use of the eTAP as a theory‐based measure to understand client engagement in digital mental health interventions. The study also highlights the need for interventions to target attitudes to improve clients' ongoing engagement in digital mental health.

Engagement Strategies to Improve Adherence and Retention in Web-Based Mindfulness Programs: Systematic Review

Background

Web-based mindfulness programs may be beneficial in improving the well-being outcomes of those living with chronic illnesses. Adherence to programs is a key indicator in improving outcomes; however, with the digitization of programs, it is necessary to enhance engagement and encourage people to return to digital health platforms. More information is needed on how engagement strategies have been used in web-based mindfulness programs to encourage adherence.

Objective

The aim of this study is to develop a list of engagement strategies for web-based mindfulness programs and evaluate the impact of engagement strategies on adherence.

Methods

A narrative systematic review was conducted across the MEDLINE Complete, CINAHL Complete, APA PsycINFO, and Embase databases and followed the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analysis) guidelines. Articles were screened using the population, intervention, comparator, and outcome framework. Adults aged >18 years with chronic health conditions were included in the study. Mindfulness interventions, including those in combination with mindfulness-based cognitive therapy, delivered on the web through the internet or smartphone technology were included. Interventions lasted at least 2 weeks. Studies with a randomized controlled trial design or a pilot randomized controlled trial design were included. Engagement strategies, including web-based program features and facilitator-led strategies, adherence, and retention, were included.

Results

A total of 1265 articles were screened, of which 19 were relevant and were included in the review. On average, 70.98% (2258/3181) of the study participants were women with a mean age of 46 (SD 13) years. Most commonly, mindfulness programs were delivered to people living with mental health conditions (8/19, 42%). Of the 19 studies, 8 (42%) used only program features to encourage adherence, 5 (26%) used facilitator-led strategies, and 6 (32%) used a combination of the two. Encouraging program adherence was the most common engagement strategy used, which was used in 77% (10/13) of the facilitator-led studies and 57% (8/14) of the program feature studies. Nearly two-thirds (63%) of the studies provided a definition of adherence, which varied between 50% and 100% completion across studies. The overall mean participant compliance to the mindfulness programs was 56% (SD 15%). Most studies (10/19, 53%) had a long-term follow-up, with the most common follow-up period being 12 weeks after intervention (3/10, 30%). After the intervention, the mean retention was 78% (SD 15%).

Conclusions

Engagement strategies in web-based mindfulness programs comprise reminders to use the program. Other features may be suitable for encouraging adherence to interventions, and a facilitator-led component may result in higher retention. There is variance in the way adherence is measured, and intervention lengths and follow-up periods are inconsistent. More thorough reporting and a standardized framework for measuring adherence are needed to more accurately assess adherence and engagement strategies.

Adapting Peer Researcher Facilitated Strategies to Recruit People Receiving Mental Health Services to a Tobacco Treatment Trial

INTRODUCTION

One of the most challenging aspects of conducting intervention trials among people who experience severe mental illness (SMI) and who smoke tobacco, is recruitment. In our parent "QuitLink" randomized controlled trial (RCT), slower than expected peer researcher facilitated recruitment, along with the impact of COVID-19 pandemic restrictions, necessitated an adaptive recruitment response. The objectives of the present study were to: (i) describe adaptive peer researcher facilitated recruitment strategies; (ii) explore the effectiveness of these strategies; (iii) investigate whether recruitment strategies reached different subgroups of participants; and (iv) examine the costs and resources required for implementing these strategies. Finally, we offer experience-based lessons in a Peer Researcher Commentary.

METHODS

People were included in the RCT if they smoked at least 10 cigarettes a day and were accessing mental health support from the project's two partnering mental health organizations in Victoria, Australia. The majority of people accessing these services will have been diagnosed with SMI. Recruitment occurred over 2 years. We began with peer facilitated recruitment strategies delivered face-to-face, then replaced this with direct mail postcards followed by telephone contact. In the final 4 months of the study, we began online recruitment, broadening it to people who smoked and were accessing support or treatment (including from general practitioners) for mental health and/or alcohol or other drug problems, anywhere in the state of Victoria. Differences between recruitment strategies on key participant variables were assessed. We calculated the average cost per enrolee of the different recruitment approaches.

RESULTS

Only 109 people were recruited from a target of 382: 29 via face-to-face (March 2019 to April 2020), 66 from postcards (May 2020 to November 2020), and 14 from online (November to December 2020 and January to March 2021) strategies. Reflecting our initial focus on recruiting from supported independent living accommodation facilities, participants recruited face-to-face were significantly more likely to be living in partially or fully supported independent living (n = 29, <0.001), but the samples were otherwise similar. After the initial investment in training and equipping peer researchers, the average cost of recruitment was AU$1,182 per participant-~US$850. Face-to-face recruitment was the most expensive approach and postcard recruitment the least (AU$1,648 and AU$928 per participant).

DISCUSSION

Peer researcher facilitated recruitment into a tobacco treatment trial was difficult and expensive. Widely dispersed services and COVID-19 restrictions necessitated non-face-to-face recruitment strategies, such as direct mail postcards, which improved recruitment and may be worthy of further research.

CLINICAL TRIAL REGISTRATION

The trial is registered with ANZCTR (www.anzctr.org.au): ACTRN12619000244101 prior to the accrual of the first participant and updated regularly as per registry guidelines. The trial sponsor was the University of Newcastle, NSW, Australia.

Insight and the number of completed modules predict a reduction of positive symptoms in an Internet-based intervention for people with psychosis

Emerging evidence suggests that Internet-based interventions for people with psychosis (ICBTp) are feasible and efficacious. However, predictors of adherence and treatment outcomes are largely unknown. To narrow this research gap, we conducted secondary analyses on data from a randomized controlled trial, which evaluated an eight-week ICBTp intervention targeting topics, such as voice hearing, mindfulness, and others. In n = 100 participants with psychosis, we aimed at identifying sociodemographic, psychopathological, and treatment-related predictor variables of post-treatment symptoms and adherence (i.e., at least four completed modules). We followed a two-stage approach. First, we conducted regression analyses to examine the effect of single candidate predictors on post-treatment symptoms as well as adherence. Subsequently, we selected variables that met a significance threshold of p < .1 and entered them into linear and logistic multiple regression models. Whereas no variable was able to predict adherence, the number of completed modules was negatively associated with self-reported delusion severity at post-treatment. Additionally, higher pre-treatment insight predicted fewer hallucinations after treatment. Because this was one of the first studies to investigate predictors in ICBTp, more research is needed to customize future interventions to the needs of users.

Improving social functioning in people with schizophrenia-spectrum disorders via mobile experimental interventions: Results from the CLIMB pilot trial

Background

Patients with Schizophrenia Spectrum Disorders (SSD) demonstrate poor social functioning. While group-based approaches show long-term improvements, access to treatments is limited. Digital platforms hold promise to overcome barriers to treatment delivery and improve outcomes.

Objective

In a parallel arm, double-blind RCT, we tested CLIMB, a clinician-assisted, adjunct to treatment that includes computerized social cognition training (SCT), ecological momentary assessments (EMAs), group tele-therapy, and moderated messaging. CLIMB was compared to an active control that includes computerized general cognitive training (GCT), unstructured support groups, and unmoderated messaging.

Methods

The primary outcome was social functioning. Secondary outcomes were negative symptoms and quality of life (QoL). Given the sample size, Propensity Score Models were used to ensure balanced baseline covariates. Mixed-effects models examined change over time.

Results

24 participants completed the study (12 per arm). No significant between-group differences emerged in engagement. CLIMB participants engaged in a median of 8 sessions (IQR = 2), 2.8 h of SCT (IQR = 7.5), and 2710 EMAs; control participants engaged in a median of 9 sessions (IQR = 3) and 2.2 h of GCT (IQR = 7.9). As a group, participants showed significant improvements in social functioning (p = .046), with no between-group differences. Intent-to-treat analyses indicated greater improvements in QoL (p = .025) for the active control.

Conclusions

Delivering group-based mobile interventions to individuals with SSD is feasible. EMAs allow clinicians to maintain inter-session engagement, build participant self-awareness, and tailor treatment delivery. In this treatment model, whether SCT or GCT is more effective remains unclear. Further research will evaluate group-based mobile interventions to improve outcomes in SSD.

Predicting response to transdiagnostic iCBT for emotional disorders from patient and therapist involvement

BACKGROUND

Transdiagnostic iCBT has been shown to be effective for the treatment of emotional disorders. Less is known about the optimal level of therapist and patient involvement in these interventions. Specific characteristics of Internet-delivered interventions include treatment adherence (e.g., amount of review of the materials) and guidance (e.g., amount of therapist support). Exploring the importance of these elements in treatment outcome may help to maximize the efficiency of Internet-delivered psychological interventions.

AIM

In this study, we aimed to analyze the relationship between patient and therapist involvement (i.e., platform usage and amount of therapist guidance) in a sample of patients with emotional disorders who received transdiagnostic iCBT in Spanish public specialized mental healthcare services.

METHOD

This is a secondary analysis of a randomized controlled trial. The sample included 63 patients who completed transdiagnostic iCBT for emotional disorders. Platform usage metrics included number of logins into the platform and number of times the participants reviewed the modules. Therapist guidance was measured as the number of support phone calls with a therapist and their total duration (minutes). Logistic regressions and ROC analyses were performed to explore the predictive value of platform usage and therapist guidance in symptom reduction. Clinical outcomes included depressive and anxiety symptoms assessed at baseline and post-intervention. The bivariate relationship between the platform usage and therapist guidance variables was also explored.

RESULTS

Overall, platform usage and therapist guidance were not associated with symptom improvement. However, the patient and therapist involvement parameters were intercorrelated. Specifically, the number of calls and their duration were associated with a greater number of logins (r = 0.61; p < .001) and more frequent reviews of the modules (0.46 ≤ r ≤ 0.60; p < .001). Higher baseline depression and anxiety were, respectively, associated with greater improvements in depression (r = -0.37, p = .003) and anxiety after treatment completion (r = -0.48, p < .001).

DISCUSSION

The results suggest that there is no reliable cut-off point for platform usage and therapist guidance in predicting optimal symptom reduction. However, significant associations were found between platform usage and guidance variables that warrant additional research. More research on this topic is necessary to further clarify the role of these and other platform usage and guidance variables in Internet-delivered iCBT outcomes.

Is Fun For Wellness Engaging? Evaluation of User Experience of an Online Intervention to Promote Well-Being and Physical Activity

Online well-being interventions demonstrate great promise in terms of both engagement and outcomes. Fun For Wellness (FFW) is a novel online intervention grounded in self-efficacy theory and intended to improve multidimensional well-being and physical activity through multi-modal methods. These strategies include capability-enhancing opportunities, learning experiences such as games, video vignettes, and self-assessments. RCT studies have suggested that FFW is efficacious in improving subjective and domain-specific well-being, and effective in improving mental health, physical health, physical activity, and self-efficacy in United States. adults who are overweight and in the general population. The present study uses qualitative and quantitative user experience data collected during two RCT trials to understand and evaluate engagement with FFW, its drivers, and its outcomes. Results suggest that FFW is enjoyable, moderately engaging, and easy to use; and contributes to positive outcomes including skill development and enhanced confidence, for both overweight individuals and the general adult population. Drivers of engagement appear to include rewards, gamification, scenario-based learning, visual tracking for self-monitoring, ease of use and simple communications, and the entertaining, interactive nature of program activities. Findings indicate that there are opportunities to streamline and simplify the experience. These results can help improve FFW and contribute to the science of engagement with online interventions designed to improve well-being.

Improved cancer coping from a web-based intervention for prostate cancer survivors: A randomized controlled trial

OBJECTIVES

Prostate cancer (PCa) survivors report poor physical functioning alongside negative psychological outcomes as they cope with treatment side effects and practical concerns after treatment completion. This study evaluated PROGRESS, a web-based intervention designed to improve adaptive coping among PCa survivors.

METHODS

Localized PCa patients (N = 431) within one year of treatment completion were randomized to receive educational booklets or PROGRESS + educational booklets. Surveys completed at baseline, 1-, 3-, and 6-months assessed patient characteristics; functional quality of life and coping (primary outcomes); and psychosocial outcomes (e.g., self-efficacy, marital communication; secondary outcomes). Intent-to-treat and as-treated analyses were completed to assess change in outcomes from baseline to 6 months using linear mixed effects regression models.

RESULTS

In the intent-to-treat analyses, participants randomized to the intervention group had improved diversion coping (i.e., healthy redirection of worrying thoughts about their cancer), but more difficulties in marital communication (ps < 0.05). However, PROGRESS usage was low among those randomized to the intervention group (38.7%). The as-treated analyses found PROGRESS users reported fewer practical concerns but had worse positive coping compared to PROGRESS non-users (ps < 0.05).

CONCLUSIONS

The findings suggest PROGRESS may improve certain aspects of adaptive coping among PCa survivors that use the website, but does not adequately address the remaining coping and psychosocial domains. Additional research is needed to better understand the gaps in intervention delivery contributing to low engagement and poor improvement across all domains of functional quality of life and adaptive coping.

Can Smartphone Apps Assist People with Serious Mental Illness in Taking Medications as Prescribed?

Adherence research commonly happens in a silo, focused on a particular disease state or type of therapy. Learning from outside disciplines can bring new insights and ideas. This article presents adherence research as related to people with a diagnosis of a serious mental illness (SMI) and medication adherence through smartphone applications (apps). Individuals with SMI have high rates of not taking medication, increasing risks of relapse and hospitalization. Advances in technology may be advantageous in promoting taking medication. Smartphones apps have been designed for people with SMI. Further research is needed to evaluate their efficacy on improving rates of taking medication.

ReMindCare App for Early Psychosis: Pragmatic Real World Intervention and Usability Study

Background

eHealth interventions are widely used in clinical trials and increasingly in care settings as well; however, their efficacy in real-world contexts remains unknown. ReMindCare is a smartphone app that has been systematically implemented in a first episode of psychosis program (FEPP) for patients with early psychosis since 2018.

Objective

The objective of this study was to assess the efficacy of ReMindCare after 19 months of use in the clinic and varying use by individual patients.

Methods

The integration of the ReMindCare app into the FEPP started in October 2018. Patients with early psychosis self-selected to the app (ReMindCare group) or treatment as usual (TAU group). The outcome variables considered were adherence to the intervention and number of relapses, hospital admissions, and visits to urgent care units. Data from 90 patients with early psychosis were analyzed: 59 in the ReMindCare group and 31 in the TAU group. The mean age of the sample was 32.8 (SD 9.4) years, 73% (66/90) were males, 91% (83/90) were White, and 81% (74/90) were single.

Results

Significant differences between the ReMindCare and TAU groups were found in the number of relapses, hospitalizations, and visits to urgent care units, with each showing benefits for the app. Only 20% (12/59) of patients from the ReMindCare group had a relapse, while 58% (18/31) of the TAU patients had one or more relapses (χ²=13.7, P=.001). Moreover, ReMindCare patients had fewer visits to urgent care units (χ²=7.4, P=.006) and fewer hospitalizations than TAU patients (χ²=4.6, P=.03). The mean of days using the app was 352.2 (SD 191.2; min/max: 18-594), and the mean of engagement was 84.5 (SD 16.04).

Conclusions

To our knowledge, this is the first eHealth intervention that has preliminarily proven its benefits in the real-world treatment of patients with early psychosis.

International Registered Report Identifier (IRRID)

RR2-10.1111/eip.12960

Adaptation of a Digital Health Innovation to Prevent Relapse and Support Recovery in Youth Receiving Services for First-Episode Psychosis: Results From the Horyzons-Canada Phase 1 Study

Background

Developing a digital health innovation can require a substantial amount of financial and human resource investment before it can be scaled for implementation across geographical, cultural, and health care contexts. As such, there is an increased interest in leveraging eHealth innovations developed and tested in one country or jurisdiction and using these innovations in local settings. However, limited knowledge exists on the processes needed to appropriately adapt digital health innovations to optimize their transferability across geographical, cultural, and contextual settings.

Objective

We report on the results of an adaptation study of Horyzons, a digital health innovation originally developed and tested in Australia. Horyzons is designed to prevent relapses and support recovery in young people receiving services for first-episode psychosis (FEP). The aim of this study is to assess the initial acceptability of Horyzons and adapt it in preparation for pilot testing in Canada.

Methods

This research took place in 2 specialized early intervention clinics for FEP, located in 1 urban and 1 urban-rural setting, in 2 Canadian provinces. A total of 26 participants were recruited: 15 clinicians (age range 26-56 years) and 11 patients (age range 19-37 years). Following the digital health adaptation framework developed by our team, we used a mixed methods approach, combining descriptive quantitative and qualitative methods across 3 stages of data collection (focus groups, interviews, and consultations), analysis, and adaptations.

Results

Overall, patients and clinicians appreciated the strengths-based approach and social media features of Horyzons. However, participants expressed concerns related to implementation, especially in relation to capacity (eg, site moderation, crisis management, internet speed in rural locations). They also provided suggestions for adapting content and features, for example, in relation to community resources, volume of text, universal accessibility (eg, for individuals with limitations in vision), and optimization of platform accessibility through mobile devices. Additional aspects of the innovation were flagged for adaptation during the final stages of preparing it for live implementation. These included terms of use, time zone configuration to reflect local time and date, safety and moderation protocols, the need help now feature, and the list of trigger words to flag posts indicative of potential risk.

Conclusions

In the context of the COVID-19 pandemic and public health guidelines for social distancing, there is an increasing interest and need to leverage the internet and mobile technologies for delivering youth mental health services. As countries look to one another for guidance on how to navigate changing social dynamics, knowledge on how to utilize and adapt existing innovations across contexts is now more important than ever. Using a systematic approach, this study illustrates the methods, processes, results, and lessons learned on adapting a digital health innovation to enhance its local acceptability.

International Registered Report Identifier (IRRID)

RR2-10.2196/resprot.8810

The Therapeutic Alliance in Digital Mental Health Interventions for Serious Mental Illnesses: Narrative Review

BACKGROUND

Digital mental health interventions offer unique advantages, and research indicates that these interventions are effective for a range of mental health concerns. Although these interventions are less established for individuals with serious mental illnesses, they demonstrate significant promise. A central consideration in traditional face-to-face therapies is the therapeutic alliance, whereas the nature of a digital therapeutic alliance and its relationship with outcomes requires further attention, particularly for individuals with serious mental illnesses.

OBJECTIVE

This narrative review aims to encourage further consideration and critical evaluation of the therapeutic alliance in digital mental health, specifically for individuals with serious mental illnesses.

METHODS

A narrative review was conducted by combining 3 main areas of the literature: the first examining the evidence for digital mental health interventions for serious mental illnesses, the second illuminating the nature and role of the therapeutic alliance in digital interventions, and the third surrounding practical considerations to enhance a digital therapeutic alliance.

RESULTS

Results indicated that a therapeutic alliance can be cultivated in digital interventions for those with serious mental illnesses, but that it may have unique, yet-to-be-confirmed characteristics in digital contexts. In addition, a therapeutic alliance appears to be less directly associated with outcomes in digital interventions than with those in face-to-face therapies. One possibility is that the digital therapeutic alliance is associated with increased engagement and adherence to digital interventions, through which it appears to influence outcomes. A number of design and implementation considerations may enhance the digital therapeutic alliance, including human support and technological features.

CONCLUSIONS

More research is required to further understand the nature and specific role of a therapeutic alliance in digital interventions for serious mental illnesses, particularly in informing their design. This review revealed several key research priorities to advance the therapeutic alliance in digital interventions.

Engaging With a Web-Based Psychosocial Intervention for Psychosis: Qualitative Study of User Experiences

BACKGROUND

Web-based interventions are increasingly being used for individuals with serious mental illness, including psychosis, and preliminary evidence suggests clinical benefits. To achieve such benefits, individuals must have some level of engagement with the intervention. Currently, little is known about what influences engagement with web-based interventions for individuals with psychotic disorders.

OBJECTIVE

This study aimed to explore users' perspectives on what influenced engagement with a web-based intervention for psychosis.

METHODS

A qualitative design was employed using semistructured telephone interviews. Participants were 17 adults with psychosis who had participated in a trial examining engagement with a self-guided, web-based intervention promoting personal recovery and self-management of mental health.

RESULTS

We identified 2 overarching themes: challenges to using the website and factors supporting persistence. Both of the main themes included several subthemes related to both user-related factors (eg, mental health, personal circumstances, approach to using the website) and users' experience of the intervention (eg, having experienced similar content previously or finding the material confronting).

CONCLUSIONS

Individuals with psychosis experienced several challenges to ongoing engagement with a web-based intervention. Adjunctive emails present an important design feature to maintain interest and motivation to engage with the intervention. However, fluctuations in mental health and psychosocial difficulties are a significant challenge. Design and implementation considerations include flexible interventions with tailoring opportunities to accommodate changeable circumstances and individual preferences.

Leveraging the social network for treatment of social anxiety: Pilot study of a youth-specific digital intervention with a focus on engagement of young men

OBJECTIVE

The primary objective was to determine the acceptability, feasibility and safety of a novel digital intervention (Entourage) for young people with prominent social anxiety symptoms, with a particular focus on the engagement of young men. The secondary aim was to explore whether the intervention was associated with clinically significant improvements to clinical and social variables known to co-occur with social anxiety.

METHOD

A multidisciplinary team comprising of mental health clinicians, researchers, young adult fiction writers, a comic artist and young people with a lived experience of social anxiety developed the Entourage platform in collaboration. Entourage combines evidence-based therapeutic techniques for social anxiety with an engaging, social-media-based interface that allows users to build social connections, while also receiving expert clinical moderation and support from peer workers. Acceptability, feasibility and safety outcomes of Entourage were tested in a 12-week pilot study with 89 young people (48.3% male; age M = 19.8 years, SD = 3.3 years). Eligible participants were recruited via liaison with four headspace early-intervention centres in north-western Melbourne.

RESULTS

56.8% of the sample reported social anxiety symptoms in the severe or very severe range at baseline. Results demonstrated the Entourage intervention was feasible, safe, and potentially acceptable, with 98.6% of participants reporting they would recommend Entourage to another young person experiencing social anxiety. Usage results were also comparable across male and non-male participants. Results showed that young people reliably and significantly improved on clinical and social variables. In particular, young males showed a clinically significant improvement on social anxiety symptoms (d = 0.79, p < .001), depression (d = 0.71, p < .001), belongingness (d = 0.58, p = .001), increased feelings of social connectedness (d = 0.46, p = .004) and decreased loneliness (d = 0.46, p = .006). Non-male participants also experienced a significant increase in social connectedness (d = 0.76, p < .001), alongside reduced social anxiety (d = 0.78, p < .001) and experiential avoidance (d = 0.81, p < .001).

CONCLUSIONS

Entourage is a highly engaging and potentially effective intervention that represents a novel combination of features designed both to reduce social anxiety symptoms and improve social connection among young people. Entourage demonstrated some acceptability, feasibility and safety, with encouraging benefits to clinical and social variables. Entourage also showed favorable results for the engagement and support of young men with social anxiety symptoms.