From Research to Practice: Ten Lessons in Delivering Digital Mental Health Services

"It happened to be the perfect thing": experiences of generative AI chatbots for mental health

The global mental health crisis underscores the need for accessible, effective interventions. Chatbots based on generative artificial intelligence (AI), like ChatGPT, are emerging as novel solutions, but research on real-life usage is limited. We interviewed nineteen individuals about their experiences using generative AI chatbots for mental health. Participants reported high engagement and positive impacts, including better relationships and healing from trauma and loss. We developed four themes: (1) a sense of 'emotional sanctuary', (2) 'insightful guidance', particularly about relationships, (3) the 'joy of connection', and (4) comparisons between the 'AI therapist' and human therapy. Some themes echoed prior research on rule-based chatbots, while others seemed novel to generative AI. Participants emphasised the need for better safety guardrails, human-like memory and the ability to lead the therapeutic process. Generative AI chatbots may offer mental health support that feels meaningful to users, but further research is needed on safety and effectiveness.

Current and Future Implementation of Digitally Delivered Psychotherapies: An Exploratory Mixed-Methods Investigation of Client, Clinician, and Community Partner Perspectives

INTRODUCTION

Following the initial outbreak of the COVID-19 pandemic, mental health clinicians rapidly shifted service delivery from in-person to digital. This pivot was instrumental in maintaining continuity of care and meeting increased mental health service demands. Many mental health services have continued to be offered via digital delivery. The long-term implications of delivering services via digital media remain unclear and need to be addressed.

OBJECTIVES

This study aimed to identify current micro (i.e., clinician-patient interactions), meso (i.e., clinician-clinic manager interactions), and macro (i.e., government-policy maker interactions) level issues surrounding the use of digital mental health interventions (DMHI). Such integrated assessments are important for optimizing services to improve treatment outcomes and client satisfaction.

METHODS

Participants were recruited between January 2022 and April 2023. Quantitative data were collected using a survey informed by the Hexagon Tool. Qualitative data were collected from online semi-structured interviews and focus groups and analyzed using rapid thematic analysis.

RESULTS

Survey data were collected from 11 client and 11 clinician participants. Twenty-six community partner participants were interviewed for this study. Client and clinician participants expressed satisfaction with the implementation of DMHI. Community partner participants generally agreed, reporting that such services will play an integral role in mental healthcare moving forward. Community partners shared that certain issues, such as uncertainty surrounding policies and regulations related to digital delivery, must be addressed in the future.

CONCLUSIONS

Participants in this study supported the use of DMHI despite difficulties implementing these programs, asserting that such services are not a temporary fix but a pivotal cornerstone in the future of mental healthcare service delivery.

Improving Access and Quality of Behavioral Health Services for Health Care Employees

OBJECTIVE

To describe key features and the initial implementation of an employer-sponsored program designed to increase access to quality mental health treatment for employees of a large health care system. Methods: Retrospective data were collected on employer's efforts to develop a programmatic solution to address barriers to accessing quality mental health treatment among its employees and on initial program implementation. Results: Data from the initial cohort ( N = 1049) of program participants support the use of low threshold digital tools to enhance access to care, the importance of care navigation and a robust curated provider network in matching employees to appropriate care options, and the value of providing online, evidence-based psychotherapy to facilitate high rates of treatment engagement. Conclusions: Findings can help inform employers about approaches to improve access to quality mental health treatment for their employees.

Evaluation of a Web-based Information Platform for Youths on Mental Health During the COVID-19 Pandemic

During the corona pandemic, youths were confronted with substantial challenges and in urgent need of information on how to prevent mental health problems. This experimental pre-post-follow-up study examined the efficacy and reception of an innovative website ( www.corona-und-du.info ) containing evidence-based information for youths on how to overcome psychological distress during the pandemic. 34 youths aged 11-18 years were presented domains of the website in the laboratory. Standardized questionnaires were applied to assess changes in knowledge, the reception of the website, and changes in behavioral intention to seek psychological help. For all content domains, we found a significant knowledge gain with large effect sizes from pre to post, and from pre to follow-up. The reception of the website was very positive, and participants indicated increased intention to seek psychological support when needed. The results constitute an important basis for future attempts to promote mental health information in youths in times of crisis.

Digital Mental Health for Schizophrenia and Other Severe Mental Illnesses: An International Consensus on Current Challenges and Potential Solutions

BACKGROUND

Digital approaches may be helpful in augmenting care to address unmet mental health needs, particularly for schizophrenia and severe mental illness (SMI).

OBJECTIVE

An international multidisciplinary group was convened to reach a consensus on the challenges and potential solutions regarding collecting data, delivering treatment, and the ethical challenges in digital mental health approaches for schizophrenia and SMI.

METHODS

The consensus development panel method was used, with an in-person meeting of 2 groups: the expert group and the panel. Membership was multidisciplinary including those with lived experience, with equal participation at all stages and coproduction of the consensus outputs and summary. Relevant literature was shared in advance of the meeting, and a systematic search of the recent literature on digital mental health interventions for schizophrenia and psychosis was completed to ensure that the panel was informed before the meeting with the expert group.

RESULTS

Four broad areas of challenge and proposed solutions were identified: (1) user involvement for real coproduction; (2) new approaches to methodology in digital mental health, including agreed standards, data sharing, measuring harms, prevention strategies, and mechanistic research; (3) regulation and funding issues; and (4) implementation in real-world settings (including multidisciplinary collaboration, training, augmenting existing service provision, and social and population-focused approaches). Examples are provided with more detail on human-centered research design, lived experience perspectives, and biomedical ethics in digital mental health approaches for SMI.

CONCLUSIONS

The group agreed by consensus on a number of recommendations: (1) a new and improved approach to digital mental health research (with agreed reporting standards, data sharing, and shared protocols), (2) equal emphasis on social and population research as well as biological and psychological approaches, (3) meaningful collaborations across varied disciplines that have previously not worked closely together, (4) increased focus on the business model and product with planning and new funding structures across the whole development pathway, (5) increased focus and reporting on ethical issues and potential harms, and (6) organizational changes to allow for true communication and coproduction with those with lived experience of SMI. This study approach, combining an international expert meeting with patient and public involvement and engagement throughout the process, consensus methodology, discussion, and publication, is a helpful way to identify directions for future research and clinical implementation in rapidly evolving areas and can be combined with measurements of real-world clinical impact over time. Similar initiatives will be helpful in other areas of digital mental health and similarly fast-evolving fields to focus research and organizational change and effect improved real-world clinical implementation.

Association between expectations and clinical outcomes in online v. face-to-face therapy - an individual participant data meta-analysis

BACKGROUND

Online treatments are increasing in number and are currently available for a wide range of clinical problems. To date little is known about the role of treatment expectations and other placebo-like mechanisms in online settings compared to traditional face-to-face treatment. To address this knowledge gap, we analyzed individual participant data from randomized clinical trials that compared online and face-to-face psychological interventions.

METHODS

MEDLINE (Ovid) and PsycINFO (Ovid) were last searched on 2 February 2021. Randomized clinical trials of therapist guided online v. face-to-face psychological interventions for psychiatric or somatic conditions using a randomized controlled design were included. Titles, abstracts, and full texts of studies were independently screened by multiple observers. The Preferred Reporting Items for Systematic Reviews and Meta-analyses guideline was followed. Authors of the matching trials were contacted for individual participant data. Ratings from the Credibility and Expectancy Questionnaire and the primary outcome measure from each trial were used to estimate the association between expectation ratings and treatment outcomes in online v. face-to-face interventions, using a mixed-effects model.

RESULTS

Of 7045 screened studies, 62 full-text articles were retrieved whereof six studies fulfilled the criteria and provided individual participant data (n = 491). Overall, CEQ ratings predicted clinical outcomes (β = 0.27) at end of treatment with no moderating effect of treatment modality (online v. face-to-face).

CONCLUSIONS

Online treatment appears to be equally susceptible to expectancy effects as face-to-face therapy. This furthers our understanding of the importance of placebo-like factors in online treatment and may aid the improvement of healthcare in online settings.

Identifying and developing strategies for implementation of a guided internet- and mobile-based infant sleep intervention in well-baby and community mental health clinics using group concept mapping

BACKGROUND

This study aimed to identify strategies for the implementation of a guided internet- and mobile-based intervention (IMI) for infant sleep problems ("Sleep Well, Little Sweetheart") in well-baby and community mental health clinics.

STUDY DESIGN

We used group concept mapping, a two-phased mixed methods approach, conducted as a two-day workshop in each clinic. We recruited 20 participants from four clinics and collected sorting and rating data for implementation strategies based on the Expert Recommendations for Implementing Change taxonomy and brainstorming sessions. Data were analyzed using descriptive statistics, multidimensional scaling, and hierarchical cluster analysis to create cluster maps, laddergrams, and Go-Zone graphs. Participants were presented with the results and discussed and interpreted the findings at each of the clinics in spring 2022.

RESULTS

Participants identified 10 clusters of strategies, of which Training, Embedding and Coherence, User Involvement and Participation, and Clinician Support and Implementation Counseling were rated as most important and feasible. Economy and Funding and Interactive and Interdisciplinary Collaboration were rated significantly lower on importance and feasibility compared to many of the clusters (all ps < 0.05). There was a correlation between the importance and feasibility ratings (r =.62, p =.004).

CONCLUSIONS

The use of group concept mapping made it possible to efficiently examine well-baby and community clinics' perspectives on complex issues, and to acquire specific knowledge to allow for the planning and prioritization of strategies for implementation. These results suggest areas of priority for the implementation of IMIs related to infant sleep problems.

TRIAL REGISTRATION

The study was pre-registered at Open Science Framework ( www.osf.io/emct8 ).

Hurdles and potentials when implementing internet-delivered Acceptance and commitment therapy for chronic pain: a retrospective appraisal using the Quality implementation framework

OBJECTIVES

Internet-delivered psychological interventions can be regarded as evidence-based practices and have been implemented in psychiatric and somatic care at primary and specialist levels. However, challenges as low adherence and poor routinization, have arisen during attempts to implement internet-delivered interventions in chronic pain settings. Internet-delivered Acceptance and Commitment Therapy (IACT) has been found to be helpful for chronic pain patients and might aid in developing pain rehabilitation services. However, the integration of IACT into standard health care has not yet been described from an implementation science perspective. The aim of this hybrid 1 effectiveness-implementation study was to evaluate the process of implementing IACT in a pain rehabilitation setting, to guide future implementation initiatives.

METHODS

In this retrospective study we described actions taken during an implementation initiative, in which IACT was delivered as part of an interdisciplinary pain rehabilitation program (IPRP) at a specialist level clinic. All documents relevant to the study were reviewed and coded using the Quality Improvement Framework (QIF), focusing on adoption, appropriateness and sustainability.

RESULTS

The QIF-analysis of implementation actions resulted in two categories: facilitators and challenges for implementation. Sustainability may be facilitated by sensitivity to the changing needs of a clinical setting and challenged by unfitting capacity building. Appropriateness might be challenged by an insufficient needs assessment and facilitated by aligning routines for communication with the clinic's existing infrastructure. Adoption may be facilitated by staff key champions and an ability to adapt to occurring hurdles. Possible influential factors, hypotheses and key process challenges are presented in a logic model to guide future initiatives.

CONCLUSIONS

Sustainable implementation may depend on both the continuity of facilitating implementation actions and flexibility to the changing needs and interests of patients, caregivers and organization. We conclude that the use of theories, models and frameworks (TMF) as well as a logic model may ease design, planning and evaluation of an implementation process. Lastly, we suggest that IACT may be appropriate for IPRP when given before or after IPRP, focusing on psychiatric comorbidities.

From research to routine care: A historical review of internet-based cognitive behavioral therapy for adult mental health problems in Sweden

This narrative historical review examines the development of internet-based cognitive behavioral therapy (ICBT) in Sweden, describing its progression within both academic and routine care settings. The review encompasses key publications, significant scientific findings, and contextual factors in real-world settings. Over 25 years ago, Sweden emerged as a pioneering force in internet-delivered treatment research for mental health. Since then, Swedish universities, in collaboration with research partners, have produced substantial research demonstrating the efficacy of ICBT across various psychological problems, including social anxiety disorder, panic disorder, generalized anxiety disorder, and depression. Although research conducted in clinical settings has been less frequent than in academic contexts, it has confirmed the effectiveness of therapist-supported ICBT programs for mild-to-moderate mental health problems in routine care. Early on, ICBT was provided as an option for patients at both the primary care level and in specialized clinics, using treatment programs developed by both public and private providers. The development of a national platform for delivering internet-based treatment and the use of procurement in selecting ICBT programs and providers are factors that have shaped the current routine care landscape. However, gaps persist in understanding how to optimize the integration of digital treatment in routine care, warranting further research and the use of specific implementation frameworks and outcomes. This historical perspective on the research and delivery of ICBT in Sweden over two decades offers insights for the international community into the development and broad dissemination of a specific digital mental health intervention within a national context.

How Can Digital Mental Health Enhance Psychiatry?

The use of digital technologies is constantly growing around the world. The wider-spread adoption of digital technologies and solutions in the daily clinical practice in psychiatry seems to be a question of when, not if. We propose a synthesis of the scientific literature on digital technologies in psychiatry and discuss the main aspects of its possible uses and interests in psychiatry according to three domains of influence that appeared to us: 1) assist and improve current care: digital psychiatry allows for more people to have access to care by simply being more accessible but also by being less stigmatized and more convenient; 2) develop new treatments: digital psychiatry allows for new treatments to be distributed via apps, and practical guidelines can reduce ethical challenges and increase the efficacy of digital tools; and 3) produce scientific and medical knowledge: digital technologies offer larger and more objective data collection, allowing for more detection and prevention of symptoms. Finally, ethical and efficacy issues remain, and some guidelines have been put forth on how to safely use these solutions and prepare for the future.

Implementing digital mental health interventions at scale: one-year evaluation of a national digital CBT service in Ireland

BACKGROUND

In recent years, exponential growth in digital innovations and internet access has provided opportunities to deliver health services at a much greater scale than previously possible. Evidence-based technology-enabled interventions can provide cost-effective, accessible, and resource-efficient solutions for addressing mental health issues. This study evaluated the first year of a supported digital cognitive behavioral therapy (CBT) service provided by the national health service in Ireland, which has been accessible to individuals who receive a referral from one of five referring groups: General Practitioners, Primary Care Psychology, Counselling Primary Care, Community Mental Health, and Jigsaw (a nationwide youth mental health service).

METHODS

A retrospective, observational study examining data from the service between April 2021 to April 2022 was conducted. Descriptive statistics on referrals, account activations, user demographics, program usage, and user satisfaction were extracted, and pre-to-post clinical outcomes for depression measured by the Patient Health Questionnaire-9 and for anxiety measured by the Generalised Anxiety Disorder-7 were analysed using linear mixed effect models.

RESULTS

There were 5,298 referrals and 3,236 (61%) account activations within the year. Most users were female (72.9%) and aged between 18 and 44 years (75.4%). The CBT programs were associated with significant reductions in both depression (β = 3.34, 95% CI [3.03, 3.65], p < 0.001) and anxiety (β = 3.64, 95% CI [3.36, 3.93], p < 0.001), with large effect sizes (Cohen's d > 0.8). Time spent using the programs was also found to be a predictor of the variability in these clinical outcomes (p < 0.001), and accounting for this resulted in significantly better model fits (p < 0.001). User satisfaction ratings were also very high, exceeding 94%.

CONCLUSIONS

Efforts to improve the representation of male and older adult users are warranted. However, overall, the results demonstrate how digital CBT can be provided at scale and lead to symptom reductions with large effect sizes for patients seeking help for depression and anxiety. The findings substantiate the continued use and expansion of this service in Ireland and the more widespread implementation of similar services in other international public healthcare settings.

Cultural Responsivity in Technology-Enabled Services: Integrating Culture Into Technology and Service Components

Technology-enabled services (TESs) are clinical interventions that combine technological and human components to provide health services. TESs for mental health are efficacious in the treatment of anxiety and depression and are currently being offered as frontline treatments around the world. It is hoped that these interventions will be able to reach diverse populations across a range of identities and ultimately decrease disparities in mental health treatment. However, this hope is largely unrealized. TESs include both technology and human service components, and we argue that cultural responsivity must be considered in each of these components to help address existing treatment disparities. To date, there is limited guidance on how to consider cultural responsivity within these interventions, including specific targets for the development, tailoring, or design of the technologies and services within TESs. In response, we propose a framework that provides specific recommendations for targets based on existing models, both at the technological component level (informed by the Behavioral Intervention Technology Model) and the human support level (informed by the Efficiency Model of Support). We hope that integrating culturally responsive considerations into these existing models will facilitate increased attention to cultural responsivity within TESs to ensure they are ethical and responsive for everyone.

Access to Virtual Mental Healthcare and Support for Refugee and Immigrant Groups: A Scoping Review

Immigrant and refugee populations face multiple barriers to accessing mental health services. This scoping review applies the (Levesque et al. in Int J Equity Health 12:18, 2013) Patient-Centred Access to Healthcare model in exploring the potential of increased access through virtual mental healthcare services VMHS for these populations by examining the affordability, availability/accommodation, and appropriateness and acceptability of virtual mental health interventions and assessments. A search in CINAHL, MEDLINE, PSYCINFO, EMBASE, SOCINDEX and SCOPUS following (Arksey and O'Malley in Int J Soc Res Methodol 8:19-32, 2005) guidelines found 44 papers and 41 unique interventions/assessment tools. Accessibility depended on individual (e.g., literacy), program (e.g., computer required) and contextual/social factors (e.g., housing characteristics, internet bandwidth). Participation often required financial and technical support, raising important questions about the generalizability and sustainability of VMHS' accessibility for immigrant and refugee populations. Given limitations in current research (i.e., frequent exclusion of patients with severe mental health issues; limited examination of cultural dimensions; de facto exclusion of those without access to technology), further research appears warranted.

Internet-Delivered Cognitive Behavioral Therapy Tailored to Spouses and Significant Others of Public Safety Personnel: Formative Evaluation Study

BACKGROUND

Spouses and significant others (SSOs) of public safety personnel (PSP) are affected by the risks and requirements of these occupations. Internet-delivered cognitive behavioral therapy (ICBT) provides a convenient and accessible treatment format that can be tailored to the needs of SSOs of PSP.

OBJECTIVE

This study aimed to assess the initial use and client perceptions (eg, likes, helpfulness, and areas for improvement) of a self-guided, transdiagnostic ICBT course designed for Canadian SSOs of PSP and identify opportunities to further tailor ICBT for this group.

METHODS

SSOs were invited to complete a 5-lesson, self-guided, transdiagnostic ICBT course. Descriptive statistics were used to analyze the demographic and clinical characteristics of participants. Content analysis was used to analyze the data from open-ended survey responses and interviews to understand their experiences with ICBT.

RESULTS

Clients (N=118) endorsed various mental health concerns (eg, depression, anxiety, posttraumatic stress symptoms, and relationship concerns) with a range of severity levels. Most clients identified as White (110/116, 94.8%) and women (108/116, 91.5%), with a mean age of 42.03 (SD 9.36) years. Of the 26 clients who were interviewed, 89% (23/26) reported believing that ICBT is helpful and 92% (24/26) reported finding at least 1 skill helpful. Clients provided suggestions for course improvements. On the basis of this feedback and quantitative data, changes were made to areas such as the delivery of materials, content, case stories, and timelines. Overall, the results indicated that many SSOs of PSP had positive perceptions of ICBT tailored to their needs and found several aspects of the course helpful, supporting the continued delivery of tailored ICBT to this population. However, there remains a need for continued promotion of the course and outreach to diverse groups of SSOs of PSP.

CONCLUSIONS

Findings from this formative evaluation provide insight into the unique experiences and needs of SSOs of PSP and provide preliminary evidence for the use of tailored ICBT to support the mental health of this group in Canada.

Implementing internet-delivered cognitive behavioral therapy in healthcare services: a qualitative exploration of stakeholder experience

Background

This study consisted of a qualitative exploration of stakeholder experience regarding the implementation of internet-delivered cognitive behavioral therapy (iCBT) as part of routine service provision within the UK's Improving Access to Psychological Therapies program.

Methods

Stakeholder groups included service providers (n = 6), commercial iCBT representatives (n = 6) and patients who received a course of iCBT as part of treatment at the service (n = 7). Participants took part in a semi-structured interview over the telephone, and subsequent data were qualitatively analyzed using the descriptive-interpretive approach.

Results

Service providers highlighted the importance of effective leadership and management, training initiatives, the provision of feedback to commercial iCBT representatives and creating work structures around iCBT to facilitate iCBT supporting staff in their use of it. Commercial iCBT representatives similarly reported the importance of training clinicians in iCBT use, identifying the appropriate individuals at all levels of the service to drive iCBT implementation, and the importance of being responsive to any problems or needs that arise from the service. Patients reported an overall positive experience of receiving iCBT but highlighted a need for more information from their supporter and the intervention to better structure their usage. Contextual factors, in terms of barriers and facilitators, were also highlighted by service provider and commercial participants; citing negative clinician attitudes and technological issues/bugs as barriers to implementation, and the exposure to iCBT created by COVID-19 and perseverance in using iCBT over time as facilitators.

Discussion

The findings contribute to a growing field of literature that seeks to understand the experience of relevant stakeholders who are involved with and contribute to iCBT implementation, including commercial iCBT representatives who, to our knowledge, have not been accounted for as part of published research to date.

A two-phase, prescriptive comparative effectiveness study to optimize the treatment of co-occurring insomnia and depression with digital interventions

BACKGROUND

Insomnia and depression frequently co-occur. Significant barriers preclude a majority of patients from receiving first line treatments for both disorders in a sequential treatment episode. Although digital versions of cognitive behavioral therapy for insomnia (CBTI) and for depression (CBTD) hold some promise to meet demand, especially when paired with human support, it is unknown whether heterogeneity of treatment effects exist, such that some patients would be optimally treated with single or sequential interventions.

OBJECTIVE

Describe the protocol for a two-phase, prescriptive comparative effectiveness study to develop and evaluate an individualized intervention rule (IIR) for prescribing the optimal digital treament of co-occurring insomnia and depression.

METHODS

The proposed sample size is 2300 U.S. military veterans with insomnia and depression recruited nationally (Phase 1 = 1500; Phase 2 = 800). In each phase, the primary endpoint will be remission of both depression and insomnia 3 months following a 12-week intervention period. Phase 1 is a 5-arm randomized trial: two single digital interventions (CBT-I or CBT-D); two sequenced interventions (CBT-I + D or CBT-D + I); and a mood monitoring control condition. A cutting-edge ensemble machine learning method will be used to develop the IIR. Phase 2 will evaluate the IIR by randomizing participants with equal allocation to either the IIR predicted optimal intervention for that individual or by randomization to one the four CBT interventions.

RESULTS

Study procedures are ongoing. Results will be reported in future manuscripts.

CONCLUSION

The study will generate evidence on the optimal scalable approach to treat co-occurring insomnia and depression.

An open trial of the feasibility of brief internet-delivered acceptance and aommitment therapy (iACT) for chronic anxiety and depression

Anxiety and depressive disorders are common, often chronic and result in significant disability and distress. The delivery of psychological interventions via the internet is now recognised to be a safe and effective way to treat these disorders. The predominant therapeutic model in clinical trials and in routine care has been cognitive-behavioural therapy (CBT), which helps patients identify and modify unhelpful thoughts and behaviours. However, other models of treatment for anxiety and depression, such as acceptance and commitment therapy (ACT), which uses the examination of both positive and negative experiences in the service of living a personally meaningful and values-based life, have been developed and tested, although most of these interventions are long and require more clinician support to ensure adherence and achieve positive outcomes. The aim of the present study was to examine the feasibility of a new brief, clinician supported transdiagnostic internet-delivered (iACT) program, designed to treat symptoms of both anxiety and depression and improve social function. A single-group open trial was conducted on 24 adults with long-term symptoms of anxiety and depression. The course is comprised of five online modules delivered over 8 weeks either self-guided or with support from a clinician. There was a high course completion rate (70 %) and a high level of satisfaction with the course (94 % satisfied or very satisfied). Significant clinical improvement in our primary outcome measures (within-group Cohen's d) of anxiety (d ≥ 0.62), depression (d ≥ 0.63), disability (d ≥ 0.43) and quality of life (d ≥ -0.57) were observed at posttreatment. Relatively little clinician time was required per participant (M = 30.6 min, SD = 5.7). The findings of the current study support the feasibility and potential of a transdiagnostic iACT treatment for adults experiencing long-term symptoms of anxiety and depression, including those patients who have not derived benefit from other treatments.

Relationship Factors in Internet-Delivered Psychological Interventions for Veterans Experiencing Postpartum Depression: Qualitative Analysis

BACKGROUND

Internet-delivered psychological interventions (IPIs) have been shown to be effective for a variety of psychological concerns, including postpartum depression. Human-supported programs produce better adherence and larger effect sizes than unsupported programs; however, what it is about support that affects outcomes is not well understood. Therapeutic alliance is one possibility that has been found to contribute to outcomes; however, the specific mechanism is not well understood. Participant perspectives and qualitative methodology are nearly absent from the IPI alliance research and may help provide new directions.

OBJECTIVE

In this study, we aimed to provide participant perspectives on engagement with an IPI for postpartum depression to help inform alliance research, development of new IPIs, and inform resource allocation.

METHODS

A qualitative methodology was used to explore participant perspectives of veteran women's engagement with the MomMoodBooster program, a human-supported internet-delivered intervention for postpartum depression. Participants were asked 4 open-ended questions with the 3-month postintervention survey, "In what ways did you find the MomMoodBooster most helpful?" "How do you think the MomMoodBooster could have been improved?" "In what ways did you find the personal coach calls to be helpful?" and "How do you think the personal coach calls could have been improved?"

RESULTS

Data were collected from 184 participants who responded to at least 1 of the open-ended questions. These were analyzed using thematic analysis and a process of reaching a consensus among coders. The results suggest that not only the engagement with the support person is perceived as a significant contributor to participant experiences while using the MomMoodBooster content but also the relationship factors are particularly meaningful. The results provide insights into the specific qualities of the support person that were perceived as most impactful, such as warmth, empathy and genuineness, and feeling normalized and supported. In addition, the results provide insight into the specific change processes that can be targeted through support interactions, such as encouraging self-reflection and self-care and challenging negative thinking.

CONCLUSIONS

These data emphasize the importance of relationship factors between support persons and an IPI program for postpartum depression. The findings suggest that focusing on specific aspects of the alliance and the therapeutic relationship could yield fruitful directions for the training of support personnel and for future alliance-based research of internet-delivered treatments.

Factors Affecting Digital Tool Use in Client Interaction According to Mental Health Professionals: Interview Study

BACKGROUND

Digital tools and interventions are being increasingly developed in response to the growing mental health crisis, and mental health professionals (MHPs) considerably influence their adoption in client practice. However, how MHPs use digital tools in client interaction is yet to be sufficiently understood, which poses challenges to their design, development, and implementation.

OBJECTIVE

This study aimed to create a contextual understanding of how MHPs use different digital tools in clinical client practice and what characterizes the use across tools.

METHODS

A total of 19 Finnish MHPs participated in semistructured interviews, and the data were transcribed, coded, and inductively analyzed.

RESULTS

We found that MHP digital tool use was characterized by 3 distinct functions: communication, diagnosis and evaluation, and facilitating therapeutic change. The functions were addressed using analog tools, digitized tools that mimic their analog counterparts, and digital tools that use the possibilities native to digital. The MHP-client communication included various media alongside face-to-face meetings, the MHPs increasingly used digitized tools in client evaluation, and the MHPs actively used digitized materials to facilitate therapeutic change. MHP tool use was generally characterized by adaptability-it was negotiated in client interactions. However, there was considerable variance in the breadth of MHPs' digital toolbox. The existing clinical practices emphasized MHP-client interaction and invited incremental rather than radical developments, which challenged the achievement of the scalability benefits expected from digital tools.

CONCLUSIONS

MHPs use digitized and digital tools in client practice. Our results contribute to the user-centered research, development, and implementation of new digital solutions in mental health care by classifying them according to their function and medium and describing how MHPs use and do not use them.

Free choice of treatment content, support on demand and supervision in internet-delivered CBT for adults with depression: A randomized factorial design trial

Even if much is known regarding the effects of internet-delivered cognitive behaviour therapy (ICBT) for depression there are several topics that have not been studied. In this factorial design trial with 197 participants we investigated if clients in ICBT could select treatment modules themselves based on a selection of 15 tailored treatment modules developed for use in ICBT for depression. We contrasted this against clinician-tailored module selection. We also investigated if support on demand (initiated by the client) could work as well as scheduled support. Finally, we tested if clients that were mentioned in supervision would improve more than clients not mentioned (with the exception of acute cases). The treatment period lasted for 10 weeks, and we measured effects at post-treatment and two-year follow-up. Measures of depression and secondary outcomes were collected at pre-treatment, post-treatment and two-year follow-up. Overall, within-group effects were large across conditions (e.g., d = 1.73 on the BDI-II). We also found a small but significant difference in favour of self-tailored treatment over clinician-tailored (d = 0.26). Within-group effects for the secondary measures were all moderate to large including a test of knowledge about CBT. The other two contrasts "support on demand" and "supervision" yielded mostly non-significant differences, with the exception of a larger dropout rate in the support on demand condition. There were few negative effects (2.2%). Effects were largely maintained at a two-year follow-up. We conclude that clients can choose treatment modules and that support on demand may work. The role of supervision is not yet clear as advice can be transferred across clients.

The Benefits and Challenges of Shifting to Telehealth During COVID-19: Qualitative Feedback from Kentucky's Sexual Violence Resource Centers and Children's Advocacy Centers

The onset of the COVID-19 pandemic presented novel challenges for service providers addressing mental health issues with a large shift to the utilization of telehealth. While previous research has examined the benefits and challenges of providing mental health and crisis services remotely through telehealth, little research exists examining the use of telehealth in children's advocacy centers (CACs) and sexual violence resource centers (SVRCs). CACs and SVRCs are multi-disciplinary agencies taking a holistic approach to addressing interpersonal violence, making them unique in that they provide a range of direct services beyond mental health counseling (e.g., legal advocacy, medical exams, and prevention education) but all geared toward public health and safety. The current study explored the experiences of direct service providers in Kentucky CACs and SVRCs and their opinions about the most significant challenges and benefits of adapting their practices at the onset of the COVID-19 pandemic. A total of 118 providers participated in the study, and 88 reported using telehealth (defined as communicating with clients via technology such as videoconferencing, phone calls, or email) since the onset of COVID-19. Qualitative data from those 88 respondents regarding the challenges and benefits of using telehealth were collected and coded using a thematic content analysis. 78.6% of the sample indicated that they served primarily rural areas. Benefits noted included increasing treatment access, increasing treatment flexibility, and advancing continuity of care, while challenges included difficulties with technology, client engagement, privacy, and logistical challenges. Responses highlighted that telehealth presented both a number of advantages and difficulties and that more formal guidance for providers at CACs and SVRCs was desired.

A meta-analytic review of randomized clinical trials of online treatments for anxiety: Inclusion/exclusion criteria, uptake, adherence, dropout, and clinical outcomes

Over the last decade there has been rapid growth in the number of clinical trials examining internet-delivered interventions for anxiety. While there have been numerous analyses of treatment efficacy, few studies have examined treatment engagement. The current meta-analysis examined participant eligibility, uptake, adherence, and drop-out in clinical trials of internet-delivered treatments for anxiety. This meta-analysis used random effects models to obtain estimates of participant inclusion, uptake, adherence, drop-out, and within-group treatment effect size. Moderator analyses examined the effects of anxiety disorder type, treatment type, and level of clinician guidance. After screening, 140 trials with 199 treatment arms (N = 11,021) were included. An average of 46% (95% CI 42, 50) of interested people were included in the clinical trials. In the active treatment arms, 98% (95% CI 97, 99) of participants began treatment, 81% (95% CI 78, 85) of the assigned treatments were completed, 21% (95% CI 18, 23) of individuals dropped out at post-treatment based on questionnaire non-completion, and an overall within-group effect size of g = 1.03 (95% CI 0.94, 1.13) was obtained. Several moderators of interest were significant (e.g., clinical guidance, anxiety disorder type), and there was substantial heterogeneity in estimates. In conclusion, a large number of inclusion and exclusion criteria have been used in trials of internet-delivered treatments for anxiety. Once recruited into a trial, however, most people appear to begin, adhere, and complete internet-delivered treatment for anxiety. Further research exploring various eligibility criteria and their impact on engagement and efficacy is warranted.

Examining Change in the Frequency of Adaptive Actions as a Mediator of Treatment Outcomes in Internet-Delivered Therapy for Depression and Anxiety

Adaptive actions, including healthy thinking and meaningful activities, have been associated with emotional wellbeing. The Things You Do Questionnaire-21 item (TYDQ-21) has recently been created to measure the frequency of such actions. A study using the TYDQ-21 found that adaptive actions increased across Internet-delivered therapy for symptoms of depression and anxiety, and higher TYDQ-21 scores were associated with lower psychological distress at post-treatment. The current study examined the relationships between adaptive actions and psychological distress among adults (n = 1114) receiving Internet-delivered therapy as part of routine care in Canada, and explored whether adaptive actions mediated reductions in depression and anxiety. As hypothesised, adaptive actions increased alongside reductions in depression and anxiety symptoms from baseline to post-treatment. Treatment effects were consistent when the intervention was provided with regular weekly therapist support or with optional weekly therapist support, and some (but not all) types of adaptive actions had a mediating effect on change in depressive symptoms. The present findings support further work examining adaptive actions as a mechanism of change in psychotherapy, as well as the utility and scalability of Internet-delivered treatments to target and increase adaptive actions with the aim of improving mental health.

Systematic assessment of the quality and integrity of popular mental health smartphone apps using the American Psychiatric Association's app evaluation model

Mobile phones are playing an increasingly important role in supporting mental health, by providing confidential, accessible and scalable support for individuals who may not seek or have means of accessing professional help. There are concerns, however, that many apps claiming to support mental health do not meet professional, ethical or evidence-based standards. App store search algorithms favour popularity (reviews and downloads) and commercial factors (in-app purchases), with what appears to be low prioritisation of safety or effectiveness features. In this paper, the most visible 100 apps for “depression”, “anxiety” and/or “mood” on the Google Play and Apple App stores were selected for assessment using the American Psychiatric Association App Evaluation model. This model systematically assesses apps across five broad steps: accessibility, integrity, clinical and research evidence base, user engagement and interoperability. Assessment is hierarchical, with the most fundamental requirements of apps assessed first, with apps excluded at each step if they do not meet the criteria. The relationship between app quality and app store visibility was first analysed. App quality was also compared across four different app function types: mental health promotion or psychoeducation; monitoring or tracking; assessment or prevention; and intervention or treatment. Of the 92 apps assessed (after eight failed to meet inclusion criteria), half failed to meet the first criterion step of accessibility, and a further 20% of the remaining apps failed to meet the second criterion step of security and privacy. Only three of the 10 apps most visible on app stores met the criteria for research/clinical base and engagement/ease of use, and only one app fulfilled all five criterion steps of the evaluation model. Quality did not differ significantly across app function type. There was no significant correlation between app quality and app store visibility, which presents a potential risk to vulnerable consumers. The findings of this review highlight the need for greater accountability of app developers to meet, and report, at least minimum quality and integrity standards for their apps. Recommendations are also provided to assist users and clinicians to make informed choices in their selection of reputable and effective mental health apps.

Efficacy of digital health interventions on depression and anxiety in patients with cardiac disease: a systematic review and meta-analysis. EUROPEAN HEART JOURNAL. DIGITAL HEALTH 2022;3:445-454. [PMID: 36712158 PMCID: PMC9707908 DOI: 10.1093/ehjdh/ztac037]

Aims

Depression and anxiety have a detrimental effect on the health outcomes of patients with heart disease. Digital health interventions (DHIs) could offer a solution to treat depression and anxiety in patients with heart disease, but evidence of its efficacy remains scarce. This review summarizes the latest data about the impact of DHIs on depression/anxiety in patients with cardiac disease.

Methods and results

Articles from 2000 to 2021 in English were searched through electronic databases (PubMed, Cochrane Library, and Embase). Articles were included if they incorporated a randomized controlled trial design for patients with cardiac disease and used DHIs in which depression or anxiety was set as outcomes. A systematic review and meta-analysis were performed. A total of 1675 articles were included and the screening identified a total of 17 articles. Results indicated that telemonitoring systems have a beneficial effect on depression [standardized mean difference for depression questionnaire score -0.78 (P = 0.07), -0.55 (P < 0.001), for with and without involving a psychological intervention, respectively]. Results on PC or cell phone-based psychosocial education and training have also a beneficial influence on depression [standardized mean difference for depression questionnaire score -0.49 (P = 0.009)].

Conclusion

Telemonitoring systems for heart failure and PC/cell phone-based psychosocial education and training for patients with heart failure or coronary heart disease had a beneficial effect especially on depression. Regarding telemonitoring for heart failure, this effect was reached even without incorporating a specific psychological intervention. These results illustrate the future potential of DHIs for mental health in cardiology.

Technology Implementation for Mental-Health End-Users: A Model to Guide Digital Transformation for Inpatient Mental Health Professionals (Preprint)

Digital transformation is the adoption of digital technologies by an entity in an effort to increase operational efficiency. In mental health care, digital transformation entails technology implementation to improve the quality of care and mental health outcomes. Most psychiatric hospitals rely heavily on "high-touch" interventions or those that require in-person, face-to-face interaction with the patient. Those that are exploring digital mental health care interventions, particularly for outpatient care, often copiously commit to the "high-tech" model, losing the crucial human element. The process of digital transformation, especially within acute psychiatric treatment settings, is in its infancy. Existing implementation models outline the development of patient-facing treatment interventions within the primary care system; however, to our knowledge, there is no proposed or established model for implementing a new provider-facing ministration tool within an acute inpatient psychiatric setting. Solving the complex challenges within mental health care demands that new mental health technology is developed in concert with a use protocol by and for the inpatient mental health professional (IMHP; the end user), allowing the "high-touch" to inform the "high-tech" and vice versa. Therefore, in this viewpoint article, we propose the Technology Implementation for Mental-Health End-Users framework, which outlines the process for developing a prototype of an IMHP-facing digital intervention tool in parallel with a protocol for the IMHP end user to deliver the intervention. By balancing the design of the digital mental health care intervention tool with IMHP end user resource development, we can significantly improve mental health outcomes and pioneer digital transformation nationwide.

Living with Loss: study protocol for a randomized controlled trial evaluating an internet-based perinatal bereavement program for parents following stillbirth and neonatal death

BACKGROUND

Stillbirth and neonatal death are devastating pregnancy outcomes with long-lasting psychosocial consequences for parents and families, and wide-ranging economic impacts on health systems and society. It is essential that parents and families have access to appropriate support, yet services are often limited. Internet-based programs may provide another option of psychosocial support for parents following the death of a baby. We aim to evaluate the efficacy and acceptability of a self-guided internet-based perinatal bereavement support program "Living with Loss" (LWL) in reducing psychological distress and improving the wellbeing of parents following stillbirth or neonatal death.

METHODS

This trial is a two-arm parallel group randomized controlled trial comparing the intervention arm (LWL) with a care as usual control arm (CAU). We anticipate recruiting 150 women and men across Australia who have experienced a stillbirth or neonatal death in the past 2 years. Participants randomized to the LWL group will receive the six-module internet-based program over 8 weeks including automated email notifications and reminders. Baseline, post-intervention, and 3-month follow-up assessments will be conducted to assess primary and secondary outcomes for both arms. The primary outcome will be the change in Kessler Psychological Distress Scale (K10) scores from baseline to 3-month follow-up. Secondary outcomes include perinatal grief, anxiety, depression, quality of life, program satisfaction and acceptability, and cost-effectiveness. Analysis will use intention-to-treat linear mixed models to examine psychological distress symptom scores at 3-month follow-up. Subgroup analyses by severity of symptoms at baseline will be undertaken.

DISCUSSION

The LWL program aims to provide an evidence-based accessible and flexible support option for bereaved parents following stillbirth or neonatal death. This may be particularly useful for parents and healthcare professionals residing in rural regions where services and supports are limited. This RCT seeks to provide evidence of the efficacy, acceptability, and cost-effectiveness of the LWL program and contribute to our understanding of the role digital services may play in addressing the gap in the availability of specific bereavement support resources for parents following the death of a baby, particularly for men.

TRIAL REGISTRATION

Australian New Zealand Clinical Trials Registry, ACTRN12621000631808 . Registered prospectively on 27 May 2021.

Ownership, Use of, and Interest in Digital Mental Health Technologies Among Clinicians and Young People Across a Spectrum of Clinical Care Needs: Cross-sectional Survey

BACKGROUND

There is currently an increased interest in and acceptance of technology-enabled mental health care. To adequately harness this opportunity, it is critical that the design and development of digital mental health technologies be informed by the needs and preferences of end users. Despite young people and clinicians being the predominant users of such technologies, few studies have examined their perspectives on different digital mental health technologies.

OBJECTIVE

This study aims to understand the technologies that young people have access to and use in their everyday lives and what applications of these technologies they are interested in to support their mental health. The study also explores the technologies that youth mental health clinicians currently use within their practice and what applications of these technologies they are interested in to support their clients' mental health.

METHODS

Youth mental health service users (aged 12-25 years) from both primary and specialist services, young people from the general population (aged 16-25 years), and youth mental health clinicians completed a web-based survey exploring technology ownership, use of, and interest levels in using different digital interventions to support their mental health or that of their clients.

RESULTS

A total of 588 young people and 73 youth mental health clinicians completed the survey. Smartphone ownership or private access among young people within mental health services and the general population was universal (611/617, 99%), with high levels of access to computers and social media. Youth technology use was frequent, with 63.3% (387/611) using smartphones several times an hour. Clinicians reported using smartphones (61/76, 80%) and video chat (69/76, 91%) commonly in clinical practice and found them to be helpful. Approximately 50% (296/609) of the young people used mental health apps, which was significantly less than the clinicians (χ²₃=28.8, n=670; P<.001). Similarly, clinicians were significantly more interested in using technology for mental health support than young people (H₃=55.90; P<.001), with 100% (73/73) of clinicians being at least slightly interested in technology to support mental health compared with 88% (520/591) of young people. Follow-up tests revealed no difference in interest between young people from the general population, primary mental health services, and specialist mental health services (all P>.23). Young people were most interested in web-based self-help, mobile self-help, and blended therapy.

CONCLUSIONS

Technology access is pervasive among young people within and outside of youth mental health services; clinicians are already using technology to support clinical care, and there is widespread interest in digital mental health technologies among these groups of end users. These findings provide important insights into the perspectives of young people and clinicians regarding the value of digital mental health interventions in supporting youth mental health.

Bridging Across the Digital Divide: Identifying the Extent to Which LGBTIQ+ Health Service Websites Engage Culturally and Linguistically Diverse (CALD) Users

eHealth is promoted as a viable platform for health service provision, as it can deliver relevant information instantaneously and anonymously, whilst circumventing geographical and discriminatory barriers that can occur in face-to-face settings. Lesbian, gay, bisexual, transgender, intersex and queer (LGBTIQ+) communities stand to benefit greatly from eHealth services, however, the way in which culturally and linguistically diverse (CALD) LGBTIQ+ users are included within eHealth service provision is currently unknown. The current study observed the way in which Australian LGBTIQ+ health service websites are inclusive of CALD users. Quantitative content analysis was performed on 19 Australian LGBTIQ+ health service websites, with a focus on translation of services and materials, English and digital literacy, and CALD specific resources. Results showed limited translated information across all websites, an absence of translation tools embedded in the home page, as well as moderate to high levels of digital and English literacy required, and largely absent CALD specific resources. These results suggest that Australian LGBTIQ+ health service websites are not currently meeting the unique needs of their CALD constituents. Increased availability of translation services, navigation tools, and CALD LGBTIQ+ stakeholder inclusion during website development is recommended to ensure more equitable access for CALD LGBTIQ+ communities.

Assessing Virtual Mental Health Access for Refugees during the COVID-19 Pandemic Using the Levesque Client-Centered Framework: What Have We Learned and How Will We Plan for the Future?

During the COVID-19 pandemic, mental health services rapidly transitioned to virtual care. Although such services can improve access for underserved populations, they may also present unique challenges, especially for refugee newcomers. This study examined the multidimensional nature of access to virtual mental health (VMH) care for refugee newcomers during the COVID-19 pandemic, using Levesque et al.'s Client-Centered Framework for Assessing Access to Health Care. One hundred and eight structured and semi structured interviews were conducted in four Canadian provinces (8 community leaders, 37 newcomer clients, 63 mental health or service providers or managers). Deductive qualitative analysis, based on the Client-Centered Framework, identified several overarching themes: challenges due to the cost and complexity of using technology; comfort for VMH outside clinical settings; sustainability post-COVID-19; and communication and the therapeutic alliance. Mental health organizations, community organizations, and service providers can improve access to (virtual) mental health care for refugee newcomers by addressing cultural and structural barriers, tailoring services, and offering choice and flexibility to newcomers.

Understanding Mental Health Professionals' Perspectives and Practices Regarding the Implementation of Digital Mental Health: Qualitative Study

BACKGROUND

Despite the potential of digital mental health to provide cost-effective mental health care, its adoption in clinical settings is limited, and little is known about the perspectives and practices of mental health professionals regarding its implementation or the factors influencing these perspectives and practices.

OBJECTIVE

This study aims to characterize in depth the perspectives and practices of mental health professionals regarding the implementation of digital mental health and explore the factors affecting such perspectives and practices.

METHODS

A qualitative study using in-depth semistructured interviews with Portuguese mental health professionals (N=13)-psychologists and psychiatrists-was conducted. The transcribed interviews were thematically analyzed.

RESULTS

Mental health professionals deemed important or engaged in the following practices during the implementation of digital mental health: indication evaluation, therapeutic contract negotiation, digital psychological assessment, technology setup and management, and intervention delivery and follow-up. Low-threshold accessibility and professionals' perceived duty to provide support to their clients facilitated the implementation of digital mental health. Conversely, the lack of structured intervention frameworks; the unavailability of usable, validated, and affordable technology; and the absence of structured training programs inhibited digital mental health implementation by mental health professionals.

CONCLUSIONS

The publication of practice frameworks, development of evidence-based technology, and delivery of structured training seem key to expediting implementation and encouraging the sustained adoption of digital mental health by mental health professionals.

Internet-Delivered Cognitive Behavioral Therapy for Generalized Anxiety Disorder in Nationwide Routine Care: Effectiveness Study

Background

Therapist-supported, internet-delivered cognitive behavioral therapy (iCBT) is efficacious for generalized anxiety disorder (GAD), but few studies are yet to report its effectiveness in routine care.

Objective

In this study, we aim to examine whether a new 12-session iCBT program for GAD is effective in nationwide routine care.

Methods

We administered a specialized, clinic-delivered, therapist-supported iCBT for GAD in 1099 physician-referred patients. The program was free of charge for patients, and the completion time was not predetermined. We measured symptoms with web-based questionnaires. The primary measure of anxiety was the GAD 7-item scale (GAD-7); secondary measures were, for pathological worry, the Penn State Worry Questionnaire and, for anxiety and impairment, the Overall Anxiety Severity and Impairment Scale.

Results

Patients completed a mean 7.8 (SD 4.2; 65.1%) of 12 sessions, and 44.1% (485/1099) of patients completed all sessions. The effect size in the whole sample for GAD-7 was large (Cohen d=0.97, 95% CI 0.88-1.06). For completers, effect sizes were very large (Cohen d=1.34, 95% CI 1.25-1.53 for GAD-7; Cohen d=1.14, 95% CI 1.00-1.27 for Penn State Worry Questionnaire; and Cohen d=1.23, 95% CI 1.09-1.37 for Overall Anxiety Severity and Impairment Scale). Noncompleters also benefited from the treatment. Greater symptomatic GAD-7–measured relief was associated with more completed sessions, older age, and being referred from private or occupational care. Of the 894 patients with a baseline GAD-7 score ≥10, approximately 421 (47.1%) achieved reliable recovery.

Conclusions

This nationwide, free-of-charge, therapist-supported HUS Helsinki University Hospital–iCBT for GAD was effective in routine care, but further research must establish effectiveness against other treatments and optimize the design of iCBT for GAD for different patient groups and individual patients.

Alcohol and drug use among clients receiving internet-delivered cognitive behavior therapy for anxiety and depression in a routine care clinic - Demographics, use patterns, and prediction of treatment completion and outcomes

BACKGROUND

Research shows that alcohol and drug use among mental health clients is common and has the potential to negatively impact treatment outcomes. Internet-delivered cognitive behavior therapy (ICBT) as a treatment for anxiety and depression is on the rise, but little is known about the prevalence of alcohol and drug use among clients and how this use affects treatment completion and outcomes.

OBJECTIVE

The objective of the current study was to explore the prevalence of alcohol and drug use among clients in ICBT for depression and anxiety, and to investigate the impact of alcohol and drug use on treatment completion and symptom outcomes.

MATERIAL AND METHODS

Data was collected from 1155 clients who participated in two randomized ICBT trials for depression and anxiety, conducted in a routine care clinic. Thirty-five individuals reporting severe substance use when applying to the trials were excluded. Demographic variables, and alcohol and drug use were measured at screening, and measures of depression and anxiety were administered at pre- and post-treatment.

RESULTS

Four out of five clients reported having used alcohol in the past year, while one in five reported having used drugs in the past year. Around a third of clients had reported either problematic alcohol use, drug problems, or both. The analyses showed that drug problems, and combined alcohol and drug problems were negatively associated with treatment completion, but neither alcohol nor drug use had an impact on depression and anxiety outcomes.

CONCLUSIONS

Alcohol and drug problems are likely to be present among a large proportion of patients using ICBT for anxiety and depression. This may not be a barrier to treatment benefit, at least when those with severe alcohol and drug problems have been excluded.

Factors associated with treatment uptake, completion, and subsequent symptom improvement in a national digital mental health service

Digital mental health services (DMHS) have proven effectiveness and play an important role within the broader mental health system by reducing barriers to evidence-based care. However, improved understanding of the factors associated with successful treatment uptake, treatment completion and positive clinical outcomes will facilitate efforts to maximise outcomes. Previous studies have demonstrated that patient age is positively associated, and initial symptom severity negatively associated with treatment uptake and treatment completion rates in both DMHS and other mental health services. The current study sought to extend these findings by examining the effect of other patient characteristics, in particular, self-reported psychosocial difficulties, using data from a large-scale national DMHS. Using a prospective uncontrolled observational cohort study design, we collected self-reported demographic, psychosocial and clinical data from 15,882 patients who accessed the MindSpot Clinic, Australia, between 1 January and 31 December 2019. Using a series of univariate regression models and multivariate classification algorithms we found that older age, higher educational attainment, and being in a relationship were all positively associated with uptake, completion and significant symptom improvement, while higher initial symptom severity was negatively associated with those outcomes. In addition, self-reported psychosocial difficulties had a significant negative impact on uptake, completion, and symptom improvement. Consistent with previous literature, the presence of these characteristics in isolation or in combination have a significant impact on treatment uptake, completion, and symptomatic improvement. Individual and multiple psychosocial difficulties are associated with reduced capacity to participate in treatment and hence an increased treatment burden. Identifying patients with lower capacity to complete treatment, modifications to treatments and the provision of supports to reduce treatment burden may promote greater engagement and completion of treatments offered by digital mental health services.

A randomized factorial trial of internet-delivered cognitive behavioural therapy: An 8-week program with or without extended support and booster lesson

While internet-delivered cognitive behavioural therapy (ICBT) is effective, some patients suggest extended support post-treatment could improve care. In this randomized factorial trial, we examined the benefits of an 8-week therapist-assisted ICBT program offered with or without an optional 4-week extension of support (Factor 1) and with or without an optional booster lesson (Factor 2). Patients screened for ICBT for depression and/or anxiety were randomly assigned to the conditions (N = 434) and we examined the use of the extension and booster, differences between those who did or did not use extension or booster, and the impact of the extension or booster on outcomes, engagement, and satisfaction at 26-weeks post-enrollment. Therapists recorded time and observations with offering support during the extension and booster. In the extension group, 54.4% (n = 56) requested the extension, while in the booster group 50.9% (n = 56) accessed the booster, and in the combined group, 41.6% (n = 47) requested the extension and 51.3% (n = 58) accessed the booster. Those who requested the extension were older, and more likely to report medication and mental health service use and severe mental health-related disability at pre-treatment; they also reported putting less effort into ICBT and finding skills more difficult. The booster was more often used among those with lower symptom severity, and those who put more effort into and had more positive experiences with ICBT. As expected, those assigned to extension sent more messages to their therapist, and those assigned to booster logged in more often. Therapists also took more time to deliver ICBT with an extension (>18 min) or booster (>13 min) compared to the 8-week program, and perceived extension and booster as beneficial for some, but not all patients. Treatment satisfaction was high across conditions, and effect sizes were large from pre-treatment to 26-week follow-up on most measures. No significant group differences were found in this study. Lack of group differences, however, could reflect low use of the extension and booster. Results provide helpful information about the demand for extensions and boosters, and provide directions for future research.

Canadian perspectives of digital mental health supports: Findings from a national survey conducted during the COVID-19 pandemic

Objectives

The impact of the COVID-19 pandemic on population mental health has highlighted the potential for digital mental health to support the needs of those requiring care. This study sought to understand the digital mental health experiences and priorities of Canadians affected by mental health conditions (i.e. seekers, patients, and care partners).

Methods

A national cross-sectional electronic survey of Canadians was administered through a market research firm's survey panel. Seekers, patients, and care partners were asked about their digital mental health experiences (e.g. uptake, barriers to access) and priorities. Survey responses were summarized using descriptive statistics.

Results

Overall, 1003 participants completed the survey. 70.2% of participants routinely use digital mental health supports to support themselves or those they care for; however, only 28.6% of participants are satisfied with the available digital mental health supports. Most participants (73.3%) have encountered some barriers when accessing digital mental health supports. Awareness of digital mental health supports was a top barrier identified by participants. The top digital mental health priorities consisted of digital mental health curation, navigation, and a digital mental health passport.

Conclusions

Most participants use digital mental health supports for themselves or others, however, many are unaware of digital mental health supports available. Efforts to improve navigating access to digital and in-person mental health services are seen as a top priority, highlighting the need to enable seekers, patients, and care partners to find the appropriate support and make decisions on how to best improve their mental health.

A Web-Based Service Delivery Model for Communication Training After Brain Injury: Protocol for a Mixed Methods, Prospective, Hybrid Type 2 Implementation-Effectiveness Study

BACKGROUND

Acquired brain injuries (ABIs) commonly cause cognitive-communication disorders, which can have a pervasive psychosocial impact on a person's life. More than 135 million people worldwide currently live with ABI, and this large and growing burden is increasingly surpassing global rehabilitation service capacity. A web-based service delivery model may offer a scalable solution. The Social Brain Toolkit is an evidence-based suite of 3 web-based communication training interventions for people with ABI and their communication partners. Successful real-world delivery of web-based interventions such as the Social Brain Toolkit requires investigation of intervention implementation in addition to efficacy and effectiveness.

OBJECTIVE

The aim of this study is to investigate the implementation and effectiveness of the Social Brain Toolkit as a web-based service delivery model.

METHODS

This is a mixed methods, prospective, hybrid type 2 implementation-effectiveness study, theoretically underpinned by the Nonadoption, Abandonment, Scale-up, Spread, and Sustainability (NASSS) framework of digital health implementation. We will document implementation strategies preemptively deployed to support the launch of the Social Brain Toolkit interventions, as well as implementation strategies identified by end users through formative evaluation of the Social Brain Toolkit. We will prospectively observe implementation outcomes, selected on the basis of the NASSS framework, through quantitative web analytics of intervention use, qualitative and quantitative pre- and postintervention survey data from all users within a specified sample frame, and qualitative interviews with a subset of users of each intervention. Qualitative implementation data will be deductively analyzed against the NASSS framework. Quantitative implementation data will be analyzed descriptively. We will obtain effectiveness outcomes through web-based knowledge tests, custom user questionnaires, and formal clinical tools. Quantitative effectiveness outcomes will be analyzed through descriptive statistics and the Reliable Change Index, with repeated analysis of variance (pretraining, posttraining, and follow-up), to determine whether there is any significant improvement within this participant sample.

RESULTS

Data collection commenced on July 2, 2021, and is expected to conclude on June 1, 2022, after a 6-month sample frame of analytics for each Social Brain Toolkit intervention. Data analysis will occur concurrently with data collection until mid-2022, with results expected for publication late 2022 and early 2023.

CONCLUSIONS

End-user evaluation of the Social Brain Toolkit's implementation can guide intervention development and implementation to reach and meet community needs in a feasible, scalable, sustainable, and acceptable manner. End user feedback will be directly incorporated and addressed wherever possible in the next version of the Social Brain Toolkit. Learnings from these findings will benefit the implementation of this and future web-based psychosocial interventions for people with ABI and other populations.

TRIAL REGISTRATION

Australia and New Zealand Clinical Trials Registry ACTRN12621001170819; https://anzctr.org.au/Trial/Registration/TrialReview.aspx?ACTRN=12621001170819, Australia and New Zealand Clinical Trials Registry ACTRN12621001177842; https://anzctr.org.au/Trial/Registration/TrialReview.aspx?ACTRN=12621001177842, Australia and New Zealand Clinical Trials Registry ACTRN12621001180808; https://anzctr.org.au/Trial/Registration/TrialReview.aspx?ACTRN=12621001180808.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

DERR1-10.2196/31995.

Internet and Face-to-face Cognitive Behavioral Therapy for Postnatal Depression Compared With Treatment as Usual: Randomized Controlled Trial of MumMoodBooster

BACKGROUND

Previous research has confirmed that symptoms of postnatal depression (PND) can be ameliorated through internet-delivered psychological interventions. Advantages of internet-delivered treatment include anonymity, convenience, and catering to women who are unable to access face-to-face (FTF) treatments. To date, no research has examined the efficacy of such interventions compared directly with FTF treatments in women clinically diagnosed with PND.

OBJECTIVE

This study aims to compare the efficacy of one of the first web-based cognitive behavioral therapy (CBT) interventions (internet CBT+coach calls) for PND (MumMoodBooster [MMB]) with FTF-CBT in a randomized controlled trial (RCT).

METHODS

In this study, 116 postnatal women with a Diagnostic and Statistical Manual for Mental Disorders, Fourth Edition (DSM-IV) diagnosis of major or minor depression were randomized to MMB (39/116, 33.6%), FTF-CBT (39/116, 33.6%), or a treatment-as-usual (TAU) control condition (38/116, 32.8%). Diagnostic status was determined at baseline and at 21-week follow-up using the Structured Clinical Interview for the DSM-IV. Severity of anxiety and depressive symptoms was evaluated using the Depression Anxiety Stress Scales and the revised Beck Depression Inventory at baseline, 12-week follow-up (after treatment), and 21-week follow-up.

RESULTS

Of the 116 participants, 107 (92.2%) had a diagnosis of major depression at baseline. Rates of remission from a major or minor depressive episode at 21 weeks in both the FTF-CBT and MMB groups were superior to that of the TAU group (56.6% and 47.7% less likely to be depressed, respectively) and they were not significantly different from each other. Although remission rates differed between TAU and FTF-CBT, growth models showed that, in terms of symptom reduction across time, the FTF-CBT treatment was not significantly better than TAU. By comparison, MMB was statistically superior to both TAU and FTF-CBT in reducing symptoms of depression, anxiety, and stress from baseline to the 21-week follow-up (large and moderate effect sizes). Thus, after 21 weeks, the average symptom scores for depression and anxiety of women receiving MMB were approximately half those of women in both the TAU and FTF-CBT groups.

CONCLUSIONS

In this RCT, MMB was at least as effective as FTF-CBT in achieving remission from a diagnosed PND episode. MMB was superior to TAU and FTF-CBT in encouraging and maintaining reduction of symptom severity over the 21-week follow-up for depressed postnatal women. These findings replicate results of prior studies on MMB that showed clinically significant improvements in depressive symptoms, and they provide direct empirical support that internet-delivered treatment for depressed postnatal women is a viable alternative to FTF treatment. The generalizability of the results needs to be examined in future research, as RCTs of internet-based versus FTF treatments necessarily involve a subset of people who are willing to undertake either modality of treatment.

TRIAL REGISTRATION

Australia and New Zealand Clinical Trials Registry (ANZCTR) ACTRN12613000881730; https://anzctr.org.au/Trial/Registration/TrialReview.aspx?id=364683&isReview=true.

Barriers and facilitators to the integration of digital technologies in mental health systems: A protocol for a qualitative systematic review

INTRODUCTION

Digital technology has the potential to improve health outcomes and health system performance in fragmented and under-funded mental health systems. Despite this potential, the integration of digital technology tools into mental health systems has been relatively poor. This is a protocol for a synthesis of qualitative evidence that will aim to determine the barriers and facilitators to integrating digital technologies in mental health systems and classify them in contextual domains at individual, organisational and system levels.

METHODS AND ANALYSIS

The methodological framework for systematic review of qualitative evidence described in Lockwood et al. will be applied to this review. A draft search strategy was developed in collaboration with an experienced senior health research librarian. A systematic search of Medline, Embase, Scopus, PsycInfo, Web of Science and Google Scholar, as well as hand searching of reference lists and reviews will identify relevant studies for inclusion. Study selection will be carried out independently by two authors, with discrepancies resolved by consensus. The quality of selected studies will be assessed using JBI Critical Appraisal Checklist for Qualitative Research. Data will be charted using JBI QUARI Data Extraction Tool for Qualitative Research. Findings will be defined and classified both deductively in a priori conceptual framework and inductively by a thematic analysis. Results will be reported based on the Enhancing transparency in reporting the synthesis of qualitative research. The level of confidence of the findings will be assessed using GRADE-CERQual.

ETHICS AND DISSEMINATION

This study does not require ethics approval. The systematic review will inform policy and practices around improving the integration of digital technologies into mental health care systems.

An Open Trial of the Effectiveness, Program Usage, and User Experience of Internet-based Cognitive Behavioural Therapy for Mixed Anxiety and Depression for Healthcare Workers on Disability Leave

OBJECTIVE

An open trial of an internet-based Cognitive Behavioural Therapy (iCBT) program for healthcare workers was conducted.

METHODS

Healthcare workers on disability leave who used the iCBT program were assessed on: self-reported depression and anxiety symptoms using the Depression Anxiety Stress Scales-21; and, program usage. Healthcare workers' experience of using iCBT was evaluated in a separate survey.

RESULTS

Of the 497 healthcare workers referred to the iCBT program, 51% logged in, 25% logged in more than once, and 12% logged in more than once and completed at least two assessments. For the latter group, self-reported depression and anxiety symptoms significantly decreased from the first assessment.

CONCLUSIONS

This iCBT program was perceived to be of benefit to healthcare workers, with program usage and effectiveness that was similar to what has been previously reported for unguided iCBT.

Implementation of online psychosocial interventions for people with neurological conditions and their caregivers: A systematic review protocol

Background

As the burden of neurological conditions increases globally, online psychosocial interventions offer a potentially scalable solution to enabling healthcare access. However, their successful development and implementation require research into electronic healthcare implementation specifically.

Methods

Using a search strategy combining the concepts of implementation, electronic healthcare, psychosocial interventions and neurological conditions, we will conduct comprehensive electronic searches for primary implementation evidence in MEDLINE, EMBASE, PsycINFO, CINAHL, Scopus, SpeechBITE and NeuroBITE databases. Included studies will be analysed according to the Non-adoption, Abandonment, Scale-Up, Spread, and Sustainability framework, appraised using the Mixed-Methods Appraisal Tool and evaluated for theoretical underpinning in implementation science, with hybrid studies of effectiveness-implementation research classified according to the type of hybrid design.

Discussion

This review will be the first to use a theoretical underpinning in the Non-adoption, Abandonment, Scale-Up, Spread, and Sustainability framework to evaluate strengths and gaps in existing implementation research into online psychosocial interventions for people with neurological conditions and/or their caregivers. The results may be useful to provide direction and recommendations for future clinical implementation and research into online psychosocial interventions for people with neurological conditions and/or their caregivers.

Systematic review registration

PROSPERO 2020: CRD42020186387.

The effect of user interface on treatment engagement in a self-guided digital problem-solving intervention: A randomized controlled trial

BACKGROUND

Resources are spent worldwide on the development of digital platforms and their user interfaces (UIs) for digital mental health services (DMHS). However, studies investigating the potential benefits of different UIs for DMHS are currently lacking. To fill this knowledge gap, the aim of this study was to investigate differences in treatment engagement between two different UIs for DMHS.

METHODS

A total of 397 participants from the Swedish general public were randomized (1:1) to use a self-guided digital problem-solving intervention during one week, either with an optimized UI (N = 198), based on user experience (UX) design principles and with automated features, or a basic UI (N = 199), analogous with a UI used in Swedish regular health care comprising elementary UI features and less automation. Primary outcome measures were self-rated usability, on the System Usability Scale, and treatment credibility, on the Credibility/Expectancy Questionnaire. Secondary outcome measures included behavioral engagement with the intervention.

FINDINGS

There were no significant differences between the UIs in ratings of usability or treatment credibility. However, participants who used the optimized UI were significantly more engaged with the intervention as measured by usage of the intervention at least once (odds ratio 2.54, 95% CI [1.67, 3.85]), total number of generated solutions (mean difference 1.41, 95% CI [0.72, 2.11]), and mean number of generated solutions per initiated problem-solving attempt (mean difference 1.45, 95% CI [1.06, 1.85]). Other findings included participants using the optimized UI rating the intervention as easier to understand, while feeling more overwhelmed, than those using the basic UI.

INTERPRETATION

Our findings indicate that an optimized UI based on UX design principles, in comparison to a basic UI comprising elementary UI features, do not affect overall self-rated usability or treatment credibility but increases some measures of behavioral engagement with a digital intervention.

FUNDING

Funded by the Government of Sweden, Ministry of Health and Social Affairs.

Online interventions for people hospitalized for deliberate self-harm and problematic alcohol use: Lessons learned from the iiAIM trial

Deliberate self-harm and suicide affect all age groups, sexes, and regions, and their prevention is a global health priority. Acute alcohol misuse and chronic alcohol misuse are strong, modifiable risk factors, and Internet interventions aiming to reduce alcohol misuse and comorbid mental health problems (e.g., depression) are a promising and effective treatment modality. The research team aimed to evaluate the feasibility and effectiveness of an Internet-based comorbidity intervention primarily aiming to reduce alcohol consumption, and secondarily to reduce readmission for deliberate self-harm and improve psychological outcomes among people hospitalized for deliberate self-harm who also engage in problematic alcohol use. However, due to several barriers to recruitment, the trial could not be completed and was discontinued. The authors present a "Lessons Learned" discussion and describe the Internet Intervention for Alcohol Improvement (iiAIM) trial, discuss the key barriers experienced by the research team, and recommend potential solutions that may help future trials in this area.

Does a Skills Intervention for Parents Have a Positive Impact on Adolescents' Anorexia Nervosa Outcome? Answers from a Quasi-Randomised Feasibility Trial of SUCCEAT

Skills trainings for caregivers of patients with anorexia nervosa (AN) have been proven to be effective in improving caregiver skills and reducing caregivers’ psychopathology. The effects on patients, especially adolescents, are largely unknown. The aim of this study was to evaluate the effectiveness of a caregivers’ skills training program (Supporting Carers of Children and Adolescents with Eating Disorders in Austria, SUCCEAT, workshop or online version) on adolescents with AN delivered as workshops (WS) or online (ONL). Outcomes are Body-Mass-Index (BMI) percentile, eating psychopathology (Eating Disorder Examination, EDE), attitudinal and behavioural dimensions of eating disorders (Eating Disorder Inventory-2), motivation to change (AN Stages of Change Questionnaire), emotional and behavioural problems (Youth Self-Report) and quality of life (KINDL). All outcome variables significantly improved across both SUCCEAT groups (WS and ONL) and were sustained at 12-month follow-up. The online and workshop delivery of SUCCEAT were equally effective. Most effect sizes were in the medium-to-high range. Full or partial remission was observed in 72% (WS) and 87% (ONL) of patients. Caregiver skills trainings, either delivered as workshops or online modules, are highly recommended to complement treatment as usual.

Internet-based treatment of anxiety and depression in patients with ischaemic heart disease attending cardiac rehabilitation: a feasibility study (eMindYourHeart)

Aims

Anxiety and depression are prevalent in 20% of patients with ischaemic heart disease (IHD); however, treatment of psychological conditions is not commonly integrated in cardiac rehabilitation (CR). Internet-based psychological treatment holds the potential to bridge this gap. To examine the feasibility of an eHealth intervention targeting anxiety and depression in patients with IHD attending CR.

Methods and results

We used a mixed-methods design, including quantitative methods to examine drop-out and change in anxiety and depression scores, and qualitative methods (thematic analysis) to evaluate patients' and nurses' experiences with the intervention. The therapist-guided intervention consisted of 12 modules provided via a web-based platform. The primary outcome was drop-out, with a drop-out rate <25% considered acceptable. Patients were considered as non-drop-out if they completed ≥5 modules. Out of 60 patients screened positive for anxiety and/or depression, 29 patients were included. The drop-out rate was 24% (7/29). Patients had a mean improvement in anxiety and depression scores of 5.5 and 4.6, respectively. On average, patients had 8.0 phone calls with their therapist and 19.7 written messages. The qualitative analysis of patients' experiences identified four themes: treatment platform, intervention, communication with therapist, and personal experience. Patients were positive towards the intervention, although some found the assignments burdensome. From the nurses, we identified three themes: intervention, inclusion procedure, and collaboration with study team. The nurses were positive, however, due to limited time some struggled with the inclusion procedure.

Conclusion

Integrating an eHealth intervention in CR is feasible and the drop-out rate acceptable.

Cultural adaptation of the Smiling is Fun program for the treatment of depression in the Ecuadorian public health care system: A study protocol for a randomized controlled trial

BACKGROUND

Depression is one of the world's major health problems. Due to its high prevalence, it constitutes the first cause of disability among the Americas, where only a very low percentage of the population receives the adequate evidence-based psychological treatment. Internet-Based Interventions (IBIs) are a great alternative to reduce the treatment gap for mental disorders. Although there are several studies in low-and middle-income countries proving IBIs' feasibility and acceptability, there is still little evidence of the effectiveness in diverse social and cultural contexts such as Latin America.

METHODS

Two studies will be described: Study 1 is focused on the cultural adaptation of a cognitive-behavioral IBI Smiling is Fun (Botella et al. 2012, 2015) for Ecuadorian population with depression based on the procedure by Salamanca-Sanabria et al. (2018). Study 2 describes the design of a randomized controlled trial to test the preliminary efficacy of the culturally adapted intervention in a Public Health Care setting. A total of 153 patients with mild to moderate degree of depression as assessed with the Mini-International Neuropsychiatric Interview (M.I.N.I.) and the Patient Health Questionnaire-9 (PHQ-9) will be randomly assigned to either an IBI group using only automated support by the system; an IBI group including also minimal human support; or a waiting list group. The primary outcome (depression) and secondary outcomes (e.g., anxiety, affect, quality of life) will be collected at baseline, 3, 6 and 12 months. Mixed-model analyses with no ad hoc imputations will be conducted.

DISCUSSION

This paper is pioneering in exploring the role of an Internet-based culturally adapted intervention for depression in a public care context in Ecuador. Results obtained will offer new insights into the viability and effectiveness of digital technologies for the psychological treatment of mental illnesses in developing countries.

Dropping the E: The potential for integrating e-mental health in psychotherapy

E-mental health, or the use of technology in mental healthcare, has been the focus of research for over two decades. Over that period, the evidence base for the potential of technology to improve psychotherapeutic practice has grown steadily. This sharply contrasts with the actual use of e-mental health by psychotherapists, which has remained limited. In this article, we aim to illustrate how and when different technological tools and applications can play a role in psychotherapy. At the same time, we also highlight current limitations and discuss challenges for future research. A specific, yet hypothetical case, is used to guide this narrative review and make proposed applications tangible and concrete.

Transdiagnostic Internet-delivered cognitive behaviour therapy with therapist support offered once-weekly or once-weekly supplemented with therapist support within one-business-day: Pragmatic randomized controlled trial

In routine care, internet-delivered cognitive behaviour therapy (iCBT) regularly includes therapist support delivered via secure email, but the optimal response time to emails is unknown. In this study, we compared the benefits of therapists providing support once-weekly versus therapists providing support once-weekly supplemented with a one-business-day response to all patient emails. This pragmatic randomized controlled trial included therapists employed by a specialized iCBT clinic or community mental health clinics, where providing iCBT is a secondary service. Patients with depression and/or anxiety who enrolled in transdiagnostic iCBT (5 core lessons over 8 weeks) were randomized to: 1) once-weekly support supplemented with a one-business-day response to patient emails by specialized therapists (n = 233); 2) once-weekly support also offered by specialized therapists (n = 216); or 3) once-weekly support offered by community clinic therapists (n = 226). Outcomes were measured at 8, 12, 24, and 52-weeks post-enrollment. Patient engagement and treatment experiences (e.g., treatment satisfaction, therapist alliance) were also assessed and a focus group was conducted with therapists. Supplementing once-weekly therapist support with a one-business-day response to patient emails resulted in therapists sending more emails to patients (M: 13 versus 9) and required more therapist time over treatment (M: 155 versus 109 min), but was not associated with improved outcomes, patient engagement or treatment experiences. All groups showed large improvements in symptoms of depression and anxiety maintained at 52-week follow-up, strong engagement and positive treatment experiences. Therapists viewed challenges of responding to patient emails within one-business-day to outweigh benefits. Contrary to expectations, supplementing once-weekly therapist support with a one-business-day response to all patient emails did not benefit patients and increased therapist time as well as therapist challenges when delivering iCBT in routine care.

A pragmatic factorial randomized controlled trial of transdiagnostic internet-delivered cognitive behavioural therapy: Exploring benefits of homework reflection questionnaires and twice-weekly therapist support

With the growing demand for internet-delivered cognitive behavioural therapy (iCBT), this pragmatic factorial (2 × 2 × 2) randomized controlled trial evaluated strategies for facilitating iCBT engagement and outcomes in routine care. Specifically, the benefits to patients and therapists of using homework reflection questionnaires and offering patients twice-weekly therapist support were examined. Patients (n = 632) accepted into iCBT for depression and/or anxiety were randomly assigned to complete homework reflection questionnaires or not (factor 1), receive once- or twice-weekly support (factor 2), and to receive care from therapists employed in one of two settings (iCBT clinic or a community mental health clinic; factor 3). Outcomes were measured at pre-treatment, and 8, 12, and 24-weeks post-enrollment. Therapist time was tracked and a focus group was conducted to examine therapist experiences. No differences in patient outcomes were found between therapists employed in the two settings; as such, these two groups were combined for further analyses. In terms of engagement, homework reflection questionnaires were associated with fewer website log-ins and days accessing iCBT; twice-weekly support was associated with more patient emails sent to therapists. Despite engagement differences, homework reflection questionnaires and twice-weekly support did not significantly impact primary outcomes; all groups showed large improvements in depression and anxiety that were maintained at 24-week follow-up. Therapists perceived a number of benefits and challenges associated with responding to homework reflection questionnaires and offering twice-weekly support; most notably the strategies did not benefit all patients. Twice-weekly support was associated with increased therapist time and organizational challenges. It is concluded that neither completion of homework questionnaires nor offering twice-weekly support significantly improve iCBT in routine care.