Technology-based interventions for mental health support after stroke: A systematic review of their acceptability and feasibility

Factors Associated with Device, Internet and Videoconferencing Use Amongst Individuals with Moderate-to-Severe Traumatic Brain Injury

Videoconferencing (VC) has the potential to improve access to quality healthcare for individuals with traumatic brain injury (TBI) who require intensive and ongoing rehabilitation post-injury. Gaps in information and communication technology (ICT) use, access, and skills, however, may undermine equitable participation in remotely delivered healthcare and rehabilitation. This cross-sectional study sought to identify which demographic, injury-related, and psychological factors are associated with gaps in digital inclusion amongst individuals with a TBI. Between March 2020 and December 2023, 186 adults with a moderate-to-severe TBI who were aged 18-65 years and were within five years post-injury completed a range of self-report measures. The results demonstrated that most individuals with a moderate-to-severe TBI reported high levels of technology skills and access and used the internet from multiple devices daily. While injury severity was unrelated to technology use, this finding may reflect an overestimation of technology use amongst individuals with the most severe injuries, who were excluded from the study. Several demographic and psychological factors were found to predict VC readiness and are presented within a model to guide clinicians considering client suitability for VC rehabilitation. The current findings indicate that the use of VC in clinical settings following a moderate-to-severe TBI is feasible and suggest that individuals with a TBI may benefit from the greater provision of remotely delivered healthcare than is currently offered.

Acceptability of Tele-mental Health Services Among Users: A Systematic Review and Meta-analysis

BACKGROUND

Mental disorders are currently a global public health concern, particularly after the coronavirus disease 2019 (COVID-19) pandemic. Mental health services gradually transitioned to teleservices, employing various methods like texting and videoconferencing. This meta-analysis aimed mainly to quantify the acceptability of tele-mental health services among both beneficiaries and providers. Secondary objectives included quantifying the usability of and satisfaction with these services.

METHODS

We conducted a systematic search of the following databases PubMed Central, SAGE, Google Scholar, Scopus, Web of Science, PubMed Medline, and EBSCO according to Preferred Reporting Items of the Systematic Reviews and Meta-Analysis (PRISMA) guidelines until December 2022.

RESULTS

Out of 3366 search results, 39 studies fully met the inclusion criteria. The pooled acceptability of tele-mental health services among beneficiaries was [71.0% with a 95% confidence interval (CI) of 63.0 - 78.5%, I2 = 98%]. Using meta-regression, four key factors contributed to this heterogeneity (R2 = 99.75%), namely, year of publication, type of mental disorder, participant category, and the quality of included studies. While acceptability among providers was [66.0% (95%CI, 52.0 - 78.0%), I2 = 95%]. The pooled usability of tele-mental health services among participants was [66.0% (95%CI, 50.0 - 80.0%), I2 = 83%]. Subgroup analysis revealed statistically significant results (p = 0.003), indicating that usability was higher among beneficiaries compared to providers.

CONCLUSIONS

The study highlighted a high acceptability of tele-mental health services. These findings suggest a promising outlook for the integration and adoption of tele-mental health services and emphasize the importance of considering user perspectives and addressing provider-specific challenges to enhance overall service delivery and effectiveness.

Acceptance and Commitment Therapy is feasible for people with acquired brain injury: A process evaluation of the BrainACT treatment

OBJECTIVE

To evaluate the feasibility of Acceptance and Commitment Therapy for people with acquired brain injury.

DESIGN

A process evaluation of the BrainACT treatment was conducted alongside a randomised controlled trial.

SETTING

Psychology departments of hospitals and rehabilitation centres.

SUBJECTS

Tweny-seven participants with acquired brain injury and 11 therapists.

INTERVENTION

BrainACT is an Acceptance and Commitment Therapy adapted for the needs and possible cognitive deficits of people with acquired brain injury, provided in eight one-hour face-to-face or video-conference sessions.

MEASUREMENTS

The attendance and compliance rates, engagement, satisfaction, and perceived barriers and facilitators for delivery in clinical practice were investigated using semi-structured interviews with participants and therapists and therapy logs.

RESULTS

212 of the 216 sessions in total were attended and 534 of the 715 protocol elements across participants and sessions were delivered. Participants were motivated and engaged. Participants and therapists were satisfied with the intervention and participants reported to have implemented skills in their daily routines acquired during therapy. Key strengths are the structure provided with the bus of life metaphor, the experiential nature of the intervention, and the materials and homework. Participants and therapists often preferred face-to-face sessions, however, when needed video-conferencing is a good alternative.

CONCLUSION

BrainACT is a feasible intervention for people with anxiety and depressive symptoms following acquired brain injury. However, when the content of the intervention is too extensive, we recommend adding two extra sessions.

Collection and Analysis of Adherence Information for Software as a Medical Device Clinical Trials: Systematic Review

BACKGROUND

The rapid growth of digital health apps has necessitated new regulatory approaches to ensure compliance with safety and effectiveness standards. Nonadherence and heterogeneous user engagement with digital health apps can lead to trial estimates that overestimate or underestimate an app's effectiveness. However, there are no current standards for how researchers should measure adherence or address the risk of bias imposed by nonadherence through efficacy analyses.

OBJECTIVE

This systematic review aims to address 2 critical questions regarding clinical trials of software as a medical device (SaMD) apps: How well do researchers report adherence and engagement metrics for studies of effectiveness and efficacy? and What efficacy analyses do researchers use to account for nonadherence and how appropriate are their methods?

METHODS

We searched the Food and Drug Administration's registration database for registrations of repeated-use, patient-facing SaMD therapeutics. For each such registration, we searched ClinicalTrials.gov, company websites, and MEDLINE for the corresponding clinical trial and study articles through March 2022. Adherence and engagement data were summarized for each of the 24 identified articles, corresponding to 10 SaMD therapeutics. Each article was analyzed with a framework developed using the Cochrane risk-of-bias questions to estimate the potential effects of imperfect adherence on SaMD effectiveness. This review, funded by the Richard King Mellon Foundation, is registered on the Open Science Framework.

RESULTS

We found that although most articles (23/24, 96%) reported collecting information about SaMD therapeutic engagement, of the 20 articles for apps with prescribed use, only 9 (45%) reported adherence information across all aspects of prescribed use: 15 (75%) reported metrics for the initiation of therapeutic use, 16 (80%) reported metrics reporting adherence between the initiation and discontinuation of the therapeutic (implementation), and 4 (20%) reported the discontinuation of the therapeutic (persistence). The articles varied in the reported metrics. For trials that reported adherence or engagement, there were 4 definitions of initiation, 8 definitions of implementation, and 4 definitions of persistence. All articles studying a therapeutic with a prescribed use reported effectiveness estimates that might have been affected by nonadherence; only a few (2/20, 10%) used methods appropriate to evaluate efficacy.

CONCLUSIONS

This review identifies 5 areas for improving future SaMD trials and studies: use consistent metrics for reporting adherence, use reliable adherence metrics, preregister analyses for observational studies, use less biased efficacy analysis methods, and fully report statistical methods and assumptions.

Key Drivers and Facilitators of the Choice to Use mHealth Technology in People With Neurological Conditions: Observational Study

Background

There is increasing interest in the potential uses of mobile health (mHealth) technologies, such as wearable biosensors, as supplements for the care of people with neurological conditions. However, adherence is low, especially over long periods. If people are to benefit from these resources, we need a better long-term understanding of what influences patient engagement. Previous research suggests that engagement is moderated by several barriers and facilitators, but their relative importance is unknown.

Objective

To determine preferences and the relative importance of user-generated factors influencing engagement with mHealth technologies for 2 common neurological conditions with a relapsing-remitting course: multiple sclerosis (MS) and epilepsy.

Methods

In a discrete choice experiment, people with a diagnosis of MS (n=141) or epilepsy (n=175) were asked to select their preferred technology from a series of 8 vignettes with 4 characteristics: privacy, clinical support, established benefit, and device accuracy; each of these characteristics was greater or lower in each vignette. These characteristics had previously been emphasized by people with MS and or epilepsy as influencing engagement with technology. Mixed multinomial logistic regression models were used to establish which characteristics were most likely to affect engagement. Subgroup analyses explored the effects of demographic factors (such as age, gender, and education), acceptance of and familiarity with mobile technology, neurological diagnosis (MS or epilepsy), and symptoms that could influence motivation (such as depression).

Results

Analysis of the responses to the discrete choice experiment validated previous qualitative findings that a higher level of privacy, greater clinical support, increased perceived benefit, and better device accuracy are important to people with a neurological condition. Accuracy was perceived as the most important factor, followed by privacy. Clinical support was the least valued of the attributes. People were prepared to trade a modest amount of accuracy to achieve an improvement in privacy, but less likely to make this compromise for other factors. The type of neurological condition (epilepsy or MS) did not influence these preferences, nor did the age, gender, or mental health status of the participants. Those who were less accepting of technology were the most concerned about privacy and those with a lower level of education were prepared to trade accuracy for more clinical support.

Conclusions

For people with neurological conditions such as epilepsy and MS, accuracy (ie, the ability to detect symptoms) is of the greatest interest. However, there are individual differences, and people who are less accepting of technology may need far greater reassurance about data privacy. People with lower levels of education value greater clinician involvement. These patient preferences should be considered when designing mHealth technologies.

Development of the "Kalmer" relaxation intervention: co-design with stroke survivors with aphasia

PURPOSE

Anxiety is common after stroke and more prevalent in survivors with aphasia. Relaxation is an effective first-line therapy. The current study aimed to obtain the perspectives of stroke survivors with aphasia to inform the development of an accessible, technology-based, relaxation intervention.

MATERIALS AND METHODS

Qualitative co-design methods were used with twelve people with aphasia after stroke. The "Kalmer" Relaxation treatment package materials were iteratively based on participants' experiences and preferences; barriers and facilitators to treatment compliance were explored. Participants were also asked to consider how the intervention might be evaluated in a research trial.

RESULTS

A thematic analysis highlighted the importance and need for the development of an appropriate and inclusive relaxation product, to be implemented by health professionals early post-stroke. Several behavioural strategies to improve treatment adherence were recommended. Participants had varying perspectives on clinically meaningful treatment outcomes.

CONCLUSIONS

Overall, a co-designed accessible relaxation product was viewed as a necessary component of usual stroke care. Acceptability and feasibility and preliminary efficacy of the "Kalmer" intervention should be trialled in future studies. IMPLICATIONS FOR REHABILITATIONCo-designing psychological interventions for people with aphasia after stroke is needed to meet the needs of this at-risk population.Technology-based relaxation interventions to manage anxiety after stroke are viewed positively by people with aphasia and deemed acceptable and feasible.Clinical trials of these co-designed relaxation interventions are required before recommending integration into routine practice.

Implementability of healthcare interventions: an overview of reviews and development of a conceptual framework

Background

Implementation research may play an important role in reducing research waste by identifying strategies that support translation of evidence into practice. Implementation of healthcare interventions is influenced by multiple factors including the organisational context, implementation strategies and features of the intervention as perceived by people delivering and receiving the intervention. Recently, concepts relating to perceived features of interventions have been gaining traction in published literature, namely, acceptability, fidelity, feasibility, scalability and sustainability. These concepts may influence uptake of healthcare interventions, yet there seems to be little consensus about their nature and impact. The aim of this paper is to develop a testable conceptual framework of implementability of healthcare interventions that includes these five concepts.

Methods

A multifaceted approach was used to develop and refine a conceptual framework of implementability of healthcare interventions. An overview of reviews identified reviews published between January 2000 and March 2021 that focused on at least one of the five concepts in relation to a healthcare intervention. These findings informed the development of a preliminary framework of implementability of healthcare interventions which was presented to a panel of experts. A nominal group process was used to critique, refine and agree on a final framework.

Results

A total of 252 publications were included in the overview of reviews. Of these, 32% were found to be feasible, 4% reported sustainable changes in practice and 9% were scaled up to other populations and/or settings. The expert panel proposed that scalability and sustainability of a healthcare intervention are dependent on its acceptability, fidelity and feasibility. Furthermore, acceptability, fidelity and feasibility require re-evaluation over time and as the intervention is developed and then implemented in different settings or with different populations. The final agreed framework of implementability provides the basis for a chronological, iterative approach to planning for wide-scale, long-term implementation of healthcare interventions.

Conclusions

We recommend that researchers consider the factors acceptability, fidelity and feasibility (proposed to influence sustainability and scalability) during the preliminary phases of intervention development, evaluation and implementation, and iteratively check these factors in different settings and over time.

Supplementary Information

The online version contains supplementary material available at 10.1186/s13012-021-01171-7.

Innovative Technology-Based Interventions to Reduce Stigma Toward People With Mental Illness: A Systematic Review and Meta-Analysis. (Preprint)

Background

Stigma toward people with mental illness presents serious consequences for the impacted individuals, such as social exclusion and increased difficulties in the recovery process. Recently, several interventions have been developed to mitigate public stigma, based on the use of innovative technologies, such as virtual reality and video games.

Objective

This review aims to systematically review, synthesize, measure, and critically discuss experimental studies that measure the effect of technological interventions on stigmatization levels.

Methods

This systematic review and meta-analysis was based on PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-analyses) guidelines and included studies in English and Spanish published between 2016 and 2021. Searches were run in 5 different databases (ie, PubMed, PsycInfo, Scopus, Cochrane Library, and ScienceDirect). Only randomized controlled trials were included. Two independent reviewers determined the eligibility, extracted data, and rated methodological quality of the studies. Meta-analyses were performed using the Comprehensive Meta-Analysis software.

Results

Based on the 1158 articles screened, 72 articles were evaluated as full text, of which 9 were included in the qualitative and quantitative syntheses. A diversity of interventions was observed, including video games, audiovisual simulation of hallucinations, virtual reality, and electronic contact with mental health services users. The meta-analysis (n=1832 participants) demonstrated that these interventions had a consistent medium effect on reducing the level of public stigma (d=–0.64; 95% CI 0.31-0.96; P<.001).

Conclusions

Innovative interventions involving the use of technologies are an effective tool in stigma reduction, therefore new challenges are proposed and discussed for the demonstration of their adaptability to different contexts and countries, thus leading to their massification.

Trial Registration

PROSPERO International Prospective Register of Systematic Reviews CRD42021261935; https://www.crd.york.ac.uk/prospero/display_record.php?ID=CRD42021261935

Acceptability of telehealth-delivered rehabilitation: Experiences and perspectives of people with traumatic brain injury and their carers

INTRODUCTION

Communication skills training for people with traumatic brain injury (TBI) and their carers is recommended best practice. Delivery via telehealth could improve access to this training. This paper focuses on the acceptability of telehealth delivery of communication skills training.

METHODS

A mixed-methods investigation of acceptability of telehealth to people with TBI and their carers was incorporated into a clinical trial. Thirty-six people with TBI (23 metropolitan and 13 regional) and their carers were recruited. Metropolitan participants were randomly allocated to telehealth or in-person intervention at a 1:3 ratio. Regional participants were allocated to telehealth. Telehealth and in-person participants were compared on retention, time to complete the programme, home practice completion and therapeutic alliance ratings. Participants completed semi-structured interviews regarding their views on telehealth, which were analysed using thematic analysis.

RESULTS

There were no significant differences between telehealth and in-person participants in retention rate, time to complete the programme, degree of home practice completion or therapeutic alliance ratings. Three themes were identified: 'telehealth delivery opens a window for access to rehabilitation in the context of my daily life', 'in-person delivery offers rehabilitation based on natural human interaction' and 'weighing telehealth against in-person delivery'.

DISCUSSION

Participants found telehealth delivery acceptable, as indicated by the similarity between groups in the quantitative process measures, and as reported in interviews. Some reported a preference for in-person delivery if there had been a choice of delivery mode. Participants described characteristics of the two delivery modes which were relevant to their attitudes towards telehealth.