Participant experiences of an internet-based intervention and randomised control trial: interview study

Adapting the ADVANCE group program for digitally-supported delivery to reduce intimate partner violence by men in substance use treatment: a feasibility study

Introduction

COVID-19 restrictions created barriers to "business as usual" in healthcare but also opened the door to innovation driven by necessity. This manuscript (1) describes how ADVANCE, an in-person group perpetrator program to reduce intimate partner violence (IPV) against female (ex)partners by men in substance use treatment, was adapted for digitally-supported delivery (ADVANCE-D), and (2) explores the feasibility and acceptability of delivering ADVANCE-D to men receiving substance use treatment.

Methods

Firstly, the person-based approach and mHealth development framework were used to iteratively adapt ADVANCE for digitally-supported delivery including conceptualization, formative research, and pre-testing. Then, a non-randomized feasibility study was conducted to assess male participants' eligibility, recruitment, and attendance rates and uptake of support offered to their (ex)partners. Exploratory analyses on reductions in IPV perpetration (assessed using the Abusive Behavior Inventory; ABI) and victimization (using the revised ABI; ABI-R) at the end of the program were performed. Longitudinal qualitative interviews with participants, their (ex)partners, and staff provided an understanding of the program's implementation, acceptability, and outcomes.

Results

The adapted ADVANCE-D program includes one goal-setting session, seven online groups, 12 self-directed website sessions, and 12 coaching calls. ADVANCE-D includes enhanced risk management and support for (ex)partners. Forty-five participants who had perpetrated IPV in the past 12 months were recruited, forty of whom were offered ADVANCE-D, attending 11.4 (SD 9.1) sessions on average. Twenty-one (ex)partners were recruited, 13 of whom accepted specialist support. Reductions in some IPV perpetration and victimization outcome measures were reported by the 25 participants and 11 (ex)partners interviewed pre and post-program, respectively. Twenty-two participants, 11 (ex)partners, 12 facilitators, and 7 integrated support service workers were interviewed at least once about their experiences of participation. Overall, the program content was well-received. Some participants and facilitators believed digital sessions offered increased accessibility.

Conclusion

The digitally-supported delivery of ADVANCE-D was feasible and acceptable. Remote delivery has applicability post-pandemic, providing greater flexibility and access. Given the small sample size and study design, we do not know if reductions in IPV were due to ADVANCE-D, time, participant factors, or chance. More research is needed before conclusions can be made about the efficacy of ADVANCE-D.

The impact of an integrated early palliative care telehealth intervention on the quality of life of heart failure patients: a randomized controlled feasibility study

BACKGROUND

While palliative care for patients with heart failure has gained global attention, in Iran most palliative care interventions have focused only on cancer patients. The purpose of this study is to determine the feasibility and acceptability of a telehealth palliative care intervention to improve the quality of life in patients with heart failure in Iran.

METHODS

This single-site, pilot randomized controlled trial of a telehealth palliative care intervention versus usual care was conducted on patients with New York Heart Association class II/III heart failure recruited from a heart failure clinic in Iran. Under the supervision of a nurse interventionist, intervention participants received 6 weekly educational webinars and concurrent WhatsApp® group activities, with 6 weeks of follow-up. Feasibility was assessed by measuring recruitment, attrition, and questionnaire completion rates; acceptability was assessed via telephone interviews asking about satisfaction and attitudes. Secondary outcomes measured at baseline and 6 weeks included quality of life (PKCCQ and FACIT-Pal-14), anxiety and depression (HADS), and emergency department visits.

RESULTS

We recruited and randomized 50 patients (mean age 47.5 years, 60% men). Among those approached for consent, 66% of patients agreed to participate and total study attrition was 10%. Also 68% of patients successfully completed at least 4 out of the 6 webinar sessions. Acceptability: 78% of patient participants expressed willingness to participate in the present study again or recommend other patients to participate. There was a trend towards improvement in anxiety and depression scores in the intervention group though the study was not powered to detect a statistical difference.

CONCLUSION

This nurse-led, early telehealth-palliative care intervention demonstrated evidence of feasibility, acceptability, and potential improvement on quality of life in patients with heart failure in Iran.

TRIAL REGISTRATION

The study was registered at the Iranian Registry of Clinical Trials (IRCT) at 14 November, 2021, and can be found on the Iranian Registry of Clinical Trials Platform. IRCT registration number: IRCT20100725004443N29.

Understanding Engagement Strategies in Digital Interventions for Mental Health Promotion: Scoping Review

BACKGROUND

Digital interventions offer a solution to address the high demand for mental health promotion, especially when facing physical contact restrictions or lacking accessibility. Engagement with digital interventions is critical for their effectiveness; however, retaining users' engagement throughout the intervention is challenging. It remains unclear what strategies facilitate engagement with digital interventions that target mental health promotion.

OBJECTIVE

Our aim is to conduct a scoping review to investigate user engagement strategies and methods to evaluate engagement with digital interventions that target mental health promotion in adults.

METHODS

This scoping review adheres to the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines for scoping reviews. The search was conducted in 7 electronic databases from inception to April 2020. The inclusion criteria for studies were as follows: adult (aged ≥18 years) users of digital interventions for mental health promotion from the general population; any digital intervention for mental health promotion; and user engagement strategies described in the intervention design. We extracted the following data items: study characteristics, digital intervention (type and engagement strategy), evaluation of engagement strategy (method and result specifying whether the strategy was effective at facilitating engagement), and features of engagement (extent of use and subjective experience of users).

RESULTS

A total of 2766 studies were identified, of which 16 (0.58%) met the inclusion criteria. The 16 studies included randomized controlled trials (6/16, 37%), studies analyzing process data (5/16, 31%), observational studies (3/16, 19%), and qualitative studies (2/16, 13%). The digital interventions for mental health promotion were either web based (12/16, 75%) or mobile app based (4/16, 25%). The engagement strategies included personalized feedback about intervention content or users' mental health status; guidance regarding content and progress through e-coaching; social forums, and interactivity with peers; content gamification; reminders; and flexibility and ease of use. These engagement strategies were deemed effective based on qualitative user feedback or responses on questionnaires or tools (4/16, 25%), usability data (5/16, 31%), or both (7/16, 44%). Most studies identified personalized support in the form of e-coaching, peer support through a social platform, personalized feedback, or joint videoconference sessions as an engaging feature.

CONCLUSIONS

Personalized support during the intervention, access to social support, and personalized feedback seem to promote engagement with digital interventions for mental health promotion. These findings need to be interpreted with caution because the included studies were heterogeneous, had small sample sizes, and typically did not address engagement as the primary outcome. Despite the importance of user engagement for the effectiveness of digital interventions, this field has not yet received much attention. Further research is needed on the effectiveness of different strategies required to facilitate user engagement in digital interventions for mental health promotion.

Dropout From an Internet-Delivered Cognitive Behavioral Therapy Intervention for Adults With Depression and Anxiety: Qualitative Study

BACKGROUND

Treatment dropout continues to be reported from internet-delivered cognitive behavioral therapy (iCBT) interventions, and lower completion rates are generally associated with lower treatment effect sizes. However, evidence is emerging to suggest that completion of a predefined number of modules is not always necessary for clinical benefit or consideration of the needs of each individual patient.

OBJECTIVE

The aim of this study is to perform a qualitative analysis of patients' experiences with an iCBT intervention in a routine care setting to achieve a deeper insight into the phenomenon of dropout.

METHODS

A total of 15 purposively sampled participants (female: 8/15, 53%) from a larger parent randomized controlled trial were interviewed via telephone using a semistructured interview schedule that was developed based on the existing literature and research on dropout in iCBT. Data were analyzed using a descriptive-interpretive approach.

RESULTS

The experience of treatment leading to dropout can be understood in terms of 10 domains: relationship to technology, motivation to start, background knowledge and attitudes toward iCBT, perceived change in motivation, usage of the program, changes due to the intervention, engagement with content, experience interacting with the supporter, experience of web-based communication, and termination of the supported period.

CONCLUSIONS

Patients who drop out of treatment can be distinguished in terms of their change in motivation: those who felt ready to leave treatment early and those who had negative reasons for dropping out. These 2 groups of participants have different treatment experiences, revealing the potential attributes and nonattributes of dropout. The reported between-group differences should be examined further to consider those attributes that are strongly descriptive of the experience and regarded less important than those that have become loosely affiliated.

Factors that impact on recruitment to randomised trials in health care: a qualitative evidence synthesis

BACKGROUND

Randomised trials (also referred to as 'randomised controlled trials' or 'trials') are the optimal way to minimise bias in evaluating the effects of competing treatments, therapies and innovations in health care. It is important to achieve the required sample size for a trial, otherwise trialists may not be able to draw conclusive results leading to research waste and raising ethical questions about trial participation. The reasons why potential participants may accept or decline participation are multifaceted. Yet, the evidence of effectiveness of interventions to improve recruitment to trials is not substantial and fails to recognise these individual decision-making processes. It is important to synthesise the experiences and perceptions of those invited to participate in randomised trials to better inform recruitment strategies.

OBJECTIVES

To explore potential trial participants' views and experiences of the recruitment process for participation. The specific objectives are to describe potential participants' perceptions and experiences of accepting or declining to participate in trials, to explore barriers and facilitators to trial participation, and to explore to what extent barriers and facilitators identified are addressed by strategies to improve recruitment evaluated in previous reviews of the effects of interventions including a Cochrane Methodology Review.

SEARCH METHODS

We searched the Cochrane Library, Medline, Embase, CINAHL, Epistemonikos, LILACS, PsycINFO, ORRCA, and grey literature sources. We ran the most recent set of searches for which the results were incorporated into the review in July 2017.

SELECTION CRITERIA

We included qualitative and mixed-methods studies (with an identifiable qualitative component) that explored potential trial participants' experiences and perceptions of being invited to participate in a trial. We excluded studies that focused only on recruiters' perspectives, and trials solely involving children under 18 years, or adults who were assessed as having impaired mental capacity.

DATA COLLECTION AND ANALYSIS

Five review authors independently assessed the titles, abstracts and full texts identified by the search. We used the CART (completeness, accuracy, relevance, timeliness) criteria to exclude studies that had limited focus on the phenomenon of interest. We used QSR NVivo to extract and manage the data. We assessed methodological limitations using the Critical Skills Appraisal Programme (CASP) tool. We used thematic synthesis to analyse and synthesise the evidence. This provided analytical themes and a conceptual model. We used the GRADE-CERQual (Confidence in the Evidence from Reviews of Qualitative research) approach to assess our confidence in each finding. Our findings were integrated with two previous intervention effectiveness reviews by juxtaposing the quantitative and qualitative findings in a matrix.

MAIN RESULTS

We included 29 studies (published in 30 papers) in our synthesis. Twenty-two key findings were produced under three broad themes (with six subthemes) to capture the experience of being invited to participate in a trial and making the decision whether to participate. Most of these findings had moderate to high confidence. We identified factors from the trial itself that influenced participation. These included how trial information was communicated, and elements of the trial such as the time commitment that might be considered burdensome. The second theme related to personal factors such as how other people can influence the individual's decision; and how a personal understanding of potential harms and benefits could impact on the decision. Finally, the potential benefits of participation were found to be key to the decision to participate, namely personal benefits such as access to new treatments, but also the chance to make a difference and help others. The conceptual model we developed presents the decision-making process as a gauge and the factors that influence whether the person will, or will not, take part.

AUTHORS' CONCLUSIONS

This qualitative evidence synthesis has provided comprehensive insight into the complexity of factors that influence a person's decision whether to participate in a trial. We developed key questions that trialists can ask when developing their recruitment strategy. In addition, our conceptual model emphasises the need for participant-centred approaches to recruitment. We demonstrated moderate to high level confidence in our findings, which in some way can be attributed to the large volume of highly relevant studies in this field. We recommend that these insights be used to direct or influence or underpin future recruitment strategies that are developed in a participant-driven way that ultimately improves trial conduct and reduces research waste.

The effects of bibliotherapy on the mental well-being of informal caregivers of people with neurocognitive disorder: A systematic review and meta-analysis

BACKGROUND

The number of people with neurocognitive disorder is increasing, and the majority of them are cared for by informal caregivers in the community. Mental health problems are common among caregivers, however, professional support for them is often limited. Non-pharmacological self-help interventions, such as bibliotherapy, may improve mental well-being and has the potential for being integrated into clinical or social services.

OBJECTIVES

To explore what types of bibliotherapy have been used for improving the mental well-being of informal caregivers of people with neurocognitive disorders, and the effect on mental well-being outcomes.

DESIGN

A systematic review and meta-analysis.

REVIEW METHODS

Six databases were searched for relevant articles on July 1, 2019. Clinical trial registries and the reference lists of included studies were also searched. Both randomized controlled trials and quasi-experimental studies were included. The Cochrane Collaboration risk of bias tool for randomized controlled trials was used to assess the quality of studies. Review Manager 5.3 was used to analyze data, standardized mean difference (SMD) and 95% confidence interval (CI) were used to estimate the pooled treatment effect. Random effects models were used for meta-analyses. Funnel plot was not performed due to the limited number of studies. This systematic review was registered at PROSPERO (CRD42019129152).

RESULTS

Nine randomized controlled trials with 1036 informal caregivers were included. Most of the included studies had some aspects of bias. Three types of bibliotherapy were used. Bibliotherapy had a significant pooled medium to large effect on reducing depression at Z = 1.99 (SMD = -0.74, 95%CI = -1.47 to -0.01, p = .05), however, the heterogeneity was high (I² = 94%). For the subgroups, only the video-based bibliotherapy significantly reduced depression at Z = 2.78 (I² = 83%, SMD = -2.11, 95%CI = -3.6 to -0.62, p = .005). Bibliotherapy had a significant small to medium effect on caregiver's self-efficacy for dealing with problem behaviours at Z = 2.44 (I² = 0, SMD = 0.36, 95%CI = 0.05 to 0.67, p = .02), however, the effect on self-efficacy for obtaining respite was not significant (I² = 0, SMD =  0.17, 95%CI = -0.16 to 0.49, p = .32). The effect on decreasing state anxiety was significant at Z = 2.30 (I² = 22%, SMD = -0.22, 95% CI = -0.41 to -0.33, p = .02).

CONCLUSIONS

Bibliotherapy showed positive effects on reducing depression, improving self-efficacy for dealing with problem behaviors and reducing anxiety among informal caregivers. The effects on reducing depression should be viewed with caution due to high heterogeneity. The effects on other mental well-being outcomes are inconclusive due to limited number of studies and this underscores the need for further research.

FitMindKit: Randomised controlled trial of an automatically tailored online program for mood, anxiety, substance use and suicidality

PURPOSE

Online mental health programs can be effective in reducing symptoms of depression, anxiety disorders, substance use and suicidal ideation. However, most existing e-mental health programs focus on a single domain of mental health, neglecting comorbidity. Furthermore, few programs are tailored to the symptom patterns of the individual user. FitMindKit was designed to overcome the gaps of existing e-mental health programs, providing tailored, transdiagnostic therapeutic content to address a range of comorbid mental health symptoms. A trial was conducted to test the program's efficacy.

METHODS

Australian adults with elevated symptoms of depression, anxiety, suicidal ideation and/or substance use were recruited through social media, with n = 194 randomised into a fully-automated trial of a 10-day brief intervention. Participants were randomly allocated to receive FitMindKit tailored to their symptoms, an untailored generic version of FitMindKit, or an attention control.

RESULTS

Mixed model repeated measures ANOVA indicated that participants in both FitMindKit and the attention control had significant reductions in symptom composite scores. Effects were not significantly greater in the FitMindKit program relative to control, either at post-test or 3-month follow-up. No effects were detected for specific decreases in depression, generalized anxiety, social anxiety, panic, suicidal ideation or alcohol/substance use. There were no significant differences between the tailored and static versions in effectiveness or adherence. Participants in the tailored and static conditions were more satisfied than in the control condition, with some evidence favouring the tailored condition. High attrition reduced power to find effects.

CONCLUSIONS

FitMindKit provides a model for addressing comorbid mental health symptoms in an online program, using automated tailoring to symptom patterns. Modifications to the program are recommended, along with the need for larger trials to test the effects of tailoring on mental health outcomes.

Effectiveness and cost-effectiveness of a fully self-guided internet-based intervention for sub-clinical social anxiety symptoms: Protocol for a randomised controlled trial

Design and objective

This paper describes the protocol for a large-scale pragmatic, randomised controlled trial and economic evaluation to investigate the effectiveness and cost-effectiveness of the self-directed E-Couch social anxiety module versus a waiting list control condition, for reducing sub-clinical social anxiety symptoms in the general population.

Study population

Community-based adults (aged 18+) with social anxiety symptoms that do not meet the criteria for social anxiety disorder recruited via a direct-to-consumer advertisement on national websites.

Intervention and control

Intervention is the self-guided E-Couch social anxiety module. Control group participants are placed on a waiting list to receive the intervention at the end of the trial. Both groups receive email and text message reminders.

Outcome measures

The primary outcome will be change in self-reported social anxiety score using the Social Phobia Inventory (SPIN). Secondary outcomes will be the changes in the following self-report measures: Brief Fear of Negative Evaluation scale (BFNE-S); depression (CES-D); mental wellbeing (SWEMWEBS); health status (SF36); use of health services; safety events; and adherence, retention, and attrition rates. All measures will be administered at baseline, 6 weeks, and 3, 6 and 12 months.

Analysis

A mixed effects model will be used to analyse the effect of the intervention on the primary and secondary outcomes (intention to treat analysis). Secondary analyses will explore moderators and mediators of effect. A prospective economic evaluation, conducted from a NHS and social care perspective, will provide estimates of cost utility and cost-effectiveness. An interview study will be conducted with 20 participants to explore issues including acceptability, adherence, retention and attrition.

Trial registration numbers

NCT02451878 and ISRCTN15819951

Game-based online antenatal breastfeeding education: A pilot

AIM

The aim of this study was to evaluate the effect of the Healthy Moms intervention on antenatal breastfeeding self-efficacy and intention and to determine the feasibility of using an online game-based learning platform to deliver antenatal breastfeeding education.

BACKGROUND

The Internet has potential for improving breastfeeding rates through improving women's access to antenatal breastfeeding education.

METHODS

Twelve computer-based breastfeeding education modules were developed using an online learning platform. Changes in participants' breastfeeding self-efficacy and intention pre- and post-intervention were measured using descriptive statistics and a one-way ANOVA.

RESULTS

Of the 25 women submitting the pretest, four completed zero quests; seven, orientation only; eight, one to six breastfeeding quests; and six, 10 to 12 breastfeeding quests. No significant differences in breastfeeding self-efficacy and intention were found among the groups.

CONCLUSIONS

Online antenatal breastfeeding education is feasible; however, further research is warranted to determine if it can affect breastfeeding outcomes.

Generating and predicting high quality action plans to facilitate physical activity and fruit and vegetable consumption: results from an experimental arm of a randomised controlled trial

Background

In order to improve the transition from an intention to a change in health behaviour, action planning is a frequently used behavioural change method. The quality of action plans in terms of instrumentality and specificity is important in terms of supporting a successful change in health behaviour. Until now, little has been known about the predictors of action plan generation and the predictors of high quality action plans and, therefore, the current study investigates these predictors.

Method

A randomised controlled trial was conducted to improve physical activity (PA) and fruit and vegetable (FV) consumption using a web-based computer tailored intervention. During the 8-week intervention period, participants in the intervention arm (n = 346) were guided (step-by-step) to generate their own action plans to improve their health behaviours. Demographic characteristics, social cognitions, and health behaviour were assessed at baseline by means of self-reporting. Whether participants generated action plans was tracked by means of server registrations within two modules of the intervention.

Results

The action planning component of the intervention regarding physical activity and fruit and vegetable consumption was used by 40.9 and 20.7 % of the participants, respectively. We found that participants who were physically active at baseline were less likely to generate action plans concerning physical activity. With regards to generating fruit and vegetable action plans, participants with a high risk perception and a strong intention to eat fruit and vegetables on a daily basis made more use of the action planning component for this behaviour. Finally, the large majority of the action plans for physical activity (96.6 %) and fruit and vegetable consumption (100 %) were instrumental and about half of the action plans were found to be highly specific (PA = 69.6 %/FV = 59.7 %). The specificity of the action plans is associated with having a relationship and low levels of negative outcome expectancies.

Conclusion

Risk perception and intention are predictors of using the application of action planning. Increasing the motivation to change behaviour should be prioritised in interventions concerning changes in health behaviour before participants are asked to generate action plans. This would also make the intervention suitable for unmotivated people. For those participants who already perform the desired health behaviour prior to the intervention, action plans might be less relevant. Nevertheless, using a guided step-by-step approach to generate action plans resulted in highly instrumental and specific action plans and might be integrated into other interventions concerning changes in health behaviour.

Trial Registration

Netherlands Trial Register: NTR 3706, ClinicalTrials.gov: NCT01909349.

Download Your Doctor: Implementation of a Digitally Mediated Personal Physician Presence to Enhance Patient Engagement With a Health-Promoting Internet Application

BACKGROUND

Brief interventions delivered in primary health care are effective in reducing excessive drinking; online behavior-changing technique interventions may be helpful. Physicians may actively encourage the use of such interventions by helping patients access selected websites (a process known as "facilitated access"). Although the therapeutic working alliance plays a significant role in the achievement of positive outcomes in face-to-face psychotherapy and its development has been shown to be feasible online, little research has been done on its impact on brief interventions. Strengthening patients' perception of their physician's endorsement of a website could facilitate the development of an effective alliance between the patient and the app.

OBJECTIVE

We describe the implementation of a digitally mediated personal physician presence to enhance patient engagement with an alcohol-reduction website as part of the experimental online intervention in a noninferiority randomized controlled trial. We also report the feedback of the users on the module.

METHODS

The Download Your Doctor module was created to simulate the personal physician presence for an alcohol-reduction website that was developed for the EFAR-FVG trial conducted in the Italian region of Friuli-Venezia-Giulia. The module was designed to enhance therapeutic alliance and thus improve outcomes in the intervention group (facilitated access to the website). Participating general and family practitioners could customize messages and visual elements and upload a personal photo, signature, and video recordings. To assess the perceptions and attitudes of the physicians, a semistructured interview was carried out 3 months after the start of the trial. Participating patients were invited to respond to a short online questionnaire 12 months following recruitment to investigate their evaluation of their online experiences.

RESULTS

Nearly three-quarters (23/32, 72%) of the physicians interviewed chose to customize the contents of the interaction with their patients using the provided features and acknowledged the ease of use of the online tools. The majority of physicians (21/32, 57%) customized at least the introductory photo and video. Barriers to usage among those who did not customize the contents were time restrictions, privacy concerns, difficulties in using the tools, and considering the approach not useful. Over half (341/620, 55.0%) of participating patients completed the optional questionnaire. Many of them (240/341, 70.4%) recalled having noticed the personalized elements of their physicians, and the majority of those (208/240, 86.7%) reacted positively, considering the personalization to be of either high or the highest importance.

CONCLUSIONS

The use of a digitally mediated personal physician presence online was both feasible and welcomed by both patients and physicians. Training of the physicians seems to be a key factor in addressing perceived barriers to usage. Further research is recommended to study the mechanisms behind this approach and its impact.

TRIAL REGISTRATION

Clinicaltrials.gov NCT 01638338; https://clinicaltrials.gov/ct2/show/NCT01638338 (Archived by WebCite at http://www.webcitation.org/6f0JLZMtq).

Defining the Role of the Online Therapeutic Facilitator: Principles and Guidelines Developed for Couplelinks, an Online Support Program for Couples Affected by Breast Cancer

Development of psychological interventions delivered via the Internet is a rapidly growing field with the potential to make vital services more accessible. However, there is a corresponding need for careful examination of factors that contribute to effectiveness of Internet-delivered interventions, especially given the observed high dropout rates relative to traditional in-person (IP) interventions. Research has found that the involvement of an online therapist in a Web-based intervention reduces treatment dropout. However, the role of such online therapists is seldom well articulated and varies considerably across programs making it difficult to discern processes that are important for online therapist involvement.In this paper, we introduce the concept of "therapeutic facilitation" to describe the role of the online therapist that was developed and further refined in the context of a Web-based, asynchronous psychosocial intervention for couples affected by breast cancer called Couplelinks. Couplelinks is structured into 6 dyadic learning modules designed to be completed on a weekly basis in consultation with a facilitator through regular, asynchronous, online text-based communication.Principles of therapeutic facilitation derived from a combination of theory underlying the intervention and pilot-testing of the first iteration of the program are described. Case examples to illustrate these principles as well as commonly encountered challenges to online facilitation are presented. Guidelines and principles for therapeutic facilitation hold relevance for professionally delivered online programs more broadly, beyond interventions for couples and cancer.