Evaluating reach, adoption, implementation and maintenance of Internet-based interventions to prevent eating disorders in adolescents: a systematic review

Process Evaluation and Investigation of Cultural Adaptations for an Online Parent-Based Intervention Using a Mixed-Method Approach

Most alcohol intervention research focuses on program efficacy, yet few studies have investigated the acceptability of a program's design and implementation to the target population or adapting existing alcohol interventions to different populations. To address these gaps in the literature, we (1) examined participant responsiveness to and implementation quality of FITSTART+, a web-app delivered parent-based alcohol intervention designed for incoming first-year college students in the United States, and (2) gathered feedback on how this intervention could be adapted to other populations of parents. A sample of U.S. parents of 17-20-year-old first-year college students (N = 109) participated in FITSTART+ during their child's first year of college and completed a survey about parents' responsiveness to the app and its quality. Next, a sample of non-U.S. parents of adolescents aged 13 to 19 (N = 44) participated in one of 11 focus groups in which they briefly explored the app and then discussed how it could be adapted to be applicable and culturally relevant for them and their context. Results revealed that U.S. parents rated the intervention's quality as high and parents were responsive to the web-app's content, but some did not visit one of the most critical aspects of the intervention (i.e., alcohol-related parenting resources). Non-U.S. participants provided a range of suggestions for adapting the intervention to their context, which varied by culture. Results identify areas for improvement, particularly regarding the use of alcohol-related parenting resources, in this intervention and for web-delivered PBIs more broadly.

Enhancing the Implementation and Integration of mHealth Interventions in Resource-Limited Settings: A Scoping Review

Background

Although mobile health (mHealth) interventions have shown promise in improving health outcomes, most of them rarely translate to scale. Prevailing mHealth studies are largely small-sized, short-term and donor-funded pilot studies with limited evidence on their effectiveness. To facilitate scale-up, several frameworks have been proposed to enhance the generic implementation of health interventions. However, there is a lack of a specific focus on the implementation and integration of mHealth interventions in routine care in low-resource settings. Our scoping review aimed to synthesize and develop a framework that could guide the implementation and integration of mHealth interventions.

Methods

We searched the PubMed, Google Scholar, and ScienceDirect databases for published theories, models, and frameworks related to the implementation and integration of clinical interventions from 1st January 2000 to 31st December 2023. The data processing was guided by a scoping review methodology proposed by Arksey and O'Malley. Studies were included if they were i) peer-reviewed and published between 2000 and 2023, ii) explicitly described a framework for clinical intervention implementation and integration, or iii) available in full text and published in English. We integrated different domains and constructs from the reviewed frameworks to develop a new framework for implementing and integrating mHealth interventions.

Results

We identified eight eligible papers with eight frameworks composed of 102 implementation domains. None of the identified frameworks were specific to the integration of mHealth interventions in low-resource settings. Two constructs (skill impartation and intervention awareness) related to the training domain, four constructs (technical and logistical support, identifying committed staff, supervision, and redesigning) from the restructuring domain, two constructs (monetary incentives and nonmonetary incentives) from the incentivize domain, two constructs (organizational mandates and government mandates) from the mandate domain and two constructs (collaboration and routine workflows) from the integrate domain. Therefore, a new framework that outlines five main domains-train, restructure, incentivize, mandate, and integrate (TRIMI)-in relation to the integration and implementation of mHealth interventions in low-resource settings emerged.

Conclusion

The TRIMI framework presents a realistic and realizable solution for the implementation and integration deficits of mHealth interventions in low-resource settings.

Effectiveness of Different Online Intervention Modalities for Middle-Aged Adults with Overweight and Obesity: A 20-Year Systematic Review and Meta-analysis

The main objectives of this systematic review and meta-analysis study include evaluating the methodological quality of existing randomized controlled trials (RCTs) for weight loss and features of online intervention [OI]s in each trial, examining the associations between the methodological quality, intervention features and the effectiveness of OIs, and comparing the effectiveness of OIs and other intervention modalities through systematic review and meta-analysis. Systematic searches were conducted using PubMed, Cochrane Library, CINAHL, and PsycINFO in the past two decades (2000 through 2019). Inclusion criteria includes Online intervention (intervention modality), middle-aged adults with overweight or obesity, at least six months or longer study period, an RCT, and 70% plus retention rate. Risk of Bias was assessed using Miller et al. in (Hester, Miller (eds) Handbook of alcoholism treatment approaches: Effective alternatives (3rd ed.). Allyn & Bacon, Boston, 2003)'s Methodological Quality Rating Scale (MQRS) and GRADE. MOOSE guidelines was referred for data synthesis. In total, 29 OIs were evaluated using 10 criteria for methodological quality and eight criteria for intervention features. Results revealed that the mean methodological quality score of the RCTs was 12.1 (out of 16), and the mean intervention features score was 6.6 (out of 8). RCTs with higher scores were more effective in weight loss than those with lower scores. Results of meta-regression showed that methodological quality was more important than intervention features to increase the effectiveness. Results of meta-analysis showed that OIs were significantly more effective than controls. Compared to OIs only, OIs with interactions with others and professionals were more effective. The study limitation includes assessing 'effectiveness' based on weight only due to lack of other indicators to compare between studies; some results are self-reported; and feedback from intervention participants were hard to review. Nevertheless, this study may contribute to improving the effectiveness of existing OIs for weight loss considering methodological quality and better intervention features.

Optimising the implementation of digital-supported interventions for the secondary prevention of heart disease: a systematic review using the RE-AIM planning and evaluation framework

BACKGROUND

mHealth technologies are now widely utilised to support the delivery of secondary prevention programs in heart disease. Interventions with mHealth included have shown a similar efficacy and safety to conventional programs with improvements in access and adherence. However, questions remain regarding the successful wider implementation of digital-supported programs. By applying the Reach-Effectiveness-Adoption-Implementation-Maintenance (RE-AIM) framework to a systematic review and meta-analysis, this review aims to evaluate the extent to which these programs report on RE-AIM dimensions and associated indicators.

METHODS

This review extends our previous systematic review and meta-analysis that investigated the effectiveness of digital-supported programs for patients with coronary artery disease. Citation searches were performed on the 27 studies of the systematic review to identify linked publications that reported data for RE-AIM dimensions. All included studies and, where relevant, any additional publications, were coded using an adapted RE-AIM extraction tool. Discrepant codes were discussed amongst reviewers to gain consensus. Data were analysed to assess reporting on indicators related to each of the RE-AIM dimensions, and average overall reporting rates for each dimension were calculated.

RESULTS

Searches found an additional nine publications. Across 36 publications that were linked to the 27 studies, 24 (89%) of the studies were interventions solely delivered at home. The average reporting rates for RE-AIM dimensions were highest for effectiveness (75%) and reach (67%), followed by adoption (54%), implementation (36%) and maintenance (11%). Eleven (46%) studies did not describe relevant characteristics of their participants or of staff involved in the intervention; most studies did not describe unanticipated consequences of the intervention; the ongoing cost of intervention implementation and maintenance; information on intervention fidelity; long-term follow-up outcomes, or program adaptation in other settings.

CONCLUSIONS

Through the application of the RE-AIM framework to a systematic review we found most studies failed to report on key indicators. Failing to report these indicators inhibits the ability to address the enablers and barriers required to achieve optimal intervention implementation in wider settings and populations. Future studies should consider alternative hybrid trial designs to enable reporting of implementation indicators to improve the translation of research evidence into routine practice, with special consideration given to the long-term sustainability of program effects as well as corresponding ongoing costs.

REGISTRATION

PROSPERO-CRD42022343030.

Positive attitudes toward adoption of a multi-component intervention strategy aimed at improving HIV outcomes among adolescents and young people in Nampula, Mozambique: perspectives of HIV care providers

BACKGROUND

Service providers' attitudes toward interventions are essential for adopting and implementing novel interventions into healthcare settings, but evidence of evaluations in the HIV context is still limited. This study is part of the CombinADO cluster randomized trial (ClinicalTrials.gov NCT04930367), which is investigating the effectiveness of a multi-component intervention package (CombinADO strategy) aimed at improving HIV outcomes among adolescents and young adults living with HIV (AYAHIV) in Mozambique. In this paper we present findings on key stakeholder attitudes toward adopting study interventions into local health services.

METHODS

Between September and December 2021, we conducted a cross-sectional survey with a purposive sample of 59 key stakeholders providing and overseeing HIV care among AYAHIV in 12 health facilities participating in the CombinADO trial, who completed a 9-item scale on attitudes towards adopting the trial intervention packages in health facilities. Data were collected in the pre-implementation phase of the study and included individual stakeholder and facility-level characteristics. We used generalized linear regression to examine the associations of stakeholder attitude scores with stakeholder and facility-level characteristics.

RESULTS

Overall, service-providing stakeholders within this setting reported positive attitudes regarding adopting intervention packages across study clinic sites; the overall mean total attitude score was 35.0 ([SD] = 2.59, Range = [30-41]). The study package assessed (control or intervention condition) and the number of healthcare workers delivering ART care in participating clinics were the only significant explanatory variables to predict higher attitude scores among stakeholders (β = 1.57, 95% CI = 0.34-2.80, p = 0.01 and β = 1.57, 95% CI = 0.06-3.08, p = 0.04 respectively).

CONCLUSIONS

This study found positive attitudes toward adopting the multi-component CombinADO study interventions among HIV care providers for AYAHIV in Nampula, Mozambique. Our findings suggest that adequate training and human resource availability may be important in promoting the adoption of novel multi-component interventions in healthcare services by influencing healthcare provider attitudes.

Effectiveness of an online self-help program, expert-patient support, and their combination for eating disorders: Results from a randomized controlled trial

OBJECTIVE

Many individuals with an eating disorder do not receive appropriate care. Low-threshold interventions could help bridge this treatment gap. The study aim was to evaluate the effectiveness of Featback, a fully automated online self-help intervention, online expert-patient support and their combination.

METHOD

A randomized controlled trial with a 12-month follow-up period was conducted. Participants aged 16 or older with at least mild eating disorder symptoms were randomized to four conditions: (1) Featback, a fully automated online self-help intervention, (2) chat or email support from a recovered expert patient, (3) Featback with expert-patient support and (4) a waiting list control condition. The intervention period was 8 weeks and there was a total of six online assessments. The main outcome constituted reduction of eating disorder symptoms over time.

RESULTS

Three hundred fifty five participants, of whom 43% had never received eating disorder treatment, were randomized. The three active interventions were superior to a waitlist in reducing eating disorder symptoms (d = -0.38), with no significant difference in effectiveness between the three interventions. Participants in conditions with expert-patient support were more satisfied with the intervention.

DISCUSSION

Internet-based self-help, expert-patient support and their combination were effective in reducing eating disorder symptoms compared to a waiting list control condition. Guidance improved satisfaction with the internet intervention but not its effectiveness. Low-threshold interventions such as Featback and expert-patient support can reduce eating disorder symptoms and reach the large group of underserved individuals, complementing existing forms of eating disorder treatment.

PUBLIC SIGNIFICANCE STATEMENT

Individuals with eating-related problems who received (1) a fully automated internet-based intervention, (2) chat and e-mail support by a recovered individual or (3) their combination, experienced stronger reductions in eating disorder symptoms than those who received (4) usual care. Such brief and easy-access interventions play an important role in reaching individuals who are currently not reached by other forms of treatment.

Feasibility and effect of adding a concurrent parental component to a school-based wellness program using two modes of mobile-based technology - mixed methods evaluation of RCT

BACKGROUND

This study assessed the feasibility and effect of two mobile modes (WhatsApp vs. a specially designed app) in their delivery of updates and assignments to parents.

METHODS

Two three-armed, randomized, controlled feasibility studies were conducted. In each trial, four schools with a total of 418 students in grade 5th, mean age 10.1 years, were randomly allocated to the control arm, youth-only arm, or youth & parental component arm. Only the data of those that completed all three assessments (pre, post and 3 months post program) were analyzed: 133 in the first trial and 137 in the second. In the youth-only arm, students participated in an interactive age-tailored prevention program delivered in 10 weekly, 90-min sessions on self-care behaviors, media literacy, self-esteem, and positive body image. The control groups in both studies received three health- and nutrition-related sessions. In the parental arm, in addition to the 'Favoring-Myself-Young's ten sessions program, parents received updates and were requested to complete shared assignments with their children. In the first year, the assignments were sent via WhatsApp, and in the following year via "Favoring Myself" smartphone application. Facilitators were third year undergraduate students. They used a detailed semi-structured guide and received 4-weekly hours of didactic and group dynamic supervision. Mixed-methods assessments were performed using semi-structured interviews with ten parents and five school staff members each year, as well as a computerized self-report questionnaire.

RESULTS

Feasibility of parent-adolescent shared assignments in both digital modes was lower than expected. The use of WhatsApp had higher feasibility and uptake than the use of the special application. The addition of the concurrent parental component via WhatsApp was associated with superior improvement in self-esteem and identification of advertisement strategies, compared with the youth-only program. However, adolescents in the youth-only program delivered via the smartphone application demonstrated superior improvement compared to those in the youth and parental component arm.

CONCLUSIONS

Although the addition of the concurrent parenting component was praised by the actively participating parents, overall, under the chosen structure and population, it did not prove to add statistically significant value to the youth-only arm.

TRIAL REGISTRATIONS

NCT03216018 (12.7.2017) and NCT03540277 (26.4.2018).

Stakeholder consultation to facilitate implementation of interventions for prevention and promotion in mental health in Europe: introducing the design of the ICare Stakeholder Survey

BACKGROUND

Online interventions to prevent mental health problems have proven to be effective. However, knowledge about their implementation in real-world practice as well as for dissemination to the target groups in different settings is scarce. The goal of the 'ICare' network is to establish a comprehensive model of eMental-health service delivery in and across different European countries. Since implementation and dissemination are influenced by many contextual factors, in the first phase of ICare a stakeholder survey was conducted. The survey aim was to explore stakeholders' experiences, needs and attitudes regarding Internet-based prevention of mental health problems and hindering and fostering factors for implementation and dissemination. This article is part of a supplement and describes the design of the stakeholder survey. Survey results are published in separate articles in the same supplement.

METHODS

Based on a literature review and the individual characteristics of the ICare interventions, stakeholder groups were identified in different settings across six European countries. The RE-AIM framework guided the development of the research questions and survey instruments. A concurrent mixed methods design was applied comprising focus groups with the intended target groups of ICare interventions, an online questionnaire with potential facilitators/delivery staff and semi-structured interviews with policy makers.

CONCLUSION

The challenge was to develop a design that allowed flexibility but at the same did not jeopardize the validity of the study. Implications drawn from this survey are not restricted to specific preventive interventions but will provide general information on how online mental illness prevention can be best implemented in various settings.

Does a Skills Intervention for Parents Have a Positive Impact on Adolescents' Anorexia Nervosa Outcome? Answers from a Quasi-Randomised Feasibility Trial of SUCCEAT

Skills trainings for caregivers of patients with anorexia nervosa (AN) have been proven to be effective in improving caregiver skills and reducing caregivers’ psychopathology. The effects on patients, especially adolescents, are largely unknown. The aim of this study was to evaluate the effectiveness of a caregivers’ skills training program (Supporting Carers of Children and Adolescents with Eating Disorders in Austria, SUCCEAT, workshop or online version) on adolescents with AN delivered as workshops (WS) or online (ONL). Outcomes are Body-Mass-Index (BMI) percentile, eating psychopathology (Eating Disorder Examination, EDE), attitudinal and behavioural dimensions of eating disorders (Eating Disorder Inventory-2), motivation to change (AN Stages of Change Questionnaire), emotional and behavioural problems (Youth Self-Report) and quality of life (KINDL). All outcome variables significantly improved across both SUCCEAT groups (WS and ONL) and were sustained at 12-month follow-up. The online and workshop delivery of SUCCEAT were equally effective. Most effect sizes were in the medium-to-high range. Full or partial remission was observed in 72% (WS) and 87% (ONL) of patients. Caregiver skills trainings, either delivered as workshops or online modules, are highly recommended to complement treatment as usual.

Is it time to RE-AIM? A systematic review of economic empowerment as HIV prevention intervention for adolescent girls and young women in sub-Saharan Africa using the RE-AIM framework

BACKGROUND

Economic empowerment (EE) HIV prevention programs for adolescent girls and young women (AGYW) in sub-Saharan Africa are gaining traction as effective strategies to reduce HIV risk and vulnerabilities among this population. While intervention effectiveness is critical, there are numerous factors beyond effectiveness that shape an intervention's impact. The objective of this systematic review was to assess the reporting of implementation outcomes of EE HIV prevention programs for AGYW in SSA, as conceptualized in the RE-AIM (reach, efficacy/effectiveness, adoption, implementation, and maintenance) framework.

METHODS

We searched PubMed, Ovid/MEDLINE, Science Direct, Ebscohost, PsycINFO, Scopus, and Web of Science for EE HIV interventions for AGYW in SSA. Study selection and data extraction were conducted according to the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-analyses) guidelines. Two researchers coded each article using a validated RE-AIM data extraction tool and independently extracted information from each article. The reporting of RE-AIM dimensions were summarized and synthesized across included interventions.

RESULTS

A total of 25 unique interventions (reported in 45 articles) met the predefined eligibility criteria. Efficacy/effectiveness 19(74.4%) was the highest reported RE-AIM dimension, followed by adoption 17(67.2%), reach 16(64.0%), implementation 9(38.0%), and maintenance 7(26.4%). Most interventions reported on RE-AIM components such as sample size 25(100.0%), intervention location 24(96.0%), and measures and results for at least one follow-up 24(96.0%). Few reported on RE-AIM components such as characteristics of non-participants 8(32.0%), implementation costs 3(12.0%), and intervention fidelity 0(0.0%).

CONCLUSIONS

Results of the review emphasize the need for future economic empowerment HIV prevention interventions for AGYW in SSA to report multiple implementation strategies and highlight considerations for translating such programs into real-world settings. Researchers should pay close attention to reporting setting-level adoption, implementation cost, and intervention maintenance. These measures are needed for policy decisions related to the full merit and worth of EE HIV interventions and their long-term sustainability for AGYW.