Applying RE-AIM to Evaluate the External Validity of Weight Gain Prevention Interventions in Young Adults: A Systematic Review

Applying RE-AIM to evaluations of Veterans Health Administration Enterprise-Wide Initiatives: lessons learned

Introduction

The United States Veterans Health Administration (VHA) Office of Rural Health funds Enterprise-Wide Initiatives (system-wide initiatives) to spread promising practices to rural Veterans. The Office requires that evaluations of Enterprise-Wide Initiatives use the Reach, Effectiveness, Adoption, Implementation, and Maintenance (RE-AIM) framework. This presents a unique opportunity to understand the experience of using RE-AIM across a series of evaluations. The authors conducted a study to document the benefits and pitfalls of using RE-AIM, capture the variety of ways that the team captured the elements of RE-AIM, and develop recommendations for the future use of RE-AIM in evaluation.

Materials and methods

The authors first conducted a document review to capture pre-existing information about how RE-AIM was used. They subsequently facilitated two focus groups to gather more detailed information from team members who had used RE-AIM. Finally, they used member-checking throughout the writing process to ensure accurate data representation and interpretation and to gather additional feedback.

Results

Four themes emerged from the document review, focus groups, and member checking. RE-AIM: provides parameters and controls the evaluation scope, "buckets" are logical, plays well with other frameworks, and can foster collaboration or silo within a team. Challenges and attributes for each RE-AIM dimension were also described.

Discussion

Overall, participants reported both strengths and challenges to using RE-AIM as an evaluation framework. The overarching theme around the challenges with RE-AIM dimensions was the importance of context. Many of these benefits and challenges of using RE-AIM may not be unique to RE-AIM and would likely occur when using any prescribed framework. The participants reported on the RE-AIM domains in a variety of ways in their evaluation reports and were not always able capture data as originally planned. Recommendations included: start with an evaluation framework (or frameworks) and revisit it throughout the evaluation, consider applying RE-AIM PRISM (Practical Robust Implementation Framework) to gain a broader perspective, and intentionally integrate quantitative and qualitative team members, regardless of the framework used.

Development of the Brazilian Version of a Pan-Canadian Behavior Change Program and Its Health and Fitness Outcomes

Chronic diseases are a major health problem worldwide, especially in lower-income jurisdictions. Considering this scenario, the World Health Organization has recently established, as a research priority, preventive interventions for populations from lower-income countries, such as the middle-income country of Brazil. The purpose of this article is to describe the components of a pan-Canadian lifestyle program adapted to Brazilians and to report its health and fitness outcomes. A 12-week program called ACCELERATION was translated and culturally adapted to Brazilians. A quasi-randomized controlled trial was designed, consisting of weekly emails and educational videos addressing risk factors for chronic disease. Health and fitness measures included body composition, cardiovascular variables, aerobic fitness, and muscular strength. The Brazilian experimental group showed maintenance in heart rate, blood pressure, and VO2max values while presenting an improvement of 3.3% in body fat percentage (p = 0.040, d = −0.325) and 5.1% in muscular strength (p = 0.039, d = 0.328). Overall, these results were similar to the Canadian intervention. Based on these findings, the Brazilian version of the program has the potential to contribute to the fight against chronic diseases in Brazil.

Participatory design application in obesity prevention targeting young adults and adolescents: a mixed-methods systematic scoping review protocol

BACKGROUND

Prevention of obesity is economically and sociologically preferable to treatment, with early intervention key to preventing excess weight gain and obesity. The transition from adolescence to young adulthood is a critical intervention period. An expert-led, top-down model has dominated obesity prevention research and practice with limited success. Participatory design (PD) offers potential in transforming obesity prevention research and practice by delivering bottom-up solutions that young people value and may therefore voluntarily engage with over time. An evidence synthesis of PD application in obesity prevention targeting adolescents and young adults is currently lacking.

OBJECTIVES

Report the protocol for a mixed-methods systematic scoping review which aims to integrate and synthesise available evidence on PD application in obesity prevention targeting adolescents and young adults. Specifically, the review will address three research questions: RQ1: How is PD defined in obesity prevention interventions targeting adolescents and young adults? RQ2: To what extent is PD applied in obesity preventions interventions targeting adolescents and young adults? RQ3a: How is the utility of PD evaluated in obesity preventions interventions targeting adolescents and young adults? RQ3b: What is the utility of PD application in obesity prevention interventions targeting adolescents and young adults?

METHODS

This mixed-methods systematic scoping review protocol adheres to the PRISMA-P guidelines and is informed by the PRISMA extension for scoping reviews (PRISMA-ScR). The search strategy and eligibility criteria are informed by the sample, phenomenon of interest, design, evaluation, and research type tool. Eligible studies will be peer-reviewed literature published in English, reporting on PD application in obesity prevention interventions (including intervention development, implementation, and/or evaluation) targeting adolescents and young adults (aged 10-35 years). Study designs will include qualitative, quantitative, and mixed methods. The review will comprise a systematic literature search, eligibility screening, data extraction, quality assessment using the Mixed-Methods Appraisal Tool (MMAT), and data analysis using an iterative narrative evidence synthesis approach. Evidence on PD application will be thematically integrated in terms of who was involved, when they were involved, and how and why they were involved. Further thematic analyses will be conducted according to the MATE taxonomy and the United Kingdom Medical Research Council (UK MRC's) key functions of process evaluations. The MATE taxonomy classifies PD application in terms of methodology, agent of change, training, and engagement. The MRC describes three functions of process evaluations: implementation, mechanisms of impact, and context. Applying both in the evidence synthesis is intended to provide a more complete picture of PD application. Exploratory analyses will be conducted to assess any potential associations between PD application and effectiveness across key outcomes (weight, physical activity, sedentary time, nutrition and dietary habit, mental health, and sleep) reported within intervention evaluations.

CONCLUSIONS

Elucidating PD application is a prerequisite to establishing its utility. Through the location and synthesis of available evidence on PD application in obesity prevention targeting adolescents and young adults, this review will categorise and describe different methods of PD application and explore the utility of PD application including whether any differences may be observed between PD method applied and the effectiveness of obesity prevention interventions. Implications will be delineated from the narrative evidence synthesis to inform future research and advance practice in this context.

SYSTEMATIC REVIEW REGISTRATION

PROSPERO CRD42021268240.

'Shape-Up', a Modified Cognitive-Behavioural Community Programme for Weight Management: Real-World Evaluation as an Approach for Delivering Public Health Goals

Obesity is widespread, with serious health consequences; addressing it requires considerable effort at a public health level, incorporating prevention and management along with policies to support implementation. Behavioural weight-management programmes are widely used by public health bodies to address overweight and obesity. Shape-Up is an evidence-based programme combining a structured behavioural intervention (targeting nutrition and physical activity behaviours) within a peer-learning framework. This study was a service-evaluation of Shape-Up, as delivered in Rotherham by a local leisure provider, and included a secondary analysis of data collected in the community by service providers. The RE-AIM (Reach Effectiveness Adoption Implementation Maintenance) framework was used to explore programme effectiveness, implementation, and whom it reached. A total of 141 participants were included. Compared to local demographics, participants were older, at 48.9 (SD 14.47) years, with a lower employment rate (41% employed) and greater proportion female (67% female). Mean BMI was 38.0 (SD 7.54) kg/m2. Mean weight-change between baseline and endpoint (12 weeks, 10 group sessions) was -4.4 (SD 3.38) kg, and degree of weight change was associated with session attendance (F (9, 131) = 6.356, p < 0.0005). There were positive effects on participants' weight, health-related behaviours, and quality of life. The intervention content (including the focus of nutritional recommendations) and structure were adapted during implementation to better suit national guidelines and local population needs. RE-AIM was found to be a useful framework for evaluating and adapting an existing evidence-based weight management programme in line with local population needs. This could be a more cost-effective approach, compared to developing new programmes, for delivering public health goals relating to obesity, nutrition, and physical activity.