A RE-AIM evaluation of evidence-based multi-level interventions to improve obesity-related behaviours in adults: a systematic review (the SPOTLIGHT project)

Implementation Evaluation of a Parks- and Faith-Based Multilevel Intervention to Promote Physical Activity Among Latinos

BACKGROUND

Latinos in the United States face multiple barriers to engaging in physical activity (PA). We implemented a faith-based multilevel intervention to promote PA in parks for Latino adults, which was partially adapted to a virtual platform during the COVID-19 pandemic, and evaluated it using the Reach, Effectiveness, Adoption, Implementation, and Maintenance framework.

METHODS

We conducted in-depth semistructured interviews (83% in Spanish) with 24 intervention participants (75% women) participating in a cluster randomized controlled trial in 2019-2022 that linked 6 churches (3 intervention, 3 control) with parks in East Los Angeles, CA. The intervention included in-person, park-based fitness classes, which were adapted to Facebook during the pandemic; PA motivational text messages; and other activities. Interviews assessed Reach (participation), Effectiveness (perceived impacts), Implementation (participation barriers/facilitators), and Maintenance (plans for sustaining PA), as well as perceived pandemic impacts.

RESULTS

About 80% of interviewees participated in ≥1 park class and 67% in ≥1 virtual class (Reach). Interviewees perceived positive intervention impacts across multiple health and well-being domains (Effectiveness) despite perceived negative pandemic impacts; several facilitators to participation (personal, social, program) and few barriers (personal, virtual, environmental; Implementation); and plans for maintaining PA (eg, revisiting intervention text messages and video recordings; Maintenance).

CONCLUSIONS

Findings support the utility of Reach, Effectiveness, Adoption, Implementation, and Maintenance to understand the broad impacts of a faith-based PA intervention. Findings point to the adaptability and robustness of the intervention during a public health crisis. Overall, findings may help inform the translation of the intervention to other communities to advance health equity.

Multilevel Interventions Targeting Obesity: State of the Science and Future Directions

A seminal report, released in 2001 by the Institute of Medicine, spurred research on the design, implementation, and evaluation of multilevel interventions targeting obesity and related behaviors. By addressing social and environmental factors that support positive health behavior change, interventions that include multiple levels of influence (e.g., individual, social, structural) aim to bolster effectiveness and, ultimately, public health impact. With more than 20 years of multilevel obesity intervention research to draw from, this review was informed by published reviews (n = 51) and identified intervention trials (n = 103), inclusive of all ages and countries, to elucidate key learnings about the state of the science. This review provides a critical appraisal of the scientific literature related to multilevel obesity interventions and includes a description of their effectiveness on adiposity outcomes and prominent characteristics (e.g., population, setting, levels). Key objectives for future research are recommended to advance innovations to improve population health and reduce obesity.

Bridging the Gap: The Need to Implement Dietary Guidance to Address Cardiovascular Health

Cardiovascular disease (CVD) is the leading cause of death in the U.S. and globally. Research demonstrates that diet is a leading contributor to the development of CVD, its prevention and management, and the overall promotion of cardiovascular health. This article describes the current state of the evidence, including research on the DASH and Mediterranean diets to promote cardiovascular health and prevent CVD. The article suggests approaches to implement evidence-based diets and federal dietary guidance to promote the adoption and integration of these interventions in both community and clinical settings. It highlights the current U.S. federal interest in "Food is Medicine" and its importance in addressing diet-related chronic diseases and promoting cardiovascular health.

Identifying multilevel predictors of behavioral outcomes like park use: A comparison of conditional and marginal modeling approaches

This study compared marginal and conditional modeling approaches for identifying individual, park and neighborhood park use predictors. Data were derived from the ParkIndex study, which occurred in 128 block groups in Brooklyn (New York), Seattle (Washington), Raleigh (North Carolina), and Greenville (South Carolina). Survey respondents (n = 320) indicated parks within one half-mile of their block group used within the past month. Parks (n = 263) were audited using the Community Park Audit Tool. Measures were collected at the individual (park visitation, physical activity, sociodemographic characteristics), park (distance, quality, size), and block group (park count, population density, age structure, racial composition, walkability) levels. Generalized linear mixed models and generalized estimating equations were used. Ten-fold cross validation compared predictive performance of models. Conditional and marginal models identified common park use predictors: participant race, participant education, distance to parks, park quality, and population >65yrs. Additionally, the conditional mode identified park size as a park use predictor. The conditional model exhibited superior predictive value compared to the marginal model, and they exhibited similar generalizability. Future research should consider conditional and marginal approaches for analyzing health behavior data and employ cross-validation techniques to identify instances where marginal models display superior or comparable performance.

Perspective: Nutrition Health Disparities Framework: A Model to Advance Health Equity

Disparities in nutrition, such as poor diet quality and inadequate nutrient intake, arise from multiple factors and are related to adverse health outcomes such as obesity, diabetes, cardiovascular disease, and some cancers. The aim of the current perspective is to present a nutrition-centric socioecological framework that delineates determinants and factors that contribute to diet and nutrition-related disparities among disadvantaged populations. The Nutrition Health Disparities Framework (NHDF) describes the domains (biological, behavioral, physical/built environment, sociocultural environment, and healthcare system) that influence nutrition-related health disparities through the lens of each level of influence (that is, individual, interpersonal, community, and societal). On the basis of the scientific literature, the authors engaged in consensus decision making in selecting nutrition-related determinants of health within each domain and socioecological level when creating the NHDF. The framework identifies how neighborhood food availability and access (individual/built environment) intersect with cultural norms and practices (interpersonal/sociocultural environment) to influence dietary behaviors, exposures, and risk of diet-related diseases. In addition, the NHDF shows how factors such as genetic predisposition (individual/biology), family dietary practices (interpersonal/behavioral), and food marketing policies (societal) may impact the consumption of unhealthy foods and beverages and increase chronic disease risk. Family and peer norms (interpersonal/behavior) related to breastfeeding and early childhood nutrition interact with resource-poor environments such as lack of access to preventive healthcare settings (societal/healthcare system) and low usage of federal nutrition programs (societal/behavioral), which may increase risk of poor nutrition during childhood and food insecurity. The NHDF describes the synergistic interrelationships among factors at different levels of the socioecological model that influence nutrition-related outcomes and exacerbate health disparities. The framework is a useful resource for nutrition researchers, practitioners, food industry leaders, and policymakers interested in improving diet-related health outcomes and promoting health equity in diverse populations.

Population health interventions for cardiometabolic diseases in primary care: a scoping review and RE-AIM evaluation of current practices

Introduction

Cardiometabolic diseases (CMD) are the leading cause of death in high-income countries and are largely attributable to modifiable risk factors. Population health management (PHM) can effectively identify patient subgroups at high risk of CMD and address missed opportunities for preventive disease management. Guided by the Reach, Efficacy, Adoption, Implementation and Maintenance (RE-AIM) framework, this scoping review of PHM interventions targeting patients in primary care at increased risk of CMD aims to describe the reported aspects for successful implementation.

Methods

A comprehensive search was conducted across 14 databases to identify papers published between 2000 and 2023, using Arksey and O'Malley's framework for conducting scoping reviews. The RE-AIM framework was used to assess the implementation, documentation, and the population health impact score of the PHM interventions.

Results

A total of 26 out of 1,100 studies were included, representing 21 unique PHM interventions. This review found insufficient reporting of most RE-AIM components. The RE-AIM evaluation showed that the included interventions could potentially reach a large audience and achieve their intended goals, but information on adoption and maintenance was often lacking. A population health impact score was calculated for six interventions ranging from 28 to 62%.

Discussion

This review showed the promise of PHM interventions that could reaching a substantial number of participants and reducing CMD risk factors. However, to better assess the generalizability and scalability of these interventions there is a need for an improved assessment of adoption, implementation processes, and sustainability.

Applying RE-AIM to evaluations of Veterans Health Administration Enterprise-Wide Initiatives: lessons learned

Introduction

The United States Veterans Health Administration (VHA) Office of Rural Health funds Enterprise-Wide Initiatives (system-wide initiatives) to spread promising practices to rural Veterans. The Office requires that evaluations of Enterprise-Wide Initiatives use the Reach, Effectiveness, Adoption, Implementation, and Maintenance (RE-AIM) framework. This presents a unique opportunity to understand the experience of using RE-AIM across a series of evaluations. The authors conducted a study to document the benefits and pitfalls of using RE-AIM, capture the variety of ways that the team captured the elements of RE-AIM, and develop recommendations for the future use of RE-AIM in evaluation.

Materials and methods

The authors first conducted a document review to capture pre-existing information about how RE-AIM was used. They subsequently facilitated two focus groups to gather more detailed information from team members who had used RE-AIM. Finally, they used member-checking throughout the writing process to ensure accurate data representation and interpretation and to gather additional feedback.

Results

Four themes emerged from the document review, focus groups, and member checking. RE-AIM: provides parameters and controls the evaluation scope, "buckets" are logical, plays well with other frameworks, and can foster collaboration or silo within a team. Challenges and attributes for each RE-AIM dimension were also described.

Discussion

Overall, participants reported both strengths and challenges to using RE-AIM as an evaluation framework. The overarching theme around the challenges with RE-AIM dimensions was the importance of context. Many of these benefits and challenges of using RE-AIM may not be unique to RE-AIM and would likely occur when using any prescribed framework. The participants reported on the RE-AIM domains in a variety of ways in their evaluation reports and were not always able capture data as originally planned. Recommendations included: start with an evaluation framework (or frameworks) and revisit it throughout the evaluation, consider applying RE-AIM PRISM (Practical Robust Implementation Framework) to gain a broader perspective, and intentionally integrate quantitative and qualitative team members, regardless of the framework used.

A cluster randomized trial of a comprehensive intervention nesting family and clinic into school centered implementation to reduce myopia and obesity among children and adolescents in Beijing, China: study protocol

BACKGROUND

Myopia and obesity in children and adolescents have become serious public health problems that endanger public health, especially in China. Unhealthy lifestyle behaviors are environmental drivers of both myopia and obesity. This protocol describes a study to evaluate the effectiveness of "22510SS", that is 2 h of daytime outdoor activities ('2'); Limit screen time to no more than 2 h per day ('2'); Consume at least 5 servings of fruits and vegetables daily ('5'); Attain 1 h of physical activity daily ('1'); Consume 0 sugar-sweetened beverages ('0'); Reasonable sleep duration ('S'); Regular supervision ('S'). A school-based, multifaceted intervention strategy for myopia and obesity prevention, and to assess and explore the implementation of "22510SS" with regards to acceptability, feasibility, adoption, usage and maintenance.

METHODS AND ANALYSIS

This study aims to develop a comprehensive intervention strategy "22510SS" based on the socio-ecological model, and A two-arm cluster randomized trial with a parallel-group of a 1:1 allocation ratio in 36 primary and secondary schools to test its evidence-based intervention programs on the effects and implementation of myopia and obesity epidemics in children and adolescents in grades 4 and 7. The primary outcomes will include differences in visual acuity, body mass index, outdoor activity indicators, screen time, fruit and vegetable intake, high-quality protein intake, sugar-sweetened beverage intake, sleep duration, and level of monitoring among children and adolescents. Secondary outcomes will assess the acceptability, feasibility, uptake, use, and maintenance of the intervention. Effects on the primary and secondary outcomes will be analyzed using linear and logistic regression analyses, as well as difference-in-difference analysis, taking into account cluster effects and possible confounding factors. Process assessments will also be conducted through quantitative and qualitative analyses, including acceptability, feasibility, gender, adoption, implementation, and sustainability.

DISCUSSION

This study will evaluate the effectiveness of "22510SS" and examine its implementation in the school-based network nesting family and clinic. Following this intervention study, the integrated intervention program focused on myopia and obesity among children and adolescents have great potential to be implemented in China to promote and support healthy lifestyle behavior change and reduce the risk of myopia and obesity in children and adolescents.

TRIAL REGISTRATION

NCT05275959. Registered 23 Mach 2022.

Electronic Health Interventions for Patients With Breast Cancer: Systematic Review and Meta-Analyses

PURPOSE

Ongoing supportive care using electronic health (eHealth) interventions has the potential to provide remote support and improve health outcomes for patients with breast cancer. This study aimed to evaluate the effectiveness of eHealth interventions on patient-reported outcomes (quality of life [QOL], self-efficacy, and mental or physical health) for patients during and after breast cancer treatment and patient-reported experience measures (acceptability and engagement).

METHODS

Systematic review with meta-analyses (random-effects model) of randomized controlled trials was conducted following Preferred Reporting Items for Systematic Reviews and Meta-Analysis guidelines. Nine databases were searched using a prespecified search strategy. Patient-directed eHealth interventions for adult patients during or after active breast cancer treatment measuring QOL, self-efficacy, and mental (depressive, anxiety, and distress symptoms) or physical (physical activity, nutrition, and fatigue) health outcomes were included. Data from eligible full-text articles were independently extracted by six observers.

RESULTS

Thirty-two unique studies (4,790 patients) were included. All were health self-management interventions, and most were multicomponent (videos, forums, and electronic reminder systems) websites. Meta-analyses revealed a significant effect of eHealth interventions on QOL (standardized mean difference [SMD], 0.20 [95% CI, 0.03 to 0.36]), self-efficacy (SMD, 0.45 [95% CI, 0.24 to 0.65]), distress (SMD, -0.41 [95% CI,-0.63 to -0.20]), and fatigue (SMD, -0.37 [95% CI, -0.61 to -0.13]). Twenty-five studies (78.1%) measured patient-reported experience measures. Acceptability (n = 9) was high, with high ratings for satisfaction (range, 71%-100%), usefulness (range, 71%-95%), and ease-of-use (range, 73%-92%). Engagement (n = 25) decreased over time, but disease-focused information and interactive support were most engaging.

CONCLUSION

eHealth interventions may provide an acceptable and effective strategy for improving QOL, distress, self-efficacy, and fatigue among patients with breast cancer.

Healthy Schoolhouse 2.0 Strides toward Equity in Obesity Prevention

Background: Over the past two decades, childhood obesity has been recognized as an increasing health problem with stark disparities by race, ethnicity, and zip code. A single-level intervention that focuses on individual choices has limited success especially in under-resourced communities. Methods: The "Getting to Equity" model provides a framework for building interventions that incorporate multilevel strategies. We applied this model to an elementary school-based obesity prevention program. Results: By applying the "Getting to Equity" framework, we demonstrate how a school-based program aligns with the quadrants within the framework to holistically address childhood obesity. Conclusion: By applying this model to an elementary school-based obesity prevention program, we demonstrate how program leaders can address childhood obesity while advancing health equity.

Evaluating the Dissemination and Implementation of a Community Health Worker-Based Community Wide Campaign to Improve Fruit and Vegetable Intake and Physical Activity among Latinos along the U.S.-Mexico Border

This study evaluated the dissemination and implementation of a culturally tailored community-wide campaign (CWC), Tu Salud ¡Si Cuenta! (TSSC), to augment fruit and vegetable (FV) consumption and physical activity (PA) engagement among low-income Latinos of Mexican descent living along the U.S.-Mexico Border in Texas. TSSC used longitudinal community health worker (CHW) home visits as a core vehicle to enact positive change across all socioecological levels to induce behavioral change. TSSC's reach, effectiveness, adoption, implementation, and maintenance (RE-AIM) was examined. A dietary questionnaire and the Godin-Shepherd Exercise Questionnaire measured program effectiveness on mean daily FV consumption and weekly PA engagement, respectively. Participants were classified based on CHW home visits into "low exposure" (2-3 visits) and "high exposure" (4-5 visits) groups. The TSSC program reached low-income Latinos (n = 5686) across twelve locations. TSSC demonstrated effectiveness as, compared to the low exposure group, the high exposure group had a greater FV intake (mean difference = +0.65 FV servings daily, 95% CI: 0.53-0.77) and an increased PA (mean difference = +185.6 MET-minutes weekly, 95% CI: 105.9-265.4) from baseline to the last follow-up on a multivariable linear regression analysis. Multivariable logistic regression revealed that the high exposure group had higher odds of meeting both FV guidelines (adjusted odds ratio (AOR) = 2.03, 95% CI: 1.65-2.47) and PA guidelines (AOR = 1.36, 95% CI: 1.10-1.68) at the last follow-up. The program had a 92.3% adoption rate, with 58.3% of adopting communities meeting implementation fidelity, and 91.7% of communities maintaining TSSC. TSSC improved FV consumption and PA engagement behaviors among low-income Latinos region wide. CHW delivery and implementation funding positively influenced reach, effectiveness, adoption, and maintenance, while lack of qualified CHWs negatively impacted fidelity.

The Faith, Activity, and Nutrition (FAN) dissemination and implementation study: changes in and maintenance of organizational practices over 24 months in a statewide initiative

BACKGROUND

Few studies have examined the impact of ecological health promotion interventions on organizational practices over time, especially in faith-based settings. This statewide dissemination and implementation study examined change in organizational practices and their predictors across a 24-month period, as well as maintenance of change.

METHODS

Using a pre-post quasi-experimental design, church coordinators from 92 United Methodist Churches in South Carolina (42% predominantly African American congregations) completed surveys at baseline, and immediate, 12-, and 24-months post-training regarding physical activity (PA) and healthy eating (HE) organizational practices consistent with the Faith, Activity, and Nutrition (FAN) program (opportunities, policies, pastor support, messages) and possible predictors. The study was guided by the RE-AIM framework and the Consolidated Framework for Implementation Research (CFIR). Mixed model repeated measures analyses examined change in organizational practices over time. Regression models examined CFIR predictors of 24-month PA and HE organizational practices, controlling for baseline practices. Churches were also classified as maintainers (implemented at 12 and 24 months), non-sustained implementers (implemented at 12 but not 24 months), delayed implementers (implemented at 24 but not 12 months), and low implementers (implemented at neither 12 nor 24 months) for each FAN component.

RESULTS

PA and HE organizational practices increased over time (p < .0001). CFIR domains (and constructs within) of intervention characteristics (adaptability, relative advantage, cost/time), inner setting (relative priority, organizational rewards, readiness, congregant needs), characteristics of the implementer (self-efficacy, perceived benefits), and implementation process (engaging opinion leaders, engaging champions) were important predictors of 24-month PA and HE organizational practices. Over half of churches implementing PA policies, PA messages, HE policies, and HE opportunities at 12 months were maintainers at 24 months, and one-third were maintainers for PA opportunities, HE messages, and PA and HE pastor support. Furthermore, 16% of 12-month non-implementers were delayed implementers at 24 months for PA policies and 31% were delayed implementers for HE policies.

CONCLUSIONS

This study makes important contributions to the faith-based health promotion literature by including a large sample of churches, testing an ecological intervention approach, and assessing organizational practices over a 24-month period. Study findings can guide technical assistance and program adaptations over time.

TRIAL REGISTRATION

This study was registered in clinicaltrials.gov NCT02868866 on August 16, 2016.

Frameworks for implementation of policies promoting healthy nutrition and physically active lifestyle: systematic review

Background

Policy frameworks focusing on policy implementation may vary in terms of their scope, included constructs, relationships between the constructs, and context factors. Although multiple policy implementation frameworks exist, the overarching synthesis characterizing differences between the frameworks is missing. This study investigated frameworks guiding implementation of policies aiming at healthy nutrition, physical activity promotion, and a reduction of sedentary behavior. In particular, we aimed at examining the scope of the frameworks and the content of included constructs (e.g., referring to implementation processes, determinants, or implementation evaluation), the level at which these constructs operate (e.g., the individual level, the organizational/community level), relationships between the constructs, and the inclusion of equity factors.

Methods

A systematic review (the PROSPERO registration no. CRD42019133251) was conducted using 9 databases and 8 stakeholder websites. The content of 38 policy implementation frameworks was coded and analyzed.

Results

Across the frameworks, 47.4% (18 in 38) addressed three aims: description of the process, determinants, and the evaluation of implementation. The majority of frameworks (65.8%; 25 in 38) accounted for constructs from three levels: individual, organizational/community, and the system level. System-level constructs were included less often (76.3%; 29 in 38) than individual-level or organizational/community-level constructs (86.8% [33 in 38 frameworks] and 94.7% [36 in 38 frameworks] respectively). The majority of frameworks (84.2%, 32 in 38) included at least some sections that were solely of descriptive character (a list of unassociated constructs); 50.0% (19 in 38) included sections of prescriptive character (general steps of implementation); 60.5% (23 in 38) accounted for explanatory sections (assuming bi- or uni-directorial associations). The complex system approach was accounted for only in 21.1% (8 in 38) of frameworks. More than half (55.3%; 21 in 38) of frameworks did not account for any equity constructs (e.g., socioeconomic status, culture).

Conclusions

The majority of policy implementation frameworks have two or three aims (combining processes, determinants and/or the evaluation of implementation), include multi-level constructs (although the system-level determinants are less frequently included than those from the individual- or organizational/community-level), combine sections of purely descriptive character with sections accounting for prescriptive and/or explanatory associations, and are likely to include a little or no equity constructs.

Registration

PROSPERO, #CRD42019133251.

A systematic review of randomized control trials of HPV self-collection studies among women in sub-Saharan Africa using the RE-AIM framework

Introduction

Self-collection of samples for HPV testing may increase women’s access to cervical cancer screening in low- and middle-income settings. However, implementation remains poor in many regions. The purpose of this systematic review was to examine implementation data from randomized controlled trials evaluating human papillomavirus (HPV) self-collection testing among women in sub-Saharan Africa using the RE-AIM (Reach, Efficacy/Effectiveness, Adoption, Implementation, and Maintenance) framework.

Methods

We searched four electronic databases (PubMed, CINAHL, Web of Science, and Global Health) for pragmatic randomized controlled trials that promote HPV self-collection among women in sub-Saharan Africa. Study selection and data extraction were conducted according to the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-analyses) checklist. Two researchers independently extracted information from each article using a RE-AIM data extraction tool. The reporting of RE-AIM dimensions was summarized and synthesized across included interventions.

Results

We identified 2008 citations, and eight studies were included. These reported on five unique interventions. The five interventions were conducted in five countries: Cameroon, Ethiopia, Kenya, Nigeria, and Uganda. Intervention reach (80%) was the most commonly reported RE-AIM dimension, followed by adoption (56%), efficacy/effectiveness (52%), implementation (47%), and maintenance (0%). All the interventions described increased uptake of HPV testing among study participants (effectiveness). However, the majority of the studies focused on reporting internal validity indicators such as inclusion criteria (100%) and exclusion criteria (100%), and few reported on external validity indicators such as participation rate (40%), intervention cost (40%), staff selection (20%), and cost of maintenance (0%).

Conclusions

Our review highlights the under-reporting of external validity indicators such as participation rate, intervention, and maintenance costs in studies of self-collection for HPV testing among women in SSA. Future research should focus on including factors that highlight internal validity factors and external validity factors to develop a greater understanding of ways to increase not only reach but also implementation and long-term maintenance of these interventions. Such data may advance the translation of HPV interventions into practice and reduce health disparities in SSA. Findings highlight the need for innovative tools such as participatory learning approaches or open challenges to expand knowledge and assessment of external validity indicators to ultimately increase the uptake of HPV testing among women in SSA.

Supplementary Information

The online version contains supplementary material available at 10.1186/s43058-021-00243-5.

Is walking netball an effective, acceptable and feasible method to increase physical activity and improve health in middle- to older age women?: A RE-AIM evaluation

Background

Physical activity is a modifiable risk factor for health and wellbeing, all-cause mortality and healthy aging. However, for middle- to older-age females less is known about the benefits of sports participation on these outcomes. Further, the acceptability and feasibility of setting-up, implementing and maintaining sports-based programmes for an aging population is an understudied area of inquiry. The current study used the RE-AIM framework to investigate a nationwide Walking Netball (WN) programme.

Methods

The evaluation used a mixed-methods approach incorporating a multiple-baseline study, quasi-experimental study, programme monitoring data and qualitative studies to evaluate the programme in the Women’s Institutes (WI) in England. Data were analysed using multilevel growth modelling, mixed-design ANOVAs, multilevel regression, t-testing, and thematic analysis. Data were triangulated to address each dimension of the RE-AIM framework.

Findings

The programme reached 1.4% (n = 3148) of the WI population across 82.0% of WI regions in England and attracted inactive members at risk of ill-health. WN contributed to adaptations in physical function, mental health and wellbeing, social isolation, quality of life and increased physical activity. The adoption of the programme was successful with 87.7% WN groups’ maintaining participation beyond the 20-session initial delivery phase. Adoption was effective because of its set-up, peer-mentorship and long-term delivery; these factors likewise shaped implementation. Adapting and tailoring WN to the varying characteristics of participants within the WI and the facilities available, along with training delivery staff and providing resources are key programme components. The Walking Netball programme can be maintained through promotion within the local community, sustainable funding, inter-WI competitions, festivals and networks, multiple-hosts and continued host development.

Conclusions

WN was found to be an acceptable, feasible and effective intervention to increase physical activity and improve health in middle- to older- aged women. Future programmes may consider adapted styles of set-up and delivery. These include adapting to people, places and spaces through personalised support and providing a range of resources. Future designs may seek to understand how participation can contribute to healthy aging through longitudinal research beyond 12-months.

Study registration

The evaluation protocol was published in Open Science Framework in December 2018 prior to follow-up data collection being collected (https://www.osf.io/dcekz). Date of registration: 17 December 2018.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12966-021-01204-w.

Association between multi-component initiatives and physical activity-related behaviors: interim findings from the Healthy Schools Healthy Communities initiative

Background

Although successful, assessment of multi-component initiatives (MCIs) prove to be very challenging. Further, rigorous evaluations may not be viable, especially when assessing the impact of MCIs on long-term population-level behavior change (e.g., physical activity (PA) and health outcomes (e.g., childhood obesity). The purpose of this study was to use intensity scoring, to assess whether higher intensity MCIs implemented as part of Healthy Schools Healthy Communities (HSHC) were associated with improved physical activity and reduced sedentary behaviors among youth (dependent variables).

Methods

PA-related interventions were assigned point values based on three characteristics: 1) purpose of initiative; 2) duration; and 3) reach. A MCI intensity score of all strategies was calculated for each school district and its respective community. Multivariate longitudinal regressions were applied, controlling for measurement period, Cohort, and student enrollment size.

Results

Strategy intensity scores ranged from 0.3 to 3.0 with 20% considered “higher-scoring” (score > 2.1) and 47% considered “lower-scoring” (< 1.2). Average MCI intensity scores more than tripled over the evaluation period, rising from 14.8 in the first grant year to 32.1 in year 2, 41.1 in year 3, and 48.1 in year 4. For each additional point increase in average MCI intensity score, the number of days per week that students reported PA for at least 60 min increased by 0.010 days (p < 0.01), and the number of hours per weekday that students reported engaging in screen time strategies decreased by 0.006 h (p < 0.05). An increase of 50 points in MCI intensity score was associated with an average 0.5 day increase in number of weekdays physically active and an increase of 55 points was associated with an average decrease of 20 min of sedentary time per weekday.

Conclusions

We found a correlation between intensity and PA and sedentary time; increased PA and reduced sedentary time was found with higher-intensity MCIs. While additional research is warranted, practitioners implementing MCIs, especially with limited resources (and access to population-level behavior data), may consider intensity scoring as a realistic and cost effective way to assess their initiatives. At a minimum, the use of intensity scoring as an evaluation method can provide justification for, or against, the inclusion of an individual strategy into an MCI, as well as ways to increase the likelihood of the MCI impacting population-health outcomes.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12889-021-10312-y.

Raising awareness for dementia risk reduction through a public health campaign: a pre-post study

OBJECTIVES

Evaluate the effect of a health promotion campaign aimed at increasing awareness about dementia risk reduction in middle-aged community-dwelling individuals in the Netherlands.

DESIGN

A 10-month public health campaign using mass media and community participation, supported by eHealth. Population-level difference in awareness before and after the campaign, including variation between demographic groups, was assessed in two independent cross-sectional samples from the same target population.

SETTING

The public health campaign was launched in the Province of Limburg, the Netherlands, targeting all inhabitants aged 40-75 years old. Three specific districts within the Province were chosen for an additional community participation approach, in which local stakeholders were invited to support the campaign.

RESULTS

No pre- (n=590) post- (n=602) difference was observed in people agreeing to the statement that dementia risk reduction is possible (X²(1)=1.27, p=0.260). For the individual lifestyle factors, physical activity (7.6% increase (X²(1)=7.48, p=0.006)) and healthy diet (10.5% increase (X²(1)=12.37, p≤0.001)) were identified more often as being protective against dementia after the campaign. Of all risk/protective factors assessed, cognitive activity was identified most often at both preassessment (79.4%) and postassessment (80.4%), but there was no increase in awareness (X²(1)=0.17, p=0.677). Self-reported exposure to the campaign was associated with greater awareness and motivation for behavioural change (X²(1)=6.52, p=0.011). Compared with mass media only, the addition of community participation resulted in better recognition of campaign material and the eHealth platform.

CONCLUSIONS

This study was not able to reach a population-level increase of awareness of dementia risk reduction. Two out of the three lifestyle factors that formed the foundation of the campaign were identified more often after the campaign. Those reported having been exposed to the campaign were more aware and more inclined towards behavioural change.

Effectiveness of a family-, school- and community-based intervention on physical activity and its correlates in Belgian families with an increased risk for type 2 diabetes mellitus: the Feel4Diabetes-study

Background

The study aimed to investigate the effectiveness of the European Feel4Diabetes intervention, promoting a healthy lifestyle, on physical activity and its correlates among families at risk for type 2 diabetes mellitus (based on the Finnish Diabetes Risk Score) in Belgium.

Methods

The Feel4Diabetes intervention involved three components: family, school and community component, with the family component consisting of 6 counseling sessions for families at risk. Main outcomes were objectively measured physical activity levels and its subjectively measured correlates. The final sample consisted of 454 parents (mean age 39.4 years; 72.0% women) and 444 children (mean age 8.0 years; 50.1% girls). Multilevel repeated measures analyses were performed to assess intervention effectiveness after 1 year.

Results

In parents, there was no significant intervention effect. In children, there were only significant negative effects for moderate to vigorous physical activity (p = 0.05; η_p² = 0.008) and steps (p = 0.03; η_p² = 0.006%) on weekdays, with physical activity decreasing (more) in the intervention group.

Conclusions

The F4D-intervention lacks effectiveness on high-risk families’ physical activity and its correlates in Belgium. This could partially be explained by low attendance rates and a large drop-out. To reach vulnerable populations, future interventions should invest in more appropriate recruitment (e.g. more face-to-face contact) and more bottom-up development of the intervention (i.e. co-creation of the intervention with the target group).

Trial registration

The Feel4Diabetes-study was prospectively registered at clinicaltrials.gov as NCT02393872 on 20 March 2015.

Implementing Policy, Systems, and Environmental Change Through Community Coalitions and Extension Partnerships to Address Obesity in Rural Louisiana

Community coalitions and agents funded by the Louisiana State University Agricultural Center's Healthy Communities program implemented multilevel obesity prevention interventions in 3 rural parishes (ie, counties) with an obesity prevalence of 40% or higher. The Healthy Communities coalitions appraised local health concerns through needs assessments and community forums. On the basis of local needs and the evidence base, the coalitions identified and implemented policy, systems, and environmental (PSE) strategies and supporting education to promote healthy behavior change among residents, overcoming barriers in the process. Interventions varied by parish but included Complete Streets implementation plans, healthy retail initiatives, play space improvements, downtown beautification projects, and Smarter Lunchrooms.

Efficacy of population-wide diabetes and obesity prevention programs: An overview of systematic reviews on proximal, intermediate, and distal outcomes and a meta-analysis of impact on BMI

We conducted an overview of systematic reviews and a meta-analysis of the impact on body mass index (BMI) of primary studies of population-wide obesity and diabetes prevention programs, in order to evaluate their efficacy. We searched eight databases for reviews of population-level programs reporting effect on diet, physical activity, BMI, or prevalence of obesity/overweight or type 2 diabetes mellitus (T2DM). Meta-analysis of primary studies within reviews reporting effect on BMI. Interventions were categorized using ANGELO framework and quality assessment using AMSTAR. Fifty-three systematic reviews were included. Primary studies were largely natural experiments or cross-sectional studies of national data. Increased price of sugar-sweetened beverages (SSBs) and fast food, decreased price of fruit and vegetables, food labelling, and grocery store interventions were associated with positive effects on diet. Park and playground renovations and point-of-choice prompts to increase stair use were associated with positive effects on physical activity. Increased price of SSBs, menu labelling, grocery store interventions, and multicomponent interventions were associated with small reductions in BMI. There was insufficient evidence of impact of any interventions on the prevalence of overweight, obesity, or T2DM. We have identified a promising suite of population-wide actions to improve diet, increase physical activity, and reduce BMI. Impact on subsequent incidence of T2DM remains speculative.

The HealtheSteps™ lifestyle prescription program to improve physical activity and modifiable risk factors for chronic disease: a pragmatic randomized controlled trial

BACKGROUND

Our objective was to determine the influence of the HealtheSteps™ lifestyle prescription program on physical activity and modifiable risk factors for chronic disease in individuals at risk.

METHODS

One hundred eighteen participants were recruited from 5 sites in Southwestern Ontario, Canada and randomized to either the intervention (HealtheSteps™ program, n = 59) or a wait-list control group (n = 59). The study comprised three phases: an Active Phase (0 to 6 months) consisted of bi-monthly in-person lifestyle coaching with access to a suite of eHealth technology supports (Heathesteps app, telephone coaching and a private HealtheSteps™ social network) followed by a Minimally-Supported Phase I (6 to 12 months), in which in-person coaching was removed, but participants still had access to the full suite of eHealth technology supports. In the final stage, Minimally-Supported Phase II (12 to 18 months), access to the eHealth technology supports was restricted to the HealtheSteps™ app. Assessments were conducted at baseline, 6, 12 and 18 months. The study primary outcome was the 6-month change in average number of steps per day. Secondary outcomes included: self-reported physical activity and sedentary time; self-reported eating habits; weight and body composition measures; blood pressure and health-related quality of life. Data from all participants were analyzed using an intent-to-treat approach. We applied mixed effects models for repeated measurements and adjusted for age, sex, and site in the statistical analyses.

RESULTS

Participants in HealtheSteps™ increased step counts (between-group [95% confidence interval]: 3132 [1969 to 4294], p < 0.001), decreased their sitting time (- 0.08 [- 0.16 to - 0.006], p = 0.03), and improved their overall healthful eating (- 1.5 [- 2.42 to - 0.58], p = 0.002) to a greater extent compared to control at 6 months. Furthermore, exploratory results showed that these individuals maintained these outcomes 12 months later, after a minimally-supported phase; and retained improvements in sedentary time and improved healthful eating after 18 months. No differences in self-reported physical activity, health-related quality of life, weight, waist circumference or blood pressure were observed between groups at 6 months.

CONCLUSIONS

Our findings suggest that HealtheSteps™ is effective at increasing physical activity (i.e., step counts per day), decreasing weekday sitting time, and improving healthful eating in adults at increased risk for chronic disease after 6 months; however, we did not see change in other risk factors. Nonetheless, the maintenance of these behaviours with minimal support after 12 and even 18 months indicates the promise of HealtheSteps™ for long-term sustainability.

TRIAL REGISTRATION

The trial was registered on April 6, 2015 with ClinicalTrials.gov (identifier: NCT02413385 ).

Making Health Research Matter: A Call to Increase Attention to External Validity

Most of the clinical research conducted with the goal of improving health is not generalizable to nonresearch settings. In addition, scientists often fail to replicate each other's findings due, in part, to lack of attention to contextual factors accounting for their relative effectiveness or failure. To address these problems, we review the literature on assessment of external validity and summarize approaches to designing for generalizability. When investigators conduct systematic reviews, a critical need is often unmet: to evaluate the pragmatism and context of interventions, as well as their effectiveness. Researchers, editors, and grant reviewers can implement key changes in how they consider and report on external validity issues. For example, the recently published expanded CONSORT figure may aid scientists and potential program adopters in summarizing participation in and representativeness of a program across different settings, staff, and patients. Greater attention to external validity is needed to increase reporting transparency, improve program dissemination, and reduce failures to replicate research.

Improving cardiometabolic health through nudging dietary behaviours and physical activity in low SES adults: design of the Supreme Nudge project

Background

Initiating and maintaining a healthy lifestyle -including healthy eating and sufficient physical activity- is key for cardiometabolic health. A health-promoting environment can facilitate a healthy lifestyle, and may be especially helpful to reach individuals with a lower socio-economic status (SES). In the Supreme Nudge project, we will study the effects of pricing and nudging strategies in the supermarket – one of the most important point-of-choice settings for food choices – and of a context-specific mobile physical activity promotion app. This paper describes the stepwise and theory-based design of Supreme Nudge, which aims to develop, implement and evaluate environmental changes for a sustained impact on lifestyle behaviours and cardiometabolic health in low SES adults.

Methods

Supreme Nudge uses a multi-disciplinary and mixed methods approach, integrating participatory action research, qualitative interviews, experimental pilot studies, and a randomized controlled trial in a real-life (supermarket) setting. First, we will identify the needs, characteristics and preferences of the target group as well as of the participating supermarket chain. Second, we will conduct a series of pilot studies to test novel, promising and feasible intervention components. Third, a final selection of intervention components will be implemented in a full-scale randomised controlled supermarket trial. Approximately 1000 low SES adults will be recruited across 8–12 supermarkets and randomised at supermarket level to receive 1) no intervention (control); 2) environmental nudges such as food product placement or promotion; 3) nudges and a tailored physical activity app that provides time- and context specific feedback; 4) pricing interventions, nudges, and the physical activity app. The effects on dietary behaviours and physical activity will be evaluated at 3, 6 and 12 months, and on cardiometabolic health at 6 and 12 months. Finally, we will evaluate the Reach, Effectiveness, Adoption, Implementation and Maintenance (RE-AIM) of the intervention, and we will use insights from System Innovation and Transition Management theories to define the best strategies for implementation and upscaling beyond the study period.

Discussion

The Supreme Nudge project is likely to generate thorough evidence relevant for policy and practice on the effects of a mixed method and multi-disciplinary intervention targeting dietary behaviours and physical activity.

Trial registration

The real-life trial has been registered on 30 May 2018, NTR7302.

A group-based lifestyle intervention for diabetes prevention in low- and middle-income country: implementation evaluation of the Kerala Diabetes Prevention Program

BACKGROUND

While several efficacy trials have demonstrated diabetes risk reduction through targeting key lifestyle behaviours, there is a significant evidence gap in relation to the successful implementation of such interventions in low- and middle-income countries (LMICs). This paper evaluates the implementation of a cluster randomised controlled trial of a group-based lifestyle intervention among individuals at high-risk of developing type 2 diabetes mellitus (T2DM) in the state of Kerala, India. Our aim is to uncover provider-, participant- and community-level factors salient to successful implementation and transferable to other LMICs.

METHODS

The 12-month intervention program consisted of (1) a group-based peer-support program consisting of 15 sessions over a period of 12 months for high-risk individuals, (2) peer leader (PL) training and ongoing support for intervention delivery, (3) diabetes education resource materials and (4) strategies to stimulate broader community engagement. The evaluation was informed by the RE-AIM and PIPE frameworks.

RESULTS

Provider-level factors: Twenty-nine (29/30, 97%) intervention groups organised all 15 sessions. A 2-day PL training was attended by 51(85%) of 60 PLs. The PL handbook was found to be 'very useful' by 78% of PLs. Participant-level factors: Of 1327 eligible individuals, 1007(76%) participants were enrolled. On average, participants attended eight sessions. Sixty-eight percent rated their interest in group sessions as 'very interested', and 55% found the group sessions 'very useful' in making lifestyle changes. Inconvenient time (43%) and location (21%) were found to be important barriers for participants who did not attend any sessions. Community-level factors: Community-based activities reached to 41% of the participants for walking groups, 40% for kitchen garden training, and 31% for yoga training. PLs were readily available for support outside the sessions, as 75% of participants reported extracurricular contacts with their PLs. The commitment from the local partner institute and political leaders facilitated the high uptake of the program.

CONCLUSION

A comprehensive evaluation of program implementation from the provider-, participant- and community-level perspectives demonstrates that the K-DPP program was feasible and acceptable in changing lifestyle behaviours in high-risk individuals. The findings from this evaluation will guide the future delivery of structured lifestyle modification diabetes programs in LMICs.

TRIAL REGISTRATION

Trial registration: Australia and New Zealand Clinical Trials Registry ACTRN12611000262909 . Registered 10 March 2011.

Intervention strategies to improve nutrition and health behaviours before conception

The nutritional status of both women and men before conception has profound implications for the growth, development, and long-term health of their offspring. Evidence of the effectiveness of preconception interventions for improving outcomes for mothers and babies is scarce. However, given the large potential health return, and relatively low costs and risk of harm, research into potential interventions is warranted. We identified three promising strategies for intervention that are likely to be scalable and have positive effects on a range of health outcomes: supplementation and fortification; cash transfers and incentives; and behaviour change interventions. On the basis of these strategies, we suggest a model specifying pathways to effect. Pathways are incorporated into a life-course framework using individual motivation and receptiveness at different preconception action phases, to guide design and targeting of preconception interventions. Interventions for individuals not planning immediate pregnancy take advantage of settings and implementation platforms outside the maternal and child health arena, since this group is unlikely to be engaged with maternal health services. Interventions to improve women's nutritional status and health behaviours at all preconception action phases should consider social and environmental determinants, to avoid exacerbating health and gender inequalities, and be underpinned by a social movement that touches the whole population. We propose a dual strategy that targets specific groups actively planning a pregnancy, while improving the health of the population more broadly. Modern marketing techniques could be used to promote a social movement based on an emotional and symbolic connection between improved preconception maternal health and nutrition, and offspring health. We suggest that speedy and scalable benefits to public health might be achieved through strategic engagement with the private sector. Political theory supports the development of an advocacy coalition of groups interested in preconception health, to harness the political will and leadership necessary to turn high-level policy into effective coordinated action.

How can clinical practices pragmatically increase physical activity for patients with type 2 diabetes? A systematic review

Although regular physical activity (PA) is a cornerstone of treatment for type 2 diabetes (T2D), most adults with T2D are sedentary. Randomized controlled trials (RCTs) have proven the effectiveness of PA behavioral interventions for adults with T2D but have rarely been conducted in healthcare settings. We sought to identify PA interventions that are effective and practical to implement in clinical practice settings. Our first aim was to use the valid Pragmatic-Explanatory Continuum Indicator Summary 2 (PRECIS-2) tool to assess the potential for future implementation of PA interventions in clinical practice settings. Our second aim was to identify interventions that effectively increased PA and glycemic control among the interventions in the top tertile of PRECIS-2 scores. We searched PubMed MEDLINE from January 1980 through May 2015 for RCTs of behavioral PA interventions coordinated by clinical practices for patients with T2D. Dual investigators assessed pragmatism by PRECIS-2 scores, and study effectiveness was extracted from original RCT publications. The PRECIS-2 scores of the 46 behavioral interventions (n = 13,575 participants) ranged from 3.0 to 4.8, where 5 is the most pragmatic score. In the most pragmatic tertile of interventions (n = 16) by PRECIS-2 scores, 30.8 and 31.3% of interventions improved PA outcomes and hemoglobin A1c, respectively. A minority of published evidence-based PA interventions for adults with T2D were both effective and pragmatic for clinical implementation. These should be tested for dissemination using implementation trial designs.

Peer support to improve diabetes care: an implementation evaluation of the Australasian Peers for Progress Diabetes Program

BACKGROUND

Several studies have now demonstrated the benefits of peer support in promoting diabetes control. The aim of this study is to evaluate the implementation of a cluster randomised controlled trial of a group-based, peer support program to improve diabetes self-management and thereby, diabetes control in people with Type 2 Diabetes in Victoria, Australia.

METHODS

The intervention program was designed to address four key peer support functions i.e. 1) assistance in daily management, 2) social and emotional support, 3) regular linkage to clinical care, and 4) ongoing and sustained support to assist with the lifelong needs of diabetes self-care management. The intervention participants attended monthly group meetings facilitated by a trained peer leader for 12 months. Data was collected on the intervention's reach, participation, implementation fidelity, groups' effectiveness and participants' perceived support and satisfaction with the intervention. The RE-AIM and PIPE frameworks were used to guide this evaluation.

RESULTS

The trial reached a high proportion (79%) of its target population through mailed invitations. Out of a total of 441 eligible individuals, 273 (61.9%) were willing to participate. The intervention fidelity was high (92.7%). The proportion of successful participants who demonstrated a reduction in 5 years cardiovascular disease risk score was 65.1 and 44.8% in the intervention and control arm respectively. Ninety-four percent (94%) of the intervention participants stated that the program helped them manage their diabetes on a day to day basis. Overall, attending monthly group meetings provided 'a lot of support' to 57% and 'moderate' support to 34% of the participants.

CONCLUSION

Peer support programs are feasible, acceptable and can be used to supplement treatment for patients motivated to improve behaviours related to diabetes. However, program planners need to focus on the participation component in designing future programs. The use of two evaluation frameworks allowed a comprehensive evaluation of the trial from the provider-, participant- and public health perspective. The learnings gained from this evaluation will guide and improve future implementation by improving program feasibility for adoption and acceptability among participants, and will ultimately increase the likelihood of program effectiveness for the participants.

TRIAL REGISTRATION

Australian New Zealand Clinical Trials Registry (ANZCTR) ACTRN12609000469213 . Registered 16 June 2009.

Views of policy makers and health promotion professionals on factors facilitating implementation and maintenance of interventions and policies promoting physical activity and healthy eating: results of the DEDIPAC project

Background

The uptake, implementation, and maintenance of effective interventions promoting physical activity (PA) and a healthy diet and the implementation of policies targeting these behaviors are processes not well understood. We aimed to gain a better understanding of what health promotion professionals and policy makers think are important factors facilitating adoption, implementation, and maintenance of multi-level interventions and policies promoting healthy eating and PA in Belgium, Germany, Ireland, Norway, and Poland.

Methods

Six interventions and six policies were identified based on pre-defined criteria. Forty semi-structured interviews were conducted with stakeholders from various sectors to elicit information on factors impacting adoption, implementation, and maintenance of these interventions and policies. All interview transcripts were coded in NVivo, using a common categorization matrix. Coding in the respective countries was done by one researcher and validated by a second researcher.

Results

Active involvement of relevant stakeholders and good communication between coordinating organizations were described as important factors contributing to successful adoption and implementation of both interventions and policies. Additional facilitating factors included sufficient training of staff and tailoring of materials to match needs of various target groups. The respondents indicated that maintenance of implemented interventions/policies depended on whether they were embedded in existing or newly created organizational structures in different settings and whether continued funding was secured.

Conclusions

Despite considerable heterogeneity of interventions and health policies in the five countries, stakeholders across these countries identify similar factors facilitating adoption, implementation, and maintenance of these interventions and policies.

Electronic supplementary material

The online version of this article (10.1186/s12889-017-4929-9) contains supplementary material, which is available to authorized users.

Effectiveness of a nationwide intervention to increase helmet use in Dutch skiers and snowboarders: an observational cohort study

OBJECTIVE

Helmet use in Dutch recreational skiers and snowboarders (DRSS) remains low. This study evaluated the effects of exposure to a nationwide intervention on relevant determinants of helmet use and helmet use in DRSS.

METHODS

The intervention mapping protocol was used to develop an in-season intervention programme targeted at adult DRSS. A prospective single-cohort study was conducted to evaluate the impact of intervention exposure on determinants of helmet use (ie, knowledge about head injury risk and preventive measures, risk perception, attitudes to head injury risk and helmet use and intention to helmet use) and self-reported helmet use. A random sample of 363 DRSS from an existing panel participated in this study. Data were collected using online questionnaires before and immediately after the 2010/2011 intervention season. In a separate sample of 363 DRSS, intervention reach was assessed after the 2010/2011 season.

RESULTS

Overall, no significant associations were found between intervention exposure and the determinants of helmet use. However, subgroup analyses revealed intervention effects on risk perception and knowledge in specific subpopulations. Intervention exposure had a significant, positive effect on helmet use in DRSS (β=0.23; 95% CI 0.017 to 0.44). Subgroup analyses revealed that this effect was found in: (1) skiers, (2) female DRSS, (3) young skiers and (4) intermediate skiers. Overall, intervention reach was 28.1%, with differences found between skiers and snowboarders.

CONCLUSIONS

Exposure to a nationwide intervention programme was associated with increased self-reported helmet use in DRSS. Differences were found in intervention effectiveness and reach between subpopulations. These differences must be taken into account when developing and evaluating future interventions.

HealtheSteps™ Study Protocol: a pragmatic randomized controlled trial promoting active living and healthy lifestyles in at-risk Canadian adults delivered in primary care and community-based clinics

BACKGROUND

Physical inactivity is one of the leading causes of chronic disease in Canadian adults. With less than 50% of Canadian adults reaching the recommended amount of daily physical activity, there is an urgent need for effective programs targeting this risk factor. HealtheSteps™ is a healthy lifestyle prescription program, developed from an extensive research base to address risk factors for chronic disease such as physical inactivity, sedentary behaviour and poor eating habits. HealtheSteps™ participants are provided with in-person lifestyle coaching and access to eHealth technologies delivered in community-based primary care clinics and health care organizations.

METHOD/DESIGN

To determine the effectiveness of Healthesteps™, we will conduct a 6-month pragmatic randomized controlled trial with integrated process and economic evaluations of HealtheSteps™ in 5 clinic settings in Southwestern Ontario. 110 participants will be individually randomized (1:1; stratified by site) to either the intervention (HealtheSteps™ program) or comparator (Wait-list control). There are 3 phases of the HealtheSteps™ program, lasting 6 months each. The active phase consists of bi-monthly in-person coaching with access to a full suite of eHealth technology supports. During the maintenance phase I, the in-person coaching will be removed, but participants will still have access to the full suite of eHealth technology supports. In the final stage, maintenance phase II, access to the full suite of eHealth technology supports is removed and participants only have access to publicly available resources and tools.

DISCUSSION

This trial aims to determine the effectiveness of the program in increasing physical activity levels and improving other health behaviours and indicators, the acceptability of the HealtheSteps™ program, and the direct cost for each person participating in the program as well as the costs associated with delivering the program at the different community sites. These results will inform future optimization and scaling up of the program into additional community-based primary care sites.

TRIAL REGISTRATION

NCT02413385 (Clinicaltrials.gov). Date Registered: April 6, 2015.

Evaluation of a large healthy lifestyle program: informing program implementation and scale-up in the prevention of obesity

BACKGROUND

The Healthy Lifestyle Program for women (HeLP-her) is a low-intensity, self-management program which has demonstrated efficacy in preventing excess weight gain in women. However, little is known about the implementation, reach, and sustainability of low-intensity prevention programs in rural settings, where risk for obesity in women is higher than urban settings. We aimed to evaluate a low-intensity healthy lifestyle program delivered to women in a rural setting to inform development of effective community prevention programs.

METHODS

A mixed method hybrid implementation and evaluation study, guided by the RE-AIM framework (addressing the Reach, Effectiveness, Adoption, Implementation, and Maintenance), was undertaken. Data collection tools included anthropometric measures, program checklists, questionnaires, and semi-structured interviews with participants and local stakeholders. The RE-AIM self-audit tool was applied to assess evaluation rigor.

RESULTS

Six hundred and forty-nine women from 41 relatively socio-economic disadvantaged communities in Australia participated: mean age 39.6 years (±SD 6.7) and body mass index of 28.8 kg/m2 (±SD 6.9). A between-group weight difference of -0.92 kg (95% CI -1.67 to -0.16) showed program effectiveness. Reach was broad across 41 towns with 62% of participants reporting influencing some of the health behaviors of their families. Strong implementation fidelity was achieved with good retention rates at 1 year (76%) and high participant satisfaction (82% of participants willing to recommend this program). Over 300 multi-level community partnerships were established supporting high adoption. Stakeholders reported potential capacity to implement and sustain the prevention program in resource poor rural settings, due to the low-intensity design and minimal resources required.

CONCLUSIONS

Our comprehensive RE-AIM evaluation demonstrates that an evidence-based obesity prevention program can be successfully implemented in real-world settings. The program achieved broad reach, effectiveness, and satisfaction at the community and stakeholder level, revealing potential for program sustainability. The evaluation addressed implementation knowledge gaps to support future obesity prevention program scale-up.

TRIAL REGISTRATION

Australian and New Zealand Clinical Trial Registry ACTRN 12612000115831 [ http://www.anzctr.org.au/ ].

Bristol Girls Dance Project: a cluster randomised controlled trial of an after-school dance programme to increase physical activity among 11- to 12-year-old girls

Background

Many children do not meet UK physical activity (PA) guidelines. Girls are less active than boys, and the age-related decline in activity is steeper for girls. Dance is the favourite form of PA among adolescent girls in the UK. Participation in after-school dance classes could significantly contribute to girls’ PA. Therefore, after-school dance may be effective for increasing PA levels.

Objectives

To determine the effectiveness and cost-effectiveness of a dance-based intervention to increase the objectively assessed mean weekday minutes of moderate- to vigorous-intensity physical activity (MVPA) of Year 7 girls (11- and 12-year olds) 1 year after baseline measurement.

Design

Two-arm cluster randomised controlled trial and economic evaluation. Year 7 girls in participant schools received a ‘taster’ session and were invited to participate. Up to 33 girls per school were able to participate. Schools were randomly assigned (equal numbers) to intervention or control arms.

Setting

A total of 18 mainstream secondary schools across greater Bristol.

Participants

Year 7 girls in participating schools who could participate in physical education.

Intervention

Nine intervention schools received an after-school dance intervention (40 × 75-minute sessions) underpinned by self-determination theory, which attempts to improve intrinsic motivation for being active, and delivered by external dance instructors. Control schools continued as normal.

Main outcome measures

The main outcome was accelerometer-assessed mean minutes of MVPA at T2. Measures were assessed at baseline (T0), the end of the intervention (T1) and at T0 + 52 weeks (T2).

Results

Baseline MVPA levels were high. A total of 508 girls were included in the primary analysis, which found no difference in weekday MVPA between trial arms. There was no effect on secondary accelerometer outcomes. Data were subjected to a per-protocol analysis and no effect was found. However, at T1, girls who attended dance classes had 4.61 minutes more of MVPA and 14.27 minutes more of light-intensity activity between 15.00 and 17.00 on the days on which they attended intervention sessions. The intervention was inexpensive at £73 per participant (£63 when excluding dance instructor travel) but was not cost-effective owing to the ineffectiveness of the intervention. The European Quality of Life-5 Dimensions Youth survey data were unresponsive to changes in the sample. The process evaluation reported that girls in attendance enjoyed the sessions, that exertion levels were low during sessions and that attendance was low and declined. Fidelity to the session-plan manual was low but theoretical fidelity (to self-determination theory) was good. Qualitative information provides information for improving future interventions.

Conclusions

The intervention was enjoyed by participants. However, there was no difference in the MVPA levels (which were high at baseline) of girls allocated to receive dance compared with girls receiving the control. High baseline MVPA levels indicate that the study appealed to an already active cohort and, therefore, may not have targeted those most in need of an intervention. Dance is an enjoyable activity for adolescent girls and could be further trialled as a means by which to increase PA. Research might consider the impact of dividing the intervention period into smaller blocks.

Trial Registration

Current Controlled Trials ISRCTN52882523.

Funding

The National Institute for Health Research Public Health Research programme. The work was also undertaken with the support of the Centre for the Development and Evaluation of Complex Interventions for Public Health Improvement (DECIPHer), a UK Clinical Research Collaboration (UKCRC) PHR Centre of Excellence. Joint funding (MR/KO232331/1) from the British Heart Foundation, Cancer Research UK, Economic and Social Research Council, Medical Research Council, the Welsh Government and the Wellcome Trust, under the auspices of the UKCRC, is gratefully acknowledged. This study was designed and delivered in collaboration with the Bristol Randomised Trials Collaboration, a UKCRC Registered Clinical Trials Unit in receipt of NIHR Clinical Trials Unit support funding. All intervention costs were funded by the respective councils to which the participant schools were affiliated, namely North Somerset Council, Bristol City Council, and Bath and North East Somerset Council.

Is Participatory Design Associated with the Effectiveness of Serious Digital Games for Healthy Lifestyle Promotion? A Meta-Analysis

Background

Serious digital games can be effective at changing healthy lifestyles, but large differences in their effectiveness exist. The extent of user involvement in game design may contribute to game effectiveness by creating a better fit with user preferences. Participatory design (PD), which represents active user involvement as informant (ie, users are asked for input and feedback) or codesigner (ie, users as equal partners in the design) early on and throughout the game development, may be associated with higher game effectiveness, as opposed to no user involvement or limited user involvement.

Objective

This paper reports the results of a meta-analysis examining the moderating role of PD in the effectiveness of serious digital games for healthy lifestyle promotion.

Methods

Four databases were searched for peer-reviewed papers in English that were published or in press before October 2014, using a (group-) randomized controlled trial design. Effectiveness data were derived from another meta-analysis assessing the role of behavior change techniques and game features in serious game effectiveness.

Results

A total of 58 games evaluated in 61 studies were included. As previously reported, serious digital games had positive effects on healthy lifestyles and their determinants. Unexpectedly, PD (g=0.075, 95% CI 0.017 to 0.133) throughout game development was related to lower game effectiveness on behavior (Q=6.74, P<.05) than when users were only involved as testers (g=0.520, 95% CI 0.150 to 0.890, P<.01). Games developed with PD (g=0.171, 95% CI 0.061 to 0.281, P<.01) were also related to lower game effectiveness on self-efficacy (Q=7.83, P<.05) than when users were not involved in game design (g=0.384, 95% CI 0.283 to 0.485, P<.001). Some differences were noted depending on age group, publication year of the study, and on the specific role in PD (ie, informant or codesigner), and depending on the game design element. Games developed with PD were more effective in changing behavioral determinants when they included users in design elements on game dynamics (beta=.215, 95% CI .075 to .356, P<.01) and, more specifically, as an informant (beta=.235, 95% CI .079 to .329, P<.01). Involving users as informants in PD to create game levels was also related to higher game effectiveness (Q=7.02, P<.01). Codesign was related to higher effectiveness when used to create the game challenge (Q=11.23, P<.01), but to lower game effectiveness when used to create characters (Q=4.36, P<.05) and the game world (Q=3.99, P<.05).

Conclusions

The findings do not support higher effectiveness of games developed with PD. However, significant differences existed among PD games. More support was found for informant roles than for codesign roles. When PD was applied to game dynamics, levels, and game challenge, this was associated with higher effectiveness than when it was applied to game aesthetics. Since user involvement may have an important influence on reach, adoption, and implementation of the intervention, further research and design efforts are needed to enhance effectiveness of serious games developed with PD.

The IDEFICS intervention: what can we learn for public policy?

INTRODUCTION

As considered in the rest of this volume, the effects of the IDEFICS intervention on obesity rates were not encouraging. This paper considers how far findings from the IDEFICS study and similar intervention studies are relevant to the policy process and political decision-making.

METHODS

The paper offers theoretical and policy-level arguments concerning the evaluation of evidence and its implications for policymaking. The paper is divided into three parts. The first considers problems in the nature and applicability of evidence gained from school- and community-level obesity interventions. The second part considers whether such interventions present a model that policymakers could implement. The third part considers how we should think about policy measures given the limited evidence we can obtain and the many different goals that public policy must take account of.

RESULTS

The paper argues that (1) there are clear reasons why we are not obtaining good evidence for effective school- and community-level interventions; (2) public policy is not in a good position to mandate larger-scale, long-term versions of these interventions; and (3) there are serious problems in obtaining 'evidence' for most public policy options, but this should not deter us from pursuing options that tackle systemic problems and have a good likelihood of delivering benefits on several dimensions.

CONCLUSIONS

Research on school- and community-level obesity interventions has not produced much evidence that is directly relevant to policymaking. Instead, it shows how difficult it is to affect obesity rates without changing wider social and economic factors. Public policy should focus on these.

Effect and cost of an after-school dance programme on the physical activity of 11-12 year old girls: The Bristol Girls Dance Project, a school-based cluster randomised controlled trial

Background

The aim of this study was to examine the effectiveness and cost of an after-school dance intervention at increasing the physical activity levels of Year 7 girls (age 11–12).

Methods

A cluster randomised controlled trial was conducted in 18 secondary schools. Participants were Year 7 girls attending a study school. The Bristol Girls Dance Project (BGDP) intervention consisted of up to forty, 75-minute dance sessions delivered in the period immediately after school by experienced dance instructors over 20-weeks. The pre-specified primary outcome was accelerometer assessed mean minutes of weekday moderate to vigorous physical activity (MVPA) at time 2 (52 weeks are T0 baseline assessments). Secondary outcomes included accelerometer assessed mean minutes of weekday MVPA at time 1 (while the intervention was still running) and psychosocial outcomes. Intervention costs were assessed.

Results

571 girls participated. Valid accelerometer data were collected from 549 girls at baseline with 508 girls providing valid accelerometer data at baseline and time 2. There were no differences between the intervention and control group for accelerometer assessed physical activity at either time 1 or time 2. Only one third of the girls in the intervention arm met the pre-set adherence criteria of attending two thirds of the dance sessions that were available to them. Instrumental variable regression analyses using complier average causal effects provided no evidence of a difference between girls who attended the sessions and the control group. The average cost of the intervention was £73 per girl, which was reduced to £63 when dance instructor travel expenses were excluded.

Conclusion

This trial showed no evidence that an after-school dance programme can increase the physical activity of Year 7 girls. The trial highlighted the difficulty encountered in maintaining attendance in physical activity programmes delivered in secondary schools. There is a need to find new ways to help adolescent girls to be physically active via identifying ways to support and encourage sustained engagement in physical activity over the life course.

Trial registration

ISRCTN52882523

Electronic supplementary material

The online version of this article (doi:10.1186/s12966-015-0289-y) contains supplementary material, which is available to authorized users.

The assessment of ongoing community-based interventions to prevent obesity: lessons learned

BACKGROUND

The assessment of real-life, community-based interventions to tackle obesity is an important step in the development of effective policies. Especially multi-level interventions have a high likely effectiveness and potential reach in counteracting the obesity epidemic. Although much can be learned from these initiatives, performing an evaluation of such interventions is challenging. The aim of the current article is to provide a descriptive overview of the data collection process and general results of an assessment of ongoing multi-level obesity prevention community interventions for adults in Europe, and the lessons learned from this effort.

METHODS

The data collection was divided into two main phases: a) finding the ongoing obesity prevention interventions by contacting key informants in each of the European Union countries and the European Economic Area, and searching existing databases; and b) collecting detailed information (including the reach, effectiveness, adoption, implementation and maintenance (RE-AIM)) of the selected interventions using questionnaires for informants in each of the interventions.

RESULTS

A total of 78 interventions from 24 European countries were included in the final sample. The number of identified interventions varied greatly per country. The interventions covered various implementation levels (national, regional or local) and determinants (physical, sociocultural, economic, political), mostly addressing both nutrition and physical activity behaviours.

CONCLUSIONS

We found that many multi-level obesity prevention interventions among adults are currently active in Europe, although we found relatively few in Southern and Eastern Europe. Identifying interventions and obtaining detailed information proved to be a difficult, time consuming and painstaking process. We discuss some of the reasons why this might be the case and present recommendations based on our experiences. We suggest that future research uses a step-wise approach, keeping participant burden to a minimum. The use of personalised and tailored strategies is recommended, led by researchers who exercise flexibility, tact and patience during the data collection process.