Long-Term Sustainability of Evidence-Based Prevention Interventions and Community Coalitions Survival: a Five and One-Half Year Follow-up Study

The ACHIEVE Program: Bringing Chicago Youth and Community Organizations Together to Impact Local Disparities

To evaluate the Advancing Community Health and Individual leadership through a noVel Educational (ACHIEVE) program uniting Chicago high school and undergraduate students (scholars) and community organizations to empower youth to meaningfully impact communities while enhancing organizational capacity. Between 2020 and 2022, the ACHIEVE program engaged cohorts of youth in classroom-based learning and community-based projects targeting health and education disparities. Pre and post-program surveys were administered to scholars to assess knowledge about disparities, skills, and self-efficacy. Semi-structured interviews were conducted with community organization leaders to examine programmatic impact. Descriptive and thematic analyses were performed. Across four cohorts (March 2020; September 2020-May 2021; September-November 2021; March-May 2022), 85 students participated in the ACHIEVE program. Scholars supported 19 community-based projects that increased awareness of local issues and resources and evaluated programs. Scholars reported advancement in their knowledge and skills as well as interest in sustaining their community engagement. Leaders shared several benefits at the organizational and community levels from collaborating with scholars. The ACHIEVE program enabled bidirectional learning between scholars and organizations. It also demonstrated that youth can contribute positively to addressing disparities while supporting local organizations and communities.

Organizational and coalition strategies for youth violence prevention: A longitudinal mixed-methods study

This longitudinal study identifies espoused change orientations and actual youth violence prevention (YVP) practices over five years by 99 public and nonprofit organizations in one city. Annual key informant interviews provided both qualitative and quantitative data, including organizational collaborative network data. Data were also obtained on participation in a citywide YVP coalition, juvenile arrests and court referrals. On average, organizations both in and outside the coalition adopted a problem-focused as often as a strengths-based change orientation, and were only marginally more oriented toward empowering community members than professionals and changing communities than individual youth. Most surprisingly, YVP coalition members adopted more of a tertiary (reactive/rehabilitative) than primary prevention orientation compared to nonmembers. The number of different YVP strategies implemented increased over five years from mainly positive youth development and education interventions to those strategies plus mentoring, youth activities, events and programs, and counseling youth. Network analysis reveals dense initial collaboration with no critical gatekeepers and coalition participants more central to the city-wide organizational network. Coalition participation and total network collaboration declined in Years 3-5. Youth violence arrests and court referrals also declined. The coalition was marginally involved in successful community-collaborative, school-based interventions and other strategies adopted, and it disbanded a year after federal funding ended. Despite, or possibly due to, both national and local government participation, the coalition missed opportunities to engage in collective advocacy for local YVP policy changes. Coalitions should help nonprofit and public organizations develop more effective change orientations and implement commensurate strategies at the community level.

Developing a sustainability readiness strategy for health systems: Toolkit, interactive tools, and virtual support system

While the literature strongly supports the need for sustainability of evidence-based interventions (EBIs), we present a review of the literature that indicates only three articles discuss a health-focused sustainability strategy. The aims of our sustainability readiness strategy (SRS) are to increase infrastructure capacity and EBI advocacy to impact the level of sustainability readiness. In this article, we describe the development of an evidence-informed promising practice sustainability readiness strategy (SRS) with three evidence-based components. This strategy: 1) is based on an adaptation of the Getting To Outcomes® (GTO) evidence-based implementation process, 2) includes a logic model with documented evidence of the connection between targeted readiness factors and sustainability outcomes, and 3) describes resources considered necessary to support implementation of the readiness strategy, namely a step-by-step Toolkit, Excel™ Tools, webinar coaching and evaluation guides, and a coaching and evaluation training guide. The national SRS survey results are presented. Lessons learned and future dissemination and implementation plans are described.

Initial conditions and functioning over time among community coalitions

Developing operationally strong community coalitions is critical to actualizing their potential for public health improvement. The purpose of this study was to measure how substance use prevention coalitions in Mexico functioned across their first 1.5 years, and to test associations between initial community contextual factors and subsequent coalition functioning and outcomes. Members of 19 coalitions participated in three waves of surveys about coalition context and functioning. We used paired t-tests to assess changes in coalition functioning and outcomes. Regression models estimated associations between coalition functioning and outcomes and initial community context. Among coalition functioning factors, over coalitions' first 1.5 years, member engagement increased, as did coordinator skill and participatory leadership style. Two initial community context factors - community support for prevention and community champions - predicted several measures of process competence, but only community champions predicted perceived community improvement. Thus, community champions may play a pivotal role in later coalition success. The observed increases in member engagement and process competence may support subsequent coalition sustainability, a crucial component to realizing their potential impact on public health.

Community engagement to implement evidence-based practices in the HEALing communities study

BACKGROUND

The implementation of evidence-based practices to reduce opioid overdose deaths within communities remains suboptimal. Community engagement can improve the uptake and sustainability of evidence-based practices. The HEALing Communities Study (HCS) aims to reduce opioid overdose deaths through the Communities That HEAL (CTH) intervention, a community-engaged, data-driven planning process that will be implemented in 67 communities across four states.

METHODS

An iterative process was used in the development of the community engagement component of the CTH. The resulting community engagement process uses phased planning steeped in the principles of community based participatory research. Phases include: 0) Preparation, 1) Getting Started, 2) Getting Organized, 3) Community Profiles and Data Dashboards, 4) Community Action Planning, 5) Implementation and Monitoring, and 6) Sustainability Planning.

DISCUSSION

The CTH protocol provides a common structure across the four states for the community-engaged intervention and allows for tailored approaches that meet the unique needs or sociocultural context of each community. Challenges inherent to community engagement work emerged early in the process are discussed.

CONCLUSION

HCS will show how community engagement can support the implementation of evidence-based practices for addressing the opioid crisis in highly impacted communities. Findings from this study have the potential to provide communities across the country with an evidence-based approach to address their local opioid crisis; advance community engaged research; and contribute to the implementation, sustainability, and adoption of evidence-based practices.

TRIAL REGISTRATION

ClinicalTrials.gov (NCT04111939).

Individualized approach to primary prevention of substance use disorder: age-related risks

Background

The misuse of legal and illegal substances has led to an increase in substance use disorder (SUD) in the United States. Although primary prevention strategies have been successfully used to target chronic physical diseases, these strategies have been less effective with SUD, given misconceptions of SUD, shortages in behavioral health professionals, and the population-based focus on specific substances. A developmental approach to the identification and primary prevention of SUD that does not fully rely upon behavioral health workers is needed. The purpose of this paper was to examine age related risk factors for developing SUD and present a novel individualized approach to SUD prevention.

Methods

A literature search was conducted to identify risk factors for SUD among children, young adults, adults, and older adults. We searched CINAHL, PsycINFO, and PubMed between the years 1989–2019, and extracted data, analyzing similarities and differences in risk factors across life stages. Broader categories emerged that were used to group the risk factors.

Results

More than 370 articles were found. Across all age groups, risk factors included adverse childhood experiences, trauma, chronic health diseases, environmental factors, family history, social determinants, and grief and loss. Despite the similarities, the contextual factors and life challenges associated with these risks varied according to the various life stages. We proposed an approach to primary prevention of SUD based on risk factors for developing the disease according to different age groups. This approach emphasizes screening, education, and empowerment (SEE), wherein individuals are screened for risk factors according to their age group, and screening results are used to customize interventions in the form of education and empowerment. Given that trained persons, including non-healthcare providers, close to the at-risk individual could conduct the screening and then educate and mentor the individual according to the risk level, the number of people who develop SUD could decrease.

Conclusions

The risk factors for developing SUD vary across the various life stages, which suggests that individualized approaches that do not overtax behavioral healthcare workers are needed. Using SEE may foster early identification and individualized prevention of SUD.

Sustaining an Evidence-Based Program Over Time: Moderators of Sustainability and the Role of the Getting to Outcomes® Implementation Support Intervention

Problematic rates of alcohol, e-cigarette, and other drug use among US adolescents highlight the need for effective implementation of evidence-based programs (EBPs), yet schools and community organizations have great difficulty implementing and sustaining EBPs. Although a growing number of studies show that implementation support interventions can improve EBP implementation, the literature on how to improve sustainability through implementation support is limited. This randomized controlled trial advances the literature by testing the effects of one such implementation intervention-Getting To Outcomes (GTO)-on sustainability of CHOICE, an after-school EBP for preventing substance use among middle-school students. CHOICE implementation was tracked for 2 years after GTO support ended across 29 Boys and Girls Club sites in the greater Los Angeles area. Predictors of sustainability were identified for a set of key tasks targeted by the GTO approach (e.g., goal setting, evaluation, collectively called "GTO performance") and for CHOICE fidelity using a series of path models. One year after GTO support ended, we found no differences between GTO and control sites on CHOICE fidelity. GTO performance was also similar between groups; however, GTO sites were superior in conducting evaluation. Better GTO performance predicted better CHOICE fidelity. Two years after GTO support ended, GTO sites were significantly more likely to sustain CHOICE implementation when compared with control sites. This study suggests that using an implementation support intervention like GTO can help low-resource settings continue to sustain their EBP implementation to help them get the most out of their investment. ClinicalTrials.gov Identifier: NCT02135991.

Protocol for an economic evaluation of WHO STOPS childhood obesity stepped-wedge cluster randomised controlled trial

INTRODUCTION

Prevention of overweight and obesity in childhood is a priority because of associated acute and chronic conditions in childhood and later in life, which place significant burden on health systems. Evidence suggests prevention should engage a range of actions and actors and target multiple levels. The Whole of Systems Trial Of Prevention Strategies for childhood obesity (WHO STOPS) will evaluate the outcomes of a novel systems-based intervention that aims to engage whole communities in a locally led multifaceted response. This paper describes the planned economic evaluation of WHO STOPS and examines the methodological challenges for economic evaluation of a complex systems-based intervention.

METHODS AND ANALYSIS

Economic evaluation alongside a stepped-wedge cluster randomised controlled trial in regional and rural communities in Victoria, Australia. Cost-effectiveness and cost-utility analyses will provide estimates of the incremental cost (in $A) per body mass index unit saved and quality adjusted life year gained. A Markov cohort model will be employed to estimate healthcare cost savings and benefits over the life course of children. The dollar value of community resources harnessed for the community-led response will be estimated. Probabilistic uncertainty analyses will be undertaken to test sensitivity of results to plausible variations in all trial-based and modelled variables. WHO STOPS will also be assessed against other implementation considerations (such as sustainability and acceptability to communities and other stakeholders).

ETHICS AND DISSEMINATION

The trial is registered by the Australian New Zealand Clinical Trials Registry (ACTRN12616000980437). Full ethics clearances have been received for all methods described below: Deakin University's Human Research Ethics Committee 2014-279, Deakin University's Human Ethics Advisory Group-Health (HEAG-H) HEAG-H 194_2014, HEAG-H 17 2015, HEAG-H 155_2014, HEAG-H 197_2016, HEAG-H 118_2017, the Victorian Department of Education and Training 2015_002622 and the Catholic Archdiocese of Ballarat. Trial findings (including economic evaluation) will be published in peer-reviewed journals and presented at international conferences. Collected data and analyses will be made available in accordance with journal policies and study ethics approvals. Results will be presented to relevant government authorities with an interest in cost-effectiveness of these types of interventions.

TRIAL REGISTRATION NUMBER

ACTRN12616000980437; Pre-results.

The Sustainability of Evidence-Based Interventions and Practices in Public Health and Health Care

There is strong interest in implementation science to address the gap between research and practice in public health. Research on the sustainability of evidence-based interventions has been growing rapidly. Sustainability has been defined as the continued use of program components at sufficient intensity for the sustained achievement of desirable program goals and population outcomes. This understudied area has been identified as one of the most significant translational research problems. Adding to this challenge is uncertainty regarding the extent to which intervention adaptation and evolution are necessary to address the needs of populations that differ from those in which interventions were originally tested or implemented. This review critically examines and discusses conceptual and methodological issues in studying sustainability, summarizes the multilevel factors that have been found to influence the sustainability of interventions in a range of public health and health care settings, and highlights key areas for future research.