Understanding key implementation determinants for a school-based universal prevention intervention: a qualitative study

An implementation evaluation of a sports-based health intervention for underrepresented middle school youth in Philadelphia

Multicomponent, community-based programs aiming to improve health behaviors in youth are needed but can be challenging to implement. Research is needed to better understand the factors that facilitate and inhibit effective implementation of these programs especially for youth at increased risk of health disparities. This study aimed to identify and explore the implementation determinants and outcomes of a multicomponent health intervention conducted from 2021 to 2022 for middle school students living in underserved communities in Philadelphia, PA, USA. Mixed methods approaches, including self-report surveys and semi-structured qualitative interviews, were administered to 18 members of the implementation staff at the end of the program, including coaches (n = 7), assistant coaches (n = 2), school champions (n = 6), administrative leaders (n = 2), and a school district administrator (n = 1). Survey and interview questions were guided by the Consolidated Framework for Implementation Research (CFIR), and interviews were thematically coded following transcription based on 26 CFIR constructs. Innovation source, evidence strength and quality, cosmopolitanism, and the personal attributes of individuals were key constructs associated with implementation effectiveness. Data revealed three multidimensional themes that highlighted broader challenges influencing implementation: (i) broad consensus, different interpretations, (ii) staffing challenges, and (iii) continuity is key. The need for the program was clearly recognized and overall belief in the purpose of the intervention was strong among key program staff and administration. However, issues including limited engagement with training, staffing turnover, and the rotational programming design hindered implementation. Future projects aiming to implement multicomponent after-school time interventions must ensure a consistent vision among partners and continuity in program delivery.

Building on Strong Foundations: Deploying Enhanced Replicating Effective Programs for evidence-based prevention curriculum adaptation

Schools frequently adopt new interventions for each new public health issue, but this is both time- and resource-intensive. Adversity exposure is an example of a pervasive public health issue that emerged during Coronavirus Disease 2019 (COVID-19) with notable consequences, including an elevated risk of developing substance use disorders and mental illnesses. Adapting existing, universal, evidence-based interventions, such as the Michigan Model for HealthTM (MMH), by incorporating trauma-sensitive content is a promising approach to meet this need. We examined critical steps in promoting MMH adaptability as part of the Enhanced REP (Replicating Effective Programs) implementation strategy during the COVID-19 pandemic. We share usability testing from the 2020 to 2021 school year and describe how we apply the results to inform the group randomized trial pilot study. We applied key steps from implementation adaptation frameworks to integrate trauma-sensitive content as COVID-19 unfolded, documenting the process through field notes. We conducted initial usability testing with two teachers via interviews and used a rapid qualitative analysis approach. We conducted member checking by sharing the information with two health coordinators to validate results and inform additional curriculum refinement. We developed an adapted MMH curriculum to include trauma-sensitive content, with adaptations primarily centered on adding content, tailoring content, substituting content, and repeating/reinforcing elements across units. We designed adaptations to retain the core functional elements of MMH. Building foundational relationships and infrastructure supports opportunities to user-test intervention materials for Enhanced REP that enhance utility and relevance for populations that would most benefit. Enhanced REP is a promising strategy to use an existing evidence-based intervention to meet better the needs of youth exposed to adversity. Building on the foundations of existing evidence-based interventions, is vital to implementation success and achieving desired public health outcomes.

Teaching Strategies to Enhance Knowledge and Understanding of Opisthorchis viverrini and Cholangiocarcinoma in Thailand: Lessons for Asian Countries

Although Opisthorchis viverrini (OV) is a neglected tropical disease, the International Agency for Research on Cancer (IARC) listed it as a human carcinogen 30 years ago. Cholangiocarcinoma (CCA) is the ultimate pathology outcome. However, it remains a significant public health problem in the Greater Mekong Subregion and Asia. Its widespread impact on human health requires urgent action using various strategies. This study aimed to investigate and prioritize the need for developing teaching and learning management of OV and CCA among primary school students in Thailand endemic areas. The samples consisted of 36 Grade 6 students. This study was conducted by using a needs questionnaire. Data were analyzed using Mean and Standard Deviation. The needs were prioritized using the Modified Priority Needs Index (PNI modified). The findings revealed a moderate overall need for teaching and learning management development. The area with the highest need was learning activity organization (PNI = 0.410), followed by audiovisual equipment (PNI = 0.276) and buildings (PNI = 0.265). The teaching content the students needed most included CCA prevention, risk factors, and disease symptoms (58.33%). Based on the findings, it is suggested that teachers design various learning activities and emphasize hands-on activities for students. Additionally, administrators should allocate budgets to improve buildings and audiovisual equipment, and relevant organizations should establish policies to promote learning on these issues in educational institutions. Essential lessons from this study can provide a starting point for executives and public health personnel worldwide to apply to develop educational strategies for cancer education and cancer prevention and control.

[Facilitators and barriers to the implementation of health promotion in daycare centers and elementary schools based on four selected projects]

BACKGROUND

Health promotion (HP) is a complex, politically required task. The quality of implementation correlates with the effectiveness of health promotion initiatives. Successful implementation requires consideration of contextual conditions, which tend to be neglected in effectiveness studies. The aim is to identify success factors and obstacles to the implementation of HP in daycare centers and elementary schools based on 4 projects (Fit fürs Leben, fit für pisa +, Buchprojekt Sonnige Traurigtage, and The Daily Mile) in the Göttingen/South Lower Saxony region. The effects of the COVID-19 pandemic are assumed to be relevant for the implementation of these projects.

METHODS

In 24 semi-structured interviews and 2 focus group discussions between August 2021 and March 2022, practitioners were asked about the implementation of the four projects in their areas of activity. After transcription, the interviews were analyzed using qualitative content analysis. The Consolidated Framework for Implementation Research supported the analysis.

RESULTS

A total of 22 groups of factors were identified, on the basis of which 22 recommendations for action for GF implementation were formulated. Success factors at the individual and intervention level were at the forefront. The COVID-19 pandemic had a positive impact on the importance of HP, even though its feasibility was hampered.

DISCUSSION

Numerous findings on the implementation of HP in children's living environments were confirmed by the study. The high significance of the individual factors is striking, which could be due to the survey of interviewees being familiar with the projects. The study results contribute to the further development of implementation strategies in HP.

Examining implementation determinants of a culturally grounded, school-based prevention curriculum in rural Hawai'i: A test development and validation study

Background

This study examined the implementation determinants of a culturally grounded, school-based drug prevention curriculum in rural Hawai'i. Test development and validation procedures were used to examine the impact of implementation barriers and facilitators of the curriculum in public or charter middle/intermediate schools on Hawai'i Island.

Method

A five-phase, mixed-methods approach toward test development and validation was used. These phases included item generation (Phase 1), item refinement and selection (Phase 2), item reduction (Phase 3), reliability testing (Phase 4), and validity testing (Phase 5). Educational administrators, teachers, and staff employed by the Hawai'i State Department of Education (HIDOE) participated in the study.

Results

Phases 1 and 2 yielded 50 implementation barriers and 27 implementation facilitators that were evaluated by 204 HIDOE administrators, teachers, and staff. Factor analysis of the barrier items indicated a four-factor solution: (1) Innovation Barriers, (2) HIDOE State-Level Barriers, (3) Teacher-Level Barriers, and (4) Administrator-Level Barriers. Mean comparisons indicated that several barrier and facilitator items differentiated teachers from administrators in the sample.

Conclusions

This study contributes to the implementation measurement literature, specifically in the areas of mental health and substance use. It also highlights the importance of addressing multiple contextual levels in the implementation of culturally focused prevention interventions.

Plain Language Summary Title

Examining Implementation Barriers and Facilitators for School-Based Prevention in Hawai'i. Plain Language Summary Compared with other major ethnic groups, Native Hawaiian and Pacific Islander (NHPI) youth have substantially higher rates of substance use and higher adverse mental and physical health effects related to their use. Despite these disparities, educational and community-based practitioners have long struggled with implementing and sustaining promising substance use interventions for NHPI youth. This study contributes to our understanding of measuring implementation barriers and facilitators for substance use prevention for NHPI youth in rural school settings. It contributes to the field of health disparities and health equity promotion, by addressing calls for research to understand factors affecting successful implementation of prevention programs. This is critical toward achieving health equity for underrepresented and vulnerable populations, such as NHPI and rural youth.

Michigan Model for HealthTM Learning to Enhance and Adapt for Prevention (Mi-LEAP): protocol of a pilot randomized trial comparing Enhanced Replicating Effective Programs versus standard implementation to deliver an evidence-based drug use prevention curriculum

BACKGROUND

School-based drug use prevention programs have demonstrated notable potential to reduce the onset and escalation of drug use, including among youth at risk of poor outcomes such as those exposed to trauma. Researchers have found a robust relationship between intervention fidelity and participant (i.e., student) outcomes. Effective implementation of evidence-based interventions, such as the Michigan Model for HealthTM (MMH), is critical to achieving desired public health objectives. Yet, a persistent gap remains in what we know works and how to effectively translate these findings into routine practice. The objective of this study is to design and test a multi-component implementation strategy to tailor MMH to meet population needs (i.e., students exposed to trauma), and improve the population-context fit to enhance fidelity and effectiveness.

METHODS

Using a 2-group, mixed-method randomized controlled trial design, this study will compare standard implementation versus Enhanced Replicating Effective Programs (REP) to deliver MMH. REP is a theoretically based implementation strategy that promotes evidence-based intervention (EBI) fidelity through a combination of EBI curriculum packaging, training, and as-needed technical assistance and is consistent with standard MMH implementation. Enhanced REP will tailor the intervention and training to integrate trauma-informed approaches and deploy customized implementation support (i.e., facilitation). The research will address the following specific aims: (1) design and test an implementation strategy (Enhanced REP) to deliver the MMH versus standard implementation and evaluate feasibility, acceptability, and appropriateness using mixed methods, (2) estimate the costs and cost-effectiveness of Enhanced REP to deliver MMH versus standard implementation.

DISCUSSION

This research will design and test a multi-component implementation strategy focused on enhancing the fit between the intervention and population needs while maintaining fidelity to MMH core functions. We focus on the feasibility of deploying the implementation strategy bundle and costing methods and preliminary information on cost input distributions. The substantive focus on youth at heightened risk of drug use and its consequences due to trauma exposure is significant because of the public health impact of prevention. Pilot studies of implementation strategies are underutilized and can provide vital information on designing and testing effective strategies by addressing potential design and methods uncertainties and the effects of the implementation strategy on implementation and student outcomes.

TRIAL REGISTRATION

NCT04752189-registered on 8 February 2021 on ClinicalTrials.gov PRS.

A mixed methods investigation of implementation determinants for a school-based universal prevention intervention

Background

Effective implementation of evidence-based prevention interventions in schools is vital to reducing the burden of drug use and its consequences. Universal prevention interventions often fail to achieve desired public health outcomes due to poor implementation. One central reason for suboptimal implementation is the limited fit between the intervention and the setting. Research is needed to increase our understanding of how intervention characteristics and context influence intervention implementation in schools to design implementation strategies that will address barriers and improve public health impact.

Methods

Using a convergent mixed methods design we examined qualitative and quantitative data on implementation determinants for an evidence-based health curriculum, the Michigan Model for HealthTM (MMH) from the perspective of health teachers delivering the curriculum in high schools across the state. We examined data strands independently and integrated them by investigating data alignment, expansion, and divergence.

Results

We identified three mixed methods domains: (1) Acceptability, (2) intervention-context fit, and (3) adaptability. We found alignment across data strands as teachers reporting low acceptability also reported low fidelity. The fit between student needs and the curriculum predicted fidelity (expansion). Teachers mentioned instances of poor intervention-context fit (discordance), including when meeting the needs of trauma-exposed youth and keeping updated on youth drug use trends. Teachers reported high adaptability (concordance) but also instances when adaptation was challenging (discordance).

Conclusions

This investigation advances implementation research by deepening our understanding of implementation determinants for an evidence-based universal prevention intervention in schools. This will support designing effective implementation strategies to address barriers and advance the public health impact of interventions that address important risk and protective factors for all youth.

Plain Language Summary

(1) What is Already Known About the Topic? While many evidence-based interventions (EBIs) exist to address key health issues among youth including substance use and mental health, few of these interventions are effectively implemented in community settings, such as schools. Notable multilevel barriers exist to implement universal prevention in schools. Researchers identify that misalignment between the intervention and the context is a key reason why many implementation efforts do not achieve desired outcomes. (2) What Does This Paper Add? This paper combines the strengths of qualitative and quantitative research methods to identify and understand challenges to intervention-context fit for a comprehensive health curriculum, the Michigan Model for HealthTM (MMH) which is widely adopted throughout Michigan, from the perspective of end users. This paper also utilizes the consolidated framework for implementation research and implementation outcomes framework to guide our understanding of implementing complex interventions and key barriers to implementation in schools. This research provides a foundation to design effective strategies that will balance curriculum fidelity and adaptation to achieve public health objectives. (3) What are the Implications for Practice, Research, or Policy? We need implementation strategies that guide flexibility and fidelity in EBI delivery in schools. While overall teachers felt the curriculum was adaptable and met student needs, they also mentioned specific instances when they would benefit from additional implementation support, such as making adaptations to meet the needs of trauma-exposed youth and keeping up-to-date with emerging drugs. Implementation strategies designed to address these challenges can improve fidelity and ultimately student well-being.