Teachers' patterns of implementation of an evidence-based intervention and their impact on student outcomes: results from a nationwide dissemination over 24-months follow-up

Bahamas National Implementation Project: Proposal for Sustainability of an Evidence-based HIV Prevention Intervention in a School Setting

BACKGROUND

Sustained implementation of school-based prevention programs is low. Effective strategies are needed to enhance both high-level implementation fidelity and sustainability of prevention programs.

OBJECTIVE

This proposed study aims to determine if the provision of either biweekly monitoring and feedback and site-based assistance and mentorship or both to at-risk and moderate-performing teachers with monitoring through an enhanced decision-making platform by the Ministry of Education (MOE) and Ministry of Health (MOH) based on the real-time implementation data will increase national implementation fidelity and result in sustained implementation over time.

METHODS

This study will target government schools including 200 grade 6 teachers in 80 primary schools and 100 junior/middle high school teachers (and their classes) on 12 Bahamian islands. Teacher and school coordinator training will be conducted by the MOE in year 1, followed by an optimization trial among teachers in the capital island. Informed by these results, an implementation intervention will be conducted to train using different levels of educational intensity all at-risk and moderate-performing teachers. Subsequently selected training and implementation strategies will be evaluated for the national implementation of Focus on Youth in the Caribbean and Caribbean Informed Parents and Children Together in years 2 to 5.

RESULTS

It is hypothesized that a more intensive training and supervision program for at-risk and moderate-performing teachers will enhance their implementation fidelity to the average level of the high-performing group (85%), an HIV prevention program delivered at the national level can be implemented with fidelity in grade 6 and sustained over time (monitored annually), and student outcomes will continue to be highly correlated with implementation fidelity and be sustained over time (assessed annually through grade 9). The proposed study is funded by the National Institute of Child Health and Human Development from August 1, 2018, through May 31, 2023.

CONCLUSIONS

The study will explore several theory-driven implementation strategies to increase sustained teacher implementation fidelity and thereby increase the general public health impact of evidence-based interventions. The proposed project has potential to make significant contributions to advancing school-based HIV prevention research and implementation science and serve as a global model for the Fast Track strategy.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

PRR1-10.2196/14816.

STI Health Disparities: A Systematic Review and Meta-Analysis of the Effectiveness of Preventive Interventions in Educational Settings

The purpose of this systematic review and meta-analysis was to address disparities related to sexual health among students by examining the effectiveness of sexually transmitted infection (STI) preventive interventions in educational settings. PubMed, Medline, Cochrane Library, Public Health Database, and EMBASE databases were used to conduct searches. Information relating to studies, programs, participants, and quantitative outcome variables were extracted. Risk of bias was assessed and meta-analysis was conducted. This systematic review included 16 articles. The outcomes were classified into behavioral and psychosocial categories. The behavioral category included sexual partners, sexual activity, condom use, STI/HIV testing, and alcohol/drug use before sex. The psychosocial category consisted of knowledge, motivational factors, and skills. Interventions had a significantly positive impact on both behavioral (OR, 1.28; 95% CI, 1.17–1.39) and psychosocial (OR, 1.92; 95% CI, 1.36–2.72) outcomes. Among the psychosocial outcomes, the interventions were most effective at promoting knowledge (OR, 3.17; 95% CI, 2.13–4.72), followed by enhancing motivational factors (OR, 1.69; 95% CI, 1.04–2.75) and increasing behavioral skills (OR, 1.43; 95% CI, 1.13–1.81). The results of this systematic review provide empirical evidence for public health professionals and policy makers regarding planning, implementation, evaluation, and modification of STI preventive intervention programs in educational settings.

Studies evaluating of health interventions at schools: an integrative literature review

OBJECTIVE

to identify and analyze the available evidence on the strategies used in the studies evaluating health interventions at school.

METHOD

this is an integrative review searching in LILACS, CINAHL, CUIDEN, ScienceDirect, and PubMed. From the pre-defined inclusion and exclusion criteria, there were 121 articles chosen to compose the sample.

RESULTS

english studies (97.5%), with a quantitative approach (80.2%), related to the interventions carried out in the Region of the Americas (54.6%) and the European Region (23.1%) predominated. For the most part, they are interventions as programs (70.2%), interested in evaluating results (73.5%) from the value judgment (83.4%). Prevalence of interventions focused on efficacy, effects or impact, and activities carried out on interventions were focused on physical activity, healthy eating, sexual and reproductive health, mental health, and use of tobacco, alcohol, and other drugs. They are worked through activities of clinical monitoring, health promotion and disease prevention.

CONCLUSION

the evidence indicates that the evaluations of health interventions in the school focus the results produced in programs through the judgment of value. The topics most addressed were healthy eating, physical activity, prevention of alcohol and other drugs, among others.

Multi-year school-based implementation and student outcomes of an evidence-based risk reduction intervention

Background

Intervention effects observed in efficacy trials are rarely replicated when the interventions are broadly disseminated, underscoring the need for more information about factors influencing real-life implementation and program impact. Using data from the ongoing national implementation of an evidence-based HIV prevention program [Focus on Youth in The Caribbean (FOYC)] in The Bahamas, this study examines factors influencing teachers’ patterns of implementation, the impact of teachers’ initial implementation of FOYC, and subsequent delivery of the booster sessions on students’ outcomes.

Methods

Data were collected from the 80 government elementary and 34 middle schools between 2011 and 2014, involving 208 grade 6, 75 grade 7, and 58 grade 8 teachers and 4411 students initially in grade 6 and followed for 3 years. Student outcomes include HIV/AIDS knowledge, reproductive health skills, self-efficacy, and intention to use protection. Data from teachers includes implementation and modification of the curriculum, attitudes towards the prevention program, comfort level with the curriculum, and attendance at training workshops. Structural equation modeling and mixed-effect modeling analyses were applied to examine the impact of teachers’ implementation.

Results

Teachers’ attitudes towards and comfort with the intervention curriculum, and attendance at the curriculum training workshop had a direct effect on teachers’ patterns of implementation, which had a direct effect on student outcomes. Teachers’ attitudes had a direct positive effect on student outcomes. Teachers’ training in interactive teaching methods and longer duration as teachers were positively associated with teachers’ comfort with the curriculum. High-quality implementation in grade 6 was significantly related to student outcomes in grades 6 and 7 post-implementation. Level of implementation of the booster sessions in grades 7 and 8 were likewise significantly related to subsequent student outcomes in both grades.

Conclusions

High-quality initial implementation of a prevention program is significantly related to better program outcomes. Poor subsequent delivery of booster sessions can undermine the positive effects from the initial implementation while strong subsequent delivery of booster sessions can partially overcome poor initial implementation.

Electronic supplementary material

The online version of this article (doi:10.1186/s13012-016-0539-7) contains supplementary material, which is available to authorized users.

Development of a Brief Pre-Implementation Screening Tool to Identify Teachers Who Are at Risk for Not Implementing Intervention Curriculum and High-Implementing Teachers

Few questionnaires have been developed to screen for potentially poor implementers of school-based interventions. This study combines teacher characteristics, perceptions, and teaching/training experiences to develop a short screening tool that can identify potential "low-performing" or "high-performing" teachers pre-implementation. Data were gathered from 208 teachers and 4,411 students who participated in the national implementation of an evidence-based HIV intervention in The Bahamas. Sensitivity and specificity were evaluated for the detection of "low-performing" and "high-performing" teachers. The validity of the screening tool was assessed using receiver operating characteristics analysis. The School Pre-implementation Screening Tool consists of seven predictive factors: duration as teacher, working site, attendance at training workshops, training in interactive teaching, perceived importance of the intervention, comfort in teaching the curriculum, and program priority. The sensitivity and specificity were 74% and 57% in identifying "low-performing" teachers and 81% and 65% with "high-performing" teachers. The screening tool demonstrated an acceptable/good validity (area under the receiver operating characteristics curve was 0.68 for "low-performing teachers" and 0.78 for "high-performing" teachers). Our brief screening tool can facilitate teacher training and recruitment of engaged teachers in implementation of school-based interventions.