The Irie Classroom Toolbox: developing a violence prevention, preschool teacher training program using evidence, theory, and practice

"When I hold my daughter, she quiets, no need [for]any verbal conversation": A qualitative understanding of responsive caregiving in rural, Sindh Pakistan

Responsive caregiving is associated with secure attachment and positive child developmental outcomes. However, there is some debate on whether responsive caregiving is a universal construct. Few studies have researched responsive caregiving in diverse cultural settings, particularly in low- and middle-income countries. In this study, we explore if and how responsive caregiving is conceptualized among mothers of children under 3-years-old in rural, Sindh Pakistan. A phenomenological qualitative study was implemented in Naushahro Feroze through in-depth interviews with twenty mothers. Mothers were asked about their aspirations for their children and how they would respond in a variety of different scenarios. Data were analyzed using thematic content analysis with an inductive-deductive coding scheme. There was substantial variation in mothers' described responsive behaviors and beliefs. Almost all mothers described using some form of responsive parenting. Responding to children's demands while the mother was preoccupied, using verbal responses to console children, and if mothers believed that children should be praised, lacked consensus. Most mothers described using breastfeeding for consolation and highlighted the importance of immediately consoling their crying child. The results suggest that there is a need for a more nuanced approach to understand caregiver behaviors across contexts.

The Process of Scaling Early Childhood Violence Prevention Programs in Jamaica

BACKGROUND

Violence is a global public health problem, and early childhood interventions are a core component of violence prevention programming. Interventions to support parents and teachers of young children can prevent violence against children by caregivers and prevent the early development of antisocial behavior. However, there is limited guidance on how to scale up these programs in low- and middle-income countries.

METHODS

In this article, we describe how we applied implementation science principles in the design, implementation, evaluation, and initial scaling of 2 complementary early childhood, violence prevention, caregiver training programs in Jamaica: the Irie Classroom Toolbox (a teacher-training program) and the Irie Homes Toolbox (a parenting program).

RESULTS

We identified 7 implementation science principles most relevant to our work in scaling the Irie Toolbox programs and describe how these principles were operationalized in the Jamaican context. The principles are: (1) design programs for scale from the outset; (2) use learning cycles for quality improvement; (3) plan strategically for government agency adoption; (4) provide high-quality initial and ongoing training and regular supervision; (5) monitor implementation quality; (6) use flexible delivery modes; and (7) plan for program sustainment.

CONCLUSIONS

Through applying these principles to scale the Irie Toolbox programs, we aim to promote a consistent approach to reducing violence against children, reducing child behavior problems, and increasing caregiver and child competencies across both home and school contexts at the population level. The principles and processes described in this article are relevant to other behavior change interventions in early childhood development, education, and public health.

A qualitative evaluation of the mechanisms of action in an early childhood parenting programme to prevent violence against children in Jamaica

BACKGROUND

Violence against children (VAC) is a global public health problem, and parenting programmes are a key strategy to reduce VAC at home. We developed and evaluated a preschool-based, early childhood, violence prevention, parenting programme (the Irie Homes Toolbox) in Jamaica and reported significant reductions in parents' use of VAC [Effect size (ES) = -0.29] and increases in parents' positive practices (ES = 0.30). This study presents qualitative findings on the mechanisms of action of the programme.

METHODS

As part of a cluster randomized trial, 115 parents from nine preschools participated in the Irie Homes Toolbox parenting programme. The programme consisted of eight 90-min sessions with groups of six parents and focussed on strengthening parent-child relationships, understanding children's behaviour, using appropriate discipline strategies and understanding and managing emotions. We conducted in-depth, semi-structured interviews with a stratified random sample of 28 parents (two to four parents per school) and with nine preschool teachers (one teacher per preschool). Topic guides were developed to explore participants' perspectives of the mechanisms of action of the programme. All interviews were audio-recorded and transcribed, and data were analysed using the framework approach.

RESULTS

The most salient direct pathways to reduced VAC by both parent and teacher reports were through parents' use of alternative strategies to manage child misbehaviour and through improved parent well-being, especially parents' self-management skills. Other factors leading to reduced VAC by parents, reported by both parents and teachers, included self-identification as an 'Irie parent', use of proactive parenting strategies and improved child behaviour. Parents reported that the main factors leading to continued use of VAC were their inconsistency in using positive discipline strategies and poor emotional self-regulation.

CONCLUSION

Reports from participating parents and preschool teachers indicate that contents related to parental self-management and how to use positive discipline strategies to manage child misbehaviour were important factors on the pathway to reduced VAC.

Nonviolent Discipline Options for Caregivers and Teachers: A Systematic Overview of the Evidence

Violence against children is a widespread problem with devastating consequences, and corporal punishment is a risk factor for more serious forms of physical abuse. One reason for the persistence of corporal punishment may be the lack of awareness of positive disciplinary alternatives. Nonviolent options offered to caregivers and teachers must be effective in addressing challenging behavior, or they may be rejected in favor of a return to physical punishment. There is an urgent need to determine which discipline options are evidence-supported and what that evidence says so that robust alternatives to corporal punishment can be made available. The primary objective of this research was to find, and explore the state of the science on, individual nonviolent interventions for challenging behavior, in so doing forming a "tool kit" for use by caregivers and teachers. A systematic overview of systematic reviews was conducted. Included systematic reviews were peer-reviewed and published in English between 1999 and 2018. Screening, quality assessment using AMSTAR, and data extraction were performed independently by two reviewers. A total of 223 reviews were included, covering data from 3,921 primary studies. A wide range of evidence-supported interventions exist, many of which have been found effective with severely challenging behavior. Important positive outcomes shown suggest that the use of these tools should be promoted not only for the prevention of violence but also for optimum child development. More research is needed on the use of these methods in home situations and on de-escalation skills.

Qualitative evaluation of a scalable early childhood parenting programme in rural Colombia

BACKGROUND

Integrating early childhood parenting programmes into existing government services is a key strategy for reducing the loss of children's developmental potential in low- and middle-income countries. There is limited evidence of participants' perceptions of these programmes, especially when implemented at scale. We integrated an intervention into an existing government programme targeting pregnant women and mothers of children up to 2 years of age and their families in rural Colombia.

METHODS

As part of a cluster randomized trial, 171 government workers (facilitators) implemented the intervention. The intervention included four components: (1) structured curricula, (2) play materials, (3) nutrition and (4) training and supervision. In this qualitative evaluation of the programme, we conducted semi-structured interviews with beneficiary mothers (n = 62), facilitators (n = 40) and supervisors (n = 8). Topic guides were developed to collect information on participants' perspectives of the acceptability, feasibility and effectiveness of the intervention and the enablers and barriers to implementation. All interviews were audiotaped and transcribed, and data were analysed using the framework approach.

RESULTS

Participants' responses indicated that the intervention was acceptable, feasible and effective. Key enablers to implementation were (1) the use of evidence-based behaviour change techniques leading to interactive, fun and participatory sessions; (2) structured curricula with easy to use, simple activities and materials; (3) the focus on positive, supportive relationships; and (4) the perceived benefits of the programme to the beneficiary mothers, children and families, facilitators and programme supervisors. The main barriers were (1) facilitators took time to become comfortable and competent in using the new participatory methodology and (2) the logistics related to making and distributing the play materials.

CONCLUSION

Providing structured curricula and play materials with training and ongoing supervision to enhance an existing programme targeting mothers, families and children was reported as acceptable, feasible and effective by beneficiary mothers and programme staff.

The Irie Classroom Toolbox: Mixed method assessment to inform future implementation and scale-up of an early childhood, teacher-training, violence-prevention programme

Introduction

Violence against children (VAC) is a violation of child rights, has high prevalence in low- and middle-income countries, is associated with long-term negative effects on child functioning, and with high economic and social costs. Ending VAC at home and at school is thus a global public health priority.

Methods

In Jamaica, we evaluated an early childhood, teacher-training, violence-prevention programme, (the Irie Classroom Toolbox), in a cluster-randomised trial in 76 preschools. The programme led to large reductions to teachers' use of VAC, although the majority of teachers continued to use VAC at times. In this paper, we describe a mixed-method evaluation of the Irie Classroom Toolbox in the 38 Jamaican preschools that were assigned to the wait-list control group of the trial. In a quantitative evaluation, 108 preschool teachers in 38 preschools were evaluated at pre-test and 91 teachers from 37 preschools were evaluated at post-test. One preschool teacher from each of these 37 preschools were randomly selected to participate in an in-depth interview as part of the qualitative evaluation.

Results

Preschool teachers were observed to use 83% fewer instances of VAC across one school day after participating in the programme, although 68% were observed to use VAC at least once across two days. The qualitative evaluation confirmed these findings with all teachers reporting reduced use of violence, but 70% reporting continued use of VAC at times. Teachers reported that the behaviour change techniques used to deliver the intervention increased their motivation, knowledge and skills which in turn led to improved child behaviour, improved relationships and improved professional well-being. Direct pathways to reduced use of VAC by teachers were through improved child behaviour and teacher well-being. The main reasons for continued use of VAC were due to barriers teachers faced using positive discipline techniques, teachers' negative affect, and child behaviours that teachers perceived to be severe.

Discussion

We describe how we used the results from the mixed-method evaluation to inform revisions to the programme to further reduce teachers' use of VAC and to inform the processes of training, supervision and ongoing monitoring as the programme is scaled-up through government services.

A Systematic Review of Corporal Punishment in Schools: Global Prevalence and Correlates

Despite global shifts toward prevention of school corporal punishment, the practice remains widespread. This systematic review focused on (a) prevalence, (b) associated mental health and behavioral factors, and (c) correlates that may be risk or protective factors. Studies included in this review were peer-reviewed, published in English between 1980 and July 2017, and quantitative in design. Fifty-three papers met the inclusion criteria. All were cross-sectional surveys, predominantly of moderate quality and conducted in the United States (US) and on the African continent. Results indicated that school corporal punishment is prevalent across the globe (including where bans are in place) and does not appear to be decreasing over time, although measurement differences preclude firm conclusions. It is associated with physical, academic, mental health, and behavioral problems for children. Boys, Black students (in the US), and students exposed to violence at home were most at risk of corporal punishment. It is unclear whether disability puts a student at risk. Schools with high rates of other disciplinary practices were more likely to use corporal punishment, while those who employed a mental health professional and trained staff in safety procedures were less likely to use corporal punishment. Teacher attitudes favoring corporal punishment, and their use of violence in other contexts, increased risk. Low socioeconomic status (of the student or the school environment) increased risk, while high levels of state social capital reduced risk. Future research must include areas where corporal punishment is banned and focus on developing effective interventions to prevent school corporal punishment.

The Irie Classroom Toolbox, a universal violence-prevention teacher-training programme, in Jamaican preschools: a single-blind, cluster-randomised controlled trial

BACKGROUND

Violence is a leading global public health problem, and interventions in early childhood are important in the primary prevention of violence. We tested whether the Irie Classroom Toolbox, a violence-prevention teacher-training programme reduced violence against children by teachers and reduced class-wide child aggression in Jamaican preschools (catering to children aged 3-6 years).

METHODS

We did a single-blind, cluster-randomised controlled trial in 76 preschools in Kingston and St Andrew, randomly selected, using simple randomisation, from 120 eligible preschools. Inclusion criteria were two to four classes of children; at least ten children per class; and located in an urban area. We randomly assigned preschools (1:1) to either the Irie Classroom Toolbox intervention or waiting-list control that received no intervention, using a computer-generated randomisation sequence by an independent statistician masked to school identity. The Toolbox involved training teachers in classroom behaviour management and promoting child social-emotional competence. All assessors were masked to group assignment. All teachers and classrooms in the selected schools participated in the study. Within each school, we used simple randomisation to randomly select up to 12 children aged 4 years for evaluation of child outcomes. The Toolbox intervention was implemented from August to April the following year. Teacher and classroom measures were done at baseline (the summer school term; ie, May to June), post-intervention (after 8 months of intervention; ie, May to June of the following year), and 1-year follow-up (ie, May to June 2 years later). The primary outcomes were observations of violence against children (including physical violence and psychological aggression) by teachers occurring across one full school day, and class-wide child aggression occurring over five 20-min intervals on another school day, all measured at post-intervention and 1-year follow-up and analysed by intention to treat. This trial is registered with ISRCTN, number ISRCTN11968472.

FINDINGS

Between June 22, 2015, and April 29, 2016, (after baseline measurements were completed), we assigned 38 preschools (with 119 teachers) to the Toolbox intervention and 38 preschools (with 110 teachers) to control. 441 children in the intervention schools and 424 in the control schools were included in the evaluation. All schools were included in the post-intervention and follow-up analyses. There were fewer counts of violence against children by teachers in the intervention schools compared with control schools at post-intervention (median counts 3 [IQR 0-11] vs 15 [3-35]; effect size -67·12%, 95% CI -80·71 to -53·52, p<0·0001) and 1-year follow-up (median counts 3 [IQR 0-9] vs 6 [1-16]; effect size -53·86, 95% CI -71·08 to -36·65, p<0·0001). No differences between groups were found for class-wide child aggression at post-intervention (effect size 0·07, 95% CI -0·16 to 0·29, p=0·72) or 1-year follow-up (-0·14, -0·42 to 0·16, p=0·72).

INTERPRETATION

In Jamaican preschools, the Irie Classroom Toolbox effectively reduced violence against children by teachers. The Toolbox was designed for use with undertrained teachers working in low-resource settings and should be effective with early childhood practitioners in other LMICs. Additional research is needed to further develop the Toolbox to reduce class-wide child aggression.

FUNDING

Medical Research Council, Wellcome Trust, UK Aid, and the National Institute of Health Research.

Design and Implementation of the Irie Homes Toolbox: A Violence Prevention, Early Childhood, Parenting Program

This paper describes the development of the Irie Homes Toolbox, a violence prevention program targeting parents of children aged two to six years. The intervention was designed to complement an existing, teacher-training, violence prevention program, the Irie Classroom Toolbox, thus promoting an integrated approach across home and school settings. The Irie Homes Toolbox was developed through a four-stage process by integrating data from theory, formative research, and practice to ensure the intervention is acceptable, feasible, relevant, and effective in the context. The perspectives of Jamaican preschool teachers and parents of preschool children, who are the end users, were integrated into the design of the intervention throughout the development process. Stage one involved integrating theory and formative research to inform the initial intervention design. Stages two and three involved iterative cycles of design, implementation and evaluation of the intervention content, process of delivery, structure and materials. Stage four involved a further cycle of learning through a process evaluation conducted as part of a cluster-randomized controlled trial. Data from each of these four stages was used to inform the design and ongoing revisions of the toolbox with the aim of developing a low-cost, scalable and sustainable intervention for the Jamaican context. The resulting program is theory-informed and uses empirically derived content and behavior change principles operationalized for the context in which it will be delivered. The Irie Homes Toolbox is suitable for integration into the existing preschool provision in Jamaica, thus utilizing an existing service and existing staff and increasing the likelihood for wide-scale dissemination.

Measuring the implementation of early childhood development programs

In this paper we describe ways to measure variables of interest when evaluating the implementation of a program to improve early childhood development (ECD). The variables apply to programs delivered to parents in group sessions and home or clinic visits, as well as in early group care for children. Measurements for four categories of variables are included: training and assessment of delivery agents and supervisors; program features such as quality of delivery, reach, and dosage; recipients' acceptance and enactment; and stakeholders' engagement. Quantitative and qualitative methods are described, along with when measures might be taken throughout the processes of planning, preparing, and implementing. A few standard measures are available, along with others that researchers can select and modify according to their goals. Descriptions of measures include who might collect the information, from whom, and when, along with how information might be analyzed and findings used. By converging on a set of common methods to measure implementation variables, investigators can work toward improving programs, identifying gaps that impede the scalability and sustainability of programs, and, over time, ascertain program features that lead to successful outcomes.

Evaluation of a Violence-Prevention Programme with Jamaican Primary School Teachers: A Cluster Randomised Trial

This study investigated the effect of a school-based violence prevention programme implemented in Grade 1 classrooms in Jamaican primary schools. Fourteen primary schools were randomly assigned to receive training in classroom behaviour management (n = 7 schools, 27 teachers/classrooms) or to a control group (n = 7 schools, 28 teachers/classrooms). Four children from each class were randomly selected to participate in the evaluation (n = 220 children). Teachers were trained through a combination of workshop and in-class support sessions, and received a mean of 11.5 h of training (range = 3–20) over 8 months. The primary outcomes were observations of (1) teachers’ use of violence against children and (2) class-wide child aggression. Teachers in intervention schools used significantly less violence against children (effect size (ES) = −0.73); benefits to class-wide child aggression were not significant (ES = −0.20). Intervention teachers also provided a more emotionally supportive classroom environment (ES = 1.22). No benefits were found to class-wide prosocial behaviour, teacher wellbeing, or child mental health. The intervention benefited children’s early learning skills, especially oral language and self-regulation skills (ES = 0.25), although no benefits were found to achievement in maths calculation, reading and spelling. A relatively brief teacher-training programme reduced violence against children by teachers and increased the quality of the classroom environment.