The Triple P Implementation Framework: the Role of Purveyors in the Implementation and Sustainability of Evidence-Based Programs

Implementation Feasibility and Hidden Costs of Statewide Scaling of Evidence-Based Therapies for Children and Adolescents

OBJECTIVE

State mental health systems are retraining their workforces to deliver services supported by research. Knowledge about evidence-based therapies (EBTs) for child and adolescent disorders is robust, but the feasibility of their statewide scaling has not been examined. The authors reviewed implementation feasibility for 12 commonly used EBTs, defining feasibility for statewide scaling as an EBT having at least one study documenting acceptability, facilitators and barriers, or fidelity; at least one study with a racially and ethnically diverse sample; an entity for training, certification, or licensing; and fiscal data reflecting the costs of implementation.

METHODS

The authors reviewed materials for 12 EBTs being scaled in New York State and conducted a literature review with search terms relevant to their implementation. Costs and certification information were supplemented by discussions with treatment developers and implementers.

RESULTS

All 12 EBTs had been examined for implementation feasibility, but only three had been examined for statewide scaling. Eleven had been studied in populations reflecting racial-ethnic diversity, but few had sufficient power for subgroup analyses to demonstrate effectiveness with these samples. All had certifying or licensing entities. The per-clinician costs of implementation ranged from $500 to $3,500, with overall ongoing costs ranging from $100 to $6,000. A fiscal analysis of three EBTs revealed hidden costs ranging from $5,000 to $24,000 per clinician, potentially limiting sustainability.

CONCLUSIONS

The evidence necessary for embedding EBTs in state systems has notable gaps that may hinder sustainability. Research-funding agencies should prioritize studies that focus on the practical aspects of scaling to assist states as they retrain their workforces.

The Triple P System of Evidence-Based Parenting Support: Past, Present, and Future Directions

Triple P is an integrated, multi-level system of evidence-based parenting support designed to promote the well-being of children and families to reduce prevalence rates of social, emotional, and behavioral problems in children and adolescents and to prevent child maltreatment. The system developed gradually over four decades to address the complex needs of parents and children from diverse family, socioeconomic and cultural backgrounds. It blends universal and targeted programs, a focus on developing parental self-regulation capabilities, and adopts a life span perspective with a population health framework. The Triple P system is used as a case example to discuss the past, present and future challenges, and opportunities involved in developing, evaluating, adapting, scaling and maintaining a sustainable system of evidence-based parenting intervention. Seven stages of program development are outlined from initial theory building and development of the core parenting program through to the sustained deployment of the intervention system delivered at scale. The importance of ongoing research and evaluation is highlighted so that different programs within the system evolve and adapt to address the contemporary concerns and priorities of families in diverse cultural contexts. A well-trained workforce is essential to deliver evidence-based programs, in a need-responsive manner that blends both fidelity of delivery and flexibility and is tailored to respond to the needs of individual families and local context. Programs need to be gender-sensitive, culturally informed, and attuned to the local context including relevant policies, resources, cultural factors, funding, workforce availability and their capacity to implement programs.

The role of implementation organizations in scaling evidence-based psychosocial interventions

BACKGROUND

To bring evidence-based interventions (EBIs) to individuals with behavioral health needs, psychosocial interventions must be delivered at scale. Despite an increasing effort to implement effective treatments in communities, most individuals with mental health and behavioral problems do not receive EBIs. We posit that organizations that commercialize EBIs play an important role in disseminating EBIs, particularly in the USA. The behavioral health and implementation industry is growing, bringing the implementation field to an important inflection point: how to scale interventions to improve access while maintaining EBI effectiveness and minimizing inequities in access to psychosocial intervention.

MAIN BODY

We offer a first-hand examination of five illustrative organizations specializing in EBI implementation: Beck Institute for Cognitive Behavioral Therapy; Incredible Years, Inc.; the PAXIS Institute; PracticeWise, LLC; and Triple P International. We use the Five Stages of Small Business Growth framework to organize themes. We discuss practical structures (e.g., corporate structures, intellectual property agreements, and business models) and considerations that arise when trying to scale EBIs including balancing fidelity and reach of the intervention. Business models consider who will pay for EBI implementation and allow organizations to scale EBIs.

CONCLUSION

We propose research questions to guide scaling: understanding the level of fidelity needed to maintain efficacy, optimizing training outcomes, and researching business models to enable organizations to scale EBIs.

The Change of Practitioner's Self-Efficacy in Triple P Professional Training: Moderating Role of Practitioner Characteristics, Country, and Delivery Mode

Two studies examined the change in self-efficacy of practitioners after attending Triple P training and the moderators that affect training outcomes. Study 1 used a large multidisciplinary sample of health, education, and welfare practitioners (N = 37,235) came from 30 countries around the world, which all participate in a Triple P professional training course during 2012-2019. This study assessed practitioners' overall self-efficacy and their consultation skills efficacy prior to training, immediately following training, and at six- to eight-weeks follow-up. Participants reported significant improvements of their overall self-efficacy and their consultation skills self-efficacy. There were significantly small differences based on practitioners' gender, disciplines, education levels, and country location. Study 2 examined the training outcomes of videoconference-based training (following the COVID-19 pandemic) compared to in-person training (N = 6867). No significant differences were found between videoconference and in-person training on any outcome measure. Implications for the global dissemination of evidence-based parenting programs as part of a comprehensive public health response to COVID-19 was discussed.

Predictors of champion behaviors in an evidence-based parenting program: A structural equation modeling approach

The importance of champions in the implementation of evidence-based public health programs has been well established. Champions perform a range of behaviors which can have significant influence on the adoption and sustainability of interventions. This study investigates champion behaviors in parenting practitioners with the aim to provide insight into the range and extent that practitioners engage in champion behaviors and to examine predictors of practitioners' champion behaviors using structural equation modeling. Data were collected during a large international implementation survey of 1606 practitioners trained to deliver an evidence-based parenting program, the triple P-Positive Parenting Program. We developed a 13-item Champion Behaviors Scale which was administered alongside other measures of predictors of implementation outcomes. Perceived usefulness of the program was the most important facilitator of both public and personal champion behaviors. Certain desirable features of the program tended to not only be positively associated with the perceived usefulness of the program, but also had a unique impact on practitioners' personal champion behaviors. Higher positions within organizations were linked with more public champion behaviors. Although organizational support was found to be unrelated to champion behaviors in the structural model, it facilitated other predictors of champion behaviors.

Mechanisms of change in external implementation support: A conceptual model and case examples to guide research and practice

Background

External implementation support (EIS) is a well-recognized feature of implementation science and practice, often under related terms such as technical assistance and implementation facilitation. Existing models of EIS have gaps related to addressing practice outcomes at both individual and organizational levels, connecting practice activities to intended outcomes, or grounding in well-established theories of behavior and organization change. Moreover, there have been calls to clarify the mechanisms of change through which EIS influences related outcomes.

Method

In this article, we theorize about mechanisms of change within EIS. Our theorizing process aligns with the approach advocated by Kislov et al. We aim to consolidate prior EIS literature, combining related constructs from previous empirical and conceptual work while drawing on our extensive EIS experience to develop a higher-order, midrange theory of change.

Results

Our theory of change is empirically and practically informed, conceptually situated within an established grand theory of change, and guided by eight practice principles and social cognitive theory. The theory of change proposes 10 core practice components as mechanisms of change within EIS. When used according to underlying theory and principles, they are believed to contribute to favorable practice outcomes at individual, team, organizational, and system levels. The model offers flexibility by recognizing the need for sequential support processes and the demand to practice in dynamic and responsive ways. Case examples are presented to illustrate major themes and patterns of the model in action.

Conclusions

The proposed model is intended to support prospective EIS studies by conceptualizing discernable practice components with hypothesized relationships to proximal and distal practice outcomes. The model can be behaviorally operationalized to compliment and extend competency-based approaches to implementation support practitioner (ISP) training and coaching. Over time, the model should be refined based on new empirical findings and contributions from ISPs across the field.

Predicting the Sustained Implementation of an Evidence-Based Parenting Program: A Structural Equation Modelling Approach

PURPOSE

Sustained implementation is required for evidence-based parenting programs to promote children and their families' wellbeing at the societal level. Previous literature has examined the role of a range of different factors in enhancing sustainability. However, the inter-relationship between, and the relative importance of different factors remain largely unknown. The overall aim of this study is to identify predictors of sustained program use, the relative importance of factors, and potential mediation pathways.

METHODS

We surveyed 1202 practitioners who were trained in at least one variant of the Triple P-Positive Parenting Program, at least one and half years before data collection. The present data were linked with data collected during professional training. We first examined the independent effect of each factor on sustained program use, then, developed and evaluated a structural equation model of sustained program use.

RESULTS

The structural equation model explained a considerable amount of variance in sustained program use, with seven positive predictors and one negative predictor identified. Organisational support was identified as a key facilitator, which was not only positively linked with other facilitators but also had an independent positive effect. Perceived usefulness of the program was the most important practitioner-level facilitator, which might be contributed by both research-based evidence and practice-based evidence. Practitioners' self-regulation in program delivery impacted sustained use by influencing other factors such as perceived usefulness of the program.

CONCLUSION

The findings provided insight into factors influencing the sustainability of evidence-based parenting programs which could be used to inform future implementation practice.

Mechanisms of Change in Population-Based Parenting Interventions for Children and Adolescents

OBJECTIVE

Developing an effective population-level system of evidence-based parenting support capable of shifting (at a population level) rates of child maltreatment and social, emotional, and behavioral problems in children requires an integrated theory of change. This paper presents a systems-contextual model of change and identifies modifiable mechanisms that can potentially explain population-level changes in parenting and child outcomes.

METHOD

Using the Triple P-Positive Parenting Program as an exemplar of a tiered, multi-level system of evidence-based parenting interventions, we discuss the putative mechanisms of change necessary to produce change in child behavior, parenting, practitioner behavior, and organizational changes to support the sustained implementation of an intervention.

RESULTS

A model of change is proposed that blends theoretical perspectives derived from social learning theory, self-regulation theory, applied behavior analysis, cognitive behavior principles, developmental theory, and principles derived from the fields of public health, implementation science, and economics to explain change in the behavior at the community wide level. Different types of interventions targeting different populations and mechanisms are used to illustrate how sustainable change in child and parent outcomes can be achieved.

CONCLUSIONS

Evidence supporting specific mechanisms and moderators of intervention effects are discussed as well as directions for future research on mechanisms.

Sustaining program implementation: A co-constructed technical assistance process to support continuous high-quality implementation of the Therapeutic Crisis Intervention program

Strategies for sustaining a program beyond initial implementation remain one of the most poorly understood aspects of high-quality program implementation. This paper describes the Quality Improvement and Fidelity Assessment Process (QIFAP), a program purveyor-agency partnership that uses a unique, multi-step method for supporting sustained implementation of the Therapeutic Crisis Intervention (TCI) system to manage crises in child serving organizations. It outlines the steps of the process and highlights how specific activities are linked to current knowledge and principles from implementation science. The QIFAP occurs over a period of about three months, during which time program developers and agency representatives conduct staff surveys, a two-day site visit, and fidelity assessments in order to gather information, discuss findings, and plan steps for improving the TCI system in the organization. The process is guided by principles that emphasize the importance of organization leadership, building relationships, co-learning, using an individualized approach, data informed decision making, acknowledging risk, and congruence. We describe ways in which the strategies and approaches within the QIFAP are rooted in implementation science literature. Thus, the model represents an illustration of how research-based knowledge can work in practice to support long-term, high-quality program implementation.

Exploring Staff Implementation of a Self-directed Parenting Intervention for Parents with Mental Health Difficulties

Parents with mental health difficulties face significant barriers in accessing evidence-based parenting interventions. Self-directed approaches may be a destigmatising, accessible alternative. Evidence has suggested that Triple P Positive Parenting Programme's self-directed format is as effective as more time- and cost-intensive delivery methods. The aim of the current study was to establish whether staff were able to use this intervention with parents with mental health difficulties and to explore staff experiences of implementation. Triple P self-help workbooks were provided to practitioners across three teams. Data were collected regarding workbook uptake and use. Interviews with staff exploring their experiences of implementation were analysed using thematic analysis. Overall, 41 participants were recruited, of which 12 (29.27%) also consented to interviews. Overall, six practitioners (14.63%) reported that they utilised the workbook. Uptake and utilisation were varied, but practitioners who used the workbook reported positive outcomes. Interviews revealed themes regarding practitioner concerns, views of the intervention and implementation issues. Self-directed Triple remains a promising intervention but its feasibility is dependent on addressing barriers to implementation and facilitating a family-focused approach to meet the needs of these parents and their children.

Harnessing the Power of Positive Parenting to Promote Wellbeing of Children, Parents and Communities Over a Lifetime

Evidence-based parenting support (EBPS) programs derived from social learning theory, cognitive behavioural principles, and developmental theory are among the most successful innovations in the entire field of psychological intervention. EBPS programs have been at the cutting edge of global dissemination efforts to increase community access to evidence-based parenting programs. Despite the widely recognised success of these efforts, existing models of parenting intervention are not a panacea, and much can be done to improved outcomes. Efforts to improve outcomes have included the emergence of a population-based approach to increase reach of intervention. This has included the development of flexible delivery modalities, including online parenting interventions, the incorporation of strategies to enhance cultural relevance and acceptability of programs, and more recently, applications with parents in very low resource settings. Further enhancements of outcomes are likely to be forthcoming as we gain a better understanding of the mechanisms that explain positive intervention effects and non-response to interventions. More cost-effective online professional training models are needed to disseminate and promote the sustained use of EBPS programs. New interventions are required for the most vulnerable parents when parenting concerns are complicated by other problems such as trauma, addictions, relationship conflict, family violence, mental health problems and intergenerational poverty. However, to scale effective programs, Commonwealth and state government policies and funding priorities need to respond to evidence about what works and make sustained investments in the implementation of parenting programs. Possible strategies to enhance the policy impact of intervention research are discussed.

Is the Concept of Self-Regulation Useful for Supporting Effective Implementation in Community Settings?

The literature and utility of self-regulation extends beyond individuals; a critical factor for successful and sustainable implementation of evidence-based programs in a community setting may be the capacity of teams to self-regulate implementation processes. The conceptual foundation of this proposal is explored and definitions of the five dimensions of self-regulation for implementation processes are provided. Practice examples illustrate how the provision of external implementation support to build self-regulatory capacity among implementation teams adopting and scaling-up EBPs in the local community setting has shaped and refined the proposed definitions to better reflect the work on-the-ground. The role of external implementation support providers in developing implementation team self-regulation is explored and practice strategies to promote self-regulation are provided. Implications and directions for future research are discussed.

Social Interface Model: Theorizing Ecological Post-Delivery Processes for Intervention Effects

Successful prevention programs depend on a complex interplay among aspects of the intervention, the participant, the specific intervention setting, and the broader set of contexts with which a participant interacts. There is a need to theorize what happens as participants bring intervention ideas and behaviors into other life-contexts, and theory has not yet specified how social interactions about interventions may influence outcomes. To address this gap, we use an ecological perspective to develop the social interface model. This paper presents the key components of the model and its potential to aid the design and implementation of prevention interventions. The model is predicated on the idea that intervention message effectiveness depends not only on message aspects but also on the participants' adoption and adaptation of the message vis-à-vis their social ecology. The model depicts processes by which intervention messages are received and enacted by participants through social processes occurring within and between relevant microsystems. Mesosystem interfaces (negligible interface, transference, co-dependence, and interdependence) can facilitate or detract from intervention effects. The social interface model advances prevention science by theorizing that practitioners can create better quality interventions by planning for what occurs after interventions are delivered.