Implementation of AF-CBT by community practitioners serving child welfare and mental health: a randomized trial

Implementing a Child Mental Health Intervention in Child Welfare Services: Stakeholder Perspectives on Feasibility

This pilot study integrated quantitative and qualitative data to examine the feasibility of implementing a modified version of a multiple family group behavioral parent training intervention (The 4Rs and 2Ss for Strengthening Families Program [4Rs and 2Ss]) in child welfare (CW) placement prevention services, from the perspectives of participating caregivers (n = 12) and CW staff (n = 12; i.e., 6 caseworkers, 4 supervisors, and 2 administrators). Quantitative surveys were administered to caregivers and CW staff followed by semi-structured interviews to examine the feasibility of implementing the modified 4Rs and 2Ss program, as well as factors impacting feasibility. Results indicated that quantitative benchmarks for high feasibility were met in all assessed areas (e.g., family recruitment, caseworker fidelity ratings, CW staff feasibility ratings) except for family attendance, which was markedly lower than desired. Factors facilitating feasibility included agency and research support, intervention ease-of-use, perceived benefits to existing CW practice, as well as logistical support (e.g., food, transportation, childcare) promoting attendance. Factors hindering feasibility included conflicts between research-based eligibility criteria and existing client population demographics, research-related processes resulting in delays, CW staff role conflicts, added workload burden, complex family issues, and power differentials inherent to CW services which complicated families' voluntary participation.

Family-Based Prevention of Child Traumatic Stress

Most children experience potentially traumatic events, and some develop significant emotional and behavioral difficulties in response. Although the field has mainly focused on treatment, a prevention framework provides an alternate approach to reducing the public health burden of trauma. Because parents and families can affect children's trauma exposure and reactions, family-based preventive interventions represent a unique opportunity to address child traumatic stress. This article discusses family-based programs that address child traumatic stress across 3 categories: preventing children's exposure to traumatic events, preventing traumatic stress reactions following exposure, and preventing negative long-term sequelae of trauma.

Testing a community developed training protocol for an evidence-based treatment

The implementation of evidence-based treatments (EBTs) in community behavioral health settings is a recommended practice, yet training experienced by community-based clinicians may require novel and creative training methods. The current study focused on creating a training protocol for Alternative for Families: a Cognitive-Behavioral Therapy from both evidence-based foundations and community-based agency feedback to promote better EBT integration into agencies. Twenty-four clinicians from three agencies were trained using a community-informed training protocol. Outcomes for clinician-reports of organizational functioning, self-reports of skill and knowledge, and observational single-subject data of clinician skills were assessed. Minimal improvements were found for clinician skills across self-report and observations. More research on tailoring trainings to meet needs of community agencies and clinicians should be explored to determine best practice in wide-scale implementation efforts.

Sustainability of a biobehavioral intervention implemented by therapists and sustainment in community settings

The ultimate aim of dissemination and implementation of empirically supported treatments (ESTs) in behavioral medicine is (a) sustainability of the therapist/provider's EST usage and (b) sustainment of EST delivery in the setting. Thus far, sustainability has been understudied, and the therapist and setting variables that may be influential are unclear. The purpose of the study was to test the therapists' sustainability of a cancer-specific EST using a prospective longitudinal design and examine its predictors. Oncology mental health therapists (N = 134) from diverse settings (N = 110) completed training in the biobehavioral intervention (BBI) and were provided with 6 months of support for implementation, with no support thereafter. BBI usage (percent of patients treated) was reported at 2, 4, 6, and 12 months. Using a generalized estimating equation with a logistic link function, 12-month sustainability (a nonsignificant change in usage from 6 to 12 months) was studied along with therapist, supervisor, and setting variables as predictors. BBI usage increased through 6 months and, importantly, usage was sustained from 6 (68.4% [95% CI = 62.2%-73.9%]) to 12 months (70.9% [95% CI = 63.6%-77.3%]), with sustainment in 66 settings (60.0%). Predictors of implementation-to-sustainability usage were therapists' early intentions to use the BBI (p < .001) and from the setting, supervisors' positive attitudes toward ESTs (p = .016). Adding to the DI literature, a health psychology intervention was disseminated, implemented, and found sustainable across diverse therapists and settings. Therapists and setting predictors of usage, if modified, might facilitate future sustainability/sustainment of ESTs.

An equivalence analysis of provider education in youth mental health care

OBJECTIVE

To test for equivalence between providers with and without advanced degrees in multiple domains related to delivery of evidence-based treatment.

DATA SOURCE

Provider and client data from an effectiveness trial of Alternatives for Families: A Cognitive Behavioral Therapy (AF-CBT) in a major metropolitan area in the United States.

STUDY DESIGN

We tested for equivalence between providers (N = 182) with and without advanced degrees in treatment-related knowledge, practices, and attitudes; job demands and stress; and training engagement and trainer-rated competence in AF-CBT. We also conducted exploratory analyses to test for equivalence in family clinical outcomes.

DATA COLLECTION

Providers completed measures prior to randomization and at 6-month follow-up, after completion of training and consultation in AF-CBT. Children and caregivers completed assessments at 0, 6, 12, and 18 months.

PRINCIPAL FINDINGS

Providers without advanced degrees were largely non-inferior to those with advanced degrees in treatment-related knowledge, practices, and attitudes, while findings for job demands and stress were mixed. Providers without advanced degrees were non-inferior to providers with advanced degrees in consultation attendance (B = -1.42; confidence interval (CI) = -3.01-0.16; margin of equivalence (Δ) = 2), number of case presentations (B = 0.64; CI = -0.49-1.76; Δ = 2), total training hours (B = -4.57; CI = -10.52-1.37; Δ = 3), and trainer-rated competence in AF-CBT (B = -0.04; CI = -3.04-2.96; Δ = 4), and they were significantly more likely to complete training (odds ratio = 0.66; CI = 0.10-0.96; Δ = 30%). Results for clinical outcomes were largely inconclusive.

CONCLUSIONS

Provider-level outcomes for those with and without advanced degrees were generally comparable. Additional research is needed to examine equivalence in clinical outcomes. Expanding evidence-based treatment training to individuals without advanced degrees may help to reduce workforce shortages and improve reach of evidence-based treatments.

The Association Between Clinician and Perceived Organizational Factors with Early Fidelity to Cognitive Processing Therapy for Posttraumatic Stress Disorder in a Randomized Controlled Implementation Trial

A common metric for determining implementation success is the measurement of clinician adherence to, and competence in, delivering a psychotherapy. The present study examined clinician and organizational factors as predictors of early adherence and competence among 78 clinicians delivering cognitive processing therapy (CPT), an evidence-based psychotherapy (EBP) for posttraumatic stress disorder, in a randomized controlled implementation trial. Results indicated that clinicians' willingness to adopt an EBP if required to do so was significantly associated with early adherence and competence in CPT delivery. Level of clinician education was significantly associated with early competence in delivering CPT. Organizational factors did not predict early adherence or competence. Implications of the findings are discussed.

Changes in Community Clinicians' Attitudes and Competence following a Transdiagnostic Cognitive Behavioral Therapy Training

Background

Although the literature suggest that attitudes toward evidence-based practices (EBPs) are associated with provider use of EBPs, less is known about the association between attitudes and how competently EBPs are delivered. This study examined how initial attitudes and competence relate to improvements in attitudes and competence following EBP training.

Methods

Program evaluation data was collected during implementation of an EBP in a large community mental health network. Clinicians (N=891) received intensive training in cognitive behavioral therapy followed by six months of consultation. Attitudes were assessed using the Evidence-Based Practice Attitude Scale, and competence was assessed using the Cognitive Therapy Rating Scale. Data were analyzed by fitting three latent change score models to examine the relationship between changes in attitudes and competence across the training and within its two phases (workshop phase, consultation phase).

Results

Latent change models identified significant improvement in attitudes (Ms _latent change≥1.03, SEs≤ 0.18, zs≥6.55, ps< .001) and competence (Ms _{latent change} ≥14.16, SEs≤3.10, zs≥2.82, ps<.001) across the full training and in each phase. Higher pre-workshop attitudes predicted significantly greater change in competence in the workshop and across training (bs≥1.62, SEs≤0.90, z≥1.09, p<.04, β≥0.10); however, contrary to our hypothesis, post-workshop attitudes did not significantly predict change in competence in consultation (b=1.62, SE=0.86, z=1.87, p=.06, β=0.09). Change in attitudes and change in competence in the training period and within the two phases were not significantly correlated.

Conclusions

Results indicate that pre-training attitudes about EBPs present a target for implementation interventions, given their relation to changes in both attitudes and competence throughout training. Following participation in in itial training workshops, other factors such as subjective norms, implementation culture, or system-level policy shifts may be more predictive of change in competence through consultation.

Leader–member exchange and organizational climate effects on clinician turnover intentions

Purpose

Clinician turnover in mental health settings impacts service quality, including availability and delivery of evidence-based practices. Leadership is associated with organizational climate, team functioning and clinician turnover intentions (TI). This study examines leader–member exchange (LMX), reflecting the relationship between a supervisor and each supervisee, using mean team LMX, dispersion of individual clinician ratings compared to team members (i.e. relative LMX) and team level variability (i.e. LMX differentiation), in relation to organizational climate and clinician TI.

Design/methodology/approach

Survey data were collected from 363 clinicians, nested in children's mental health agency workgroups, providing county-contracted outpatient services to youth and families. A moderated mediation path analysis examined cross-level associations of leader–member exchange with organizational climate and turnover intentions.

Findings

Lower relative LMX and greater LMX differentiation were associated with higher clinician TI. Higher team-level demoralizing climate also predicted higher TI. These findings indicate that poorer LMX and more variability in LMX at the team level are related to clinician TI.

Originality/value

This study describes both team- and clinician-level factors on clinician TI. Few studies have examined LMX in mental health, and fewer still have examined relative LMX and LMX differentiation associations with organizational climate and TI. These findings highlight the importance of leader–follower relationships and organizational climate and their associations with clinician TIs. Mental health service systems and organizations can address these issues through fostering more positive supervisor–supervisee relationships.

Therapist training in evidence-based interventions for mental health: A systematic review of training approaches and outcomes

A lack of effective therapist training is a major barrier to evidence-based intervention (EBI) delivery in the community. Systematic reviews published nearly a decade ago suggested that traditional EBI training leads to higher knowledge but not more EBI use, indicating that more work is needed to optimize EBI training and implementation. This systematic review synthesizes the training literature published since 2010 to evaluate how different training models (workshop, workshop with consultation, online training, train-the-trainer, and intensive training) affect therapists' knowledge, beliefs, and behaviors. Results and limitations for each approach are discussed. Findings show that training has advanced beyond provision of manuals and brief workshops; more intensive training models show promise for changing therapist behavior. However, methodological issues persist, limiting conclusions and pointing to important areas for future research.

Mixed method study of workforce turnover and evidence-based treatment implementation in community behavioral health care settings

BACKGROUND

Practitioner turnover in behavioral health settings is high and hinders the implementation of new interventions.

OBJECTIVE

This study examined practitioner and organizational characteristics that contribute to high staff turnover in community behavioral health settings.

PARTICIPANTS AND SETTING

Clinicians in nine community-based agencies participated. Included agencies treated a high volume of families referred from child welfare.

METHODS

This study was part of a larger trial testing the effectiveness of a Cognitive Behavior Therapy for family conflict. Authors assessed predictors of turnover quantitatively and qualitatively. Quantitative data was collected prospectively (n = 169) on practitioner and organizational-level variables (e.g., demographics, professional practice, job satisfaction, emotional exhaustion, organizational commitment). Semi-structured interviews with practitioners who left their agencies (n = 40) provided qualitative data retrospectively.

RESULTS

Forth-five percent of practitioners left their agencies over three years. Two predictors of final survival status (lower age and lower job satisfaction) were associated with leaving the agency at the p < .05 level; however, they accounted for very little variance. Qualitative themes highlighted the importance of job characteristics, compensation, productivity requirements, advancement opportunities, and co-worker relationships as influential in the decision to leave.

CONCLUSIONS

This study highlights the value of a mixed-method approach given that themes emerged from the qualitative interviews that were not accounted for in the quantitative results. Additional research is needed to better understand workforce turnover so that strategies can be developed to stabilize the behavioral health workforce.

Associations Among Job Role, Training Type, and Staff Turnover in a Large-Scale Implementation Initiative

Staff turnover is problematic for behavioral health agencies implementing evidence-based practices (EBPs), which are costly and time-consuming. The current study examined the association between EBP training methods and turnover and explored predictors of turnover for different types of staff. Participants (100 clinicians, 50 supervisors, 50 administrators) were randomized to one of three training conditions for an EBP. Results indicated low annual rates of turnover for clinicians, supervisors, and administrators. However, contrary to hypothesis, no statistically significant differences were found in rates of turnover across training conditions. Partially consistent with prior research, organizational climate was a significant predictor of supervisor and administrator turnover at 24 months, but was not a significant predictor of clinician turnover. Implications and future directions for research are discussed.

AF-CBT for Families Experiencing Physical Aggression or Abuse Served by the Mental Health or Child Welfare System: An Effectiveness Trial

The Partnerships for Families project is a randomized clinical trial to evaluate the effectiveness of Alternatives for Families: A Cognitive Behavioral Therapy (AF-CBT), an evidence-based treatment (EBT) for families who are at risk of or have histories of child physical abuse. Across 10 agencies whose programs were supported by referrals from the mental health or child welfare system, individual providers were randomized to receive AF-CBT training ( n = 90) in a 6-month learning community or treatment as usual (TAU; n = 92) which provided trainings per agency routine. We recruited families served by providers in the AF-CBT ( n = 122) and TAU ( n = 73) conditions and collected multiple outcomes at up to four time points (0, 6, 12, and 18 months). Using univariate tests and growth curve models, the analyses revealed that AF-CBT (vs. TAU) showed improvements in both service systems (e.g., abuse risk, family dysfunction) or one service system (e.g., threats of force, child to parent minor assault), with some outcomes showing no improvement (e.g., parental anger). These findings are discussed in relation to AF-CBT, service system, provider, and family characteristics, and training/dissemination methods that affect the delivery of an EBT for this population in community settings.

Adaptive School-based Implementation of CBT (ASIC): clustered-SMART for building an optimized adaptive implementation intervention to improve uptake of mental health interventions in schools

Background

Depressive and anxiety disorders affect 20–30% of school-age youth, most of whom do not receive adequate services, contributing to poor developmental and academic outcomes. Evidence-based practices (EBPs) such as cognitive behavioral therapy (CBT) can improve outcomes, but numerous barriers limit access among affected youth. Many youth try to access mental health services in schools, but school professionals (SPs: counselors, psychologists, social workers) are rarely trained adequately in CBT methods. Further, SPs face organizational barriers to providing CBT, such as lack of administrative support. Three promising implementation strategies to address barriers to school-based CBT delivery include (1) Replicating Effective Programs (REP), which deploys customized CBT packaging, didactic training in CBT, and technical assistance; (2) coaching, which extends training via live supervision to improve SP competence in CBT delivery; and (3) facilitation, which employs an organizational expert who mentors SPs in strategic thinking to promote self-efficacy in garnering administrative support. REP is a relatively low-intensity/low-cost strategy, whereas coaching and facilitation require additional resources. However, not all schools will require all three strategies. The primary aim of this study is to compare the effectiveness of a school-level adaptive implementation intervention involving REP, coaching, and facilitation versus REP alone on the frequency of CBT delivered to students by SPs and student mental health outcomes. Secondary and exploratory aims examine cost-effectiveness, moderators, and mechanisms of implementation strategies.

Methods

Using a clustered, sequential multiple-assignment, randomized trial (SMART) design, ≥ 200 SPs from 100 schools across Michigan will be randomized initially to receive REP vs. REP+coaching. After 8 weeks, schools that do not meet a pre-specified implementation benchmark are re-randomized to continue with the initial strategy or to augment with facilitation.

Discussion

EBPs need to be implemented successfully and efficiently in settings where individuals are most likely to seek care in order to gain large-scale impact on public health. Adaptive implementation interventions hold the promise of providing cost-effective implementation support. This is the first study to test an adaptive implementation of CBT for school-age youth, at a statewide level, delivered by school staff, taking an EBP to large populations with limited mental health care access.

Trial registration

NCT03541317—Registered on 29 May 2018 on ClinicalTrials.gov PRS

Electronic supplementary material

The online version of this article (10.1186/s13012-018-0808-8) contains supplementary material, which is available to authorized users.

Proposing a Mechanistic Model of Clinician Training and Consultation

To make evidence-based treatments deliverable, effective, and scalable in community settings, it is critical to develop a workforce that can deliver evidence-based treatments as designed with skill. However, the science and practice of clinician training and consultation lags behind other areas of implementation science. In this paper, we present the Longitudinal Education for Advancing Practice (LEAP) model designed to help span this gap. The LEAP model is a mechanistic model of clinician training and consultation that details how training inputs, training and consultation strategies, and mechanisms of learning influence training outcomes. We first describe the LEAP model and then discuss how key implications of the model can be used to develop effective training and consultation strategies.

Implementing mental health training programmes for non-mental health trained professionals: A qualitative synthesis

Introduction

Given the prevalence of mental health problems globally, there is an increasing need for the police and other non-mental health trained professionals to identify and manage situations involving individuals with mental health problems. The review aimed to identify and explore qualitative evidence on views and experiences of non-mental health professionals receiving mental health training and the barriers and facilitators to training delivery and implementation.

Methods

A meta-synthesis of qualitative evidence on the barriers, facilitators and perceived impact of mental health training programmes for non-mental health trained professionals. Systematic literature searches were undertaken of the following databases: Criminal Justice Abstracts (CJA); MEDLINE; Embase; PsycINFO; ASSIA; CENTRAL; SSCI; ERIC; Campbell Library; Social Care Online and EPOC from 1995 to 2016. Records were independently screened for eligibility by two researchers, data extraction and quality appraisal of studies was also undertaken independently by two researchers. The CASP tool was used to quality appraise included studies. Included studies were synthesised using a meta-ethnographic approach as outlined by Noblit and Hare.

Results

10,282 records were identified and eight qualitative studies were included. A range of barriers and facilitators to training were identified and related to the delivery and content of training; the use of additional resources; and staff willingness to engage with training and organisational factors. The perceived impact of training was also discussed in terms of how it affects trainees; perceptions of mental health; self-perception; responses to situations involving mental health and the potential of training to reduce injury or physical harm in situations involving mental health. The value of training and how to measure its impact were also discussed.

Conclusion

Findings from this review have implications for those designing, implementing and evaluating mental health training programmes. It is recommended that research evaluating mental health training includes a qualitative component to ensure that the barriers and facilitators to training and its impact on trainees’ perceptions of mental health are understood.

Protocol registration number

PROSPERO: CRD42015015981

Caregiver Report of Child Symptoms Predicts Attrition in Abuse-Specific Cognitive Behavioral Therapies

A common critique of empirically supported treatments for abuse-related psychopathology is attrition during critical phases of therapy (i.e., exposure). The goal of this study was to examine whether child and caregiver symptoms were predictive of attrition among families in abuse-specific cognitive-behavioral therapies (CBTs). Children ( N = 104) and their caregivers completed baseline assessments of internalizing symptoms, externalizing problems, and post-traumatic stress disorder (PTSD) and were enrolled in abuse-specific CBTs. Logistic regressions were conducted with baseline symptoms as predictor variables and treatment status (attrition vs. completion) as the criterion variable. Caregiver report of child internalizing symptoms showed the predicted quadratic relation to attrition. Caregiver report of child externalizing symptoms at moderate and high (vs. low) levels was associated with attrition. Child self-report and caregiver self-report of symptoms were not associated with the dyad's attrition. These results underscore the importance of attending to caregivers' initial perceptions of children's symptoms in abuse-specific therapy.

Training Community-Based Clinicians in Parent-Child Interaction Therapy: The Interaction Between Expert Consultation and Caseload

Professional psychologists are increasingly encouraged to utilize evidence-based treatments (EBTs), and therefore have a need to participate and provide the most efficient training methods for these treatments. Multicomponent trainings, which commonly include ongoing support, are more effective than brief methods such as 1-day workshops or reading treatment manuals. The present study examined the effectiveness of 1 form of ongoing support, consultation, as part of a multicomponent training protocol. Thirty-two community-based clinicians were trained in Parent-Child Interaction Therapy (PCIT) as part of a statewide implementation effort, and data were collected on clinician and implementation outcomes at pre-, mid-, and posttraining. Simple and multiple linear regression analyses were conducted to predict posttraining knowledge, skill, acceptability, and feasibility, as well as to examine clinician variables that might moderate these relations. Greater consultation call attendance significantly predicted higher posttraining skill; however, this association was qualified by a significant interaction with PCIT caseload. Implications for training guidelines are discussed.

Mental health training programmes for non-mental health trained professionals coming into contact with people with mental ill health: a systematic review of effectiveness

BACKGROUND

The police and others in occupations where they come into close contact with people experiencing/with mental ill health, often have to manage difficult and complex situations. Training is needed to equip them to recognise and assist when someone has a mental health issue or learning/intellectual disability. We undertook a systematic review of the effectiveness of training programmes aimed at increasing knowledge, changing behaviour and/or attitudes of the trainees with regard to mental ill health, mental vulnerability, and learning disabilities.

METHODS

Databases searched from 1995 onwards included: ASSIA, Cochrane Central Register of Controlled Clinical Trials (CENTRAL), Criminal Justice Abstracts, Embase, ERIC, MEDLINE, PsycINFO, Social Science Citation Index. Courses, training, or learning packages aimed at helping police officers and others who interact with the public in a similar way to deal with people with mental health problems were included. Primary outcomes were change in practice and change in outcomes for the groups of people the trainees come into contact with. Systematic reviews, randomised controlled trials (RCTs) and non- randomised controlled trials (non-RCTs) were included and quality assessed. In addition non-comparative evaluations of training for police in England were included.

RESULTS

From 8578 search results, 19 studies met the inclusion criteria: one systematic review, 12 RCTs, three prospective non-RCTs, and three non-comparative studies. The training interventions identified included broad mental health awareness training and packages addressing a variety of specific mental health issues or conditions. Trainees included police officers, teachers and other public sector workers. Some short term positive changes in behaviour were identified for trainees, but for the people the trainees came into contact with there was little or no evidence of benefit.

CONCLUSIONS

A variety of training programmes exist for non-mental health professionals who come into contact with people who have mental health issues. There may be some short term change in behaviour for the trainees, but longer term follow up is needed. Research evaluating training for UK police officers is needed in which a number of methodological issues need to be addressed.

TRIAL REGISTRATION

Protocol registration number: PROSPERO: CRD42015015981 .

A Non-randomized Comparison of Strategies for Consultation in a Community-Academic Training Program to Implement an Evidence-Based Psychotherapy

Despite the central role of training and consultation in the implementation of evidence-based psychological interventions (EBPIs), comprehensive reviews of research on training have highlighted serious gaps in knowledge regarding best practices. Consultation after initial didactic training appears to be of critical importance, but there has been very little research to determine optimal consultation format or interventions. This observational study compared two consultation formats that included review of session audio and feedback in the context of a program to train clinicians (n = 85) in community mental health clinics to deliver cognitive therapy (CT). A "gold standard" condition in which clinicians received individual feedback after expert consultants reviewed full sessions was compared to a group consultation format in which short segments of session audio were reviewed by a group of clinicians and an expert consultant. After adjusting for potential baseline differences between individuals in the two consultation conditions, few differences were found in terms of successful completion of the consultation phase or in terms of competence in CT at the end of consultation or after a 2 year follow-up. However, analyses did not support hypotheses regarding non-inferiority of the group consultation condition. While both groups largely maintained competence, clinicians in the group consultation condition demonstrated increases in competence over the follow-up period, while a sub-group of those in the individual condition experienced decreases. These findings, if replicated, have important implications for EBP implementation programs, as they suggest that observation and feedback is feasible in community mental health setting, and that employing this method in a group format is an effective and efficient consultation strategy that may enhance the implementation and sustainability of evidence-based psychotherapies.

Bridging the Gap Between Research and Practice in Mental Health Service Settings: An Overview of Developments in Implementation Theory and Research

Twenty years after Sobell's (1996) influential call to integrate advances in behavior therapy into clinical settings, significant progress has been made in implementation science. In this narrative review, we provide an overview of implementation research findings and highlight recent findings that can inform efforts to bridge the gap between research and practice in mental health service settings. Key findings are summarized, organized according to levels of influence described in two implementation frameworks: The Exploration, Planning, Implementation, and Sustainment Framework (EPIS; Aarons et al., 2011) and the Consolidated Framework for Implementation Research (CFIR; Damschroder et al., 2009). Important levels of influence to consider when implementing new treatments include the outer context, inner context, characteristics of the individual, and characteristics of the innovation. Research on strategies to prepare clinicians to deliver evidence-based psychosocial treatments (EBPTs) and to address contextual barriers to implementation at each level is described, with discussion of implications for the implementation of EBPTs and next steps for research.

The Effect of a Change Agent on Use of Evidence-Based Mental Health Practices

Children's service systems are faced with a critical need to disseminate evidence-based mental health interventions. Despite the proliferation of comprehensive implementation models, little is known about the key active processes in effective implementation strategies. This proof of concept study focused on the effect of change agent interactions as conceptualized by Rogers' diffusion of innovation theory on providers' (N = 57) use of a behavioral intervention in a child welfare agency. An experimental design compared use for providers randomized to training as usual or training as usual supplemented by change agent interactions after the training. Results indicate that the enhanced condition increased use of the intervention, supporting the positive effect of change agent interactions on use of new practices. Change agent types of interaction may be a key active process in implementation strategies following training.

Validating the Implementation Climate Scale (ICS) in child welfare organizations

There is increasing emphasis on the use of evidence-based practices (EBPs) in child welfare settings and growing recognition of the importance of the organizational environment, and the organization's climate in particular, for how employees perceive and support EBP implementation. Recently, Ehrhart, Aarons, and Farahnak (2014) reported on the development and validation of a measure of EBP implementation climate, the Implementation Climate Scale (ICS), in a sample of mental health clinicians. The ICS consists of 18 items and measures six critical dimensions of implementation climate: focus on EBP, educational support for EBP, recognition for EBP, rewards for EBP, selection or EBP, and selection for openness. The goal of the current study is to extend this work by providing evidence for the factor structure, reliability, and validity of the ICS in a sample of child welfare service providers. Survey data were collected from 215 child welfare providers across three states, 12 organizations, and 43 teams. Confirmatory factor analysis demonstrated good fit to the six-factor model and the alpha reliabilities for the overall measure and its subscales was acceptable. In addition, there was general support for the invariance of the factor structure across the child welfare and mental health sectors. In conclusion, this study provides evidence for the factor structure, reliability, and validity of the ICS measure for use in child welfare service organizations.

A gloomy picture: a meta-analysis of randomized controlled trials reveals disappointing effectiveness of programs aiming at preventing child maltreatment

BACKGROUND

Consistent findings about the effectiveness of parent programs to prevent or reduce child maltreatment are lacking.

METHODS

In the present meta-analysis we synthesized findings from 27 independent samples from randomized controlled trials (RCTs) on the effectiveness of 20 different intervention programs aimed at (i) preventing the occurrence of child maltreatment in the general population or with at-risk but non-maltreating families, or (ii) reducing the incidence of child maltreatment in maltreating families.

RESULTS

A significant combined effect on maltreatment (d = 0.13; N = 4883) disappeared after the trim-and-fill approach that takes into account publication bias against smaller studies without significant outcomes. However, moderator analyses showed that larger effect sizes were found for more recent studies, studies with smaller samples, programs that provide parent training instead of only support, programs that target maltreating instead of at-risk families, and programs with a moderate length (6-12 months) or a moderate number of sessions (16-30).

CONCLUSIONS

More RCTs are needed to further unravel which factors are associated with program effectiveness. Because currently existing programs appeared to only reduce and not prevent child maltreatment, efforts in the field of preventive intervention should also focus on the development and testing of preventive programs for families at risk for child maltreatment.

Protocol for a statewide randomized controlled trial to compare three training models for implementing an evidence-based treatment

BACKGROUND

Evidence-based treatments (EBTs) are available for treating childhood behavioral health challenges. Despite EBTs' potential to help children and families, they have primarily remained in university settings. Little empirical evidence exists regarding how specific, commonly used training and quality control models are effective in changing practice, achieving full implementation, and supporting positive client outcomes.

METHODS/DESIGN

This study (NIMH RO1 MH095750; ClinicalTrials.gov Identifier: NCT02543359), which is currently in progress, will evaluate the effectiveness of three training models (Learning Collaborative (LC), Cascading Model (CM), and Distance Education (DE)) to implement a well-established EBT , Parent-Child Interaction Therapy, in real-world, community settings. The three models differ in their costs, skill training, quality control methods, and capacity to address broader implementation challenges. The project is guided by three specific aims: (1) to build knowledge about training outcomes, (2) to build knowledge about implementation outcomes, and (3) to test the differential impact of training clinicians using LC, CM, and DE models on key client outcomes. Fifty (50) licensed psychiatric clinics across Pennsylvania were randomized to one of the three training conditions: (1) LC, (2) CM, or (3) DE. The impact of training on practice skills (clinician level) and implementation/sustainment outcomes (clinic level) are being evaluated at four timepoints coinciding with the training schedule: baseline, 6 (mid), 12 (post), and 24 months (1 year follow-up). Immediately after training begins, parent-child dyads (client level) are recruited from the caseloads of participating clinicians. Client outcomes are being assessed at four timepoints (pre-treatment, 1, 6, and 12 months after the pre-treatment).

DISCUSSION

This proposal builds on an ongoing initiative to implement an EBT statewide. A team of diverse stakeholders including state policy makers, payers, consumers, service providers, and academics from different, but complementary areas (e.g., public health, social work, psychiatry), has been assembled to guide the research plan by incorporating input from multidimensional perspective.

TRIAL REGISTRATION

ClinicalTrials.gov: NCT02543359.

Evidence-based psychosocial treatment in the community: considerations for dissemination and implementation

BACKGROUND

In psycho-oncology care, steps toward dissemination and implementation of evidence-based treatments (EBTs) have not been made. For this to change, factors associated with real-world dissemination and implementation must be identified. In the community, providers, their organizations, and patients are key stakeholders.

METHOD

A focused review of literatures in continuing education, dissemination, and implementation of mental health services is provided.

RESULTS

Early-career providers are most ready to implement as they have greater openness and more positive attitudes toward EBTs. Current continuing education practices to teach EBTs have limited effectiveness. Instruction using interactive strategies tailored to therapists' clinical needs and the provision of post-education consultation is needed. There is tension between EBT delivery with fidelity and the necessity for adaptation. EBT service provision is the key outcome of implementation, and documenting such is important to patients, providers, and organizations.

CONCLUSION

A multilevel conceptual framework, Setting, Therapist, Education, imPlementation, and Sustainability, is offered and provides directions for dissemination and sustainable implementation. Guidelines from the Commission on Cancer of the American College of Surgeons and the American Society of Clinical Oncology underscore the timeliness of the proposed framework to move EBTs from the research settings where they were developed to the practice settings where they are needed.

Dissemination and implementation of evidence-based practices for child and adolescent mental health: a systematic review

OBJECTIVE

Although there has been a dramatic increase in the number of evidence-based practices (EBPs) to improve child and adolescent mental health, the poor uptake of these EBPs has led to investigations of factors related to their successful dissemination and implementation. The purpose of this systematic review was to identify key findings from empirical studies examining the dissemination and implementation of EBPs for child and adolescent mental health.

METHOD

Of 14,247 citations initially identified, 73 articles drawn from 44 studies met inclusion criteria. The articles were classified by implementation phase (exploration, preparation, implementation, and sustainment) and specific implementation factors examined. These factors were divided into outer (i.e., system level) and inner (i.e., organizational level) contexts.

RESULTS

Few studies used true experimental designs; most were observational. Of the many inner context factors that were examined in these studies (e.g., provider characteristics, organizational resources, leadership), fidelity monitoring and supervision had the strongest empirical evidence. Albeit the focus of fewer studies, implementation interventions focused on improving organizational climate and culture were associated with better intervention sustainment as well as child and adolescent outcomes. Outer contextual factors such as training and use of specific technologies to support intervention use were also important in facilitating the implementation process.

CONCLUSIONS

The further development and testing of dissemination and implementation strategies is needed to more efficiently move EBPs into usual care.