What Predicts Clinician Dropout from State-Sponsored Managing and Adapting Practice Training

Physical and occupational therapists' learning needs and preferences for education on functional electrical stimulation: A qualitative descriptive study

BACKGROUND

Functional electrical stimulation (FES) is an evidence-based intervention that is rarely used by Canadian physical therapists (PTs) and occupational therapists (OTs). A common barrier to FES implementation is a lack of knowledge and training. FES learning resources that meet therapists' learning needs and preferences may address this barrier.

OBJECTIVE

To explore OTs' and PTs' perspectives on the utility of FES e-learning resources, including whether the resources met their learning needs and preferences.

METHODS

Through this qualitative descriptive study, feedback on FES e-learning resources was solicited from 5 PTs and 18 OTs who work clinically, but do not use FES. Participants reviewed ≥3 prerecorded lectures on FES topics and then completed a semi-structured interview. Participants were asked about the lectures' content, delivery, ease of use and comprehensibility, and were asked to suggest modifications to facilitate self-directed learning about FES. Interviews were analyzed using conventional content analysis.

RESULTS

Three themes were identified. (1) Feedback on FES e-learning: the content and delivery of the prerecorded lectures facilitated participants' learning, although opportunities to improve content and delivery were identified. (2) Factors influencing FES learning needs and preferences: Participants identified internal (i.e., baseline knowledge, learning style) and external (i.e., learning with colleagues, practice setting) factors that affected learning. Themes 1 and 2 impacted (3) the effects of FES e-learning: Participants described the outcomes of their FES e-learning, including increases in FES knowledge, confidence, and use in clinical practice.

CONCLUSION

Therapists' perceived the FES e-learning resources to be useful and to address their learning needs and preferences.

Implementation of Evidence-Based Practices within Treatment-As-Usual and Evidence-Based Practice Initiatives

Publicly funded initiatives are underway to improve implementation of evidence-based practices (EBP) in youth mental health services. However, we know little about the success of these initiatives or about EBP implementation independent of such initiatives. We examined EBP implementation in a treatment as usual (TAU) state and in six states with publicly funded EBP initiatives (EBPIs). In Study 1, we examined providers' use of practices derived from the evidence base (PDEB) and their predictors among 780 providers in a TAU state. In Study 2, we conducted a systematic review of implementation strategies, outcomes, and predictors of EBP use in six state funded EBPIs. Study 1 suggests TAU providers use PDEB alongside practices without consistent research support; provider racial/ethnic minority status, learning theory orientation, and manual use predict greater PDEB use. Study 2 indicates EBPIs employ multiple recommended implementation strategies with variable outcomes across studies and measurement approaches. Predictors of EBP use in EBPIs also varied, though training, setting, and youth age were consistent predictors across studies. While sample differences and inconsistent measurement across studies made direct comparisons somewhat tenuous, rates of PDEB use in the TAU sample appeared similar to those in publicly funded EBPIs. However, two states reported comparisons with TAU samples and found higher EBP implementation under EBPI. Different predictors impacted EBP use in TAU versus EBPIs. Our findings highlight the need for improved evaluation of EBPIs including clear reporting standards for outcomes and more consistent, standardized measurement of EBP use in order to better understand and improve EBPIs.

Testing a community developed training protocol for an evidence-based treatment

The implementation of evidence-based treatments (EBTs) in community behavioral health settings is a recommended practice, yet training experienced by community-based clinicians may require novel and creative training methods. The current study focused on creating a training protocol for Alternative for Families: a Cognitive-Behavioral Therapy from both evidence-based foundations and community-based agency feedback to promote better EBT integration into agencies. Twenty-four clinicians from three agencies were trained using a community-informed training protocol. Outcomes for clinician-reports of organizational functioning, self-reports of skill and knowledge, and observational single-subject data of clinician skills were assessed. Minimal improvements were found for clinician skills across self-report and observations. More research on tailoring trainings to meet needs of community agencies and clinicians should be explored to determine best practice in wide-scale implementation efforts.

Race and Equity in Statewide Implementation Programs: An Application of the Policy Ecology of Implementation Framework

Although the literature is growing regarding large-scale, system-wide implementation programs, the broader political and social contexts, including race and ethnicity, are frequently ignored. Using the Policy Ecology of Implementation framework (Raghavan et al., Implement Sci 3:26, 2008), Minnesota's CEMIG is examined to investigate the role of social and political contexts in the implementation process and the barriers they create. Data from 22 interview transcripts from DHS administrators, agency grant managers, university educators, advocacy group representatives, and mental health board members, along with more than 1000 grant documents were qualitatively analyzed using content analysis to reveal three themes concerning how the participants experienced program implementation: invisibility, isolation, and inequity. Findings demonstrate the participants perceived that the grant program perpetuated inequities by neglecting to promote the program, advocate for clinicians of color, and coordinate isolated policy ecology systems. Strategies for future large-scale, system-wide mental health program implementation are provided.

Preaching to the Choir? Predictors of Engagement in a Community-Based Learning Collaborative

This study examined predictors of engagement among 283 professionals from 34 agencies participating in three community-based learning collaboratives (CBLCs) on trauma-focused cognitive-behavioral therapy (TF-CBT). Only 50.2% of participants completed the CBLC, primarily due to not attending consultation calls or completing training cases. While higher engagement was associated with being trauma-informed and using more of the TF-CBT components prior to the CBLC, most predictors were not significant, perhaps due to ceiling effects. Positive attitudes and high organizational support were not sufficient to ensure engagement. Future research using longitudinal measurement of a wider range of predictors is needed.

Sustainability of an Evidence-Based Practice in Community Mental Health Agencies Serving Children

OBJECTIVE

The authors documented rates of sustained use of an evidence-based practice following training sponsored by New York State (NYS), and they identified clinician characteristics related to sustained use.

METHODS

Clinicians (N=89) who were employed in licensed NYS Office of Mental Health agencies serving children and adolescents and who were trained to proficiency in Managing and Adapting Practice (MAP) in 2016 were contacted between 9 and 18 months later and asked whether they were still using (users) or had stopped using (nonusers) MAP and their reason for doing so.

RESULTS

Responses were received from 57% of trainees and of those, 80% reported continued use of MAP. Score on the appeal subscale of the Evidence-Based Practices Attitude Scale (EBPAS) was the only significant difference between users and nonusers.

CONCLUSIONS

Most clinicians reported sustained use of MAP. The EBPAS appeal subscale can be used to identify clinicians who are likely to discontinue use.

A Mixed Methods Study of the Stages of Implementation for an Evidence-Based Trauma Intervention in Schools

A mixed methods study was conducted to examine the implementation process of 26 urban school-based mental health clinics that took part in a training and implementation support program for an evidence-based school trauma intervention. Implementation process was observed using the Stages of Implementation Completion (SIC) measure. Qualitative interviews were conducted with clinic leaders in order to gain insight into clinic processes related to the SIC. Results showed that almost all of the clinics engaged in some activities related to pre-implementation (engagement, feasibility, and readiness), but only 31% of the sites formally started delivering the program to youth. Completing more pre-implementation activities, particularly those related to readiness, predicted program start-up. Qualitative analysis comparing those that implemented the program to those that did not revealed critical differences in decision-making processes, leadership strategies, and the presence of local champions for the program. This study documented the patterns of clinic behavior that occurs as part of large-scale training efforts, suggests some unique challenges that occur in schools, and highlights the importance of engaging in particular implementation activities (i.e., readiness planning, stakeholder consensus and planning meetings) as part of program start-up. Findings indicate that pre-implementation and readiness-related consultation should be employed as part of broad-scale implementation and training efforts.

Synchronizing Watches: The Challenge of Aligning Implementation Science and Public Systems

This special issue of Administration and Policy in Mental Health explores the complexities of the outer system context in implementation science research. In this commentary, we highlight areas of asynchrony between implementation science research and policy realities of public systems. Timing is a critical factor for many aspects of system-level implementation including when and how evidence-based practice initiatives are launched, short and inconsistent timeframes for funding and support, need for early indicators of success and demonstrating return on investment. Greater consideration for the timing that drives change in public systems will strengthen efforts to implement and sustain EBPs in community settings.

Developing a sustainable child and family service system after a community tragedy: Lessons from Sandy Hook

This paper describes a systematic approach to assessing community services post-Sandy Hook shooting. An evaluation team was invited to develop a sustainability plan for community services in Newtown. Service organizations, providers and families were interviewed. Descriptive statistics were used to characterize the range of services; respondent perspectives were coded using content analysis. We found that Newtown has a broad array of community services, but respondent groups varied in their perceptions of service adequacy. Consensus existed about core components of an ideal service system, including centralizing access; coordinating care; personalizing and tailoring services for families; and providing evidence-based care. The strategic community assessment approach developed here may inform how communities examine their service capacity and develop sustainability plans post-disaster.

Non-participants in policy efforts to promote evidence-based practices in a large behavioral health system

Background

System-wide training initiatives to support and implement evidence-based practices (EBPs) in behavioral health systems have become increasingly widespread. Understanding more about organizations who do not participate in EBP training initiatives is a critical piece of the dissemination and implementation puzzle if we endeavor to increase access in community settings.

Methods

We conducted 30 1-h semi-structured interviews with leaders in non-participating agencies who did not formally participate in system-wide training initiatives to implement EBPs in the City of Philadelphia, with the goal to understand why they did not participate.

Results

We found that despite not participating in training initiatives, most agencies were adopting (and self-financing) some EBP implementation. Leadership from agencies that were implementing EBPs reported relying on previously trained staff to implement EBPs and acknowledged a lack of emphasis on fidelity. Most leaders at agencies not adopting EBPs did not have a clear understanding of what EBP is. Those familiar with EBPs in agencies not adopting EBPs reported philosophical objections to EBPs. When asked about quality assurance and treatment selection, leaders reported being guided by system audits.

Conclusions

While it is highly encouraging that many agencies are adopting EBPs on their own, significant questions about fidelity and implementation success more broadly remain.

Using a Theory-Guided Learning Collaborative Model to Improve Implementation of EBPs in a State Children's Mental Health System: A Pilot Study

Learning collaboratives (LCs) are used widely to promote implementation of evidence-based practices. However, there has been limited research on the effectiveness of LCs and models vary widely in their structure, focus and components. The goal of the present study was to develop and field test a theory-based LC model to augment a state-led, evidence-based training program for clinicians providing mental health services to children. Analysis of implementation outcomes contrasted LC sites to matched comparison sites that participated in the clinical training program alone. Results suggested that clinicians from sites participating in the LC were more highly engaged in the state-led clinical training program and were more likely to complete program requirements.