Characterizing the Quality Workforce in Private U.S. Child and Family Behavioral Health Agencies

The relationship between first-level leadership and inner-context and implementation outcomes in behavioral health: a scoping review

BACKGROUND

First-level leadership is uniquely positioned to support evidence-based practice (EBP) implementation for behavioral health due to first-level leaders' access to and relationship with service providers. First-level leaders are individuals who directly supervise and manage frontline employees who do not manage others. However, first-level leadership is underrepresented in existing reviews of the impact of leadership on EBP implementation. This review describes the relationship between first-level leadership and implementation determinants and outcomes.

METHODS

A scoping review was performed to synthesize the literature on the relationship between first-level leadership and inner-context and implementation outcomes. A literature search was conducted in PubMed, Eric, PsycINFO, CINAHL, Scopus, and Web of Science. To be eligible, studies had to examine first-level leadership, be conducted in settings providing behavioral health services, and examine the relationship between first-level leadership and an implementation or inner-context outcome. Data extraction and synthesis were performed to describe study characteristics, leader-outcome relationships, and overlap in leadership frameworks.

RESULTS

Twenty-one records met our inclusion criteria. Studies primarily relied on observational designs and were often cross-sectional. Studies more often examined general leadership rather than leadership strategically focused on EBP implementation (i.e., strategic implementation leadership). Our findings suggest that several forms of first-level leadership are inconsistently related to a broad set of implementation determinants, with infrequent examination of specific implementation outcomes. The broad set of implementation determinants studied, limited number of replications, and inconsistent findings have resulted in sparse evidence for any specific leadership-outcome relationship. The greatest accumulation of evidence exists for general leadership's positive relationship with providers' EBP attitudes, most notably in the form of transformational leadership. This was followed by evidence for strategic implementation leadership facilitating general implementation. Our synthesis revealed moderate conceptual overlap of strategic implementation leadership behaviors described in the theory of implementation leadership and theory of middle managers' role in implementation.

CONCLUSIONS

Our findings suggest that first-level leadership may play an important role in shaping implementation determinants and outcomes, but consistent empirical support is sparse and confidence dampened by methodological issues. To advance the field, we need studies that adopt stronger methodological rigor, address the conceptual overlap in leadership frameworks, examine a broader set of implementation outcomes, and examine conditions under which leadership impacts implementation.

TRIAL REGISTRATION

This review was not registered.

Evaluation of iLead, a generic implementation leadership intervention: mixed-method preintervention-postintervention design

OBJECTIVES

The present study aimed to evaluate the iLead intervention and to investigate whether or not transfer of training can be supported by contextualising the intervention (recruiting all managers from one branch of the organisation while focusing on one implementation case, as well as training senior management).

DESIGN

A pre-evaluation-postevaluation design was applied using mixed methods with process and effect surveys and interviews to measure the effects on three levels.

SETTING

Healthcare managers from Stockholm's regional healthcare organisation were invited to the training.

PARTICIPANTS

52 managers participated in the iLead intervention. Group 1 consisted of 21 managers from different organisations and with different implementation cases. Group 2, representing the contextualised group, consisted of 31 managers from the same organisation, working on the same implementation case, where senior management also received training.

INTERVENTION

iLead is an intervention where healthcare managers are trained in implementation leadership based on the full-range leadership model.

PRIMARY OUTCOME MEASURES

Reactions, knowledge and implementation leadership are measured.

RESULTS

Quantitative and qualitative analyses indicate that iLead was perceived to be of high quality and capable of increasing participants' knowledge. Mixed effects were found regarding changes in behaviours. The contextualisation did not have a boosting effect on behaviour change. Hence, group 2 did not increase its active implementation leadership in comparison with group 1.

CONCLUSIONS

iLead introduces a new approach to how implementation leadership can be trained when knowledge of effective leadership for implementations is combined with findings on the importance of environmental factors for the transfer of training. Even though managers reported general positive effects, transfer was not facilitated through the contextualisation of the intervention. There is a need to further develop approaches to help participants subsequently apply the learnt skills in their work environment.

Training in Implementation Practice Leadership (TRIPLE): evaluation of a novel practice change strategy in behavioral health organizations

Background

Effective leadership for organizational change is critical to the implementation of evidence-based practices (EBPs). As organizational leaders in behavioral health organizations often are promoted from within the agency for their long-standing, effective work as counselors, they may lack formal training in leadership, management, or practice change. This study assesses a novel implementation leadership training designed to promote leadership skills and successful organizational change specific to EBP implementation.

Methods

We conducted a pre-post outcome evaluation of the Training in Implementation Practice Leadership (TRIPLE), delivered via three in-person, half-day training sessions, with interim coaching and technical support. Sixteen mid-level leaders (75% female, 94% Caucasian, mean age 37 years) from 8 substance abuse treatment agencies participated. Professional roles included clinical managers, quality improvement coordinators, and program directors. Participants completed surveys prior to the first and following the final session. At both time points, measures included the Implementation Leadership Scale, Implementation Climate Scale, and Organizational Readiness for Implementing Change Scale. At post-test, we added the Training Acceptability and Appropriateness Scale (TAAS), assessing participant satisfaction with the training. Qualitative interviews were conducted 6 to 8 months after the training.

Results

Most participants (86% and 79%, respectively) reported increased implementation leadership skills and implementation climate; paired samples t tests indicated these pre-post increases were statistically significant. Implementation leadership scores improved most markedly on the Proactive and Knowledgeable subscales. For implementation climate, participants reported the greatest increases in educational support and recognition for using EBP. Post-test scores on the TAAS also indicated that participants found the training program to be highly acceptable and appropriate for their needs. Qualitative results supported positive outcomes of training that resulted in both increased organizational implementation as well as leadership skills of participants.

Conclusions

This training program represents an innovative, effective, and well-received implementation strategy for emerging behavioral healthcare leaders seeking to adopt or improve the delivery of EBPs. Reported implementation leadership skills and implementation climate improved following the training program, suggesting that TRIPLE may have helped fulfill a critical need for emerging behavioral healthcare leaders.

Electronic supplementary material

The online version of this article (10.1186/s13012-019-0906-2) contains supplementary material, which is available to authorized users.