1
|
Aarons GA, Sklar M, Ehrhart MG, Roesch S, Moullin JC, Carandang K. Randomized trial of the leadership and organizational change for implementation (LOCI) strategy in substance use treatment clinics. JOURNAL OF SUBSTANCE USE AND ADDICTION TREATMENT 2024; 165:209437. [PMID: 38866139 DOI: 10.1016/j.josat.2024.209437] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/07/2024] [Revised: 04/28/2024] [Accepted: 05/21/2024] [Indexed: 06/14/2024]
Abstract
INTRODUCTION Evidence-based practice (EBP) implementation represents a strategic change that requires alignment of leadership and support throughout organizations. Leadership and Organizational Change for Implementation (LOCI) is a multifaceted implementation strategy that aims to improve implementation leadership and climate within organizations through iterative cycles of leadership and climate assessment and feedback, leadership training and coaching, and strategic planning with upper-level leaders. This study tested the effects of LOCI on transformational and implementation leadership, implementation climate, implementation citizenship behavior, and EBP reach. METHODS A multiple cohort, cluster randomized trial tests the effect of LOCI in 60 clinics across nine behavioral health organizations in California and Arizona, USA. The study randomized clinics within organizations to either LOCI or a leadership training webinar control condition in three consecutive cohorts. Repeated web-based surveys of direct service providers (nLOCI = 201, nControl = 179) assessed leadership, implementation climate, and implementation citizenship over time. Multilevel autoregressive modeling was the primary statistical analysis such that providers (level-1) were nested within clinics (level-2). The study predicted between-condition differences at 4-, 8-, and 12-month follow-up assessments. Provider engagement in a fidelity monitoring process assessed reach of motivational interviewing (i.e., number of sessions recorded/submitted for fidelity coding). An independent sample t-test explored between condition differences in motivational interviewing reach. RESULTS Results indicated between condition differences at 4 months for implementation leadership, implementation climate, and implementation citizenship behavior such that greater improvements were evidenced in the LOCI condition compared to the control condition. Reach of MI was significantly greater in the LOCI vs control condition such that LOCI providers were significantly more likely to engage in the fidelity monitoring process (chi-square (1, n = 370) = 5.59, p = .018). CONCLUSIONS LOCI was developed based on organizational theories of strategic leadership and climate to affect organizational change processes that communicate that innovation implementation is expected, supported, and recognized as a value of the organization. The LOCI implementation strategy resulted in more positive hypothesized outcomes compared to the control condition. Organizational change strategies have utility for implementing health innovations in complex, multilevel contexts and for greater sustainment of facilitative leader behaviors, strategic implementation climate, and improved implementation outcomes. TRIAL REGISTRATION This study is registered with Clinicaltrials.gov gov (NCT03042832, 2 February 2017; retrospectively registered).
Collapse
Affiliation(s)
- Gregory A Aarons
- University of California San Diego, Department of Psychiatry, 9500 Gilman Drive (0812), La Jolla, CA 92093-0812, United States of America; UC San Diego Altman Clinical and Translational Research Institute Dissemination and Implementation Science Center, 9500 Gilman Drive, La Jolla, CA 92093, United States of America; Child and Adolescent Services Research Center, 3665 Kearny Villa Rd., Suite 200N, San Diego, CA 92123, United States of America.
| | - Marisa Sklar
- University of California San Diego, Department of Psychiatry, 9500 Gilman Drive (0812), La Jolla, CA 92093-0812, United States of America; UC San Diego Altman Clinical and Translational Research Institute Dissemination and Implementation Science Center, 9500 Gilman Drive, La Jolla, CA 92093, United States of America; Child and Adolescent Services Research Center, 3665 Kearny Villa Rd., Suite 200N, San Diego, CA 92123, United States of America.
| | - Mark G Ehrhart
- University of Central Florida, Department of Psychology, United States of America.
| | - Scott Roesch
- San Diego State University, Department of Psychology, 5500 Campanile Drive, San Diego, CA 92182-4611, United States of America.
| | - Joanna C Moullin
- Curtin University, School of Population Health, Kent Street, Bentley, Western Australia 6102, Australia
| | - Kristine Carandang
- University of California San Diego, Department of Psychiatry, 9500 Gilman Drive (0812), La Jolla, CA 92093-0812, United States of America; Child and Adolescent Services Research Center, 3665 Kearny Villa Rd., Suite 200N, San Diego, CA 92123, United States of America
| |
Collapse
|
2
|
Russell BS, Wink MN, Hutchison M. Mixed Methods Illustration of Teachers' Trauma-Informed Attitudes and Practice. JOURNAL OF CHILD & ADOLESCENT TRAUMA 2024; 17:349-362. [PMID: 38938939 PMCID: PMC11199473 DOI: 10.1007/s40653-023-00583-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Accepted: 10/30/2023] [Indexed: 06/29/2024]
Abstract
Traumatic events during childhood are crucial to consider when addressing children's social and emotional development, as childhood trauma is associated with negative impacts, including academic achievement. Additionally, positive classroom environments and teachers' trauma-informed attitudes and behavior play a role in supporting recovery from children's trauma-related experiences. Aspire, Connect, Thrive (ACT) is a trauma-informed school-based intervention that examined students' Social Emotional Competence (SEC) and resilience for K-8th grade students in a disadvantaged, urban elementary school in Connecticut contending with the effects of students' exposure to trauma. The present study examines the experience of ACT teachers who received professional development and subsequently implemented learned content in the classroom (N = 17; 70.6% female, mean age = 44 years; 47.1% racial/ethnic minority; mean years teaching = 15.6) through qualitative evidence of trauma sensitivity (observed and self-reported) and clinician-ratings of teachers' positive classroom environment. Quantitative results indicate significant change over time in teachers' attitudes and trauma-informed classroom responses. Interview themes suggest (1) teachers learned from and implemented the intervention content in their classrooms dependent upon the support the teacher was given, (2) teachers' perspectives on the connections between the student-teacher relationship and trauma-informed attitudes or practices influenced teacher behavior, and (3) teachers' own emotions and experiences implementing trauma-informed practices were key to classroom management.
Collapse
Affiliation(s)
- Beth S. Russell
- Department of Human Development & Family Sciences, University of Connecticut, 348 Mansfield Avenue, U-1058, 06269- 1058 Storrs, CT USA
| | - Mackenzie N. Wink
- Department of Human Development & Family Sciences, University of Connecticut, 348 Mansfield Avenue, U-1058, 06269- 1058 Storrs, CT USA
| | - Morica Hutchison
- Department of Human Development & Family Sciences, University of Connecticut, 348 Mansfield Avenue, U-1058, 06269- 1058 Storrs, CT USA
| |
Collapse
|
3
|
Lamb D, Milton A, Forsyth R, Lloyd-Evans B, Akther S, Fullarton K, O'Hanlon P, Johnson S, Morant N. Implementation of a crisis resolution team service improvement programme: a qualitative study of the critical ingredients for success. Int J Ment Health Syst 2024; 18:18. [PMID: 38704589 PMCID: PMC11069280 DOI: 10.1186/s13033-024-00638-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 11/02/2023] [Accepted: 04/25/2024] [Indexed: 05/06/2024] Open
Abstract
BACKGROUND Crisis Resolution Teams (CRTs) offer home-based care for people in mental health crisis, as an alternative to hospital admission. The success of CRTs in England has been variable. In response to this, the CRT Optimization and RElapse prevention (CORE) study developed and trialled a 12-month Service Improvement Programme (SIP) based on a fidelity model. This paper describes a qualitative evaluation of the perspectives of CRT staff, managers, and programme facilitators. We identify barriers and facilitators to implementation, and mechanisms by which service improvements took place. METHODS Managers and staff from six purposively sampled CRTs were interviewed, as well as six facilitators who were employed to support the implementation of service improvement plans. Semi-structured focus groups and individual interviews were conducted and analysed using thematic analysis. FINDINGS A majority of participants viewed all components of the SIP as helpful in improving practice, although online resources were under-used. Perceived barriers to implementation centred principally around lack of staff time and ownership. Support from both senior staff and facilitators was essential in enabling teams to undertake the work associated with the SIP. All participating stakeholder groups reported that using the fidelity model to benchmark their CRT work to best practice and feel part of a 'bigger whole' was valuable. CONCLUSION CRT staff, managers and programme facilitators thought that a structured service improvement programme helped to increase fidelity to a best practice model. Flexibility (from all stakeholders) was key to enable service improvement actions to be manageable within time- and resource-poor teams.
Collapse
Affiliation(s)
- Danielle Lamb
- Department of Applied Health Research, UCL, Gower Street, London, WC1E 6BT, UK.
| | - Alyssa Milton
- Faculty of Medicine and Health, The University of Sydney, Sydney, Australia
| | | | | | | | | | | | | | | |
Collapse
|
4
|
Boyd MR, Becker KD, Park AL, Pham K, Chorpita BF. Managers' Micro-Communities Matter: The Impact of Clinical Supervision Team on Therapist Perception of the Organization. ADMINISTRATION AND POLICY IN MENTAL HEALTH AND MENTAL HEALTH SERVICES RESEARCH 2024:10.1007/s10488-024-01376-0. [PMID: 38676872 DOI: 10.1007/s10488-024-01376-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 04/07/2024] [Indexed: 04/29/2024]
Abstract
Positive organizational climate - employee perceptions of their work environment and the impact of this environment on well-being and functioning - is associated with desirable organizational and client-level outcomes in mental health organizations. Clinical supervisors are well-positioned to impact organizational climate, as they serve as intermediaries between higher-level administrators who drive the policies and procedures and the therapists impacted by such decisions. This cross-sectional study examined the role of clinical supervisors as drivers of therapist perceptions of organizational climate within supervisory teams. Specifically, the present study investigated: (1) shared perceptions of organizational climate among therapists on the same supervisory team; (2) predictors of therapist climate perceptions. Eighty-six therapists were supervised by 22 supervisors. Indices of interrater agreement and interrater reliability of therapists on the same supervisory team were examined to determine shared or distinct perceptions of organizational climate. Multi-level models were used to examine whether supervisor attitudes towards evidence-based practices and therapist perceptions of supervisor communication predicted perceived organizational climate. Results showed perceptions of organizational cohesion and autonomy were shared among therapists on the same supervisory team and distinct from therapists on different supervisory teams. Therapist perceptions of their supervisor's communication was positively associated with perceptions of organizational cohesion and autonomy. These findings align with emerging evidence that middle managers shape their employees' experience of their work environment through communication strategies. These findings also point to the potential for intervening at lower organizational levels to improve overall organizational climate.
Collapse
Affiliation(s)
- Meredith R Boyd
- Department of Psychology, University of California Los Angeles, 502 Portola Plaza, Los Angeles, CA, 90095, USA.
| | - Kimberly D Becker
- Department of Psychology, University of South Carolina, Columbia, SC, USA
| | - Alayna L Park
- Department of Psychology, University of Oregon, Eugene, OR, USA
| | - Kaitlyn Pham
- Department of Psychology, University of California Los Angeles, 502 Portola Plaza, Los Angeles, CA, 90095, USA
| | - Bruce F Chorpita
- Department of Psychology, University of California Los Angeles, 502 Portola Plaza, Los Angeles, CA, 90095, USA
| |
Collapse
|
5
|
Williams NJ, Ehrhart MG, Aarons GA, Esp S, Sklar M, Carandang K, Vega NR, Brookman-Frazee L, Marcus SC. Improving measurement-based care implementation in youth mental health through organizational leadership and climate: a mechanistic analysis within a randomized trial. Implement Sci 2024; 19:29. [PMID: 38549122 PMCID: PMC10976812 DOI: 10.1186/s13012-024-01356-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/16/2023] [Accepted: 02/27/2024] [Indexed: 04/02/2024] Open
Abstract
BACKGROUND Theory and correlational research indicate organizational leadership and climate are important for successful implementation of evidence-based practices (EBPs) in healthcare settings; however, experimental evidence is lacking. We addressed this gap using data from the WISDOM (Working to Implement and Sustain Digital Outcome Measures) hybrid type III effectiveness-implementation trial. Primary outcomes from WISDOM indicated the Leadership and Organizational Change for Implementation (LOCI) strategy improved fidelity to measurement-based care (MBC) in youth mental health services. In this study, we tested LOCI's hypothesized mechanisms of change, namely: (1) LOCI will improve implementation and transformational leadership, which in turn will (2) mediate LOCI's effect on implementation climate, which in turn will (3) mediate LOCI's effect on MBC fidelity. METHODS Twenty-one outpatient mental health clinics serving youth were randomly assigned to LOCI plus MBC training and technical assistance or MBC training and technical assistance only. Clinicians rated their leaders' implementation leadership, transformational leadership, and clinic implementation climate for MBC at five time points (baseline, 4-, 8-, 12-, and 18-months post-baseline). MBC fidelity was assessed using electronic metadata for youth outpatients who initiated treatment in the 12 months following MBC training. Hypotheses were tested using longitudinal mixed-effects models and multilevel mediation analyses. RESULTS LOCI significantly improved implementation leadership and implementation climate from baseline to follow-up at 4-, 8-, 12-, and 18-month post-baseline (all ps < .01), producing large effects (range of ds = 0.76 to 1.34). LOCI's effects on transformational leadership were small at 4 months (d = 0.31, p = .019) and nonsignificant thereafter (ps > .05). LOCI's improvement of clinic implementation climate from baseline to 12 months was mediated by improvement in implementation leadership from baseline to 4 months (proportion mediated [pm] = 0.82, p = .004). Transformational leadership did not mediate LOCI's effect on implementation climate (p = 0.136). Improvement in clinic implementation climate from baseline to 12 months mediated LOCI's effect on MBC fidelity during the same period (pm = 0.71, p = .045). CONCLUSIONS LOCI improved MBC fidelity in youth mental health services by improving clinic implementation climate, which was itself improved by increased implementation leadership. Fidelity to EBPs in healthcare settings can be improved by developing organizational leaders and strong implementation climates. TRIAL REGISTRATION ClinicalTrials.gov identifier: NCT04096274. Registered September 18, 2019.
Collapse
Affiliation(s)
- Nathaniel J Williams
- Institute for the Study of Behavioral Health and Addiction, Boise State University, Boise, ID, USA.
- School of Social Work, Boise State University, Boise, ID, 83725, USA.
| | - Mark G Ehrhart
- Department of Psychology, University of Central Florida, Orlando, FL, USA
| | - Gregory A Aarons
- Department of Psychiatry, University of California, San Diego, CA, USA
| | - Susan Esp
- Institute for the Study of Behavioral Health and Addiction, Boise State University, Boise, ID, USA
- School of Social Work, Boise State University, Boise, ID, 83725, USA
| | - Marisa Sklar
- Department of Psychiatry, University of California, San Diego, CA, USA
| | | | - Nallely R Vega
- School of Social Work, Boise State University, Boise, ID, 83725, USA
| | | | - Steven C Marcus
- School of Social Policy and Practice, University of Pennsylvania, Philadelphia, PA, USA
| |
Collapse
|
6
|
Masterton W, Carver H, Booth H, McCulloch P, Ball L, Mitchell L, Murdoch H, Pauly B, Parkes T. A qualitative exploration of the relevance of training provision in planning for implementation of managed alcohol programs within a third sector setting. DRUGS (ABINGDON, ENGLAND) 2024; 32:154-163. [PMID: 40170951 PMCID: PMC11956780 DOI: 10.1080/09687637.2024.2311835] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 09/20/2023] [Revised: 01/24/2024] [Accepted: 01/24/2024] [Indexed: 04/03/2025]
Abstract
Background Managed Alcohol Programs (MAPs) are a harm reduction strategy for people experiencing homelessness and alcohol dependence. Despite a growing evidence base, resistance to MAPs is apparent due to limited knowledge of alcohol harm reduction and the cultural preference for abstinence-based approaches. To address this, service managers working in a not-for-profit organization in Scotland designed and delivered a program of alcohol-specific staff training as part of a larger study exploring the potential implementation of MAPs during the COVID-19 pandemic. Methods Semi-structured interviews were conducted with 15 service managers and staff regarding their experiences of the training provided. Data were analyzed using Framework Analysis, and Lewin's model of organizational change was applied to the findings to gain deeper theoretical insight into data relating to staff knowledge, training, and organizational change. Findings Participants described increased knowledge about alcohol harm reduction and MAPs, as well as increased opportunities for conversations around cultural change. Findings highlight individual- and organizational-level change is required when implementing novel harm reduction interventions like MAPs. Conclusion The findings have implications for the future implementation of MAPs in homelessness settings. Training can promote staff buy-in, facilitate the involvement of staff within the planning process, and change organizational culture.
Collapse
Affiliation(s)
- Wendy Masterton
- Faculty of Social Sciences, University of Stirling, Stirling, UK
| | - Hannah Carver
- Faculty of Social Sciences, University of Stirling, Stirling, UK
| | - Hazel Booth
- School of Health Sciences, University of Dundee, Dundee, UK
| | | | | | | | | | - Bernie Pauly
- Canadian Institute for Substance Use Research, University of Victoria, Victoria, Canada
| | - Tessa Parkes
- Faculty of Social Sciences, University of Stirling, Stirling, UK
| |
Collapse
|
7
|
Johnson C, AlRasheed R, Gray C, Triplett N, Mbwayo A, Weinhold A, Whetten K, Dorsey S. Uncovering determinants of perceived feasibility of TF-CBT through coincidence analysis. IMPLEMENTATION RESEARCH AND PRACTICE 2024; 5:26334895231220277. [PMID: 38322800 PMCID: PMC10775737 DOI: 10.1177/26334895231220277] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/08/2024] Open
Abstract
Introduction A mental health provider's perception of how well an intervention can be carried out in their context (i.e., feasibility) is an important implementation outcome. This article aims to identify determinants of feasibility of trauma-focused cognitive behavioral therapy (TF-CBT) through a case-based causal approach. Method Data come from an implementation-effectiveness study in which lay counselors (teachers and community health volunteers) implemented a culturally adapted manualized mental health intervention, TF-CBT, delivered to teens who were previously orphaned and were experiencing posttraumatic stress symptoms and prolonged grief in Western Kenya. The intervention team identified combinations of determinants that led to feasibility among teacher- and community health volunteer-counselors through coincidence analysis. Results Among teacher-counselors, organizational-level factors (implementation climate, implementation leadership) determined moderate and high levels of feasibility. Among community health volunteer-counselors, a strong relationship between a clinical supervisor and the supervisee was the most influential determinant of feasibility. Conclusion Methodology and findings from this article can guide the assessment of determinants of feasibility and the development of implementation strategies for manualized mental health interventions in contexts like Western Kenya. Plain Language Summary A mental health provider's perception of how easy a therapy is to use in their work setting (i.e., feasibility) can impact whether the provider uses the therapy in their setting. Implementation researchers have recommended finding practices and constructs that lead to important indicators that a therapy will be used. However, limited research to our knowledge has searched and found practices and constructs that might determine feasibility of a therapy. This article uses existing data from a large trial looking at the continued use of a trauma-focused therapy to find practices and constructs that lead to moderate and high levels of feasibility. We found that in settings with a strong organizational structure that organization and leadership support for the therapy led to teachers in Kenya to perceive the therapy as easy to use. On the other hand, in settings with a weaker organizational structure, outside support from a clinical supervisor led to community health volunteers in Kenya perceiving the therapy as easy to use. The findings from this article can guide context-specific recommendations for increasing perceived therapy feasibility at the provider-, organization-, and policy levels.
Collapse
Affiliation(s)
- Clara Johnson
- Department of Psychology, University of Washington, Seattle, WA, USA
| | - Rashed AlRasheed
- Department of Psychology, University of Washington, Seattle, WA, USA
| | - Christine Gray
- Center for Health Policy and Inequities Research, Duke Global Health Institute, Duke University, Durham, NC, USA
| | - Noah Triplett
- Department of Psychology, University of Washington, Seattle, WA, USA
| | - Anne Mbwayo
- Department of Psychiatry, University of Nairobi, Nairobi, Kenya
| | - Andrew Weinhold
- Center for Health Policy and Inequities Research, Duke Global Health Institute, Duke University, Durham, NC, USA
| | - Kathryn Whetten
- Center for Health Policy and Inequities Research, Duke Global Health Institute, Duke University, Durham, NC, USA
| | - Shannon Dorsey
- Department of Psychology, University of Washington, Seattle, WA, USA
| |
Collapse
|
8
|
Motamedi M, Lau AS, Byeon YV, Yu SH, Brookman-Frazee L. Supporting Emotionally Exhausted Community Mental Health Therapists in Appropriately Adapting EBPs for Children and Adolescents. J Behav Health Serv Res 2023; 50:468-485. [PMID: 37430134 DOI: 10.1007/s11414-023-09844-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 06/15/2023] [Indexed: 07/12/2023]
Abstract
Evidence-based practices (EBPs) are often adapted during community implementation to improve EBP fit for clients and the service context. Augmenting EBPs with additional dosing and content may improve fit. However, reducing EBP content can reduce EBP effectiveness. Using multilevel regression models, this study examined whether supportive program climate and program-furnished EBP-specific implementation strategies (e.g., materials, ongoing training, in-house experts) are associated with augmenting and reducing adaptations, and whether therapist emotional exhaustion moderated these associations. Data were collected from surveys completed by 439 therapists from 102 programs 9 years after a system-driven EBP implementation initiative. Supportive program climate was associated with more augmenting adaptations. Emotional exhaustion was a significant moderator. When organizations used more EBP-specific implementation strategies, more emotionally exhausted therapists reduced EBPs less and less emotionally exhausted therapists augmented EBPs more. Findings provide guidance on how organizations can support appropriate EBP adaptations in spite of therapist emotional exhaustion.
Collapse
Affiliation(s)
- Mojdeh Motamedi
- University of California San Diego, La Jolla, USA.
- Child and Adolescent Services Research Center, San Diego, USA.
| | - Anna S Lau
- University of California Los Angeles, Los Angeles, USA
| | | | | | - Lauren Brookman-Frazee
- University of California San Diego, La Jolla, USA
- Child and Adolescent Services Research Center, San Diego, USA
| |
Collapse
|
9
|
Lewis CC, Boyd MR, Marti CN, Albright K. Mediators of measurement-based care implementation in community mental health settings: results from a mixed-methods evaluation. Implement Sci 2022; 17:71. [PMID: 36271404 PMCID: PMC9587549 DOI: 10.1186/s13012-022-01244-1] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/21/2022] [Accepted: 10/05/2022] [Indexed: 12/01/2022] Open
Abstract
Background Tailored implementation approaches are touted as superior to standardized ones with the reasoning that tailored approaches afford opportunities to select strategies to resolve determinants of the local context. However, results from implementation trials on this topic are equivocal. Therefore, it is important to explore relevant contextual factors that function as determinants to evaluate if they are improved by tailoring and subsequently associated with changes in implementation outcomes (i.e., via statistical mediation) to better understand how tailoring achieves (or does not achieve) its effects. The present study examined the association between a tailored and standardized implementation approach, contextual factors that might mediate change, and a target implementation outcome in an initiative to implement measurement-based care (specifically the clinical integration of the Patient Health Questionnaire [PHQ-9] for depression) in a community mental health organization. Methods Using a cluster randomized control design, twelve community-based mental health clinics were assigned to a tailored or standardized implementation group. Clinicians completed a self-report battery assessing contextual factors that served as candidate mediators informed by the Framework for Dissemination at three time points: baseline, 5 months after active implementation support, and 10 months after sustainment monitoring. A subset of clinicians also participated in focus groups at 5 months. The routine use of the PHQ-9 (implementation outcome) was monitored during the 10-month sustainment period. Multi-level mediation analyses assessed the association between the implementation group and contextual factors and the association between contextual factors and PHQ-9 completion. Quantitative results were then elaborated by analyzing qualitative data from exemplar sites. Results Although tailored clinics outperformed standard clinics in terms of PHQ-9 completion at the end of active implementation, these group differences disappeared post sustainment monitoring. Perhaps related to this, no significant mediators emerged from our quantitative analyses. Exploratory qualitative analyses of focus group content emphasized the importance of support from colleagues, supervisors, and leadership when implementing clinical innovations in practice. Conclusions Although rates of PHQ-9 completion improved across the study, their sustained levels were roughly equivalent across groups and low overall. No mediators were established using quantitative methods; however, several partial quantitative pathways, as well as themes from the qualitative data, reveal fruitful areas for future research. Trial registration Standardized
versus tailored implementation of measurement-based care for depression. ClinicalTrials.gov
NCT02266134, first posted on October
16, 2014
Collapse
Affiliation(s)
- Cara C Lewis
- Kaiser Permanente Washington Health Research Institute, 1730 Minor Avenue, Suite 1600, WA, 98101, Seattle, USA. .,Department of Psychiatry and Behavioral Sciences, School of Medicine, & Department of Health Systems and Population Health, School of Public Health, University of Washington, 325 Ninth Street, Seattle, WA, 98104, USA.
| | - Meredith R Boyd
- Department of Psychology, University of California Los Angeles, 502 Portola Plaza, Los Angeles, CA, 90095, USA
| | | | - Karen Albright
- Division of General Internal Medicine, University of Colorado School of Medicine, 1635 Aurora Court, Aurora, CO, 80045, USA.,Denver-Seattle Center of Innovation, Department of Veterans Affairs, 1700 N. Wheeling ST, CO, P1-15180045, Aurora, USA
| |
Collapse
|
10
|
Organizational Factors Associated with Evidence-Based Practice Knowledge, Attitudes, and Implementation among Nurses in Saudi Arabia. INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH 2022; 19:ijerph19148407. [PMID: 35886258 PMCID: PMC9324115 DOI: 10.3390/ijerph19148407] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 05/25/2022] [Revised: 06/28/2022] [Accepted: 07/07/2022] [Indexed: 11/29/2022]
Abstract
Evidence-based practice (EBP) is crucial in keeping nurses aware of the current knowledge and improving clinical decision-making. The integration of nurses’ EBP competencies and organizational support has been suggested to create an effective arena in implementing EBP. The purpose of the study was to examine organizational factors influencing nurses’ EBP knowledge, attitudes, and implementation and identify staff nurses’ perceptions of EBP nursing leadership and hospital supports in Saudi Arabia. Data were collected from a convenience sample of staff nurses (N = 227) working in four hospitals using a cross-sectional, correlational descriptive design. Level of education (p < 0.05), EBP training (p < 0.05), unit type (ICU (p < 0.001) and ER (p < 0.01)), perceived nursing leadership (p < 0.001), and work environment (p < 0.05) supports were found significantly associated with nurses’ knowledge. Magnet recognition (p < 0.01) and knowledge (p < 0.001) had significant influence on nurses’ attitudes. Unit type (ER) (p < 0.05), knowledge (p < 0.001), and attitudes (p < 0.001) were associated with implementation. Encouragement to attend EBP trainings from nursing leadership was perceived by most nurses (51.1%). Nurses reported their hospitals support EBP through training (68.2%). Findings support the need for healthcare systems to create a culture that facilitates EBP implementation to enhance nurses’ EBP competencies and improve patients’ outcomes. Nursing managers may consider preparing nurses through education.
Collapse
|
11
|
Haddad G, BouChabke S. The impact of workplace exclusion on the humanitarian response to the refugee crisis in Lebanon. DISASTERS 2022; 46:246-270. [PMID: 32762089 DOI: 10.1111/disa.12458] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/11/2023]
Abstract
A contemporary issue of major concern is the millions of people fleeing homelands owing to political and socioeconomic challenges and seeking assistance elsewhere throughout the world. An effective response to this crisis includes support models that meet the various needs of refugee populations. In the complex system of humanitarian action, aid workers, among a multiplicity of actors, are the most important assets. This study utilised an inclusion-exclusion theoretical lens to examine the impact of their workplace experiences on activities in the context of the refugee crisis in Lebanon. In-depth interviews were held with 36 humanitarian practitioners, representing five international organisations that are involved in refugee aid programmes in the country. The study led to a new understanding of the link between inclusion and exclusion and the effectiveness of the humanitarian response to emergencies. In addition, it yielded new insights into apprehension about the national-international divide and its consequences for humanitarian assistance.
Collapse
Affiliation(s)
- Gloria Haddad
- Assistant Professor of Management and Strategy, Faculty of Business Administration and Management, Saint Joseph University of Beirut, Lebanon
| | - Soha BouChabke
- Humanitarian Aid Practitioner and Independent Researcher, Lebanon
| |
Collapse
|
12
|
Meza RD, Triplett NS, Woodard GS, Martin P, Khairuzzaman AN, Jamora G, Dorsey S. The relationship between first-level leadership and inner-context and implementation outcomes in behavioral health: a scoping review. Implement Sci 2021; 16:69. [PMID: 34229706 PMCID: PMC8259113 DOI: 10.1186/s13012-021-01104-4] [Citation(s) in RCA: 27] [Impact Index Per Article: 6.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/20/2020] [Accepted: 03/19/2021] [Indexed: 11/02/2023] Open
Abstract
BACKGROUND First-level leadership is uniquely positioned to support evidence-based practice (EBP) implementation for behavioral health due to first-level leaders' access to and relationship with service providers. First-level leaders are individuals who directly supervise and manage frontline employees who do not manage others. However, first-level leadership is underrepresented in existing reviews of the impact of leadership on EBP implementation. This review describes the relationship between first-level leadership and implementation determinants and outcomes. METHODS A scoping review was performed to synthesize the literature on the relationship between first-level leadership and inner-context and implementation outcomes. A literature search was conducted in PubMed, Eric, PsycINFO, CINAHL, Scopus, and Web of Science. To be eligible, studies had to examine first-level leadership, be conducted in settings providing behavioral health services, and examine the relationship between first-level leadership and an implementation or inner-context outcome. Data extraction and synthesis were performed to describe study characteristics, leader-outcome relationships, and overlap in leadership frameworks. RESULTS Twenty-one records met our inclusion criteria. Studies primarily relied on observational designs and were often cross-sectional. Studies more often examined general leadership rather than leadership strategically focused on EBP implementation (i.e., strategic implementation leadership). Our findings suggest that several forms of first-level leadership are inconsistently related to a broad set of implementation determinants, with infrequent examination of specific implementation outcomes. The broad set of implementation determinants studied, limited number of replications, and inconsistent findings have resulted in sparse evidence for any specific leadership-outcome relationship. The greatest accumulation of evidence exists for general leadership's positive relationship with providers' EBP attitudes, most notably in the form of transformational leadership. This was followed by evidence for strategic implementation leadership facilitating general implementation. Our synthesis revealed moderate conceptual overlap of strategic implementation leadership behaviors described in the theory of implementation leadership and theory of middle managers' role in implementation. CONCLUSIONS Our findings suggest that first-level leadership may play an important role in shaping implementation determinants and outcomes, but consistent empirical support is sparse and confidence dampened by methodological issues. To advance the field, we need studies that adopt stronger methodological rigor, address the conceptual overlap in leadership frameworks, examine a broader set of implementation outcomes, and examine conditions under which leadership impacts implementation. TRIAL REGISTRATION This review was not registered.
Collapse
Affiliation(s)
- Rosemary D. Meza
- Department of Psychology, University of Washington, Guthrie Hall 119A, Box 351525, Seattle, WA 98195 USA
| | - Noah S. Triplett
- Department of Psychology, University of Washington, Guthrie Hall 119A, Box 351525, Seattle, WA 98195 USA
| | - Grace S. Woodard
- Department of Psychology, University of Washington, Guthrie Hall 119A, Box 351525, Seattle, WA 98195 USA
| | - Prerna Martin
- Department of Psychology, University of Washington, Guthrie Hall 119A, Box 351525, Seattle, WA 98195 USA
| | - Alya N. Khairuzzaman
- Department of Psychology, University of Washington, Guthrie Hall 119A, Box 351525, Seattle, WA 98195 USA
| | - Gabrielle Jamora
- Department of Psychology, University of Washington, Guthrie Hall 119A, Box 351525, Seattle, WA 98195 USA
| | - Shannon Dorsey
- Department of Psychology, University of Washington, Guthrie Hall 119A, Box 351525, Seattle, WA 98195 USA
| |
Collapse
|
13
|
Grové C, Henderson L, Lee F, Wardlaw P. Therapy Dogs in Educational Settings: Guidelines and Recommendations for Implementation. Front Vet Sci 2021; 8:655104. [PMID: 34169105 PMCID: PMC8217446 DOI: 10.3389/fvets.2021.655104] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/19/2021] [Accepted: 05/14/2021] [Indexed: 11/13/2022] Open
Abstract
Therapy dogs in educational settings have gained increase traction in recent years. Despite its potential benefits and popularity, there remain concerns of perceived risks such as sanitation, allergies, and safety issues, as well as a lack of guidelines, regulations and support resources available to school staff. Research is further lacking into the implementation process of therapy dog programs in educational settings. To construct a set of recommendations for school staff to achieve successful implementation of a therapy dog program, the present study investigated the perceived facilitative and impeding factors when implementing a therapy dog program. A total of 13 school staff and 2 coordinators from therapy dog organisations took part in an open-ended online survey and/or a semi-structured interview over the phone, with the aim of gathering their perspectives of implementing a therapy dog program in schools. The thematic analysis of the data indicated facilitative factors such as program flexibility, whole-school support, the need for communication and training for all staff, as well as dog welfare. Successful implementation of therapy dogs in an education setting appear to revolve around (1) flexibility of the dog therapy program to target school's needs, (2) qualities of program instigator, (3) whole-school support, (4) communication, training and education, (5) considerations for dog's welfare. Key barriers identified included a high workload, lack of guidelines on processes, lack of support from the school community, as well as the need for better understanding of the role of a therapy dog. The results highlighted the importance of a whole-school effort when implementing a therapy dog program, as well as the need for guidelines for assessing school readiness, key factors for consideration, and strategies to overcome challenges associated with program implementation.
Collapse
Affiliation(s)
- Christine Grové
- Faculty of Education, Monash University, Victoria, VIC, Australia
| | - Linda Henderson
- Faculty of Education, Monash University, Victoria, VIC, Australia
| | - Felicia Lee
- Faculty of Education, Monash University, Victoria, VIC, Australia
| | - Phoebe Wardlaw
- Faculty of Education, Monash University, Victoria, VIC, Australia
| |
Collapse
|
14
|
Steele R. Mental health clinicians views of summary and systematic review utility in evidence-based practice. Health Info Libr J 2021; 38:295-303. [PMID: 33690980 DOI: 10.1111/hir.12359] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/30/2018] [Revised: 09/11/2020] [Accepted: 12/18/2020] [Indexed: 12/22/2022]
Abstract
BACKGROUND Evidence-based practice (EBP) requires integration of research evidence with clinical expertise and patient preferences. It is endorsed by many regulatory bodies, using the approach is challenging for many busy clinicians. OBJECTIVES To explore mental health practitioners' perceptions of the factors which help, and which hinder, EBP and their views of two formats for presenting research findings - a systematic review and a one-page summary of that review. (written by a clinical librarian) METHODS: Qualitative semi-structured interviews with a multi-professional sample of mental health clinicians. (n=7) RESULTS: Participants worked under varying time constraints, with some participants perceiving a conflict between research activities such as reading the evidence and their clinical duties one-page research summary would help some participienrs to identify potentially valuable evidence quickly. However, participants agreed that they would need to read full systematic review to assess whether and how their practice could or should change. DISCUSSION A one-page research summary can perform useful functions for clinicians; however, they require more detailed research reports such as systematic reviews to judge research's external validity. CONCLUSION This exploratory study indicates that writing evidence summaries is a useful role for clinical librarians, as part of training and support for EBP.
Collapse
Affiliation(s)
- Rachel Steele
- Library and Information Service Tees, Esk and Wear Valleys NHS Foundation Trust, Durham, UK
| |
Collapse
|
15
|
Creed TA, Crane ME, Calloway A, Olino TM, Kendall PC, Stirman SW. Changes in Community Clinicians' Attitudes and Competence following a Transdiagnostic Cognitive Behavioral Therapy Training. IMPLEMENTATION RESEARCH AND PRACTICE 2021; 2. [PMID: 34541540 PMCID: PMC8444627 DOI: 10.1177/26334895211030220] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/18/2022] Open
Abstract
Background Although the literature suggest that attitudes toward evidence-based practices (EBPs) are associated with provider use of EBPs, less is known about the association between attitudes and how competently EBPs are delivered. This study examined how initial attitudes and competence relate to improvements in attitudes and competence following EBP training. Methods Program evaluation data was collected during implementation of an EBP in a large community mental health network. Clinicians (N=891) received intensive training in cognitive behavioral therapy followed by six months of consultation. Attitudes were assessed using the Evidence-Based Practice Attitude Scale, and competence was assessed using the Cognitive Therapy Rating Scale. Data were analyzed by fitting three latent change score models to examine the relationship between changes in attitudes and competence across the training and within its two phases (workshop phase, consultation phase). Results Latent change models identified significant improvement in attitudes (Ms latent change≥1.03, SEs≤ 0.18, zs≥6.55, ps< .001) and competence (Ms latent change ≥14.16, SEs≤3.10, zs≥2.82, ps<.001) across the full training and in each phase. Higher pre-workshop attitudes predicted significantly greater change in competence in the workshop and across training (bs≥1.62, SEs≤0.90, z≥1.09, p<.04, β≥0.10); however, contrary to our hypothesis, post-workshop attitudes did not significantly predict change in competence in consultation (b=1.62, SE=0.86, z=1.87, p=.06, β=0.09). Change in attitudes and change in competence in the training period and within the two phases were not significantly correlated. Conclusions Results indicate that pre-training attitudes about EBPs present a target for implementation interventions, given their relation to changes in both attitudes and competence throughout training. Following participation in in itial training workshops, other factors such as subjective norms, implementation culture, or system-level policy shifts may be more predictive of change in competence through consultation.
Collapse
Affiliation(s)
- Torrey A Creed
- Perelman School of Medicine, University of Pennsylvania, 3535 Market Street Suite 3046, Philadelphia, PA, USA
| | - Margaret E Crane
- Department of Psychology, Temple University, Weiss Hall, 1701 N. 13th Street, Philadelphia, PA, USA
| | - Amber Calloway
- Perelman School of Medicine, University of Pennsylvania, 3535 Market Street Suite 3046, Philadelphia, PA, USA
| | - Thomas M Olino
- Department of Psychology, Temple University, Weiss Hall, 1701 N. 13th Street, Philadelphia, PA, USA
| | - Philip C Kendall
- Department of Psychology, Temple University, Weiss Hall, 1701 N. 13th Street, Philadelphia, PA, USA
| | - Shannon Wiltsey Stirman
- National Center for PTSD and Stanford University, 795 Willow Road NC-PTSD, Menlo Park, CA, 94025, USA
| |
Collapse
|
16
|
Aarons GA, Conover KL, Ehrhart MG, Torres EM, Reeder K. Leader–member exchange and organizational climate effects on clinician turnover intentions. J Health Organ Manag 2020; 35:68-87. [DOI: 10.1108/jhom-10-2019-0311] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
PurposeClinician turnover in mental health settings impacts service quality, including availability and delivery of evidence-based practices. Leadership is associated with organizational climate, team functioning and clinician turnover intentions (TI). This study examines leader–member exchange (LMX), reflecting the relationship between a supervisor and each supervisee, using mean team LMX, dispersion of individual clinician ratings compared to team members (i.e. relative LMX) and team level variability (i.e. LMX differentiation), in relation to organizational climate and clinician TI.Design/methodology/approachSurvey data were collected from 363 clinicians, nested in children's mental health agency workgroups, providing county-contracted outpatient services to youth and families. A moderated mediation path analysis examined cross-level associations of leader–member exchange with organizational climate and turnover intentions.FindingsLower relative LMX and greater LMX differentiation were associated with higher clinician TI. Higher team-level demoralizing climate also predicted higher TI. These findings indicate that poorer LMX and more variability in LMX at the team level are related to clinician TI.Originality/valueThis study describes both team- and clinician-level factors on clinician TI. Few studies have examined LMX in mental health, and fewer still have examined relative LMX and LMX differentiation associations with organizational climate and TI. These findings highlight the importance of leader–follower relationships and organizational climate and their associations with clinician TIs. Mental health service systems and organizations can address these issues through fostering more positive supervisor–supervisee relationships.
Collapse
|
17
|
Zhang H, Wang Y, Yang Y. The relevance of transformational leadership for promoting professional social work competence with EBPA. HEALTH & SOCIAL CARE IN THE COMMUNITY 2020; 28:2243-2252. [PMID: 32462725 DOI: 10.1111/hsc.13037] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/26/2019] [Revised: 12/24/2019] [Accepted: 05/04/2020] [Indexed: 06/11/2023]
Abstract
Health care social workers' attitudes towards evidence-based practice (EBP) are an indispensable precursor of implementing EBP. Using a subset including 405 health care social workers from the first nationally representative survey of social workers in China, this study empirically assesses how transformational leadership (TFL) promotes health care social workers' attitudes towards EBP. The results show that organisational learning capacity (OLC) and professional competence (PC) fully mediate the positive relationship between TFL and EBP attitudes. Furthermore, TFL, OLC and PC explain 56% of the variance in health care social workers' attitudes towards EBP. This result supports the perspective that both organisational factors and individual factors may facilitate social workers' positive attitudes towards EBP, but organisational factors are more important. Therefore, to adopt, use and sustain EBP in health care social work, learning and innovation in the organisation should be increased. Furthermore, it is important to help social workers improve their PC.
Collapse
Affiliation(s)
- Huan Zhang
- School of Social Development and Public Policy, Beijing Normal University, Beijing, China
| | - Yean Wang
- School of Social Development and Public Policy, Beijing Normal University, Beijing, China
| | - Yaya Yang
- School of Social Development and Public Policy, Beijing Normal University, Beijing, China
| |
Collapse
|
18
|
Hickey G, McGilloway S, Leckey Y, Stokes A, Bywater T, Donnelly M. "Putting Meat on the Bones": Understanding the Implementation of a Community-Based Early Intervention and Prevention Programme-Contextual, Person, and Programme Influences. PREVENTION SCIENCE : THE OFFICIAL JOURNAL OF THE SOCIETY FOR PREVENTION RESEARCH 2020; 22:113-129. [PMID: 33057874 DOI: 10.1007/s11121-020-01170-y] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 09/25/2020] [Indexed: 10/23/2022]
Abstract
The adoption and effective delivery of evidence-based interventions within "real-world" community-based, primary health care service settings are of crucial importance. In this paper, we explore the successes and challenges of implementing a new complex, group-based, early parenting intervention called the Parent and Infant (PIN) programme. This study involved a systematic analysis of the processes and factors that influence the implementation of the PIN programme; the analysis was guided and informed by the Implementation Outcome Framework and the Consolidated Framework for Implementation Research. A documentary review, alongside a series of one-to-one interviews and small group discussions with a range of stakeholders (n = 44), and 7 focus groups (n = 24) were used as data sources. Factors that promoted programme adoption, acceptability, and implementation feasibility included programme characteristics and stakeholder attitudes, as well as organisational and systems factors (e.g. leadership and collaboration). Key challenges to implementation success included engagement and adoption barriers. This research provides a useful and important example of real-world, theory-driven implementation research which helped to identify interrelated processes, factors, and contexts which shape and influence the implementation of early intervention and prevention programmes, removed for blind review.
Collapse
Affiliation(s)
- Gráinne Hickey
- Department of Psychology, Centre for Mental Health and Community Research, Maynooth University, John Hume Building, Co. Kildare, Maynooth, W23 F2H6, Ireland.
| | - Sinead McGilloway
- Department of Psychology, Centre for Mental Health and Community Research, Maynooth University, John Hume Building, Co. Kildare, Maynooth, W23 F2H6, Ireland
| | - Yvonne Leckey
- Department of Psychology, Centre for Mental Health and Community Research, Maynooth University, John Hume Building, Co. Kildare, Maynooth, W23 F2H6, Ireland
| | - Ann Stokes
- Department of Psychology, Centre for Mental Health and Community Research, Maynooth University, John Hume Building, Co. Kildare, Maynooth, W23 F2H6, Ireland
| | | | - Michael Donnelly
- Health Services Research Group, Centre for Public Health, School of Medicine, Dentistry and Biomedical Sciences, Queen's University Belfast, Belfast, UK
| |
Collapse
|
19
|
Factors Associated with Community-Partnered School Behavioral Health Clinicians' Adoption and Implementation of Evidence-Based Practices. ADMINISTRATION AND POLICY IN MENTAL HEALTH AND MENTAL HEALTH SERVICES RESEARCH 2020; 46:91-104. [PMID: 30244430 DOI: 10.1007/s10488-018-0897-3] [Citation(s) in RCA: 12] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/28/2022]
Abstract
Community-partnered school behavioral health (CP-SBH) is a model whereby schools partner with local community agencies to deliver services. This mixed-methods study examined 80 CP-SBH clinicians' adoption and implementation of evidence-based practice (EBP) approaches following mandated training. Forty-four clinicians were randomly assigned to one of two training conditions for a modular common elements approach to EBPs; 36 clinicians were preselected for training in a non-modular EBP. EBP knowledge improved for all training conditions at 8-month follow-up and practice element familiarity improved for modular approach training conditions, but the modular condition including ongoing consultation did not yield better results. Qualitative interviews (N = 17) highlighted multi-level influences of the CP-SBH service system and individual clinician characteristics on adoption and implementation.
Collapse
|
20
|
Williams NJ, Wolk CB, Becker-Haimes EM, Beidas RS. Testing a theory of strategic implementation leadership, implementation climate, and clinicians' use of evidence-based practice: a 5-year panel analysis. Implement Sci 2020; 15:10. [PMID: 32033575 PMCID: PMC7006179 DOI: 10.1186/s13012-020-0970-7] [Citation(s) in RCA: 69] [Impact Index Per Article: 13.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/31/2019] [Accepted: 01/31/2020] [Indexed: 01/15/2023] Open
Abstract
BACKGROUND Implementation theory suggests that first-level leaders, sometimes referred to as middle managers, can increase clinicians' use of evidence-based practice (EBP) in healthcare settings by enacting specific leadership behaviors (i.e., proactive, knowledgeable, supportive, perseverant with regard to implementation) that develop an EBP implementation climate within the organization; however, longitudinal and quasi-experimental studies are needed to test this hypothesis. METHODS Using data collected at three waves over a 5-year period from a panel of 30 outpatient children's mental health clinics employing 496 clinicians, we conducted a quasi-experimental difference-in-differences study to test whether within-organization change in implementation leadership predicted within-organization change in EBP implementation climate, and whether change in EBP implementation climate predicted within-organization change in clinicians' use of EBP. At each wave, clinicians reported on their first-level leaders' implementation leadership, their organization's EBP implementation climate, and their use of both EBP and non-EBP psychotherapy techniques for childhood psychiatric disorders. Hypotheses were tested using econometric two-way fixed effects regression models at the organization level which controlled for all stable organizational characteristics, population trends in the outcomes over time, and time-varying covariates. RESULTS Organizations that improved from low to high levels of implementation leadership experienced significantly greater increases in their level of EBP implementation climate (d = .92, p = .017) and within-organization increases in implementation leadership accounted for 11% of the variance in improvement in EBP implementation climate beyond all other covariates. In turn, organizations that improved from low to high levels of EBP implementation climate experienced significantly greater increases in their clinicians' average EBP use (d = .55, p = .007) and within-organization improvement in EBP implementation climate accounted for 14% of the variance in increased clinician EBP use. Mediation analyses indicated that improvement in implementation leadership had a significant indirect effect on clinicians' EBP use via improvement in EBP implementation climate (d = .26, 95% CI [.02 to .59]). CONCLUSIONS When first-level leaders increase their frequency of implementation leadership behaviors, organizational EBP implementation climate improves, which in turn contributes to increased EBP use by clinicians. Trials are needed to test strategies that target this implementation leadership-EBP implementation climate mechanism.
Collapse
Affiliation(s)
- Nathaniel J Williams
- School of Social Work, Boise State University, Boise, ID, USA. .,Institute for the Study of Behavioral Health and Addiction, Boise State University, Boise, ID, USA. .,School of Social Work, Boise State University, Room 711, 1910 University Drive, Boise, ID, 83725, USA.
| | - Courtney Benjamin Wolk
- Department of Psychiatry, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA
| | - Emily M Becker-Haimes
- Department of Psychiatry, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA.,Hall Mercer Community Mental Health Center, Pennsylvania Hospital, Philadelphia, PA, USA
| | - Rinad S Beidas
- Department of Psychiatry, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA.,Department of Medical Ethics and Health Policy, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA.,Department of Medicine, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA.,Penn Implementation Science Center at the Leonard Davis Institute of Health Economics (PISCE@LDI), University of Pennsylvania, Philadelphia, PA, USA
| |
Collapse
|
21
|
Stadnick NA, Lau AS, Barnett M, Regan J, Aarons GA, Brookman-Frazee L. Comparing Agency Leader and Therapist Perspectives on Evidence-Based Practices: Associations with Individual and Organizational Factors in a Mental Health System-Driven Implementation Effort. ADMINISTRATION AND POLICY IN MENTAL HEALTH AND MENTAL HEALTH SERVICES RESEARCH 2019; 45:447-461. [PMID: 29101604 DOI: 10.1007/s10488-017-0835-9] [Citation(s) in RCA: 18] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/25/2022]
Abstract
Agency leaders and therapists are essential stakeholders in implementation of evidence-based practices (EBPs) within publicly-funded mental health services. Little is known about how these stakeholders differ in their perceptions of specific EBPs and which individual and organizational factors differentially influence these perceptions. Within the context of a system-driven implementation of multiple EBPs, survey data from 160 leaders and 720 therapists were examined to assess differences in perceptions of six EBPs. Findings indicated that leaders and therapists have unique perspectives and preferences regarding EBPs that are shaped by distinct sociodemographic and professional characteristics and aspects of organizational functioning.
Collapse
Affiliation(s)
- Nicole A Stadnick
- Department of Psychiatry, University of California, San Diego, La Jolla, CA, USA.
- Child and Adolescent Services Research Center, 3665 Kearny Villa Road, San Diego, CA, 92123, USA.
| | - Anna S Lau
- Department of Psychology, University of California, Los Angeles, Los Angeles, CA, USA
| | - Miya Barnett
- Department of Counseling, Clinical, and School Psychology, University of California, Santa Barbara, USA
| | - Jennifer Regan
- Hathaway-Sycamores Child and Family Services, Pasadena, CA, USA
| | - Gregory A Aarons
- Department of Psychiatry, University of California, San Diego, La Jolla, CA, USA
- Child and Adolescent Services Research Center, 3665 Kearny Villa Road, San Diego, CA, 92123, USA
| | - Lauren Brookman-Frazee
- Department of Psychiatry, University of California, San Diego, La Jolla, CA, USA
- Child and Adolescent Services Research Center, 3665 Kearny Villa Road, San Diego, CA, 92123, USA
| |
Collapse
|
22
|
Hu J, Gifford W, Ruan H, Harrison D, Li Q, Ehrhart MG, Aarons GA. Translation and linguistic validation of the implementation leadership scale in Chinese nursing context. J Nurs Manag 2019; 27:1030-1038. [DOI: 10.1111/jonm.12768] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/08/2018] [Revised: 02/26/2019] [Accepted: 03/06/2019] [Indexed: 11/30/2022]
Affiliation(s)
- Jiale Hu
- School of Nursing, Faculty of Health Science University of Ottawa Ottawa Ontario Canada
| | - Wendy Gifford
- School of Nursing, Faculty of Health Science University of Ottawa Ottawa Ontario Canada
- Center for Research on Health and Nursing University of Ottawa Ottawa Ontario Canada
| | - Hong Ruan
- Integrated Administration Department Shanghai Ninth People’s Hospital Shanghai China
- Shanghai Nursing Association Shanghai China
| | - Denise Harrison
- School of Nursing, Faculty of Health Science University of Ottawa Ottawa Ontario Canada
- Children’s Hospital of Eastern Ontario Research Institute Ottawa Ontario Canada
| | - Qingge Li
- School of Nursing Shanghai Jiaotong University Shanghai China
| | - Mark G. Ehrhart
- Department of Psychology University of Central Florida Orlando Florida
| | - Gregory A. Aarons
- Department of Psychiatry University of California San Diego California
- Child and Adolescent Services Research Center University of California San Diego California
| |
Collapse
|
23
|
Williams N, Beidas R. Annual Research Review: The state of implementation science in child psychology and psychiatry: a review and suggestions to advance the field. J Child Psychol Psychiatry 2019; 60:430-450. [PMID: 30144077 PMCID: PMC6389440 DOI: 10.1111/jcpp.12960] [Citation(s) in RCA: 132] [Impact Index Per Article: 22.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Accepted: 07/18/2018] [Indexed: 02/04/2023]
Abstract
BACKGROUND Scientists have developed evidence-based interventions that improve the symptoms and functioning of youth with psychiatric disorders; however, these interventions are rarely used in community settings. Eliminating this research-to-practice gap is the purview of implementation science, the discipline devoted to the study of methods to promote the use of evidence-based practices in routine care. METHODS We review studies that have tested factors associated with implementation in child psychology and psychiatry, explore applications of social science theories to implementation, and conclude with recommendations to advance implementation science through the development and testing of novel, multilevel, causal theories. RESULTS During its brief history, implementation science in child psychology and psychiatry has documented the implementation gap in routine care, tested training approaches and found them to be insufficient for behavior change, explored the relationships between variables and implementation outcomes, and initiated randomized controlled trials to test implementation strategies. This research has identified targets related to implementation (e.g., clinician motivation, organizational culture) and demonstrated the feasibility of activating these targets through implementation strategies. However, the dominant methodological approach has been atheoretical and predictive, relying heavily on a set of variables from heuristic frameworks. CONCLUSIONS Optimizing the implementation of effective treatments in community care for youth with psychiatric disorders is a defining challenge of our time. This review proposes a new direction focused on developing and testing integrated causal theories. We recommend implementation scientists: (a) move from observational studies of implementation barriers and facilitators to trials that include causal theory; (b) identify a core set of implementation determinants; (c) conduct trials of implementation strategies with clear targets, mechanisms, and outcomes; (d) ensure that behaviors that are core to EBPs are clearly defined; and (e) agree upon standard measures. This agenda will help fulfill the promise of evidence-based practice for improving youth behavioral health.
Collapse
Affiliation(s)
| | - Rinad Beidas
- Department of Psychiatry, University of Pennsylvania Perelman School of Medicine
| |
Collapse
|
24
|
Fenwick KM, Brimhall KC, Hurlburt M, Aarons G. Who Wants Feedback? Effects of Transformational Leadership and Leader-Member Exchange on Mental Health Practitioners' Attitudes Toward Feedback. Psychiatr Serv 2019; 70:11-18. [PMID: 30373496 PMCID: PMC6408302 DOI: 10.1176/appi.ps.201800164] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/30/2022]
Abstract
OBJECTIVE The purpose of this study was to identify the mechanisms through which different aspects of leadership affect mental health practitioners' attitudes toward supervisory feedback. METHODS Data were collected from 363 practitioners nested in 68 treatment teams in public-sector mental health organizations. A multilevel path analysis was conducted to examine the associations of transformational leadership (supervisor's ability to inspire others to follow a course of action) and leader-member exchange (quality of the supervisor-practitioner relationship) with practitioner attitudes toward feedback. RESULTS Transformational leadership and leader-member exchange were directly and positively associated with practitioners' attitudes toward feedback. Transformational leadership was also indirectly associated with practitioners' attitudes toward feedback through the quality of supervisor-practitioner relationships. CONCLUSIONS Study results contribute to the growing body of evidence suggesting that leaders play a key role in shaping mental health service delivery. Both leadership behavior and high-quality supervisor-practitioner relationships are important in supporting practitioners in delivering evidence-based mental health care. Policymakers, administrators, and researchers should consider an integrative approach when developing leadership training interventions.
Collapse
Affiliation(s)
- Karissa M Fenwick
- Suzanne Dworak-Peck School of Social Work, University of Southern California, Los Angeles (Fenwick, Hurlburt); Child and Adolescent Services Research Center (Hurlburt, Aarons) and Department of Psychiatry (Aarons), University of California, San Diego; Department of Social Work, Binghamton University, State University of New York, Binghamton (Brimhall)
| | - Kim C Brimhall
- Suzanne Dworak-Peck School of Social Work, University of Southern California, Los Angeles (Fenwick, Hurlburt); Child and Adolescent Services Research Center (Hurlburt, Aarons) and Department of Psychiatry (Aarons), University of California, San Diego; Department of Social Work, Binghamton University, State University of New York, Binghamton (Brimhall)
| | - Michael Hurlburt
- Suzanne Dworak-Peck School of Social Work, University of Southern California, Los Angeles (Fenwick, Hurlburt); Child and Adolescent Services Research Center (Hurlburt, Aarons) and Department of Psychiatry (Aarons), University of California, San Diego; Department of Social Work, Binghamton University, State University of New York, Binghamton (Brimhall)
| | - Gregory Aarons
- Suzanne Dworak-Peck School of Social Work, University of Southern California, Los Angeles (Fenwick, Hurlburt); Child and Adolescent Services Research Center (Hurlburt, Aarons) and Department of Psychiatry (Aarons), University of California, San Diego; Department of Social Work, Binghamton University, State University of New York, Binghamton (Brimhall)
| |
Collapse
|
25
|
Lodge AC, Kaufman L, Stevens Manser S. Barriers to Implementing Person-Centered Recovery Planning in Public Mental Health Organizations in Texas: Results from Nine Focus Groups. ADMINISTRATION AND POLICY IN MENTAL HEALTH AND MENTAL HEALTH SERVICES RESEARCH 2017; 44:413-429. [PMID: 27037701 DOI: 10.1007/s10488-016-0732-7] [Citation(s) in RCA: 24] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/22/2022]
Abstract
Despite being an established practice in the disabilities service systems, person-centered planning is a relatively new practice in the behavioral health system. As a result, little is known about the barriers that mental health organizations face in implementing person-centered recovery planning (PCRP). To fill this gap, results are presented from a qualitative analysis of nine focus groups at three public mental health organizations in Texas that have been implementing PCRP for at least 2 years. Findings suggest that organizations experienced 12 distinct barriers to PCRP implementation which were categorized into the Consolidated Framework for Implementation Research domains of intervention characteristics, the outer setting, the inner setting, characteristics of individuals, and the implementation process. Half of these 12 barriers fell within the inner setting domain, suggesting that implementation efforts should be flexible and adaptable to organizational culture and context. One-quarter of the barriers fell into the domain of characteristics of individuals involved in the intervention, which further suggests implementation efforts should assess the impact that both staff and consumers have on implementation success.
Collapse
Affiliation(s)
- Amy C Lodge
- Texas Institute for Excellence in Mental Health, Center for Social Work Research, University of Texas at Austin, 1717 W. 6th St. Suite 310, Austin, TX, 78703, USA.
| | - Laura Kaufman
- Texas Institute for Excellence in Mental Health, Center for Social Work Research, University of Texas at Austin, 1717 W. 6th St. Suite 310, Austin, TX, 78703, USA
| | - Stacey Stevens Manser
- Texas Institute for Excellence in Mental Health, Center for Social Work Research, University of Texas at Austin, 1717 W. 6th St. Suite 310, Austin, TX, 78703, USA
| |
Collapse
|
26
|
Holbrook AM, Tennille J, Buck PW. Building Capacity for Evidence-Based Practice Together. SOCIAL WORK IN PUBLIC HEALTH 2017; 32:421-431. [PMID: 28745557 DOI: 10.1080/19371918.2017.1344601] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/07/2023]
Abstract
Social workers are increasingly called to implement evidence-based practices and systematically evaluate efficacy. As healthcare reform magnifies these mandates for a growing population of service users, social work educators are positioned to play important roles in helping organizations build capacity for this work. This article presents two examples of faculty members successfully filling this role; one developed a teaching model for evidence-based practice that synchronized classroom and field continuing education, and the other linked curricular goals with an agency's need for program evaluation. The success of these initiatives identifies opportunities for educators to meet growing needs in health services.
Collapse
Affiliation(s)
- Amber M Holbrook
- a College of Education and Social Work , West Chester University , West Chester , Pennsylvania , USA
| | - Julie Tennille
- a College of Education and Social Work , West Chester University , West Chester , Pennsylvania , USA
| | - Page W Buck
- a College of Education and Social Work , West Chester University , West Chester , Pennsylvania , USA
| |
Collapse
|
27
|
Johnson SR, Pas ET, Loh D, Debnam KJ, Bradshaw CP. High School Teachers' Openness to Adopting New Practices: The Role of Personal Resources and Organizational Climate. SCHOOL MENTAL HEALTH 2017; 9:16-27. [PMID: 28533823 DOI: 10.1007/s12310-016-9201-4] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/28/2022]
Abstract
Although evidence-based practices for students' social, emotional, and behavioral health are readily available, their adoption and quality implementation in schools are of increasing concern. Teachers are vital to implementation; yet, there is limited research on teachers' openness to adopting new practices, which may be essential to successful program adoption and implementation. The current study explored how perceptions of principal support, teacher affiliation, teacher efficacy, and burnout relate to teachers' openness to new practices. Data came from 2,133 teachers across 51 high schools. Structural equation modeling assessed how organizational climate (i.e., principal support and teacher affiliation) related to teachers' openness directly and indirectly via teacher resources (i.e., efficacy and burnout). Teachers with more favorable perceptions of both principal support and teacher affiliation reported greater efficacy, and, in turn, more openness; however, burnout was not significantly associated with openness. Post hoc analyses indicated that among teachers with high levels of burnout, only principal support related to greater efficacy, and in turn, higher openness. Implications for promoting teachers' openness to new program adoption are discussed.
Collapse
Affiliation(s)
- Stacy R Johnson
- Department of Mental Health, Johns Hopkins Bloomberg School of Public Health, 415 N. Washington St, Baltimore, MD 21231, 443-287-5063
| | - Elise T Pas
- Department of Mental Health, Bloomberg School of Public Health
| | | | | | - Catherine P Bradshaw
- Department of Human Services, Curry School of Education, University of Virginia. Adjunct Professor; Department of Mental Health, Bloomberg School of Public Health
| |
Collapse
|