Randomized trial of the leadership and organizational change for implementation (LOCI) strategy in substance use treatment clinics

INTRODUCTION

Evidence-based practice (EBP) implementation represents a strategic change that requires alignment of leadership and support throughout organizations. Leadership and Organizational Change for Implementation (LOCI) is a multifaceted implementation strategy that aims to improve implementation leadership and climate within organizations through iterative cycles of leadership and climate assessment and feedback, leadership training and coaching, and strategic planning with upper-level leaders. This study tested the effects of LOCI on transformational and implementation leadership, implementation climate, implementation citizenship behavior, and EBP reach.

METHODS

A multiple cohort, cluster randomized trial tests the effect of LOCI in 60 clinics across nine behavioral health organizations in California and Arizona, USA. The study randomized clinics within organizations to either LOCI or a leadership training webinar control condition in three consecutive cohorts. Repeated web-based surveys of direct service providers (nLOCI = 201, nControl = 179) assessed leadership, implementation climate, and implementation citizenship over time. Multilevel autoregressive modeling was the primary statistical analysis such that providers (level-1) were nested within clinics (level-2). The study predicted between-condition differences at 4-, 8-, and 12-month follow-up assessments. Provider engagement in a fidelity monitoring process assessed reach of motivational interviewing (i.e., number of sessions recorded/submitted for fidelity coding). An independent sample t-test explored between condition differences in motivational interviewing reach.

RESULTS

Results indicated between condition differences at 4 months for implementation leadership, implementation climate, and implementation citizenship behavior such that greater improvements were evidenced in the LOCI condition compared to the control condition. Reach of MI was significantly greater in the LOCI vs control condition such that LOCI providers were significantly more likely to engage in the fidelity monitoring process (chi-square (1, n = 370) = 5.59, p = .018).

CONCLUSIONS

LOCI was developed based on organizational theories of strategic leadership and climate to affect organizational change processes that communicate that innovation implementation is expected, supported, and recognized as a value of the organization. The LOCI implementation strategy resulted in more positive hypothesized outcomes compared to the control condition. Organizational change strategies have utility for implementing health innovations in complex, multilevel contexts and for greater sustainment of facilitative leader behaviors, strategic implementation climate, and improved implementation outcomes.

TRIAL REGISTRATION

This study is registered with Clinicaltrials.gov gov (NCT03042832, 2 February 2017; retrospectively registered).

Practice-based insights from specialized clinicians into youth suicide risk assessment and psychotherapy: A qualitative study

Objective: The experience of frontline clinicians is an underutilized source of knowledge about improving youth suicide intervention. This qualitative study explored the perspectives of highly experienced, specialized mental health clinicians on the practical application of risk assessment, stabilization, and treatment and their experience of working in this practice area.Method: Data were collected from seven focus groups with 28 clinicians and analyzed using consensual qualitative research methods.Results: Four domains emerged, describing 1) youth suicide intervention as relationally focused and attachment-informed, 2) the need for flexible and tailored care balancing individual and family intervention in the context of family complexity and fractured relationships, 3) a nuanced, therapeutic approach to managing the complexity and uncertainty of adolescent suicide risk, and 4) working in youth suicide intervention as emotionally demanding and facilitated or hampered by the organizational and systems context.Conclusion: The importance of harnessing family systems and attachment-informed approaches to alliance, risk assessment, and treatment was emphasized, along with the parallel need for systemic clinician support and consideration of the potential negative consequences of administrative and risk management protocols.

Similarities and Differences Between Pragmatic Trials and Hybrid Effectiveness-Implementation Trials

Pragmatism in clinical trials is focused on increasing the generalizability of research findings for routine clinical care settings. Hybridism in clinical trials (i.e., assessing both clinical effectiveness and implementation success) is focused on speeding up the process by which evidence-based practices are developed and adopted into routine clinical care. Even though pragmatic trial methodologies and implementation science evolved from very different disciplines, Pragmatic Trials and Hybrid Effectiveness-Implementation Trials share many similar design features. In fact, these types of trials can easily be conflated, creating the potential for investigators to mislabel their trial type or mistakenly use the wrong trial type to answer their research question. Blurred boundaries between trial types can hamper the evaluation of grant applications, the scientific interpretation of findings, and policy-making. Acknowledging that most trials are not pure Pragmatic Trials nor pure Hybrid Effectiveness-Implementation Trials, there are key differences in these trial types and they answer very different research questions. The purpose of this paper is to clarify the similarities and differences of these trial types for funders, researchers, and policy-makers. In addition, recommendations are offered to help investigators choose, label, and operationalize the most appropriate trial type to answer their research question. These recommendations complement existing reporting guidelines for clinical effectiveness trials (TIDieR) and implementation trials (StaRI).

How low can you go? Examining the effects of brief online training and post-training consultation dose on implementation mechanisms and outcomes for measurement-based care

BACKGROUND

Initial training and ongoing post-training consultation (i.e., ongoing support following training, provided by an expert) are among the most common implementation strategies used to change clinician practice. However, extant research has not experimentally investigated the optimal dosages of consultation necessary to produce desired outcomes. Moreover, the degree to which training and consultation engage theoretical implementation mechanisms-such as provider knowledge, skills, and attitudes-is not well understood. This study examined the effects of a brief online training and varying dosages of post-training consultation (BOLT+PTC) on implementation mechanisms and outcomes for measurement-based care (MBC) practices delivered in the context of education sector mental health services.

METHODS

A national sample of 75 clinicians who provide mental health interventions to children and adolescents in schools were randomly assigned to BOLT+PTC or control (services as usual). Those in BOLT+PTC were further randomized to 2-, 4-, or 8-week consultation conditions. Self-reported MBC knowledge, skills, attitudes, and use (including standardized assessment, individualized assessment, and assessment-informed treatment modification) were collected for 32 weeks. Multilevel models were used to examine main effects of BOLT+PTC versus control on MBC use at the end of consultation and over time, as well as comparisons among PTC dosage conditions and theorized mechanisms (skills, attitudes, knowledge).

RESULTS

There was a significant linear effect of BOLT+PTC over time on standardized assessment use (b = .02, p < .01), and a significant quadratic effect of BOLT+PTC over time on individualized assessment use (b = .04, p < .001), but no significant effect on treatment modification. BOLT + any level of PTC resulted in higher MBC knowledge and larger growth in MBC skill over the intervention period as compared to control. PTC dosage levels were inconsistently predictive of outcomes, providing no clear evidence for added benefit of higher PTC dosage.

CONCLUSIONS

Online training and consultation in MBC had effects on standardized and individualized assessment use among clinicians as compared to services as usual with no consistent benefit detected for increased consultation dosage. Continued research investigating optimal dosages and mechanisms of these established implementation strategies is needed to ensure training and consultation resources are deployed efficiently to impact clinician practices.

TRIAL REGISTRATION

ClinicalTrials.gov NCT05041517 . Retrospectively registered on 10 September 2021.

An exploration into suicide prevention initiatives for mental health nurses: A systematic literature review

Mental health and suicide prevention are national health priorities in Australia, with research currently focussed towards the ZERO Suicide (ZS) initiative. The aim of this review was to evaluate the impact of suicide prevention programmes, in particular the ZS prevention initiative. A systematic review using the PRISMA guidelines was conducted using six EBSCO Host databases; Academic Search Complete, Australian/New Zealand Reference Centre, CINAHL Complete, MEDLINE, APA PsycINFO, and APA Psyc Articles. The data extracted from the eligible papers were analysed using a thematic approach. The final data set consisted of fourteen (n = 14) peer-reviewed articles meeting the eligibility criteria, which included quantitative (n = 10), mixed methods (n = 2), and qualitative studies (n = 2). Results indicated variances between suicide prevention programmes with some papers examining single workshops and others assessing multimodal, organizational interventions. Five major themes were produced from this review including measuring the success of suicide prevention programmes, improvements to the delivery of suicide prevention programmes, barriers to implementing changes, cultural considerations, and further research required for suicide prevention programmes. This review concludes that further long-term research is required to evaluate the implementation and efficacy of suicide prevention programmes in health care. Cultural awareness in suicide prevention training is another area that may benefit from further research. A growing body of evidence establishes the need for multimodal and organizational approaches for suicide prevention initiatives.

Staff awareness of suicide and self-harm risk in healthcare settings: A mixed-methods systematic review

BACKGROUND

Suicide risk screening in healthcare settings plays a significant role in suicide prevention. Healthcare staff who are poorly informed about self-harm and suicide risk are less likely to identify and subsequently screen at-risk individuals. This mixed-method systematic review aimed to appraise and synthesise evidence from studies that explored and promoted healthcare staff's knowledge and awareness of suicide and self-harm risk in healthcare settings.

METHODS

Electronic databases (CINAHL, MEDLINE, APA PsycInfo, APA PsycARTICLES, Psychology and behavioural Science Collection, ERIC, and SocINDEX), the Cochrane Library, and various grey literature databases were searched for relevant studies. The level of evidence and methodological quality of the included studies were assessed.

RESULTS

Eighteen empirical studies were included. Levels of knowledge about suicide and self-harm risk varied significantly across the reviewed studies. Face-to-face group training and educational programmes, digital or online educational programmes, and an educational poster campaign were amongst the strategies used to promote awareness of suicide and self-harm risk, with the majority marginally succeeding in doing so.

LIMITATIONS

The reviewed studies were heterogeneous in terms of design, interventions, and outcome measures which made it difficult to make comparisons. The overall level of scientific evidence was classified as being relatively low. The lack of blinding and lack of a control group were amongst the limitations for experimental studies.

CONCLUSIONS

Long-term, routine face-to-face group training programmes should be established to educate healthcare staff about suicide risk across all professions and in specific patient groups.