Proceedings from the Second Annual Conference of the Norwegian Network for Implementation Research

In 2019, Norwegian implementation researchers formed a network to promote implementation research and practice in the Norwegian context. On November 19th, 2021, the second annual Norwegian implementation conference was held in Oslo. Ninety participants from all regions of the country gathered to showcase the frontiers of Norwegian implementation research. The conference also hosted a panel discussion about critical next steps for implementation science in Norway. The conference included 17 presentations from diverse disciplines within health and welfare services, including schools. The themes presented included stakeholder engagement, implementation mechanisms, evaluations of the implementation of specific interventions, the use of implementation guidelines and frameworks, the development and validation of implementation measurements, and barriers and facilitators for implementation. The panel discussion highlighted several critical challenges with the implementation of evidence-informed practices in Norway, including limited implementation competence and capacity among practice leaders and workforces, few opportunities for education in implementation science, limited implementation research in the Norwegian context, scarce funding possibilities for implementation research, and a lack of long-term perspectives on implementation processes. Overall, the 2021 Norwegian implementation conference showed an encouraging sign of a maturing field of science in Norway. The more voluminous proceedings from the 2020 conference called for several important advancements to improve implementation science and practice in Norway, and the 2021 conference indicates that steps have already been taken in favorable directions in terms of, for instance, research designs and measurements. However, there are still unexploited potentials for improvements in implementation research, funding, policies, and practice. Norwegian implementation researcher should be mindful of the challenges and potential pitfalls implementation science currently face as a scientific discipline.

Supplementary Information

The online version contains supplementary material available at 10.1007/s43477-022-00069-w.

A stepped-wedge randomized trial investigating the effect of the Leadership and Organizational Change for Implementation (LOCI) intervention on implementation and transformational leadership, and implementation climate

BACKGROUND

This study evaluates the Leadership and Organizational Change for Implementation (LOCI) strategy and its effect on implementation leadership, transformational leadership, and implementation climate.

METHODS

A stepped wedge cluster randomized study design enrolling 47 first-level leaders from child- and adult-specialized mental health clinics within Norwegian health trusts across three cohorts. All therapists (n = 790) received training in screening of trauma exposure and posttraumatic stress, and a subgroup of therapists (n = 248) received training in evidence-based treatment methods for posttraumatic stress disorder (PTSD). First-level leaders and therapists completed surveys at baseline, 4, 8-, 12-, 16-, and 20-months assessing leadership and implementation climate. General linear mixed-effects models were used to investigate whether the LOCI strategy would lead to greater therapist-rated scores on implementation leadership, transformational leadership, and implementation climate.

RESULTS

After introducing the LOCI strategy, there was a significant increase in therapist-rated implementation and transformational leadership and implementation climate. The increase was sustained at all measurement time points compared to non-LOCI conditions, which demonstrated a steady decrease in scores before LOCI.

CONCLUSIONS

The LOCI strategy can develop better transformational and implementation leadership skills and contribute to a more positive implementation climate, which may enhance successful EBP implementation. Thus, LOCI can help leaders create an organizational context conducive for effective EBP implementation.

TRIAL REGISTRATION

Retrospectively registered: ClinicalTrials NCT03719651 , 25th of October 2018. The trial protocol can be accessed from https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6417075/ .

Validation of the Norwegian versions of the Implementation Leadership Scale (ILS) and Multifactor Leadership Questionnaire (MLQ) in a mental health care setting

Background

The implementation of evidence-based practices (EBPs) is of crucial importance in health care institutions and requires effective management from leaders. However, there is a lack of assessment tools sufficient to evaluate the degree to which the employees´ rate how well their leaders are at implementing EBPs. This emphasises the need for validated and widely used scales relevant for EBPs.

Methods

The current study evaluated the psychometric properties of the Multifactor Leadership Questionnaire (MLQ) and Implementation Leadership Scale (ILS) in a Norwegian mental health care setting.

Results

Results from confirmatory factor analyses indicate that the MLQ and ILS are valid instruments for measuring general and implementation leadership. The scales demonstrate good convergent validity. In addition, attitudes towards EBPs did not seem to be associated with the ILS and MLQ, further supporting the applicability of the instruments.

Conclusions

The two scales demonstrate good psychometric properties in a Norwegian mental health care setting, which suggests that the MLQ and ILS are valid and reliable tools for measuring leadership in an implementation setting. More research is greatly needed to disentangle the link between perceived leadership and objective measures of successful implementation of EBPs.

Trial registration NSD 690,133, NSD 60,059/3/OOS.

Measuring implementation climate: psychometric properties of the Implementation Climate Scale (ICS) in Norwegian mental health care services

BackgroundEmployees' perceptions of organizational climate for implementation of new methods are important in assessing and planning for implementation efforts. More specifically, feedback from employees' points to which implementation strategies to select, adopt, and tailor in building positive climate for implementation of new evidence-based practices within the organization. Implementation climate can be measured with the Implementation Climate Scale (ICS). The purpose of this study was to investigate the psychometric properties of the Norwegian version of the ICS in outpatient mental health clinics.MethodsThe ICS was administered to 383 clinicians within 47 different child and adult mental health clinics across the country. We conducted confirmatory factor analysis to assess the psychometric functioning of the ICS. Cronbach's alpha was examined to assess internal consistency. We also examined criterion related validity of the scale by comparing it with an alternative measure of implementation climate (concurrent validity) and by examining correlations with clinicians' intentions to use evidence-based practices.ResultsResults supported the 6-factor structure and the internal consistency reliability of the ICS. One exception was poor functioning of the Reward scale. Concurrent validity was stronger at the group than at the individual level, and assessment of associations with clinicians' intentions to use evidence- based practices showed positive correlations.ConclusionsThe Norwegian version of the ICS is a promising tool for assessing implementation climate which can provide organizations with specific feedback concerning which aspects of the implementation climate to attend to. Due to poor functioning of the Reward scale, adaptations and further testing of this is recommended.

Good soldiers in implementation: validation of the Implementation Citizenship Behavior Scale and its relation to implementation leadership and intentions to use evidence-based practices

BACKGROUND

Implementation citizenship behavior (ICB) describes extra-role behaviors performed by employees to support evidence-based practice (EBP) implementation. Such behaviors can be measured using the Implementation Citizenship Behavior Scale (ICBS), which divides ICB into two dimensions, namely helping others and keeping informed. The current study extends the use of the ICBS to a context outside the USA and adds to the literature by investigating how leader-perceived ICB relates to practitioner-perceived implementation leadership and practitioners' intentions to use EBPs.

METHODS

Participants were 42 leaders and 152 practitioners in Norwegian mental health services implementing EBPs for post-traumatic stress disorder. Leaders rated each practitioner on ICB, and each practitioner rated their leader on implementation leadership and reported on their own intentions to use EBPs. The psychometric properties of the ICBS were assessed using confirmatory factor analysis and internal consistency reliabilities. The relationships between ICB, implementation leadership and intentions to use EBPs, were investigated through a series of bivariate correlation analyses and a path analysis of the total scales.

RESULTS

The ICBS showed excellent psychometric properties. The hypothesized two-factor model provided an excellent fit to the data, and both subscales and the total scale were internally reliable. Leader-perceived ICB was positively and significantly correlated with both practitioner-perceived implementation leadership and practitioners' intentions to use EBPs. Correlations with intentions to use EBPs were stronger for the subscale of keeping informed than for the subscale of helping others.

CONCLUSIONS

Results indicated that practitioners who rated their leader higher on implementation leadership received higher ICB ratings from their leader and reported higher intentions to use EBPs. The results provide evidence of a reciprocal social exchange relationship between leaders and practitioners during EBP implementation and a link to an important proximal implementation outcome (i.e., intentions to use EBPs). Results also suggest cultural differences in how ICB is perceived and relates to other phenomena. Scientific and practical implications are discussed.

TRIAL REGISTRATION

Retrospectively registered in ClinicalTrials with ID NCT03719651 .

Testing the leadership and organizational change for implementation (LOCI) intervention in Norwegian mental health clinics: a stepped-wedge cluster randomized design study protocol

BACKGROUND

Alignment across levels of leadership within an organization is needed for successful implementation of evidence-based practice. The leadership and organizational change for implementation (LOCI) intervention is a multi-faceted multilevel implementation strategy focusing on enhancing first-level general and implementation leadership while also engaging with organization upper management to develop an organizational climate for implementation. The aim of the project is to evaluate the effectiveness of LOCI in supporting the implementation of evidence-based treatment for PTSD in child- and adult-specialized mental health clinics in health trusts in Norway.

METHODS

The study design is a stepped-wedge cluster randomized trial with enrollment of clinics in three cohorts. Executives, clinic leaders, and therapists will be asked to complete surveys assessing leadership and implementation climate. Surveys will be completed at baseline, 4, 8, 12, 16, and 20 months. Results from surveys will be shared with executives and clinic leaders to inform the subsequent creation of tailored leadership and climate development plans for enhanced implementation. Patients will complete surveys measuring traumatic events and post-traumatic stress symptoms during the therapy process. Therapy sessions will be audio or video recorded and scored for fidelity as part of training.

DISCUSSION

This study aims to provide knowledge on how to improve leadership and organizational climate to enhance effective implementation of evidence-based treatments in mental health services.

TRIAL REGISTRATION

The study has been registrated in ClinicalTrials with ID NCT03719651 .

Psychometric properties of the Norwegian version of the Evidence-Based Practice Attitude Scale (EBPAS): to measure implementation readiness

BACKGROUND

Attitudes can be a precursor to the decision of whether or not to try a new practice. In order to tailor the implementation of evidence-based practices (EBPs) in mental health settings, we must first consider practitioner attitudes towards EBP adoption. To assess these attitudes, the Evidence-Based Practice Attitude Scale (EBPAS) was developed. The purpose of this study was to investigate the psychometric properties of the Norwegian version of the EBPAS, and to examine differences in attitudes towards implementing EBPs among mental health practitioners.

METHODS

The EBPAS was translated into Norwegian and administered to 294 practitioners from seven primary and 22 specialized mental care units within a defined geographical area of Norway.

RESULTS

The EBPAS showed good psychometric properties. The less clinical experience the practitioner had, the more positive their attitude toward EBPs. Primary care practitioners reported more positive attitudes towards implementing EBPs that were required of them than specialized care practitioners.

CONCLUSIONS

The Norwegian version of the EBPAS is a promising tool for measuring implementation readiness in mental health services, and can be used in clinical practice to tailor implementation efforts.

TRIAL REGISTRATION

The study was approved by the regional committees for medical and health research ethics [ REK 2013/2035 ] on 25(th) of May, 2014.