Sustaining guideline implementation: A multisite perspective on activities, challenges and supports

Psychometric testing of the Chinese National Health Service Sustainability Model as an instrument to assess innovation in Chinese nursing settings

OBJECTIVES

To conduct psychometric testing of the Chinese version of the National Health Service Sustainability Model as an instrument to assess the sustainability of innovation in the Chinese nursing setting.

BACKGROUND

Evidence-based practice is recognized worldwide as a way to improve the quality of healthcare; however, many evidence-based practice programmes decline over time and do not sustain the benefits of their improvements. A sustainability assessment tool is used internationally but its use has not been validated in China.

DESIGN

A methodological study to test instrument validity and reliability.

METHODS

The data collection was conducted from 15 June 2022 to 31 August 2022. The internal consistency of the Chinese version of the sustainability model was measured with Cronbach's alpha. Confirmatory factor analysis was used to test the model's structural validity.

RESULTS

Four hundred eighty-three questionnaires were returned, of which 478 were valid. The short time taken to evaluate the Chinese version of the sustainability model demonstrated its efficiency and ability to adapt to a busy clinical environment. The confirmatory factor analysis showed a good fit model and supported the convergence validity of the sustainability model. The Cronbach's alpha coefficient was 0.905 for the total scale, which indicated good internal consistency.

CONCLUSIONS

The results of this study suggest that the Chinese version of the sustainability model is a valid, reliable and efficient tool for measuring the sustainability of evidence-based practices in Chinese nursing settings.

[Continuation of implementation processes in residential long-term care : Sustainability of the expert standard "Relationship management in the care of people with dementia"]

BACKGROUND

Nursing institutions are facing many challenges due to evidence-based requirements. For example, they are required to introduce new interventions such as expert standards and thus adapt routine practices to new findings; however, if new interventions are continuously implemented in the facilities their sustainability is questionable.

OBJECTIVE

The aim was to find out how sustainably the expert standard "Relationship management in the care of people with dementia" is implemented in residential long-term care institutions.

MATERIAL AND METHODS

Qualitative, guideline-based interviews were conducted with persons from residential long-term care, oriented to the procedure of the problem-centered interview. The interviewees were involved in the model implementation of the expert standard "Relationship management in the care of people with dementia"'. The data were then analyzed using qualitative content analysis.

RESULTS

The participants assessed the sustainable implementation in different ways. Some rated the sustainability of the expert standard in their institution as successful, while others see potential for improvement. According to the participants, the sustainability of continuation of implementation processes is influenced by various factors. These relate to the institution, the external context, the intervention, the implementation process, and the people involved in the implementation.

CONCLUSION

On the basis of the factors identified, key needs can be derived for nursing practice, for science and research as well as for politics and legislation, so that the sustainability of expert standards and other evidence-based interventions can be ensured and, if necessary, optimized.

Knowledge about the best practice guidelines in the nursing degree: A non-randomized post-test design

AIM

To compare knowledge of Nursing Degree students about Best Practice Guidelines when there are included as teaching content in a subject vs knowledge through having the usual internship experience without teaching specific guidelines contents.

DESIGN

Non-randomized post-test-only design with a comparison group.

METHODS

143 students of the nursing degree at the Autonomous University of Barcelona were recruited. The intervention group received a classroom training in three Best Practice Guidelines with Problem-Based Learning methodology. The comparison group only attended internship, without specific guidelines contents. Knowledge was evaluated with an ad hoc post intervention questionnaire. The information was collected between 2016 and 2018.

RESULTS

The average score of knowledge was low, 5.1 out of 10, and differs between guides. The best results were obtained by the students with internships and that had consulted the guides on some occasions. Synchronized effort and leadership in Academia and Healthcare are needed to favour evidence-based practice. The combination of the consultation of the Best Practice Guidelines in theoretical learning combined with the practice, increases the knowledge of the Best Practice Guidelines and will favour the implementation of evidence-based practice. Some students were involved in questionnaire design.

Assessing Barriers and Facilitators for Implementing Clinical Practice Guidelines in Middle Eastern and North African Region: Delphi Study

BACKGROUND

Clinical practice guidelines (CPGs) improve clinical decision making and patient outcomes, but CPG implementation is poor. The success of CPGs is influenced by several factors related to barriers and facilitators. For this reason, it can be extremely useful to explore key barriers and facilitators of CPG implementation in the Middle East and North Africa (MENA).

METHODS

A three-round Delphi study was performed using the input of 30 experts involved in the clinical practice guidelines. In the first two rounds, participants were asked to score each statement relevant to barriers or facilitators for CPG implementation on a five-point Likert scale. These statements were identified from existing systematic reviews and expert input. In round three, participants ranked the most important barriers and facilitators identified from rounds one and two. A descriptive analysis was conducted on the barrier and facilitators statements using frequencies, percentages, and medians to summarize the variables collected.

RESULTS

We identified 10 unique barriers and 13 unique facilitators to CPG implementation within the MENA region. The two highest-ranked barriers related to communications and available research and skills. The most important facilitator was the availability of training courses for healthcare professionals.

CONCLUSIONS

Key barriers and facilitators to the implementation of clinical practice guidelines seem to exist in professional, organizational, and external contexts, which should all be taken into account in order to increase implementation success within MENA region. The results of this study are useful in the design of future implementation strategies aimed at overcoming the barriers and leveraging the facilitators.

Sharing voice during deliberative engagement to improve guideline adherence in dental clinics: findings from a qualitative evaluation of an online deliberative forum discussion

OBJECTIVES

Selecting effective implementation strategies to support guideline-concordant dental care is a complex process. For this research project, an online deliberative forum brought together staff from dental clinics to discuss the strengths and weaknesses of implementation strategies and barriers to implementation of a component of a dental (pit-and-fissure) guideline. The goal was to determine whether deliberative engagement enabled participants' sharing of promotive and prohibitive voice about implementation strategies to promote guideline-concordant care.

DESIGN

Qualitative analysis of online chat transcripts of facilitated deliberations from 31 small group sessions.

SETTING

Kaiser Permanente Dental (KP Dental) in the USA.

PARTICIPANTS

All staff from 16 dental offices.

RESULTS

The directed content analysis revealed that participants shared prohibitive and promotive voice when offering critique of the barriers and the implementation strategies suggested by the researchers. The analysis also revealed that the focus of the deliberations often was not on the aspect of the pit-and-fissure guideline intended by the research team for deliberation.

CONCLUSIONS

The deliberative forum discussions were a productive venue to ask staff in dental clinics to share their perspectives on strategies to promote guideline-concordant care as well as barriers. Participants demonstrated prohibitive voice and engaged critically with the materials the research team had put together. An important limitation of the deliberation was that the discussion often centred around an aspect of the pit-and-fissure guideline that already was implemented well. To ensure a deliberation oriented towards resolving challenging aspects of the pit-and-fissure guideline, greater familiarity with the guideline would have been important, as well as more intimate knowledge of the current discrepancies in guideline-concordant care.

TRIAL REGISTRATION NUMBER

This project is registered at ClinicalTrials.gov with ID NCT04682730. The trial was first registered on 18 December 2020. https://clinicaltrials.gov/ct2/show/NCT04682730.

Translation and cross-cultural adaptation of the National Health Service Sustainability Model to the Chinese healthcare context

BACKGROUND

International attention is being paid to the issue of making evidence sustainable after implementation. Developing an identification model is essential to promote and monitor the sustainability of evidence implementation. However, this model is not available in Chinese. This study aims to translate the National Health Service Sustainability Model into Chinese and to verify whether the model is adapted to the Chinese healthcare environment.

METHODS

This study follows the translation and validation guidelines developed by Sousa and Rojjanasrirat. The translations include forward and backward translations and their comparison. Expert reviews were used to validate the content validity of the Chinese version of the National Health Service sustainability model. Cognitive interviews were used to assess the validity of the language in the Chinese setting.

RESULTS

The translation was conducted by a bilingual research team and took 12 months. Expert reviews were undertaken with eight experts, and cognitive interviews with six participants. The content validity of the model is excellent, but at least 20% of the experts still felt that items one, three, five and nine needed refinements. In the cognitive interviews, most items, instructions and response options were well understood by the participants responsible for the evidence-based practice project. However, some language issues were still identified in items one, three, four, five, seven, nine, and ten. Participants reported that the sustainability results of the model assessment were consistent with their previous judgments of the items. Based on the expert review and interview results, items one, three, four, five, seven, nine and ten require further refinement. In summary, seven of the ten items have been amended.

CONCLUSIONS

This study provides insight into how the National Health Service sustainability model can be used in the Chinese healthcare setting and paves the way for future large-scale psychometric testing.

Capitalizing Upon Graduate Student Projects to Sustain Clinical Outcomes

As part of a clinical-academic partnership, graduate nursing students initiated evidence-based quality improvement projects in a large, metropolitan, 5-time Magnet®-designated pediatric hospital to encourage continuous innovation and evidence-based practice. This article describes the evolution and strategies used by leadership and staff to sustain the projects over time. Data collected by the organization report trended outcomes, highlight themes for success from graduate nursing students from 2017 through 2020, and report the implications for nurse executives.

Aligning healthcare, public health and social services: A scoping review of the role of purpose, governance, finance and data

Organisations spanning social services, public health and healthcare have increasingly experimented with collaboration as a tool for improving population health and reducing health disparities. While there has been progress, the results have fallen short of expectations. Reflecting on these shortcomings, the Robert Wood Johnson Foundation (RWJF) recently proposed a new framework for cross-sector alignment intended to move the field towards improved outcomes. A central idea in this framework is that collaboratives will be more effective and sustainable if they develop collaborative systems in four core areas: shared purpose, governance, finance and shared data. The goal of this paper is to provide a foundation for research on the four core areas of the cross-sector alignment framework. Accordingly, this study is based on two guiding questions: (1) how are collaboratives currently implementing systems in the four core areas identified in the framework, and (2) what strategies does the literature offer for creating sustainable systems in these four areas? Given the emergent nature of research on health-oriented cross-sector collaboration and the broad research questions, we conducted a systematic scoping review including 179 relevant research papers and reports published internationally from the years 2010-2020. We identified the main contributions and coded each based on its relevance to the cross-sector alignment framework. We found that most papers focused on programme evaluations rather than theory testing, and while many strategies were offered, they tended to reflect a focus on short-term collaboration. The results also demonstrate that starting points and resource levels vary widely across individuals and organisations involved in collaborations. Accordingly, identifying and comparing distinct pathways by which different parties might pursue cross-sector alignment is an imperative for future work. More broadly, the literature is ripe with observations that could be assessed systematically to produce a firm foundation for research and practice.

Beliefs and implementation of evidence-based practice among nurses in the nursing homes of a Swiss canton: An observational cross-sectional study

Aims and objectives

Examine beliefs about EBP and its level of implementation among nurses working in nursing homes in a bilingual canton of Switzerland and explore associations between these aspects and nurses’ sociodemographic and professional characteristics.

Background

Although evidence‐based practice (EBP) is recognised as an effective strategy for improving the quality and safety of care, little is known about its use in nursing homes. Nurses’ beliefs about EBP and their implementation of it in Switzerland’s nursing homes have never been explored.

Design

An observational cross‐sectional study.

Methods

Beliefs about and implementation of EBP were evaluated using validated French‐ and German‐language versions of the EBP Beliefs Scale and the EBP Implementation Scale, developed by Melnyk and Fineout‐Overholt (Melnyk, Fineout‐Overholt, & Mays, 2008, Worldviews on Evidence‐Based Nursing, 5, 208). The STROBE checklist for cross‐sectional studies was used in reporting this study.

Results

The participation rate was 40.6% (N = 194). Most participants stated that they had some knowledge of EBP and held favourable beliefs about it. Nevertheless, 37.1% of participants found the concept complicated and 36.1% found it time‐consuming. Participants were more likely to implement stages in the EBP process linked to direct clinical practice rather than those which required scientific knowledge and skills.

Conclusion

Most participants had favourable beliefs about EBP, but the level of implementation of EBP among nurses in their daily clinical practice was sub‐optimal.

Relevance to clinical practice

A greater emphasis should be put on fostering the use of EBP among nurses working in nursing homes. This could be achieved via training and the development of individual, institutional and contextual strategies promoting the integration of EBP in clinical settings.

A National Survey Identifying the Factors Associated With Cardiovascular Care Nurses' Perceived Knowledge of International Practice Guidelines: The First Step in the Development of an Implementation Strategy

BACKGROUND

The implementation of international guidelines within everyday practice remains problematic, which can have a detrimental impact on quality of care delivered. This study aimed to ascertain the factors associated with clinical nurses' perceived knowledge of international guidelines.

METHODS

In this cross-sectional survey, nurses from 45 hospitals across Ireland were recruited. A previously validated anonymous questionnaire that assessed guideline knowledge, use, and barriers to implementation was used. Data were analyzed using SPSS 23 and logistic regression.

RESULTS

Of the 542 responses, 54% had used international guidelines relevant to their practice and 50% had consulted within the last year. Most nurses perceived that poor patient follow-up, lack of time and resources, poor clinical leadership, workload, long guidelines, and not understanding guideline detail were barriers to guideline use and implementation. Forty-five percent rated their perceived knowledge of guidelines as "low." Logistic regression identified that "high" knowledge levels were significantly associated with having read guidelines in the last year and their use with practice. In contrast, low knowledge of the guidelines was associated with perceptions that they were lengthy and not easy to use, lack of confidence to challenge colleagues when guidelines are not implemented, or not being able to influence current practice.

CONCLUSIONS

This study identified the specific knowledge needs in this cohort of mainly basic grade registered nurses, with low perceived guideline knowledge. A whole unit or team approach led by nurse champions is needed to develop and establish practice and educational strategies that would increase the availability, application, and knowledge of guidelines within everyday practice.

SAGES guidelines: an appraisal of their quality and value by SAGES members

BACKGROUND

The Society of American Gastrointestinal and Endoscopic Surgeons (SAGES) Guidelines Committee develops evidence-based guidelines for practicing surgeons using standard methodology. Our objective was to survey the SAGES membership regarding guidelines' quality, use, and value and identify topics of interest for new guideline development.

METHODS

An anonymous online survey was emailed in October 2019 to SAGES members. Respondents were asked 18 questions on their use and evaluation of SAGES guidelines and SAGES reviews and to provide suggestions for new guideline topics and areas of improvement. The survey was open for 6 weeks with a 3-week reminder.

RESULTS

Of 548 responders, most were minimally invasive (41%) or general surgeons (33%). There was an even distribution between academic (46%) and non-academic practice (24% private practice, 23% hospital employed). Most used SAGES guidelines frequently (22%) or occasionally (68%) and found them to be of value (83%), above average quality (86%), and easy to use (74%). While most stated it was important (35%) or very important (58%) that SAGES continues to follow "rigorous guidelines development processes," common suggestions were for more timely updates and improved web access. Of 442 overlapping topic suggestions, 60% fell into overarching categories of hernia, bariatric, robotic, HPB, and colorectal surgery.

CONCLUSIONS

The SAGES guidelines are used frequently and valued by its users for their quality and content. Topics proposed by SAGES members and valuable insight from this survey can guide creation of new guidelines and refinement of established guidelines and processes.

Influence of participation in a quality improvement collaborative on staff perceptions of organizational sustainability

BACKGROUND

Sustainability capacity (SC), which is an organization's ability to implement and maintain change, is influenced by internal attributes, environmental contextual influencers, and intervention attributes. Temporal changes in staff SC perceptions, as well as the influence of quality improvement collaborative (QIC) participation, has generally not been explored. This project addresses this gap, measuring staff SC perceptions at four time points (baseline and every 9 months) for clinics participating in an intervention - the Network for the Improvement of Addiction Treatment QIC initiative (called NIATx200).

METHODS

A mixed linear model repeated measures analysis was applied to matched staff members (n = 908, representing 2329 total cases) across the evaluation timeframe. Three separate statistical models assessed potential predictors of SC perceptions: Time (Models I-III); NIATx200 intervention, staff job function, and tenure (Models II &III); and NIATx200 participation hours and four organizational variables (Model III).

RESULTS

For Model I, staff perceptions of total SC increased throughout most of the study (t1,4 = - 6.74, p < .0001; t2,4 = - 3.100, p < .036; t3,4 = - 0.23, p = ns). Model II did not change Model I's overall Time effect, but combined NIATx200 services (t = - 2.23, p = .026), staff job function (t = - 3.27, p = .001), and organizational administrators (t = - 3.50, p = .001) were also significantly associated with greater perceptions of total SC. Inclusion of additional variables in Model III demonstrated the importance of a higher participation level (t = - 3.09, p < .002) and being in a free-standing clinic (t = - 2.06, p < .04) on staff perceptions of total SC.

CONCLUSION

Although staff exposure to sustainability principals was minimal in NIATx200, staff perceptions about their organization's SC significantly differed over time. However, an organization's participation level in a QIC became the principal predictor of staff SC perceptions, regardless of other factors' influence. Given these findings, it is possible to develop and introduce specific sustainability content within the structure of a QIC to assess the impact on staff SC perceptions over time and the sustainment of organizational change.

TRIAL REGISTRATION

ClinicalTrials.gov , NCT00934141 . Registered July 6, 2009. Retrospectively registered.

Development and Psychometric Testing of the Implementation Self-efficacy for EBP (ISE4EBP) Scale

There is inadequate research about nurses’ confidence in implementation strategies that foster the application and sustainability of evidence-based practice (EBP). Guided by Bandura’s self-efficacy theory, we propose that self-efficacy (confidence) in EBP implementation strategies can accelerate the uptake of evidence into practice to improve health care quality. The purpose of this study was to develop and test the psychometric properties of the Implementation Self-efficacy for EBP (ISE4EBP) scale as a measure for evaluating self-efficacy in using EBP implementation strategies. In a sample of 65 registered nurses, the 29-item ISE4EBP scale demonstrated adequate content validity (via content validity index), internal consistency reliability (Cronbach's alpha = 0.987), and construct validity indicated by associations with organizational readiness for EBP. Clinicians may use the ISE4EBP scale to identify areas for building implementation confidence to accelerate the uptake of evidence to improve quality care.

Establishing and Sustaining a Culture of Evidence-Based Practice: An Evaluation of Barriers and Facilitators to Implementing the Best Practice Spotlight Organization Program in the Australian Healthcare Context

Background: Nurses and midwives are central to the implementation and delivery of quality care through evidence-based practice (EBP). However, implementation of EBP in nursing and midwifery is under-researched with few examples of systematic and sustained change. The Registered Nurses Association of Ontario’s Best-Practice Spotlight Organization (BPSO) Program was adopted in South Australia as a framework to systematically implement EBP in two diverse and complex healthcare settings. Methods: The study was a post-implementation, mixed-method evaluation conducted at two healthcare settings in Adelaide, South Australia utilizing qualitative and quantitative data. Proctor’s implementation evaluation framework guided the evaluation design. Information sources included; interviews, focus groups, questionnaires, and document review. Results: Clinical and executive staff (n = 109 participants) from a broad range of stakeholder groups participated in the interviews, focus groups, and returned questionnaires. A number of facilitators directly affecting program implementation were identified; these pertained to embedding continuity into the program’s implementation and delivery, a robust governance structure, and executive sponsorship. Barriers to implementation were also identified. These barriers pertained to organizational or workforce challenges; staff turnover and movement (e.g., secondment), insufficient staff to allow people to attend training, and a lack of organizational commitment to the program, especially at an executive level. As a result of successful implementation, it was observed that over three years, the BPSO program positively influenced the uptake and implementation of EBP by clinicians and the organizations into which they were introduced. Conclusions: The BPSO model can be translocated to new healthcare systems and has the potential to act as a mechanism for establishing and sustaining EBP change. This study was the first to apply an implementation evaluation framework to the BPSO program, which allowed for structured analysis of facilitating or impeding factors that affected implementation success. The findings have important implications for other health systems looking to translocate the same or similar EBP programs, as well as contributing to the growing body of implementation evaluation literature.

Transformative agency and tensions in knowledge management-A qualitative interview study for nurse leaders

AIM

To describe Finnish nurse leaders' perceptions of and experiences with knowledge management.

BACKGROUND

Health science research has traditionally focused on knowledge transfer and research evidence instead of knowledge management, culture and organisational learning. Systematic reviews indicate a lack of awareness about nurse leaders' activities in knowledge management.

DESIGN

Qualitative interview study according to the consolidated criteria for reporting qualitative research (see Supporting Information Table S1).

METHODS

Data were collected at a Finnish public, social and healthcare organisation from 33 persons in 2015 and 2017 through 35 individual interviews and seven focus groups. Data were analysed by thematic analysis.

RESULTS

Nurse leaders' daily knowledge management activities included assurance of smooth work functions and decisions about sudden changes. When managing knowledge promotion, nurse leaders focused on the near future and served information providers, coaches and developers of operating culture. Anticipatory management of knowledge requirements emphasised nurse leaders' roles as assessors and visionaries. Tensions while managing knowledge were related to the following: changes in clients' service needs, insufficient structures and tools to support the assessment and joint development of competence, time and information management, the operating culture, and nurse leader support. Participants reported only few attempts to solve tensions and therefore little to no transformative agency.

CONCLUSION

Nurse leaders prioritised daily knowledge management over management of knowledge promotion and anticipatory management of knowledge requirements. Knowledge management in nursing is a complex task requiring a command of different kinds of agency and related leadership styles. The structures, processes and tools supporting knowledge management should be developed to ensure that activities are systematic.

RELEVANCE TO CLINICAL PRACTICE

A description of nurse leaders' perceptions of and experiences with knowledge management could improve recognition of nurse leaders' agencies for knowledge management, identification of related tensions and application of lessons learned from tensions. This description could also promote nurses' professional competence and supplement nurse leaders' training.

Managerial leadership for research use in nursing and allied health care professions: a systematic review

Background

Leadership by point-of-care and senior managers is increasingly recognized as critical to the acceptance and use of research evidence in practice. The purpose of this systematic review was to identify the leadership behaviours of managers that are associated with research use by clinical staff in nursing and allied health professionals.

Methods

A mixed methods systematic review was performed. Eight electronic bibliographic databases were searched. Studies examining the association between leadership behaviours and nurses and allied health professionals’ use of research were eligible for inclusion. Studies were excluded if leadership could not be clearly attributed to someone in a management position. Two reviewers independently screened abstracts, reviewed full-text articles, extracted data and performed quality assessments. Narrative synthesis was conducted.

Results

The search yielded 7019 unique titles and abstracts after duplicates were removed. Three hundred five full-text articles were reviewed, and 31 studies reported in 34 articles were included. Methods used were qualitative (n = 19), cross-sectional survey (n = 9), and mixed methods (n = 3). All studies included nurses, and six also included allied health professionals. Twelve leadership behaviours were extracted from the data for point-of-care managers and ten for senior managers. Findings indicated that managers performed a diverse range of leadership behaviours that encompassed change-oriented, relation-oriented and task-oriented behaviours. The most commonly described behavior was support for the change, which involved demonstrating conceptual and operational commitment to research-based practices.

Conclusions

This systematic review adds to the growing body of evidence that indicates that manager-staff dyads are influential in translating research evidence into action. Findings also reveal that leadership for research use involves change and task-oriented behaviours that influence the environmental milieu and the organisational infrastructure that supports clinical care. While findings explain how managers enact leadership for research use, we now require robust methodological studies to determine which behaviours are effective in enabling research use with nurses and allied health professionals for high-quality evidence-based care.

Trial registration

PROSPERO CRD42014007660

Electronic supplementary material

The online version of this article (10.1186/s13012-018-0817-7) contains supplementary material, which is available to authorized users.

A Sustainability Oriented and Mentored Approach to Implementing a Fall Prevention Guideline in Acute Care Over 2 Years

The purpose of this study was to assess the impact of a mentored guideline implementation (Registered Nurses' Association of Ontario Prevention of Falls and Falls Injuries in the Older Adult Best Practice Guideline) focused on enhancing sustainability in reducing fall rates and number of serious falls and the experience of staff in three acute care hospitals. The National Health Service (NHS) Sustainability Model was used to guide the study. Interviews and focus groups were held with 82 point-of-care professional staff, support staff, volunteers, project leaders, clinical leaders, and senior leaders. Study results supported the importance of the factors in the NHS model for sustainability of the guideline in these practice settings. There were no statistically significant decreases in the overall fall rate and number of serious falls. The results supported strategies of participating hospitals to become senior friendly organizations and provided opportunities to enhance staff collaboration with patients and families.