Making change last? Exploring the value of sustainability approaches in healthcare: a scoping review

Feasibility, acceptability, and appropriability of a national whole-school program for reducing school violence and improving school coexistence

Introduction

The increase in school violence following the COVID-19 pandemic underscores the need for schools to adopt a multilevel whole-school approach. This study examines a national program designed by the Chilean Ministry of Education, in collaboration with universities, as part of the Ministry's Educational Reactivation Plan, aimed at improving school climate management across Chile.

Methods

The "Learning to Live Together Program" (LLT) was implemented across all 16 regions of Chile, focusing on establishing school climate networks, providing direct intensive university technical assistance, and enhancing professional development and training. The feasibility, acceptability, and appropriability of the LLT program were assessed through a survey distributed to 1,561 staff members from 783 schools. Participants responded to a comprehensive set of instruments measuring acceptability, appropriability, feasibility, attitudes toward implementation, fidelity, and initial perceived results.

Results

The results indicate high initial adoption rates and significant improvements in the assessed dimensions. The enhancement of school climate practices and strengthening school collaboration networks were of considerable relevance.

Discussion

These findings support the efficacy of the multilevel whole-school approach as a viable strategy for Latin American countries, providing critical data for educational and governmental decision-making. Furthermore, this study provides evidence that these outcomes may be applicable to the implementation of similar policies in different contexts and countries.

Role of coproduction in the sustainability of innovations in applied health and social care research: a scoping review

BACKGROUND

Innovations such as toolkits and frameworks are developed through applied health and social care research, to address identified gaps in quality or safety of care. The intention is to subsequently implement these innovations into practice to bring about improvements. Challenges can arise from poor choice of implementation strategies or lack of alignment to local contexts. Research has identified the importance of involving and engaging patients, health professionals and other stakeholders in the design and delivery of the underpinning research, and in informing subsequent implementation. However, how and why such coproduction influences the sustainability of innovations in health and social care is unclear.

OBJECTIVE

The objective of this scoping review is to identify and present the available evidence regarding the role of coproduction in the sustainability of innovations in applied health and social care research.

INCLUSION CRITERIA

This scoping review includes papers related to the role of coproduction in the sustainability of innovations in applied health and social care research published in peer-reviewed journals. The review is limited to articles reporting applied health and social care research conducted in the United Kingdom.

METHODS

Scopus, Web of Science, CINAHL and MEDLINE were searched for studies. Titles and abstracts were screened by two independent reviewers for assessment against the inclusion criteria, followed by a full-text review and data extraction. Data were extracted using a data extraction form developed by the reviewers. The completed forms were imported into NVivo and analysed using basic qualitative content analysis.

RESULTS

Our review provides insight into the role of coproduction in the sustainability of innovations in applied health and social care research. Our findings highlight that sustainability is a dynamic process, supported by coproduction activities such as ongoing collaborative partnerships; these can be planned for in both the research design and implementation phases of a project.

Psychometric testing of the Chinese National Health Service Sustainability Model as an instrument to assess innovation in Chinese nursing settings

OBJECTIVES

To conduct psychometric testing of the Chinese version of the National Health Service Sustainability Model as an instrument to assess the sustainability of innovation in the Chinese nursing setting.

BACKGROUND

Evidence-based practice is recognized worldwide as a way to improve the quality of healthcare; however, many evidence-based practice programmes decline over time and do not sustain the benefits of their improvements. A sustainability assessment tool is used internationally but its use has not been validated in China.

DESIGN

A methodological study to test instrument validity and reliability.

METHODS

The data collection was conducted from 15 June 2022 to 31 August 2022. The internal consistency of the Chinese version of the sustainability model was measured with Cronbach's alpha. Confirmatory factor analysis was used to test the model's structural validity.

RESULTS

Four hundred eighty-three questionnaires were returned, of which 478 were valid. The short time taken to evaluate the Chinese version of the sustainability model demonstrated its efficiency and ability to adapt to a busy clinical environment. The confirmatory factor analysis showed a good fit model and supported the convergence validity of the sustainability model. The Cronbach's alpha coefficient was 0.905 for the total scale, which indicated good internal consistency.

CONCLUSIONS

The results of this study suggest that the Chinese version of the sustainability model is a valid, reliable and efficient tool for measuring the sustainability of evidence-based practices in Chinese nursing settings.

Challenges confronting sustainability in nuclear medicine practice

BACKGROUND

Sustainability can be defined as the state in which consumption or depletion do not exceed regeneration. It can further be considered in five dimensions: environmental, economic, social, human resources, and ecological.

KEY FINDINGS

There are a number of key issues that threaten sustainability across nuclear medicine clinical and research practices, and across the five dimensions of sustainability there is a requirement for compromise between conflicting priorities. Nonetheless, the field of nuclear medicine benefits from an inherent culture of innovation and forethought which fosters adaptation in order to achieve sustainability.

CONCLUSION

The principles of sustainability are particularly challenging to navigate due to resource scarcity in nuclear medicine associated with both workforce shortages and supply disruptions. Specific challenges and adaptations are outlined for each of the five dimensions of sustainability.

IMPLICATIONS FOR PRACTICE

There are opportunities for improving sustainability of nuclear medicine practice although success is reliant on a deeper understanding of the interplay across the five dimensions of sustainability.

A pre-implementation examination of barriers and facilitators of an electronic prospective surveillance model for cancer rehabilitation: a qualitative study

BACKGROUND

An electronic Prospective Surveillance Model (ePSM) uses patient-reported outcomes to monitor symptoms along the cancer pathway for timely identification and treatment. Randomized controlled trials show that ePSMs can effectively manage treatment-related adverse effects. However, an understanding of optimal approaches for implementing these systems into routine cancer care is limited. This study aimed to identify barriers and facilitators prior to the implementation of an ePSM to inform the selection of implementation strategies.

METHODS

A qualitative study using virtual focus groups and individual interviews was conducted with cancer survivors, oncology healthcare providers, and clinic leadership across four cancer centres in Canada. The Consolidated Framework for Implementation Research (CFIR) guided the interviews and analysis of barriers and facilitators based on five domains (intervention characteristics, individual characteristics, inner setting, outer setting, and process).

RESULTS

We conducted 13 focus groups and nine individual interviews with 13 patient participants and 56 clinic staff. Of the 39 CFIR constructs, 18 were identified as relevant determinants to the implementation. The adaptability, relative advantage, and complexity of an ePSM emerged as key intervention-level factors that could influence implementation. Knowledge of the system was important at the individual level. Within the inner setting, major determinants were the potential fit of an ePSM with clinical workflows (compatibility) and the resources that could be dedicated to the implementation effort (readiness for implementation). In the outer setting, meeting the needs of patients and the availability of rehabilitation supports were key determinants. Engaging various stakeholders was critical at the process level.

CONCLUSIONS

Improving the implementation of ePSMs in routine cancer care has the potential to facilitate early identification and management of treatment-related adverse effects, thereby improving quality of life. This study provides insight into important factors that may influence the implementation of an ePSM, which can be used to select appropriate implementation strategies to address these factors.

Knowledge translation strategies to support the sustainability of evidence-based interventions in healthcare: a scoping review

BACKGROUND

Knowledge translation (KT) strategies are widely used to facilitate the implementation of EBIs into healthcare practices. However, it is unknown what and how KT strategies are used to facilitate the sustainability of EBIs in institutional healthcare settings.

OBJECTIVES

This scoping review aimed to consolidate the current evidence on (i) what and how KT strategies are being used for the sustainability of EBIs in institutional healthcare settings; (ii) the reported KT strategy outcomes (e.g., acceptability) for EBI sustainability, and (iii) the reported EBI sustainability outcomes (e.g., EBI activities or component of the intervention continue).

METHODS

We conducted a scoping review of five electronic databases. We included studies describing the use of specific KT strategies to facilitate the sustainability of EBIs (more than 1-year post-implementation). We coded KT strategies using the clustered ERIC taxonomy and AIMD framework, we coded KT strategy outcomes using Tierney et al.'s measures, and EBI sustainability outcomes using Scheirer and Dearing's and Lennox's taxonomy. We conducted descriptive numerical summaries and a narrative synthesis to analyze the results.

RESULTS

The search identified 3776 studies for review. Following the screening, 25 studies (reported in 27 papers due to two companion reports) met the final inclusion criteria. Most studies used multi-component KT strategies for EBI sustainability (n = 24). The most common ERIC KT strategy clusters were to train and educate stakeholders (n = 38) and develop stakeholder interrelationships (n = 34). Education was the most widely used KT strategy (n = 17). Many studies (n = 11) did not clearly report whether they used different or the same KT strategies between EBI implementation and sustainability. Seven studies adapted KT strategies from implementation to sustainability efforts. Only two studies reported using a new KT strategy for EBI sustainability. The most reported KT strategy outcomes were acceptability (n = 10), sustainability (n = 5); and adoption (n = 4). The most commonly measured EBI sustainability outcome was the continuation of EBI activities or components (n = 23), followed by continued benefits for patients, staff, and stakeholders (n = 22).

CONCLUSIONS

Our review provides insight into a conceptual problem where initial EBI implementation and sustainability are considered as two discrete time periods. Our findings show we need to consider EBI implementation and sustainability as a continuum and design and select KT strategies with this in mind. Our review has emphasized areas that require further research (e.g., KT strategy adaptation for EBI sustainability). To advance understanding of how to employ KT strategies for EBI sustainability, we recommend clearly reporting the dose, frequency, adaptations, fidelity, and cost of KT strategies. Advancing our understanding in this area would facilitate better design, selection, tailored, and adapted use of KT strategies for EBI sustainability, thereby contributing to improved patient, provider, and health system outcomes.

Sustainable quality management in hospitals: The experiences of healthcare quality managers

BACKGROUND

Quality management systems are essential in hospitals, but evidence shows a real literature gap on the sustainable implementation of quality.

PURPOSE

This study aimed to explore and identify enablers towards sustainable quality management in hospitals. Research design and Study Sample: Interviews were conducted with 23 healthcare quality managers from 20 hospitals. Data collection and/or Analysis: Data collection and analysis were conducted simultaneously by using the Qualitative Analysis Guide of Leuven and following the COREQ Guidelines. Thematic analysis from interview transcripts was performed in NVivo 12.

RESULTS

The results reveal two categories: (1) quality in the organisation's DNA and (2) quality in the professional's DNA. The first category consists of: bottom-up and top-down management, the organisation-wide integration of quality and an organisational culture shift. The second one consists of: quality awareness, understanding the added value, the encouragement and engagement, the accountability and ownership for quality. Moving towards sustainable quality management systems in hospitals requires a good interaction between a bottom-up approach and leadership to ensure continuous support from healthcare stakeholders.

CONCLUSIONS

This study contributes to existing conceptual and theoretical foundations with practical insights into sustainable quality management. The findings can guide quality departments and hospital management to regain professionals' commitment to quality and to establish a sustainable quality management system.

Cognitive behavioural therapy (CBT) with and without exercise to reduce fear of falling in older people living in the community

BACKGROUND

Fear of falling (FoF) is a lasting concern about falling that leads to an individual avoiding activities that he/she remains capable of performing. It is a common condition amongst older adults and may occur independently of previous falls. Cognitive behavioural therapy (CBT), a talking therapy that helps change dysfunctional thoughts and behaviour, with and without exercise, may reduce FoF, for example, by reducing catastrophic thoughts related to falls, and modifying dysfunctional behaviour.

OBJECTIVES

To assess the benefits and harms of CBT for reducing FoF in older people living in the community, and to assess the effects of interventions where CBT is used in combination with exercise.

SEARCH METHODS

We searched the Cochrane Central Register of Controlled Trials (CENTRAL, Issue 1, 2023), MEDLINE Ovid (from 1946 to 11 January 2023), Embase Ovid (from 1980 to 11 January 2023), CINAHL Plus (Cumulative Index to Nursing and Allied Health Literature) (from 1982 to 11 January 2023), PsycINFO (from 1967 to 11 January 2023), and AMED (Allied and Complementary Medicine from 1985 to 11 January 2023). We handsearched reference lists and consulted experts for identifying additional studies.

SELECTION CRITERIA

This review included randomised controlled trials (RCTs), quasi-RCTs, and cluster-RCTs assessing CBT with and without exercise interventions compared to control groups with sham-treatment, or treatment as usual. We defined CBT as a collaborative, time-limited, goal-oriented, and structured form of speaking therapy. Included studies recruited community-dwelling older adults, with a mean population age of at least 60 years minus one standard deviation, and not defined by a specific medical condition.

DATA COLLECTION AND ANALYSIS

Two review authors used standard methodological procedures expected by Cochrane. For continuous data, as assessed by single- or multiple-item questionnaires, we report the mean difference (MD) with 95% confidence interval (CI) when studies used the same outcome measures, and standardised mean difference (SMD) when studies used different measures for the same clinical outcome. For dichotomous outcomes, we reported the treatment effects as risk ratios (RR) with 95% CIs. We measured the primary outcome, FoF, immediately, up to, and more than six months after the intervention. We analysed secondary outcomes of activity avoidance, occurrence of falls, depression, and quality of life when measured immediately after the intervention. We assessed risk of bias for each included study, using the GRADE approach to assess the certainty of evidence.

MAIN RESULTS

We selected 12 studies for this review, with 11 studies included for quantitative synthesis. One study could not be included due to missing information. Of the 11 individual studies, two studies provided two comparisons, which resulted in 13 comparisons. Eight studies were RCTs, and four studies were cluster-RCTs. Two studies had multiple arms (CBT only and CBT with exercise) that fulfilled the inclusion criteria. The primary aim of 10 studies was to reduce FoF. The 11 included studies for quantitative synthesis involved 2357 participants, with mean ages between 73 and 83 years. Study total sample sizes varied from 42 to 540 participants. Of the 13 comparisons, three investigated CBT-only interventions while 10 investigated CBT with exercise. Intervention duration varied between six and 156 hours, at a frequency between three times a week and monthly over an eight- to 48-week period. Most interventions were delivered in groups of between five and 10 participants, and, in one study, up to 25 participants. Included studies had considerable heterogeneity, used different questionnaires, and had high risks of bias. CBT interventions with and without exercise probably improve FoF immediately after the intervention (SMD -0.23, 95% CI -0.36 to -0.11; 11 studies, 2357 participants; moderate-certainty evidence). The sensitivity analyses did not change the intervention effect significantly. Effects of CBT with or without exercise on FoF may be sustained up to six months after the intervention (SMD -0.24, 95% CI -0.41 to -0.07; 8 studies, 1784 participants; very low-certainty evidence). CBT with or without exercise interventions for FoF probably sustains improvements beyond six months (SMD -0.28, 95% CI -0.40 to -0.15; 5 studies, 1185 participants; moderate-certainty of evidence). CBT interventions for reducing FoF may reduce activity avoidance (MD -2.57, 95% CI -4.67 to -0.47; 1 study, 312 participants; low-certainty evidence), and level of depression (SMD -0.41, 95% CI -0.60 to -0.21; 2 studies, 404 participants; low-certainty evidence). We are uncertain whether CBT interventions reduce the occurrence of falls (RR 0.96, 95% CI 0.66 to 1.39; 5 studies, 1119 participants; very low-certainty evidence). All studies had a serious risk of bias, due to performance bias, and at least an unclear risk of detection bias, as participants and assessors could not be blinded due to the nature of the intervention. Downgrading of certainty of evidence also occurred due to heterogeneity between studies, and imprecision, owing to limited sample size of some studies. There was no reporting bias suspected for any article. No studies reported adverse effects due to their interventions.

AUTHORS' CONCLUSIONS

CBT with and without exercise interventions probably reduces FoF in older people living in the community immediately after the intervention (moderate-certainty evidence). The improvements may be sustained during the period up to six months after intervention (low-certainty evidence), and probably are sustained beyond six months (moderate-certainty evidence). Further studies are needed to improve the certainty of evidence for sustainability of FoF effects up to six months. Of the secondary outcomes, we are uncertain whether CBT interventions for FoF reduce the occurrence of falls (very low-certainty evidence). However, CBT interventions for reducing FoF may reduce the level of activity avoidance, and may reduce depression (low-certainty evidence). No studies reported adverse effects. Future studies could investigate different populations (e.g. nursing home residents or people with comorbidities), intervention characteristics (e.g. duration), or comparisons (e.g. CBT versus exercise), investigate adverse effects of the interventions, and add outcomes (e.g. gait analysis). Future systematic reviews could search specifically for secondary outcomes.

Systematic review of health literacy champions: who, what and how?

Health literacy is an important aspect of equitable, safe, and high-quality care. For organizations implementing health literacy initiatives, using 'change champions' appears to be a promising strategy. This systematic review aimed to identify the empirical and conceptual research that exists about health literacy champions. We conducted the systematic literature search using MEDLINE, Embase, CINAHL, Scopus, and PubMed, with additional studies identified by searching references and citations of included studies and reviews of organizational health literacy. Seventeen articles were included in the final review (case studies, n = 9; qualitative research, n = 4; quasi-experimental, n = 2; opinion articles without case studies, n = 2). Using JBI critical appraisal tools, most articles had a high risk of bias. Often champions were not the focus of the article. Champions included staff across frontline, management, and executive levels. Only five studies described training for champions. Key champion activities related to either (i) increasing organizational awareness and commitment to health literacy, or (ii) influencing organizational strategic and operational planning. The most common output was ensuring that the organization's health information materials met health literacy guidelines. Articles recommended engaging multiple champions at varying levels within the organization, including the executive level. Limited funding and resources were key barriers. Two of four articles reported positive impacts of champions on implementation of health literacy initiatives. Overall, few of the articles described health literacy champions in adequate detail. More comprehensive reporting on this implementation strategy and further experimental and process evaluation research are needed to progress this area of research. This systematic review was registered with PROSPERO (CRD42022348816).

Supporting Sustained STAR-VA Implementation: Evaluation of a Sustainment Coaching Program

OBJECTIVES

The Veterans Health Administration (VA) STAR-VA program is a person-centered, interdisciplinary intervention for managing distress behaviors in dementia in VA nursing homes, called Community Living Centers (CLCs). Teams often struggle to sustain STAR-VA after site-lead partner turnover. The STAR-VA Sustainment Coaching Program was developed to support a new local STAR-VA behavioral coordinator and/or nurse champion (ie, site-leads) and engage the team to implement sustainment strategies. The aims of this evaluation were to document sustainment needs, barriers and facilitators, and effective strategies used during a sustainment intervention.

DESIGN

We describe qualitative and quantitative findings of a program evaluation of the STAR-VA Sustainment Coaching pilot program.

SETTING AND PARTICIPANTS

Eight CLC teams participated in the pilot program, 5 training a new nurse champion, 2 a new behavioral coordinator, and 1 both new site-leads.

METHODS

CLC teams completed a needs assessment, developed sustainment goals and plans, tracked sustainment interventions implemented, and reported case outcomes. Outcome assessment and tracking reports were summarized and themes identified using a qualitative inductive approach.

RESULTS

Common sustainment needs were to train a new nurse champion, promote staff understanding of dementia and distress behaviors, and promote a culture of person-centered dementia care. Most sites selected sustainment goals of implementing training procedures and behavioral rounds. Sustainment barriers included limited staff time, staff turnover, lack of supportive routines and tools, and limited awareness of STAR-VA. Facilitators included leadership support, staff interest, and training resources. Most sites reported successful implementation of STAR-VA behavior rounds, whereas strategies to achieve training-related goals had variable success.

CONCLUSIONS AND IMPLICATIONS

The STAR-VA Sustainment Coaching Program helped CLC teams identify and implement strategies to support sustained STAR-VA implementation. The results of this project are informing ongoing efforts to integrate STAR-VA components into usual care processes for CLC residents with dementia.

Unpacking the 'process of sustaining'-identifying threats to sustainability and the strategies used to address them: a longitudinal multiple case study

BACKGROUND

Although sustainability remains a recognised challenge for Quality Improvement (QI) initiatives, most available research continues to investigate sustainability at the end of implementation. As a result, the learning and continuous adjustments that shape sustainability outcomes are lost. With little understanding of the actions and processes that influence sustainability within QI initiatives, there is limited practical guidance and direction on how to enhance the sustainability of QI initiatives. This study aims to unpack the 'process of sustaining', by exploring threats to sustainability encountered throughout the implementation of QI Initiatives and identifying strategies used by QI teams to address these threats over time.

METHODS

A longitudinal multiple case study design was employed to follow 4 QI initiatives over a 3-year period. A standardised sustainability tool was used quarterly to collect perceptions of sustainability threats and actions throughout implementation. Interviews (n=38), observations (32.5 h), documentary analysis, and a focus group (n=10) were conducted to enable a greater understanding of how the process of sustaining is supported in practice. Data were analysed using the Consolidated Framework for Sustainability (CFS) to conduct thematic analysis.

RESULTS

Analysis identified five common threats to sustainability: workforce stability, improvement timelines, organisational priorities, capacity for improvement, and stakeholder support. Each of these threats impacted multiple sustainability constructs demonstrating the complexity of the issues encountered. In response to threats, 12 strategies to support the process of sustaining were identified under three themes: engagement (five strategies that promoted the development of relationships), integration (three strategies that supported initiatives to become embedded within local systems), and adaptation (four strategies that enhanced understanding of, and response to, emergent conditions and contextual needs).

CONCLUSIONS

Sustaining improvements from QI initiatives requires continuous investment in relationships, resilience to integrate improvements in local systems, and flexibility to understand emergent conditions. Findings provide practitioners, funders, and researchers with a better understanding of, and preparation for, the threats associated with sustaining improvements from QI initiatives and offer insight into specific actions that can be taken to mitigate these risks. This learning can be used to inform future initiative design and support, to optimise the sustainability of healthcare improvements.

TRIAL REGISTRATION

Not applicable.

Translation and cross-cultural adaptation of the National Health Service Sustainability Model to the Chinese healthcare context

BACKGROUND

International attention is being paid to the issue of making evidence sustainable after implementation. Developing an identification model is essential to promote and monitor the sustainability of evidence implementation. However, this model is not available in Chinese. This study aims to translate the National Health Service Sustainability Model into Chinese and to verify whether the model is adapted to the Chinese healthcare environment.

METHODS

This study follows the translation and validation guidelines developed by Sousa and Rojjanasrirat. The translations include forward and backward translations and their comparison. Expert reviews were used to validate the content validity of the Chinese version of the National Health Service sustainability model. Cognitive interviews were used to assess the validity of the language in the Chinese setting.

RESULTS

The translation was conducted by a bilingual research team and took 12 months. Expert reviews were undertaken with eight experts, and cognitive interviews with six participants. The content validity of the model is excellent, but at least 20% of the experts still felt that items one, three, five and nine needed refinements. In the cognitive interviews, most items, instructions and response options were well understood by the participants responsible for the evidence-based practice project. However, some language issues were still identified in items one, three, four, five, seven, nine, and ten. Participants reported that the sustainability results of the model assessment were consistent with their previous judgments of the items. Based on the expert review and interview results, items one, three, four, five, seven, nine and ten require further refinement. In summary, seven of the ten items have been amended.

CONCLUSIONS

This study provides insight into how the National Health Service sustainability model can be used in the Chinese healthcare setting and paves the way for future large-scale psychometric testing.

Cyclic workflow to improve implementation of learning points from morbidity and mortality meetings

BACKGROUND

Morbidity and mortality meetings (M&MMs) are organized in most hospital departments with an educational purpose to learn from adverse events (AEs) to improve patient care. M&MMs often lack effectiveness due to unsuccessful systematic follow-up of areas of improvement. This can have an effect on improving patient safety and care. Therefore, a new strategy that focuses on implementing areas of improvement into daily practice is necessary. The study aim is to see if we could improve the implementation of meeting outcomes from the M&MM by using a cyclic workflow, and which factors are important to achieve its implementation.

METHODS

This prospective study took place at the department of gynecologic oncology of a university hospital. Research was conducted with a participatory action research (PAR) approach using 10 consecutive M&MMs in 2019 and 2020. The cyclical workflow consisted of an action list based on the PDCA-cycle, a check of the implementation of areas for improvement at the next M&MM and regular monitoring of tasks. Each M&MM was observed and each professional with an assigned task was interviewed and gave their informed consent. Thematic content analysis was performed with the program Atlas.ti 8.4.20.

RESULTS

Out of the 39 tasks that resulted from 10 M&MMs, 37 (94.8%) followed all the steps in the PDCA-cycle and were implemented. In total, 16 interviews were conducted with consultants, nurses, registrars and residents. Five main factors were important to achieve follow-up of areas for improvement: organizational culture, motivation, commitment, communication to mobilize employees and skills. Repetition of the cyclic workflow at the M&MM and an external person who reminded professionals of their assigned task(s) was important to change habits and motivate professionals.

CONCLUSION

Cyclical tools can support the implementation of areas for improvement to optimize the M&MM. A M&MM with an organizational culture where attendees can discuss openly and freely may motivate attendees to take on tasks successfully. A positive stimulant to reach commitment of professionals is team participation. Integrating new habits of reflection may lead to a deeper level of learning from the PDCA-cycle and of the M&MM. Creating a learning environment outside of the M&MM may support professionals to take on actions and engage in improvement practices. Future research may focus on including a comparative analysis to show a success rate of the implementation of learning points from the M&MM more clearly.

Identifying existing approaches used to evaluate the sustainability of evidence-based interventions in healthcare: an integrative review

BACKGROUND

There is limited evidence to evaluate the sustainability of evidence-based interventions (EBIs) for healthcare improvement. Through an integrative review, we aimed to identify approaches to evaluate the sustainability of evidence-based interventions (EBIs) and sustainability outcomes.

METHODS

Following Whittemore and Knafl's methodological process: (1) problem identification; (2) literature search; (3) data evaluation; (4) data analysis; and (5) presentation, a comprehensive search strategy was applied across five databases. Included studies were not restricted by research design; and had to evaluate the sustainability of an EBI in a healthcare context. We assessed the methodological quality of studies using the Mixed Methods Appraisal Tool.

RESULTS

Of 18,783 articles retrieved, 64 fit the inclusion criteria. Qualitative designs were most commonly used for evaluation (48%), with individual interviews as the predominant data collection method. Timing of data collection varied widely with post-intervention data collection most frequent (89%). Of the 64 studies, 44% used a framework, 26% used a model, 11% used a tool, 5% used an instrument, and 14% used theory as their primary approach to evaluate sustainability. Most studies (77%) did not measure sustainability outcomes, rather these studies focused on sustainability determinants.

DISCUSSION

It is unclear which approach/approaches are most effective for evaluating sustainability and what measures and outcomes are most commonly used. There is a disconnect between evaluating the factors that may shape sustainability and the outcomes approaches employed to measure sustainability. Our review offers methodological recommendations for sustainability evaluation research and highlights the importance in understanding mechanisms of sustainability to advance the field.

Promoters and inhibitors for quality improvement work in general practice: a qualitative analysis of 2715 free-text replies

BACKGROUND

Continuous quality improvement (QI) is necessary to develop and maintain high quality general practice services. General Practitioners (GPs') motivation is an important factor in the success of QI initiatives. We aimed to identify factors that impair or promote GPs' motivation for and participation in QI projects.

MATERIAL AND METHODS

We analysed 2715 free-text survey replies from 2208 GPs participating in the QI intervention 'Correct Antibiotic Use in the Municipalities'. GPs received reports detailing their individual antibiotic prescriptions for a defined period, including a comparison with a corresponding previous period. The content was discussed in peer group meetings. Each GP individually answered work-sheets on three separate time-points, including free-text questions regarding their experiences with the intervention. Data were analysed using inductive thematic analysis.

RESULTS

We identified three overarching themes in the GPs' thoughts on inhibitors and promoters of QI work: (1) the desire to be a better doctor, (2) structural and organisational factors as both promoters and inhibitors and (3) properties related to different QI measures. The provision of individual prescription data was generally very well received. The participants stressed the importance of a safe peer group, like the Continuous Medical Education group, for discussions, and also underlined the motivating effect of working together with their practice as a whole. Lack of time was essential in GPs' motivation for QI work. QI tools should be easily available and directly relevant in clinical work.

CONCLUSION

The desire to be good doctor is a strong motivator for improvement, but the framework for general practice must allow for QI initiatives. QI tools must be easily obtainable and relevant for practice. Better tools for obtaining clinical data for individual GPs are needed.

Total Quality and Innovation Management in Healthcare (TQIM-H) for an Effective Innovation Development: A Conceptual Framework and Exploratory Study

To thrive, an organization must adapt to the fast and constant change in the economic environment caused by an aging society, technological changes, and the pandemic crisis. Innovation becomes important for the adaptation of industries. Healthcare is one of them. Innovation development in hospitals is effective and acceptable when its management is effective and aligns with the healthcare quality context since quality is a philosophy of work in life-related settings. To the best of our knowledge, quality management and innovation management in healthcare have never been integrated. Therefore, this research aimed to create an integrated framework of quality and innovation management in healthcare (TQIM-H). To establish the effectiveness of applying TQIM-H for the development of effective healthcare innovation, this study developed a TQIM-H conceptual framework using multiple methodologies including a literature review, multiple case studies analysis, Delphi study with healthcare experts, Technology Acceptance Model (TAM), and triangulation with an external dataset. We constructed a TQIM-H conceptual framework, consisting of seven dimensions, that can be used in developing innovation projects in hospitals and which agrees with safety and quality principles in hospitals.

Maintaining Implementation through Dynamic Adaptations (MIDAS): protocol for a cluster-randomized trial of implementation strategies to optimize and sustain use of evidence-based practices in Veteran Health Administration (VHA) patients

Background

The adoption and sustainment of evidence-based practices (EBPs) is a challenge within many healthcare systems, especially in settings that have already strived but failed to achieve longer-term goals. The Veterans Affairs (VA) Maintaining Implementation through Dynamic Adaptations (MIDAS) Quality Enhancement Research Initiative (QUERI) program was funded as a series of trials to test multi-component implementation strategies to sustain optimal use of three EBPs: (1) a deprescribing approach intended to reduce potentially inappropriate polypharmacy; (2) appropriate dosing and drug selection of direct oral anticoagulants (DOACs); and (3) use of cognitive behavioral therapy as first-line treatment for insomnia before pharmacologic treatment. We describe the design and methods for a harmonized series of cluster-randomized control trials comparing two implementation strategies.

Methods

For each trial, we will recruit 8–12 clinics (24–36 total). All will have access to relevant clinical data to identify patients who may benefit from the target EBP at that clinic and provider. For each trial, clinics will be randomized to one of two implementation strategies to improve the use of the EBPs: (1) individual-level academic detailing (AD) or (2) AD plus the team-based Learn. Engage. Act. Process. (LEAP) quality improvement (QI) learning program. The primary outcomes will be operationalized across the three trials as a patient-level dichotomous response (yes/no) indicating patients with potentially inappropriate medications (PIMs) among those who may benefit from the EBP. This outcome will be computed using month-by-month administrative data. Primary comparison between the two implementation strategies will be analyzed using generalized estimating equations (GEE) with clinic-level monthly (13 to 36 months) percent of PIMs as the dependent variable. Primary comparative endpoint will be at 18 months post-baseline. Each trial will also be analyzed independently.

Discussion

MIDAS QUERI trials will focus on fostering sustained use of EBPs that previously had targeted but incomplete implementation. Our implementation approaches are designed to engage frontline clinicians in a dynamic optimization process that integrates the use of actional clinical data and making incremental changes, designed to be feasible within busy clinical settings.

Trial registration

ClinicalTrials.gov: NCT05065502. Registered October 4, 2021—retrospectively registered.

Supplementary Information

The online version contains supplementary material available at 10.1186/s43058-022-00297-z.

Digital interventions for subjective and objective social isolation among individuals with mental health conditions: a scoping review

BACKGROUND

Social isolation encompasses subjective and objective concepts. Both are associated with negative health consequences and are more prevalent among people with mental health problems than among the general population. To alleviate social isolation, digital interventions have potential as accessible alternatives or adjuncts to face-to-face interventions. This scoping review aimed to describe the types of digital interventions evaluated for feasibility, acceptability and effectiveness in alleviating social isolation among individuals with mental health problems, and to present an overview of the quantitative evidence yielded to inform future intervention design.

METHODS

We searched five electronic databases for quantitative and mixed methods studies published between January 2000 and July 2020. Studies were included if they evaluated digital interventions for individuals with mental health conditions, had subjective and/or objective social isolation as their primary outcome, or as one of their outcomes if no primary outcome was specified. Feasibility studies were included if feasibility outcomes were the primary outcomes and social isolation was among their secondary outcomes. A narrative synthesis was conducted to present our findings. The protocol was registered on Open Science Framework (doi: https://doi.org/10.17605/OSF.IO/CNX8A ).

RESULTS

Thirty-two studies were included for our review: 16 feasibility studies, seven single-group studies and nine effectiveness trials. There was great variation in the interventions, study designs and sample populations. Interventions included web-based programmes, phone-based programmes, blended interventions, socially assistive robots and virtual reality interventions. Many were feasibility studies, or otherwise not fully powered to detect an effect if one were present, thus preventing clear conclusions about clinical effectiveness. Satisfactory feasibility outcomes indicated potential for future trials to assess these interventions.

CONCLUSION

Our scoping review identified a range of digital approaches utilized to alleviate social isolation among individuals with mental health disorders. Conclusions regarding clinical effectiveness cannot be reached due to variability of approaches and lack of large-scale randomized controlled trials. To make clear recommendations for digital social isolation interventions, future research needs to be based on rigorous methods and larger samples. Future studies should also focus on utilizing theory-driven approaches and improving existing approaches to advance the field.

Iowa Implementation for Sustainability Framework

Background

An application-oriented implementation framework designed for clinicians and based on the Diffusion of Innovations theory included 81 implementation strategies with suggested timing for use within four implementation phases. The purpose of this research was to evaluate and strengthen the framework for clinician use and propose its usefulness in implementation research.

Methods

A multi-step, iterative approach guided framework revisions. Individuals requesting the use of the framework over the previous 7 years were sent an electronic questionnaire. Evaluation captured framework usability, generalizability, accuracy, and implementation phases for each strategy. Next, nurse leaders who use the framework pile sorted strategies for cultural domain analysis. Last, a panel of five EBP/implementation experts used these data and built consensus to strengthen the framework.

Results

Participants (n = 127/1578; 8% response) were predominately nurses (94%), highly educated (94% Master’s or higher), and from across healthcare (52% hospital/system, 31% academia, and 7% community) in the USA (84%). Most (96%) reported at least some experience using the framework and 88% would use the framework again. A 4-point scale (1 = not/disagree to 4 = very/agree) was used. The framework was deemed useful (92%, rating 3–4), easy to use (72%), intuitive (67%), generalizable (100%), flexible and adaptive (100%), with accurate phases (96%), and accurate targets (100%). Participants (n = 51) identified implementation strategy timing within four phases (Cochran’s Q); 54 of 81 strategies (66.7%, p < 0.05) were significantly linked to a specific phase; of these, 30 (55.6%) matched the original framework. Next, nurse leaders (n = 23) completed a pile sorting activity. Anthropac software was used to analyze the data and visualize it as a domain map and hierarchical clusters with 10 domains. Lastly, experts used these data and implementation science to refine and specify each of the 75 strategies, identifying phase, domain, actors, and function. Strategy usability, timing, and groupings were used to refine the framework.

Conclusion

The Iowa Implementation for Sustainability Framework offers a typology to guide implementation for evidence-based healthcare. This study specifies 75 implementation strategies within four phases and 10 domains and begins to validate the framework. Standard use of strategy names is foundational to compare and understand when implementation strategies are effective, in what dose, for which topics, by whom, and in what context.

Supplementary Information

The online version contains supplementary material available at 10.1186/s13012-021-01157-5.

Contextual factors and mechanisms that influence sustainability: a realist evaluation of two scaled, multi-component interventions

Background

In 2012, Alberta Health Services created Strategic Clinical Networks^TM (SCNs) to develop and implement evidence-informed, clinician-led and team-delivered health system improvement in Alberta, Canada. SCNs have had several provincial successes in improving health outcomes. Little research has been done on the sustainability of these evidence-based implementation efforts.

Methods

We conducted a qualitative realist evaluation using a case study approach to identify and explain the contextual factors and mechanisms perceived to influence the sustainability of two provincial SCN evidence-based interventions, a delirium intervention for Critical Care and an Appropriate Use of Antipsychotics (AUA) intervention for Senior’s Health. The context (C) + mechanism (M) = outcome (O) configurations (CMOcs) heuristic guided our research.

Results

We conducted thirty realist interviews in two cases and found four important strategies that facilitated sustainability: Learning collaboratives, audit & feedback, the informal leadership role, and patient stories. These strategies triggered certain mechanisms such as sense-making, understanding value and impact of the intervention, empowerment, and motivation that increased the likelihood of sustainability. For example, informal leaders were often hands-on and influential to front-line staff. Learning collaboratives broke down professional and organizational silos and encouraged collective sharing and learning, motivating participants to continue with the intervention. Continual audit-feedback interventions motivated participants to want to perform and improve on a long-term basis, increasing the likelihood of sustainability of the two multi-component interventions. Patient stories demonstrated the interventions’ impact on patient outcomes, motivating staff to want to continue doing the intervention, and increasing the likelihood of its sustainability.

Conclusions

This research contributes to the field of implementation science, providing evidence on key strategies for sustainability and the underlying causal mechanisms of these strategies that increases the likelihood of sustainability. Identifying causal mechanisms provides evidence on the processes by which implementation strategies operate and lead to sustainability. Future work is needed to evaluate the impact of informal leadership, learning collaboratives, audit-feedback, and patient stories as strategies for sustainability, to generate better guidance on planning sustainable improvements with long term impact.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12913-021-07214-5.

Adaptation, Student Participation and Gradual Withdrawal by Researchers as Sustainability Strategies in the High School-Based Young and Active Intervention: School Coordinators' Perspectives

Ensuring the sustainability of school-based public health intervention activities remains a challenge. The Young and Active (Y&A) intervention used peer-led workshops to promote movement and strengthen students' sense of community in 16 Danish high schools. Peer mentors inspired first-year students to implement movement activities. To support sustainability, we applied a three-year stepwise implementation strategy using university students as peer mentors in year 1 and senior high school students in the following two years. This study explores the sustainability potential of Y&A, focusing on school coordinators' reflections on the intervention's fit to their schools and the student-driven approach, and we assess the three-step implementation strategy. The study is based on telephone interviews with coordinators (n = 7) from schools that participated in all three years and participant observations of four workshops (a total of approximately 250 participating students). Results were generated through an abductive analysis. Seven schools continued the intervention throughout the three years and adapted it to fit their priorities. The student-driven approach was perceived to be valuable, but few student-driven activities were initiated. Teacher support seemed crucial to support students in starting up activities and acting as peer mentors in workshops. The three-step implementation strategy proved valuable due to the peer-approach and the possibility of gradual adaptation. In future similar initiatives, it is important to address how the adequate staff support of students can be facilitated.

What risks to sustainability are identified throughout care bundle implementation and how can they be addressed? A mixed methods case study

OBJECTIVES

Despite national guidance on how to identify and treat heart failure (HF), variation in HF care persists across UK hospitals. Care bundles have been proposed as a mechanism to deliver reliable optimal care for patients; however, specific challenges to sustain care bundles in practice have been highlighted. With few studies providing insight into how to design or implement care bundles to optimise sustainability, there is little direction for practitioners seeking to ensure long-term impact of their initiatives. This study explores the sustainability risks encountered throughout the implementation of a HF care bundle (HFCB) and describes how these challenges were addressed by a multidisciplinary team (MDT) to enhance sustainability over time.

DESIGN

A longitudinal mixed method case study examined the HFCB improvement initiative from September 2015 to August 2018. A standardised sustainability tool was used to collect perceptions of sustainability risks and actions throughout the initiative. Observations, key-informant interviews and documentary analysis were conducted to gain in-depth understanding of how the MDT influenced sustainability through specific actions. A qualitative database was developed using a consolidated sustainability framework to conduct thematic analysis. Sustainability outcomes were explored 1-year post funding to ascertain progress towards sustainment.

RESULTS

The MDT identified six sustainability challenges for the HFCB: infrastructure limitations, coding reliability, delivery consistency, organisational fit, resource stability and demonstrating impact. The MDT undertook multiple actions to enhance sustainability, including: (1) developing a business case to address infrastructure limitations; (2) incorporating staff feedback to increase bundle usability; (3) establishing consistent training; (4) increasing reliability of baseline data; (5) embedding monitoring and communication; and (6) integrating the bundle into current practices.

CONCLUSION

Through the description of challenges, actions and learning from the MDT, this study provides practical lessons for practitioners and researchers seeking to embed and sustain care bundles in practice.

Towards a paradigm shift in pediatric rehabilitation: Accelerating the uptake of evidence on participation into routine clinical practice

PURPOSE

Evidence for the importance of focusing on participation to promote health and wellbeing in childhood-onset disability exists, but practice is slow to change. This paper provides a knowledge translation roadmap to accelerate uptake of participation evidence into day-to-day practice.

MATERIALS AND METHODS

A structured roadmap to guide knowledge translation initiatives for implementing participation-based practices in co-creation with service users was developed based on elements from: the Five-factorframework for predicting implementation outcomes, the Cultural Cone framework, and the Knowledge-to-Action model.

RESULTS

Guiding principles paired with examples of multi-component knowledge implementation strategies to facilitate readiness for change by stakeholders at the micro (e.g., client/family, service providers), meso (e.g., administrators within organisations such as rehabilitation centres, hospitals, schools) and macro (e.g., local and governmental policy, regulatory bodies) levels are introduced. Solution-based strategies are provided to facilitate "readiness to change" for each stakeholder group. The strategies are examples for successful implementation of evidence-based interventions/approaches that can be contextualized across settings.

CONCLUSIONS

The knowledge translation roadmap can assist children and families, service providers, administrators, and policymakers to bridge existing knowledge-to-practice gaps surrounding participation. Partnering and collaborating through a "family-clinician-manager-community leader-policymaker" synergy is key for achieving strategic practice change focussed on participation.Implications for RehabilitationSound evidence surrounding the topic of participation, including effective assessments and interventions, is available and ready for use.Shifting towards participation-focused practices for children and youth with disabilities requires a systemic multi-level KT approach.Our Participation-KT roadmap, comprised of a framework and a list of principles and strategies for implementation, can be used to guide all stakeholders to foster a shift in practice.Forming partnerships and working collaboratively with all stakeholders is key for successful implementation.

Trialists perspectives on sustaining, spreading, and scaling-up of quality improvement interventions

BACKGROUND

Quality improvement (QI) evaluations rarely consider how a successful intervention can be sustained long term, nor how to spread or scale to other locations. A survey of authors of randomized trials of diabetes QI interventions included in an ongoing systematic review found that 78% of trials reported improved quality of care, but 40% of these trials were not sustained. This study explores why and how the effective interventions were sustained, spread, or scaled.

METHODS

A qualitative approach was used, focusing on case examples. Diabetes QI program trial authors were purposefully sampled and recruited for telephone interviews. Authors were eligible if they had completed the author survey, agreed to follow-up, and had a completed a diabetes QI trial they deemed "effective." Snowball sampling was used if the participant identified someone who could provide a different perspective on the same trial. Interviews were transcribed verbatim. Inductive thematic analysis was conducted to identify barriers and facilitators to sustainability, spread, and/or scale of the QI program, using case examples to show trajectories across projects and people.

RESULTS

Eleven of 44 eligible trialists participated in an interview. Four reported that the intervention was "sustained" and nine were "spread," however, interviews highlighted that these terms were interpreted differently over time and between participants. Participant stories highlighted the varied trajectories of how projects evolved and how some research careers adapted to increase impact. Three interacting themes, termed the "3C's," helped explain the variation in sustainability, spread, and scale: (i) understanding the concepts of implementation, sustainability, sustainment, spread, and scale; (ii) having the appropriate competencies; and (iii) the need for individual, organizational, and system capacity.

CONCLUSIONS

Challenges in defining sustainability, spread and scale make it difficult to fully understand impact. However, it is clear that from the beginning of intervention design, trialists need to understand the concepts and have the competency and capacity to plan for feasible and sustainable interventions that have potential to be sustained, spread and/or scaled if found to be effective.