Iowa Implementation for Sustainability Framework

A systematic review of experimentally tested implementation strategies across health and human service settings: evidence from 2010-2022

BACKGROUND

Studies of implementation strategies range in rigor, design, and evaluated outcomes, presenting interpretation challenges for practitioners and researchers. This systematic review aimed to describe the body of research evidence testing implementation strategies across diverse settings and domains, using the Expert Recommendations for Implementing Change (ERIC) taxonomy to classify strategies and the Reach Effectiveness Adoption Implementation and Maintenance (RE-AIM) framework to classify outcomes.

METHODS

We conducted a systematic review of studies examining implementation strategies from 2010-2022 and registered with PROSPERO (CRD42021235592). We searched databases using terms "implementation strategy", "intervention", "bundle", "support", and their variants. We also solicited study recommendations from implementation science experts and mined existing systematic reviews. We included studies that quantitatively assessed the impact of at least one implementation strategy to improve health or health care using an outcome that could be mapped to the five evaluation dimensions of RE-AIM. Only studies meeting prespecified methodologic standards were included. We described the characteristics of studies and frequency of implementation strategy use across study arms. We also examined common strategy pairings and cooccurrence with significant outcomes.

FINDINGS

Our search resulted in 16,605 studies; 129 met inclusion criteria. Studies tested an average of 6.73 strategies (0-20 range). The most assessed outcomes were Effectiveness (n=82; 64%) and Implementation (n=73; 56%). The implementation strategies most frequently occurring in the experimental arm were Distribute Educational Materials (n=99), Conduct Educational Meetings (n=96), Audit and Provide Feedback (n=76), and External Facilitation (n=59). These strategies were often used in combination. Nineteen implementation strategies were frequently tested and associated with significantly improved outcomes. However, many strategies were not tested sufficiently to draw conclusions.

CONCLUSION

This review of 129 methodologically rigorous studies built upon prior implementation science data syntheses to identify implementation strategies that had been experimentally tested and summarized their impact on outcomes across diverse outcomes and clinical settings. We present recommendations for improving future similar efforts.

Development and Testing of the Relational and Structural Components of Innovativeness Across Academia and Practice for Healthcare Progress Scale

OBJECTIVE

Using data from 5 academic-practice sites across the United States, researchers developed and validated a scale to measure conditions that enable healthcare innovations.

BACKGROUND

Academic-practice partnerships are a catalyst for innovation and healthcare development. However, limited theoretically grounded evidence exists to provide strategic direction for healthcare innovation across practice and academia.

METHODS

Phase 1 of the analytical strategy involved scale development using 16 subject matter experts. Phase 2 involved pilot testing the scale.

RESULTS

The final Innovativeness Across Academia and Practice for Healthcare Progress Scale (IA-APHPS) consisted of 7 domains: 3 relational domains, 2 structural domains, and 2 impact domains. The confirmatory factor analysis model fits well with a comparative fit index of 0.92 and a root-mean-square error of approximation of 0.06 (n = 477).

CONCLUSION

As the 1st validated scale of healthcare innovation, the IA-APHPS allows nurses to use a diagnostic tool to facilitate innovative processes and outputs across academic-practice partnerships.

Improving Outcomes in Patients Sent to the Emergency Department from Outpatient Providers: A Receiver-Driven Handoff Process Improvement

BACKGROUND

Outpatient providers refer to emergency departments (EDs) due to findings requiring assessment beyond existing capabilities. However, poor communication surrounding these transitions may hinder safety and timeliness of emergency care. Receiver-driven handoff (RDH) is a process that helps ensure that all pertinent information is shared. This quality improvement project aimed to (1) improve knowledge of RDH, (2) increase satisfaction and perceptions surrounding RDH, (3) modify behaviors in relation to RDH, and (4) decrease referred patients leaving without being seen (LWBS).

METHODS

The Iowa Model and Implementation Framework guided this evidence-based quality improvement project. A multidisciplinary team developed and implemented a standardized RDH process consisting of screening to determine whether a patient was referred to the ED, review of electronic health record (EHR), and use of EHR documentation. Process measures were collected via questionnaire pre- and postimplementation and were analyzed quantitatively. Outcome measures were trended by a statistical process control p-chart, which was developed to demonstrate changes in the percentage of patients who were referred to the ED from the outpatient setting and LWBS.

RESULTS

The average response for the question "How satisfied are you with the handoff of patient information from referring clinic providers to the ED?" increased from 1.51 preintervention to 2.04 postintervention (p = 0.005). Respondents rated the information received during handoff higher postintervention (2.12 vs. 2.52, p = 0.04). Compliance with screening for referral to the ED was 84.0%. The proportion of patients LWBS after referral decreased by 6.2 percentage points (p < 0.001).

CONCLUSION

Using RDH in conjunction with a standardized triage screening may improve quality of information shared during this vulnerable transition and may assist in reduction of referred patients LWBS. The RDH process should be adapted into everyday workflow to ensure sustainability and effectiveness.

Acceptability and feasibility of policy implementation strategies for taxes earmarked for behavioral health services

Background

This study's aims are to: (1) Compare the acceptability and feasibility of five types of implementation strategies that could be deployed to increase the reach of evidence-based practices (EBPs) with revenue from policies that earmark taxes for behavioral health services, and (2) Illustrate how definitions of implementation strategies and measures of acceptability and feasibility can be used in policy-focused implementation science research.

Methods

Web-based surveys of public agency and community organization professionals involved with earmarked tax policy implementation were completed in 2022-2023 (N = 211, response rate = 24.9%). Respondents rated the acceptability and feasibility of five types of implementation strategies (dissemination, implementation process, integration, capacity-building, and scale-up). Aggregate acceptability and feasibility scores were calculated for each type of strategy (scoring range 4-20). Analyses of variance compared scores across strategies and between organizational actor types.

Findings

For acceptability, capacity-building strategies had the highest rating (M = 16.3, SD = 3.0), significantly higher than each of the four other strategies, p ≤ . 004), and scale-up strategies had the lowest rating (M = 15.6). For feasibility, dissemination strategies had the highest rating (M = 15.3, significantly higher than three of the other strategies, p ≤ .002) and scale-up strategies had the lowest rating (M = 14.4).

Conclusions

Capacity-building and dissemination strategies may be well-received and readily deployed by policy implementers to support EBPs implementation with revenue from taxes earmarked for behavioral health services. Adapting definitions of implementation strategies for policy-focused topics, and applying established measures of acceptability and feasibility to these strategies, demonstrates utility as an approach to advance research on policy-focused implementation strategies.

Back to basics: Practical strategies to reduce sensory overstimulation in the emergency department identified by adults and caregivers of children with autism spectrum disorder

INTRODUCTION

Sensory overstimulation of autistic patients of all ages during an ED visit can ultimately lead to care escalation, but few studies have evaluated patient perspectives on improving the ED sensory experience across the age continuum. The purpose of this study was to explore patient-centered perspectives on reducing adult and pediatric autistic patients' sensory stimulation during an ED visit.

METHODS

We used a qualitative descriptive design to explore how autistic patients experience sensory disruption and recommendations to improve care. Data were analyzed inductively using an overall categorization of 6 senses (visual, auditory, touch, smell, taste, and proprioception).

RESULTS

Fourteen adults and 30 caregivers of children provided written responses to open-ended interview questions (n = 44). Participants suggested strategies to minimize the sensory disruption they experienced; however, an overarching recommendation was for clinicians to ask about their or their child's preferences before delivering care or services.

CONCLUSION

Because people with autism are more likely to visit an ED than their neurotypical counterparts, ED clinicians should be proficient in "sensory-friendly care." A variety of evidence-based practical strategies and design approaches exist that can be leveraged to reduce the risk of care escalation; however, the most basic may be to prioritize asking patients and their caregivers about their preferences prior to providing care.

Models and approaches for building knowledge translation capacity and capability in health services: a scoping review

BACKGROUND

Building healthcare service and health professionals' capacity and capability to rapidly translate research evidence into health practice is critical to the effectiveness and sustainability of healthcare systems. This review scoped the literature describing programmes to build knowledge translation capacity and capability in health professionals and healthcare services, and the evidence supporting these.

METHODS

This scoping review was undertaken using the Joanna Briggs Institute scoping review methodology. Four research databases (Ovid MEDLINE, CINAHL, Embase, and PsycInfo) were searched using a pre-determined strategy. Eligible studies described a programme implemented in healthcare settings to build health professional or healthcare service knowledge translation capacity and capability. Abstracts and full texts considered for inclusion were screened by two researchers. Data from included papers were extracted using a bespoke tool informed by the scoping review questions.

RESULTS

Database searches yielded 10,509 unique citations, of which 136 full texts were reviewed. Thirty-four papers were included, with three additional papers identified on citation searching, resulting in 37 papers describing 34 knowledge translation capability building programmes. Programmes were often multifaceted, comprising a combination of two or more strategies including education, dedicated implementation support roles, strategic research-practice partnerships and collaborations, co-designed knowledge translation capability building programmes, and dedicated funding for knowledge translation. Many programmes utilised experiential and collaborative learning, and targeted either individual, team, organisational, or system levels of impact. Twenty-seven programmes were evaluated formally using one or more data collection methods. Outcomes measured varied significantly and included participant self-reported outcomes, perceived barriers and enablers of knowledge translation, milestone achievement and behaviour change. All papers reported that programme objectives were achieved to varying degrees.

CONCLUSIONS

Knowledge translation capacity and capability building programmes in healthcare settings are multifaceted, often include education to facilitate experiential and collaborative learning, and target individual, team, organisational, or supra-organisational levels of impact. Although measured differently across the programmes, the outcomes were positive. The sustainability of programmes and outcomes may be undermined by the lack of long-term funding and inconsistent evaluation. Future research is required to develop evidence-informed frameworks to guide methods and outcome measures for short-, medium- and longer-term programme evaluation at the different structural levels.

Preventing sexual violence in sexual orientation and gender diverse communities: A call to action

Background: Members of the lesbian, gay, bisexual, transgender, queer, and other sexual orientation and gender diverse (SOGD) communities are at disproportionately higher risk for sexual violence compared to cisgender heterosexual people. Despite this elevated risk, relatively few sexual violence prevention efforts effectively reduce these victimization disparities based on sexual orientation or gender identity.Objective: This narrative review provides an overview of the prevalence of sexual violence in the SOGD communities, delineates risk factors for sexual victimization among SOGD community members, and reviews and evaluates existing prevention efforts for the SOGD communities. We outline specific recommendations for ensuring that prevention efforts meet the needs of the SOGD communities.Method: Drawing on ecological systems theory and public health approaches to sexual violence prevention, we outline current approaches and opportunities for preventionists and scholars to push the field forward.Results: There have been promising prevention programmes designed to be implemented within SOGD communities specifically; however, it is important that general primary prevention programmes endeavour to specifically address sexual violence perpetrated against SOGD people. While many packaged programmes that endeavour to prevent sexual violence across all gender identities and sexual orientations are inclusive of SOGD participants, more programming is needed that integrates anti-oppression training to target social norms that perpetuate SOGD-specific rape myths and normalize sexual violence against SOGD community members.Conclusion: Ecological prevention strategies in line with a public health approach for primary prevention may be particularly valuable for reducing victimization disparities based on SOGD status and identity. Comprehensive sexual education and anti-discrimination policies should be considered front-line prevention programming. To assess if these strategies are effective, the implementation of large-scale surveillance surveys that use comprehensive assessments of sexual orientation, gender identity, and sexual violence are needed. Using theoretically grounded implementation strategies for prevention programmes can ensure effective programme delivery.

A scoping review of theories, models and frameworks used or proposed to evaluate knowledge mobilization strategies

BACKGROUND

Evaluating knowledge mobilization strategies (KMb) presents challenges for organizations seeking to understand their impact to improve KMb effectiveness. Moreover, the large number of theories, models, and frameworks (TMFs) available can be confusing for users. Therefore, the purpose of this scoping review was to identify and describe the characteristics of TMFs that have been used or proposed in the literature to evaluate KMb strategies.

METHODS

A scoping review methodology was used. Articles were identified through searches in electronic databases, previous reviews and reference lists of included articles. Titles, abstracts and full texts were screened in duplicate. Data were charted using a piloted data charting form. Data extracted included study characteristics, KMb characteristics, and TMFs used or proposed for KMb evaluation. An adapted version of Nilsen (Implement Sci 10:53, 2015) taxonomy and the Expert Recommendations for Implementing Change (ERIC) taxonomy (Powell et al. in Implement Sci 10:21, 2015) guided data synthesis.

RESULTS

Of the 4763 search results, 505 were retrieved, and 88 articles were eligible for review. These consisted of 40 theoretical articles (45.5%), 44 empirical studies (50.0%) and four protocols (4.5%). The majority were published after 2010 (n = 70, 79.5%) and were health related (n = 71, 80.7%). Half of the studied KMb strategies were implemented in only four countries: Canada, Australia, the United States and the United Kingdom (n = 42, 47.7%). One-third used existing TMFs (n = 28, 31.8%). According to the adapted Nilsen taxonomy, process models (n = 34, 38.6%) and evaluation frameworks (n = 28, 31.8%) were the two most frequent types of TMFs used or proposed to evaluate KMb. According to the ERIC taxonomy, activities to "train and educate stakeholders" (n = 46, 52.3%) were the most common, followed by activities to "develop stakeholder interrelationships" (n = 23, 26.1%). Analysis of the TMFs identified revealed relevant factors of interest for the evaluation of KMb strategies, classified into four dimensions: context, process, effects and impacts.

CONCLUSIONS

This scoping review provides an overview of the many KMb TMFs used or proposed. The results provide insight into potential dimensions and components to be considered when assessing KMb strategies.

A grounded theory-based qualitative approach for examining local implementation of public health policies during crises

Background

COVID-19's emergence questions the agility of health policy deployment in a context of urgency. This exceptional pandemic offers a unique Implementation Science study opportunity. It reveals how actors adapt, coordinate, and mitigate an unknown global threat to safeguard populations from an initially mysterious virus. Limited research has explored how involved players act and adapt their practices to fulfil health protection missions during a global health crisis. Bridging the gap between public policy expectations and achievements requires a methodology for stakeholder identification and implementation practice description.

Objective

Focusing on COVID-19 management in France's second-largest region, we investigate ministerial recommendation implementation and the emergence of new links, coordination modes, and practices.

Methods

Due to the novel subject, we adopted grounded theory. Initial documentary data collection identifies stakeholders for subsequent interviews. Open-ended coding of collected discourse enables content analysis.

Results

Findings reveal a crisis-driven re-evaluation of stakeholder relationships. This research identifies three levels of implementation of health policies at the local level (administrative, organizational and operational) and reveals different types of coordination specific to each of these levels. Our results provide insights on how to better coordinate and implement healthcare policies in a period of crisis. Recommendations include real-life simulations of large-scale crises.

Conclusion

Our work establishes a methodological foundation for analysing coordination dynamics. Future research could compare these findings with other unpredictable health emergencies, such as episiotomic veterinary health crises.•The first step of the method is to analyse the guidelines of health policy implementation during the Covid-19 crisis and to identify the main stakeholders in charge of the local health policy implementation.•The second step consists of interviewing these stakeholders using a co-constructed sample and structural coding of their speech to reveal the forms of coordination between stakeholders.

Indicators to measure implementation and sustainability of nursing best practice guidelines: A mixed methods analysis

Background

The use of best practice guidelines (BPGs) has the potential to decrease the gap between best evidence and nursing and healthcare practices. We conducted an exploratory mixed method study to identify strategies, processes, and indicators relevant to the implementation and sustainability of two Registered Nurses' Association of Ontario (RNAO) BPGs at Best Practice Spotlight Organizations® (BPSOs).

Methods

Our study had four phases. In Phase 1, we triangulated two qualitative studies: a) secondary analysis of 126 narrative reports detailing implementation progress from 21 BPSOs spanning four sectors to identify strategies and processes used to support the implementation and sustainability of BPGs and b) interviews with 25 guideline implementers to identify additional strategies and processes. In Phase 2, we evaluated correlations between strategies and processes identified from the narrative reports and one process and one outcome indicator for each of the guideline. In Phase 3, the results from Phases 1 and 2 informed indicator development, led by an expert panel. In Phase 4, the indicators were assessed internally by RNAO staff and externally by Ontario Health Teams. A survey was used to validate proposed indicators to determine relevance, feasibility, readability, and usability with knowledge users and BPSO leaders.

Results

Triangulation of the two qualitative studies revealed 46 codes of implementation and sustainability of BPGs, classified into eight overarching themes: Stakeholder Engagement, Practice Interventions, Capacity Building, Evidence-Based Culture, Leadership, Evaluation & Monitoring, Communication, and Governance. A total of 28 structure, process, or outcome indicators were developed. End users and BPSO leaders were agreeable with the indicators according to the validation survey.

Conclusions

Many processes and strategies can influence the implementation and sustainability of BPGs at BPSOs. We have developed indicators that can help BPSOs promote evidence-informed practice implementation of BPGs.

The Interaction Between General and Strategic Leadership and Climate on Their Multilevel Associations with Implementer Attitudes Toward Universal Prevention Programs for Youth Mental Health: A Cross-Sectional Study

Emerging literature has highlighted the importance of discerning general and strategic organizational context (OC) factors (e.g., leadership and climate) and their interaction effect on individual implementation behaviors (e.g., attitudes toward evidence-based practices; EBPs) in youth mental healthcare. This study aimed to examine how leadership and climate (general and strategic) are associated with implementer attitudes toward EBPs across the individual and organizational levels and their interaction effect in schools. A series of multilevel models (MLMs) were fitted on a diverse sample of schools actively implementing universal prevention programs for youth mental health (441 implementers from 52 schools). The organization-level aggregates and individual educators' perceptions of general and strategic leadership and climate, and their interaction terms, were entered as level-2 and level-1 predictors of four attitudinal dimensions (Requirement, Openness, Appeal, and Divergence) based on their level of measurement. At the organizational level, higher levels of strategic leadership and climate, but not their general counterparts, were consistently associated with more favorable attitudes in all four dimensions. At the individual/within-school level, higher levels of perceived general and strategic leadership and climate were associated with more favorable attitudes of Requirement and Openness. At the organizational/between-school level, general climate moderated the positive effect of strategic climate on implementers' perception of appeal and divergence of EBPs. Our findings indicate that leaders should make data-based decisions to allocate resources on strategic and/or general leadership and climate to foster favorable staff attitudes toward EBPs based on the level of measurement, implementation-specificity, and attitudinal dimensions.

Development and Evaluation of the Fuld Institute Evidence-based Implementation and Sustainability Toolkit for Health Care Settings

Routine implementation and sustainability of evidence-based practices (EBPs) into health care is often the most difficult stage in the change process. Despite major advances in implementation science and quality improvement, a persistent 13- to 15-year research-to-practice gap remains. Nurse leaders may benefit from tools to support implementation that are based on scientific evidence and can be readily integrated into complex health care settings. This article describes development and evaluation of an evidence-based implementation and sustainability toolkit used by health care clinicians seeking to implement EBPs. For this project, implementation science and EBP experts created initial iterations of the toolkit based on Rogers' change theory, the Advancing Research through Close Collaboration (ARCC) model, and phases and strategies from implementation science. Face validity and end-user feedback were obtained after piloting the tool with health care clinicians participating in immersive EBP sessions. The toolkit was then modified, with subsequent content validity and usability evaluations conducted among implementation science experts and health care clinicians. This article presents the newly updated Fuld Institute Evidence-based Implementation and Sustainability Toolkit for health care settings. Nurse leaders seeking to implement EBPs may benefit from an evidence-based toolkit to provide a science-informed approach to implementation and sustainability of practice changes.

Implementation of Peer Messengers to Deliver Feedback: An Observational Study to Promote Professionalism in Nursing

BACKGROUND

The Co-Worker Observation System (CORS) is a tool and a process to address disrespectful behavior through feedback from trained peer messengers. First used by physicians and advanced practice providers (APPs), CORS has been shown to decrease instances of unprofessional behaviors among physicians and APPs. The research team assessed the feasibility and fidelity of implementing CORS for staff nurses.

METHODS

CORS was implemented at three academic medical centers using a project bundle with 10 essential implementation elements. Reports of unprofessional behavior among staff nurses that were submitted through the institution's electronic reporting system were screened through natural language processing software, coded by trained CORS coders using the Martinez taxonomy, and referred to a trained peer messenger to share the observations with the nurse. A mixed methods, observational design assessed feasibility and fidelity.

RESULTS

A total of 590 reports from three sites were identified by the Center for Patient and Professional Advocacy from September 1, 2019, through August 31, 2021. Most reports included more than one problematic behavior, each of which was coded. Of the peer messages, 76.5% were successfully documented using the debriefing survey as complete, 2.2% as awaiting messenger feedback, and 0.2% as awaiting messenger assignments (total of 78.9 % considered delivered). A total of 21.1% were not shared; 4.7% of reports were intentionally not shared because the issue stemmed from a new system or policy implementation (4.0%) or because of known factors affecting the nurse (0.7%).

CONCLUSION

CORS can be implemented with staff nurses efficiently when nursing infrastructure is adequate.

Influences of post-implementation factors on the sustainability, sustainment, and intra-organizational spread of complex interventions

Background

Complex interventions are increasingly applied to healthcare problems. Understanding of post-implementation sustainment, sustainability, and spread of interventions is limited. We examine these phenomena for a complex quality improvement initiative led by care aides in 7 care homes (long-term care homes) in Manitoba, Canada. We report on factors influencing these phenomena two years after implementation.

Methods

Data were collected in 2019 via small group interviews with unit- and care home-level managers (n = 11) from 6 of the 7 homes using the intervention. Interview participants discussed post-implementation factors that influenced continuing or abandoning core intervention elements (processes, behaviors) and key intervention benefits (outcomes, impact). Interviews were audio-recorded, transcribed verbatim, and analyzed with thematic analysis.

Results

Sustainment of core elements and sustainability of key benefits were observed in 5 of the 6 participating care homes. Intra-unit intervention spread occurred in 3 of 6 homes. Factors influencing sustainment, sustainability, and spread related to intervention teams, unit and care home, and the long-term care system.

Conclusions

Our findings contribute understanding on the importance of micro-, meso-, and macro-level factors to sustainability of key benefits and sustainment of some core processes. Inter-unit spread relates exclusively to meso-level factors of observability and practice change institutionalization. Interventions should be developed with post-implementation sustainability in mind and measures taken to protect against influences such as workforce instability and competing internal and external demands. Design should anticipate need to adapt interventions to strengthen post-implementation traction.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12913-022-08026-x.