Spread tools: a systematic review of components, uptake, and effectiveness of quality improvement toolkits

How valuable is an implementation toolkit for midwives? An exploratory study

BACKGROUND

Incorporating evidence-based approaches in maternity care throughout the entire trajectory from pregnancy through to the postnatal phase is integral to good public health. Yet, despite developing theories, frameworks, and models to guide midwives' implementation efforts, implementing new evidence-based practices in midwifery practice settings remains challenging.

METHODS

An exploratory study design was used to conduct an initial assessment of the appeal and suitability of an implementation 'how to' Toolkit for Australian change-leader midwives. We aimed to determine the effectiveness of the intervention by evaluating midwives' experience of using the Toolkit, and report on the usability of the Toolkit in maternity care. We also sought to establish the degree to which the intervention could reach a broad cross-section of midwives, confirming the usability of the Toolkit across a range of public and private maternity services.

RESULTS

Twenty-four midwives participated in our study. Participants provided practical Toolkit evaluation data, contextual information related to Toolkit content, their understanding of what implementation in a healthcare context is, and factors that hindered midwives' implementation efforts in clinical settings. The importance of co-design research and involving end-users in product development were also highlighted as crucial factors underpinning the effectiveness of resources like ours, particularly those designed to support specialist disciplines and the implementation challenges experienced by health practitioners in clinical environments.

CONCLUSIONS

It is crucial to progress health care practitioners understanding of how to accelerate the implementation and sustainment of new evidence-based practices in clinical settings, including strategies to support organisational readiness, local barriers or challenges, and partnerships between researchers and end-users. Evaluation of our midwifery-specific implementation Toolkit indicates health professionals require tailored materials and information specific to their disciplines and clinical work environments; ideally, packaged in a centalised, open-access format. Future research is required to evaluate the mid-to-longterm impact of our Toolkit on implementation initiatives in midwifery contexts, and to establish the adaptability of our Toolkit in other settings, and with other disciplines.

Implementation outcomes from a randomized, controlled trial of a strategy to improve integration of behavioral health and primary care services

BACKGROUND

Integrating behavioral health services in primary care is challenging; a toolkit approach to practice implementation can help. A recent comparative effectiveness randomized clinical trial examined the impact of a toolkit for improving integration on outcomes for patients with multiple chronic conditions. Some aspects of behavioral health integration improved; patient-reported outcomes did not. This report evaluates the implementation strategy (Toolkit) using Proctor's (2011) implementation outcomes model.

METHODS

Using data from the 20 practices randomized to the active (toolkit strategy) arm (education, redesign workbooks, online learning community, remote coaching), we identified 23 measures from practice member surveys, coach interviews, reports, and field logs to assess Toolkit acceptability, appropriateness, feasibility, and fidelity. A practice survey score was high (met expectations) if its average was ≥ 4 on a scale 1-5; all other data were coded dichotomously, with high = 1.

RESULTS

Regarding acceptability, 74% (14) of practices had high scores for willingness of providers and staff to use the Toolkit and 68% (13) for quality improvement teams liking the Toolkit. For appropriateness, 95% (19) of practices had high scores for the structured process being a good match and 63% (12) for the Toolkit being a good match. Feasibility, measured by Toolkit prerequisites, was scored lower by site members at project end (e.g., provider leader available as champion: 53% of practices) compared to remote coaches observing practice teams (74%). For "do-ability," coaches rated feasibility lower for practices (e.g., completion of workbook activities: 32%) than the practice teams (68%). Fidelity was low as assessed across seven measures, with 50% to 78% of practices having high scores across the seven measures.

CONCLUSIONS

Existing data from large trials can be used to describe implementation outcomes. The Toolkit was not implemented with fidelity in at least one quarter of the sites, despite being acceptable and appropriate, possibly due to low feasibility in the form of unmet prerequisites and Toolkit complexity. Variability in fidelity reflects the importance of implementation strategies that fit each organization, suggesting that further study on contextual factors and use of the Toolkit, as well as the relationship of Toolkit use and study outcomes, is needed.

TRIAL REGISTRATION

ClinicalTrials.gov NCT02868983; date of registration: 08/15/2016.

Physical activity for people with chronic conditions: a systematic review of toolkits to promote adherence

PURPOSE

The World Health Organisation (WHO) recommends that health professionals develop and implement "adherence counselling toolkits" to promote adherence to long-term therapies in people with chronic conditions. This prospectively registered review aimed to systematically identify and evaluate existing toolkits developed to promote adherence to physical activity in people with chronic conditions.

MATERIALS AND METHODS

Grey literature and six e-databases were searched for studies investigating the use of "toolkits" to promote adherence to physical activity or exercise recommendations in people with chronic conditions (Medline, PsycInfo, EmCare, Cochrane, CINAHL Plus, Pedro). A two-stage screening process was completed by two independent reviewers.

RESULTS

Five studies describing five toolkits were included. Three toolkits displayed all WHO recommended features, including information on adherence, a clinically useful way of using this information, and behavioural tools for maintaining habits. The included toolkits featured "adherence" to the intervention; however, this was not their primary aim. There were trends towards improved physical activity with some of the included toolkits.

CONCLUSIONS

There are a lack of rigorously developed toolkits that focus on adherence to physical activity in people with chronic conditions. Toolkits should be developed, tested, and implemented to improve adherence and outcomes for people with chronic conditions.

Knowledge Translation Task Force for core measures clinical practice guideline: a short report on the process and utilization

BACKGROUND

As part of the 2018 Clinical Practice Guideline (CPG): A Core Set of Outcome Measures for Adults with Neurologic Conditions Undergoing Rehabilitation, a Knowledge Translation (KT) Task Force was convened. The purpose of this short report was to (1) demonstrate the potential impact of a CPG KT Task Force through a practical example of efforts to implement a CPG into neurologic physical therapy practice and (2) describe the process to convene a KT Task Force and develop products (KT Toolkit) to facilitate implementation of the CPG.

METHODS

To describe the process used by the KT Task Force to develop and review a KT Toolkit for implementation of the CPG.

RESULTS

Utilizing the Knowledge-To-Action Cycle framework, eight tools were developed as part of the KT Toolkit and are available with open access to the public. Findings indicate that the Core Outcome Measures Homepage, which houses the KT Toolkit, has had greater than 70,000 views since its publication.

CONCLUSIONS

This short report serves as an example of the efforts made to implement a CPG into physical therapy practice. The processes to facilitate KT and the tools developed can inform future implementation efforts and underscore the importance of having a KT Task Force to implement a CPG. Moving forward, KT Task Forces should be convened to implement new or revised guidelines.

TRIAL REGISTRATION

N/A.

Increasing the use of anxiolysis and analgesia for paediatric procedures in a community emergency department network: a quality improvement initiative

Prior reports describe the care children receive in community EDs (CEDs) compared with paediatric EDs (PEDs) as uneven. The Emergency Medical Services for Children (EMSC) initiative works to close these gaps using quality improvement (QI) methodology. Project champion from a community hospital network identified the use of safe pharmacological and non-pharmacological anxiolysis and analgesia (A&A) as one such gap and partnered with EMSC to address it. Our primary Specific, Measurable, Achievable, Relevant and Time-Bound (SMART) aim was to increase intranasal midazolam (INM) use for common, anxiety-provoking procedures on children <8 years of age from 2% to 25% in a year.EMSC facilitated a QI team with representation from the CED and regional children's hospitals. Following the model for improvement, we initiated a process analysis of this CED A&A practice. Review of all paediatric procedural data identified common anxiety-provoking simple procedures as laceration repairs, abscess drainage and foreign body removal. Our SMART aims were benchmarked to two regional PEDs and tracked through statistical process control. A balancing metric was ED length of stay (ED LOS) for patients <8 years of age requiring a laceration repair. Additionally, we surveyed CED frontline staff and report perceptions of changes in A&A knowledge, attitudes and practice patterns. These data prioritised and informed our key driver diagram which guided the Plan-Do-Study-Act (PDSA) cycles, including guideline development, staff training and cognitive aids.Anxiety-provoking simple procedures occurred on average 10 times per month in children <8 years of age. Through PDSA cycles, the monthly average INM use increased from 2% to 42%. ED LOS was unchanged, and the perceptions of provider's A&A knowledge, attitudes and practice patterns improved.A CED-initiated QI project increased paediatric A&A use in a CED network. An A&A toolkit outlines our approach and may simplify spread from academic children's hospitals to the community.

Econometric evaluation of implementing a behavioral health integration intervention in primary care settings

Integrated behavioral health (IBH) is an approach to patient care that brings medical and behavioral health providers (BHPs) together to address both behavioral and medical needs within primary care settings. A large, pragmatic, national study aimed to test the effectiveness and measure the implementation costs of an intervention to improve IBH integration within primary care practices (IBH-PC). Assess the time and cost to practices of implementing a comprehensive practice-level intervention designed from the perspective of clinic owners to move behavioral service integration from co-location toward full integration as part of the IBH-PC study. IBH-PC program implementation costs were estimated in a representative sample of 8 practices using standard micro-econometric evaluation of activities outlined in the implementation workbook, including program implementation tasks, remote quality improvement coaching services, educational curricula, and learning community activities, over a 24-month period. The total median cost of implementing the IBH-PC program across all stages was $20,726 (range: $12,381 - $60,427). The median cost of the Planning Stage was $10,258 (range: $4,625 - $14,840), while the median cost of the Implementation Stage was $9,208 (range: $6,017 - 49,993). There were no statistically significant differences in practice or patient characteristics between the 8 selected practices and the larger IBH-PC practice sample (N=34). This study aimed to quantify the relative costs associated with integrating behavioral health into primary care. Although the cost assessment approach did not include all costs (fixed, variable, operational, and opportunity costs), the study aimed to develop a replicable and pragmatic measurement process with flexibility to adapt to emerging developments in each practice environment, providing a reasonable ballpark estimate of costs associated with implementation to help guide future executive decisions.

Formative evaluation prior to implementation of a brief treatment for posttraumatic stress disorder in primary care

BACKGROUND

Successful implementation of evidence-based treatments (EBT) for posttraumatic stress disorder (PTSD) in primary care may address treatment access and quality gaps by providing care in novel and less stigmatized settings. Yet, PTSD treatments are largely unavailable in safety net primary care. We aimed to collect clinician stakeholder data on organizational, attitudinal, and contextual factors relevant to EBT implementation.

METHODS

Our developmental formative evaluation was guided by the Consolidated Framework for Implementation Research (CFIR), including (a) surveys assessing implementation climate and attitudes towards EBTs and behavioral health integration and (b) semi-structured interviews to identify barriers and facilitators to implementation and need for augmentation. Participants were hospital employees (N = 22), including primary care physicians (n = 6), integrated behavioral health clinicians (n = 8), community wellness advocates (n = 3), and clinic leadership (n = 5). We report frequency and descriptives of survey data and findings from directed content analysis of interviews. We used a concurrent mixed-methods approach, integrating survey and interview data collected simultaneously using a joint display approach. A primary care community advisory board (CAB) helped to refine interview guides and interpret findings.

RESULTS

Stakeholders described implementation determinants of the EBT related to the CFIR domains of intervention characteristics (relative advantage, adaptability), outer setting (patient needs and resources), inner setting (networks and communication, relative priority, leadership engagement, available resources), and individuals involved (knowledge and beliefs, cultural considerations). Stakeholders described strong attitudinal support (relative advantage), yet therapist time and capacity restraints are major PTSD treatment implementation barriers (available resources). Changes in hospital management were perceived as potentially allowing for greater access to behavioral health services, including EBTs. Patient engagement barriers such as stigma, mistrust, and care preferences were also noted (patient needs and resources). Recommendations included tailoring the intervention to meet existing workflows (adaptability), system alignment efforts focused on improving detection, referral, and care coordination processes (networks and communication), protecting clinician time for training and consultation (leadership engagement), and embedding a researcher in the practice (available resources).

CONCLUSIONS

Our evaluation identified key CFIR determinants of implementation of PTSD treatments in safety net integrated primary care settings. Our project also demonstrates that successful implementation necessitates strong stakeholder engagement.

Exploring the intersection of hermeneutics and implementation: a scoping review

BACKGROUND

An enduring challenge remains about how to effectively implement programs, services, or practices. Too often, implementation does not achieve its intended effectiveness, fidelity, and sustainability, even when frameworks or theories determine implementation strategies and actions. A different approach is needed. This scoping review joined two markedly different bodies of literature: implementation and hermeneutics. Implementation is usually depicted as focused, direct, and somewhat linear, while hermeneutics attends to the messiness of everyday experience and human interaction. Both, however, are concerned with practical solutions to real-life problems. The purpose of the scoping review was to summarize existing knowledge on how a hermeneutic approach has informed the process of implementing health programs, services, or practices.

METHODS

We completed a scoping review by taking a Gadamerian hermeneutic approach to the JBI scoping review method. Following a pilot search, we searched eight health-related electronic databases using broadly stated terms such as implementation and hermeneutics. A diverse research team that included a patient and healthcare leader, working in pairs, independently screened titles/abstracts and full-text articles. Through the use of inclusion criteria and full-team dialogue, we selected the final articles and identified their characteristics, hermeneutic features, and implementation components.

RESULTS

Electronic searches resulted in 2871 unique studies. After full-text screening, we retained six articles that addressed both hermeneutics and implementing a program, service, or practice. The studies varied widely in location, topic, implementation strategies, and hermeneutic approach. All addressed assumptions underpinning implementation, the human dimensions of implementing, power differentials, and knowledge creation during implementation. All studies addressed issues foundational to implementing such as cross-cultural communication and surfacing and addressing tensions during processes of change. The studies showed how creating conceptual knowledge was a precursor to concrete, instrumental knowledge for action and behavioral change. Finally, each study demonstrated how the hermeneutic process of the fusion of horizons created new understandings needed for implementation.

CONCLUSIONS

Hermeneutics and implementation have rarely been combined. The studies reveal important features that can contribute to implementation success. Implementers and implementation research may benefit from understanding, articulating, and communicating hermeneutic approaches that foster the relational and contextual foundations necessary for successful implementation.

TRIAL REGISTRATION

The protocol was registered at the Centre for Open Science on September 10, 2019. MacLeod M, Snadden D, McCaffrey G, Zimmer L, Wilson E, Graham I, et al. A hermeneutic approach to advancing implementation science: a scoping review protocol 2019. Accessed at osf.io/eac37.

Study protocol for development of an options assessment toolkit (OAT) for national malaria programs in Asia Pacific to determine best combinations of vivax radical cure for their given contexts

INTRODUCTION

Recent advances in G6PD deficiency screening and treatment are rapidly changing the landscape of radical cure of vivax malaria available for National Malaria Programs (NMPs). While NMPs await the WHO's global policy guidance on these advances, they will also need to consider different contextual factors related to the vivax burden, health system capacity, and resources available to support changes to their policies and practices. Therefore, we aim to develop an Options Assessment Toolkit (OAT) that enables NMPs to systematically determine optimal radical cure options for their given environments and potentially reduce decision-making delays. This protocol outlines the OAT development process.

METHODS

Utilizing participatory research methods, the OAT will be developed in four phases where the NMPs and experts will have active roles in designing the research process and the toolkit. In the first phase, an essential list of epidemiological, health system, and political & economic factors will be identified. In the second phase, 2-3 NMPs will be consulted to determine the relative priority and measurability of these factors. These factors and their threshold criteria will be validated with experts using a modified e-Delphi approach. In addition, 4-5 scenarios representing country contexts in the Asia Pacific region will be developed to obtain the expert-recommended radical cure options for each scenario. In the third phase, additional components of OAT, such as policy evaluation criteria, latest information on new radical cure options, and others, will be finalized. The OAT will be pilot-tested with other Asia Pacific NMPs in the final phase.

ETHICS AND DISSEMINATION

Human Research Ethics Committee approval has been received from the Northern Territory, Department of Health, and Menzies School of Health Research (HREC Reference Number: 2022-4245). The OAT will be made available for the NMPs, introduced at the APMEN Vivax Working Group annual meeting, and reported in international journals.

Does the process of developing products for knowledge mobilisation from healthcare research influence their uptake? A comparative case study

Background

Getting knowledge from healthcare research into practice (knowledge mobilisation) remains a global challenge. One way in which researchers may attempt to do this is to develop products (such as toolkits, actionable tools, dashboards, guidance, audit tools, protocols and clinical decision aids) in addition to journal papers. Despite their increasing ubiquity, the development of such products remains under-explored in the academic literature. This study aimed to further this understanding by exploring the development of products from healthcare research and how the process of their development might influence their potential application.

Methods

This study compared the data generated from a prospective, longitudinal, comparative case study of four research projects which aimed to develop products from healthcare research. Qualitative methods included thematic analysis of data generated from semi-structured interviews (38), meeting observations (83 h) and project documents (300+). Cases were studied for an average of 11.5 months (range 8–19 months).

Results

Case comparison resulted in the identification of three main themes with the potential to affect the use of products in practice. First, aspects of the product, including the perceived need for the specific product being identified, the clarity of product aim and clarity and range of end-users. Second, aspects of development, whereby different types of stakeholder engagement appear to influence potential product application, which either needs to be ‘meaningful’, or delivered through the implicit understanding of users’ needs by the developing team. The third, overarching theme, relates to the academic context in which products are developed, highlighting how the academic context perpetuates the development of products, which may not always be useful in practice.

Conclusions

This study showed that aspects of products from healthcare research (need/aim/end-user) and aspects of their development (stakeholder engagement/implicit understanding of end-users) influence their potential application. It explored the motivation for product development and identifies the influence of the current academic context on product development. It shows that there is a tension between ideal ‘systems approaches’ to knowledge mobilisation and ‘linear approaches’, which appear to be more pervasive in practice currently. The development of fewer, high-quality products which fulfil the needs of specified end-users might act to counter the current cynicism felt by many stakeholders in regard to products from healthcare research.

Supplementary Information

The online version contains supplementary material available at 10.1186/s43058-022-00360-9.

Can systematic implementation support improve programme fidelity by improving care providers' perceptions of implementation factors? A cluster randomized trial

BACKGROUND

Investigations of implementation factors (e.g., collegial support and sense of coherence) are recommended to better understand and address inadequate implementation outcomes. Little is known about the relationship between implementation factors and outcomes, especially in later phases of an implementation effort. The aims of this study were to assess the association between implementation success (measured by programme fidelity) and care providers' perceptions of implementation factors during an implementation process and to investigate whether these perceptions are affected by systematic implementation support.

METHODS

Using a cluster-randomized design, mental health clinics were drawn to receive implementation support for one (intervention) and not for another (control) of four evidence-based practices. Programme fidelity and care providers' perceptions (Implementation Process Assessment Tool questionnaire) were scored for both intervention and control groups at baseline, 6-, 12- and 18-months. Associations and group differences were tested by means of descriptive statistics (mean, standard deviation and confidence interval) and linear mixed effect analysis.

RESULTS

Including 33 mental health centres or wards, we found care providers' perceptions of a set of implementation factors to be associated with fidelity but not at baseline. After 18 months of implementation effort, fidelity and care providers' perceptions were strongly correlated (B (95% CI) = .7 (.2, 1.1), p = .004). Care providers perceived implementation factors more positively when implementation support was provided than when it was not (t (140) = 2.22, p = .028).

CONCLUSIONS

Implementation support can facilitate positive perceptions among care providers, which is associated with higher programme fidelity. To improve implementation success, we should pay more attention to how care providers constantly perceive implementation factors during all phases of the implementation effort. Further research is needed to investigate the validity of our findings in other settings and to improve our understanding of ongoing decision-making among care providers, i.e., the mechanisms of sustaining the high fidelity of recommended practices.

TRIAL REGISTRATION

ClinicalTrials.gov Identifier: NCT03271242 (registration date: 05.09.2017).

Systems analysis and improvement approach to optimize outpatient mental health treatment cascades in Mozambique (SAIA-MH): study protocol for a cluster randomized trial

BACKGROUND

Significant investments are being made to close the mental health (MH) treatment gap, which often exceeds 90% in many low- and middle-income countries (LMICs). However, limited attention has been paid to patient quality of care in nascent and evolving LMIC MH systems. In system assessments across sub-Saharan Africa, MH loss-to-follow-up often exceeds 50% and sub-optimal medication adherence often exceeds 60%. This study aims to fill a gap of evidence-based implementation strategies targeting the optimization of MH treatment cascades in LMICs by testing a low-cost multicomponent implementation strategy integrated into routine government MH care in Mozambique.

METHODS

Using a cluster-randomized trial design, 16 clinics (8 intervention and 8 control) providing primary MH care will be randomized to the Systems Analysis and Improvement Approach for Mental Health (SAIA-MH) or an attentional placebo control. SAIA-MH is a multicomponent implementation strategy blending external facilitation, clinical consultation, and provider team meetings with system-engineering tools in an overall continuous quality improvement framework. Following a 6-month baseline period, intervention facilities will implement the SAIA-MH strategy for a 2-year intensive implementation period, followed by a 1-year sustainment phase. Primary outcomes will be the proportion of all patients diagnosed with a MH condition and receiving pharmaceutical-based treatment who achieve functional improvement, adherence to medication, and retention in MH care. The Consolidated Framework for Implementation Research (CFIR) will be used to assess determinants of implementation success. Specific Aim 1b will include the evaluation of mechanisms of the SAIA-MH strategy using longitudinal structural equation modeling as well as specific aim 2 estimating cost and cost-effectiveness of scaling-up SAIA-MH in Mozambique to provincial and national levels.

DISCUSSION

This study is innovative in being the first, to our knowledge, to test a multicomponent implementation strategy for MH care cascade optimization in LMICs. By design, SAIA-MH is a low-cost strategy to generate contextually relevant solutions to barriers to effective primary MH care, and thus focuses on system improvements that can be sustained over the long term. Since SAIA-MH is integrated into routine government MH service delivery, this pragmatic trial has the potential to inform potential SAIA-MH scale-up in Mozambique and other similar LMICs.

TRIAL REGISTRATION

ClinicalTrials.gov; NCT05103033 ; 11/2/2021.

Development and Refinement of the American Occupational Therapy Association's Knowledge Translation Toolkit

IMPORTANCE

Occupational therapy practitioners are expected to translate promising discoveries from empirical research into routine practice with their clients. However, complex barriers can influence practitioners' knowledge translation (KT) efforts, leading the American Occupational Therapy Association's Evidence-Based Practice (EBP) group to develop the KT Toolkit tailored to the perceived needs of occupational therapists and occupational therapy assistants.

OBJECTIVE

To identify common barriers to implementing EBPs and potential strategies to support EBP uptake.

DESIGN

Cross-sectional survey.

SETTING

United States.

PARTICIPANTS

Occupational therapy practitioners.

OUTCOMES AND MEASURES

Data underwent descriptive and directed content analysis, the latter of which was guided by the Consolidated Framework for Implementation Research.

RESULTS

Occupational therapy survey respondents (N = 818) identified common EBP implementation barriers (e.g., lack of time and resources, difficulty understanding research findings). Initial KT Toolkit content was developed to address these barriers and included resources for searching for, analyzing, and applying evidence in practice.

CONCLUSIONS AND RELEVANCE

Survey findings have informed the development of the KT Toolkit, which includes resources designed to support occupational therapy practitioners' EBP implementation efforts. This KT Toolkit is available at AOTA.org and will be continuously revised and updated on an ongoing basis. What This Article Adds: Several barriers limit the extent to which occupational therapy practitioners can implement evidence with their client populations. The KT Toolkit is directly informed by practitioner input and provides resources to support practitioners in their efforts to translate knowledge into real-world practice.

Understanding Engagement and the Potential Impact of an Electronic Drug Repository: Multi-Methods Study

BACKGROUND

Centralized drug repositories can reduce adverse events and inappropriate prescriptions by enabling access to dispensed medication data at the point of care; however, how they achieve this goal is largely unknown.

OBJECTIVE

This study aims to understand the perceived clinical value; the barriers to and enablers of adoption; and the clinician groups for which a provincial, centralized drug repository may provide the most benefit.

METHODS

A mixed methods approach, including a web-based survey and semistructured interviews, was used. Participants were clinicians (eg, nurses, physicians, and pharmacists) in Ontario who were eligible to use the digital health drug repository (DHDR), irrespective of actual use. Survey data were ranked on a 7-point adjectival scale and analyzed using descriptive statistics, and interviews were analyzed using qualitative descriptions.

RESULTS

Of the 161 survey respondents, only 40 (24.8%) actively used the DHDR. Perceptions of the utility of the DHDR were neutral (mean scores ranged from 4.11 to 4.76). Of the 75.2% (121/161) who did not use the DHDR, 97.5% (118/121) rated access to medication information (eg, dose, strength, and frequency) as important. Reasons for not using the DHDR included the cumbersome access process and the perception that available data were incomplete or inaccurate. Of the 33 interviews completed, 26 (79%) were active DHDR users. The DHDR was a satisfactory source of secondary information; however, the absence of medication instructions and prescribed medications (which were not dispensed) limited its ability to provide a comprehensive profile to meaningfully support clinical decision-making.

CONCLUSIONS

Digital drug repositories must be adjusted to align with the clinician's needs to provide value. Ensuring integration with point-of-care systems, comprehensive clinical data, and streamlined onboarding processes would optimize clinically meaningful use. The electronic provision of accessible drug information to providers across health care settings has the potential to improve efficiency and reduce medication errors.

The Coordination Toolkit and Coaching Project: Cluster-Randomized Quality Improvement Initiative to Improve Patient Experience of Care Coordination

BACKGROUND

Given persistent gaps in coordination of care for medically complex primary care patients, efficient strategies are needed to promote better care coordination.

OBJECTIVE

The Coordination Toolkit and Coaching project compared two toolkit-based strategies of differing intensity to improve care coordination at VA primary care clinics.

DESIGN

Multi-site, cluster-randomized QI initiative.

PARTICIPANTS

Twelve VA primary care clinics matched in 6 pairs.

INTERVENTIONS

We used a computer-generated allocation sequence to randomize clinics within each pair to two implementation strategies. Active control clinics received an online toolkit with evidence-based tools and QI coaching manual. Intervention clinics received the online toolkit plus weekly assistance from a distance coach for 12 months.

MAIN MEASURES

We quantified patient experience of general care coordination using the Health Care System Hassles Scale (primary outcome) mailed at baseline and 12-month follow-up to serial cross-sectional patient samples. We measured the difference-in-difference (DiD) in clinic-level-predicted mean counts of hassles between coached and non-coached clinics, adjusting for clustering and patient characteristics using zero-inflated negative binomial regression and bootstrapping to obtain 95% confidence intervals. Other measures included care coordination QI projects attempted, tools adopted, and patient-reported exposure to projects.

KEY RESULTS

N = 2,484 (49%) patients completed baseline surveys and 2,481 (48%) completed follow-ups. Six coached clinics versus five non-coached clinics attempted QI projects. All coached clinics versus two non-coached clinics attempted more than one project or projects that were multifaceted (i.e., involving multiple components addressing a common goal). Five coached versus three non-coached clinics used 1-2 toolkit tools. Both the coached and non-coached clinics experienced pre-post reductions in hassle counts over the study period (- 0.42 (- 0.76, - 0.08) non-coached; - 0.40 (- 0.75, - 0.06) coached). However, the DiD (0.02 (- 0.47, 0.50)) was not statistically significant; coaching did not improve patient experience of care coordination relative to the toolkit alone.

CONCLUSION

Although coached clinics attempted more or more complex QI projects and used more tools than non-coached clinics, coaching provided no additional benefit versus the online toolkit alone in patient-reported outcomes.

TRIAL REGISTRATION

ClinicalTrials.gov identifier: NCT03063294.

Self in medicine: Determinants of physician well-being and future directions in improving wellness

CONTEXT

Medicine, a profession dedicated to the wellness of patients, is struggling with a crisis of physician and trainee wellness. Physicians and trainees are burning out at alarming rates. Historically, medicine has been characterised by challenging working conditions and inattention to physician wellness and self-care. Healthy physicians are better at promoting wellness to their patients, and physicians who are suffering from burnout can deliver compromised patient care.

DISCUSSION

In recent years, research has increasingly focused on the causes of unwellness among doctors, and a broad range of health determinants have been identified. Studies of interventions for improving trainee and physician wellness have identified individual-focused and organisational approaches that can address the root causes of burnout. Insights from the corporate workplace may help guide interventions. Strategies for addressing physician burnout and improving wellness will involve innovative and multifaceted approaches. Despite a growing emphasis of physician wellness in the literature, implementation of wellness interventions is lagging, and quality improvement methods can address these challenges.

CONCLUSION

Physician wellness is a shared responsibility among doctors, health care organisations and governing bodies. Addressing burnout and improving physician wellness will require transformational change and the embracement of a culture of wellness in medicine. Quality improvement methods are the next step in identifying effective wellness interventions and the targeted groups of physicians and trainees who will most benefit.

Translating Violence Prevention Programs from Research to Practice: SafERteens Implementation in an Urban Emergency Department

BACKGROUND

Youth violence is a leading cause of adolescent mortality, underscoring the need to integrate evidence-based violence prevention programs into routine emergency department (ED) care.

OBJECTIVES

To examine the translation of the SafERteens program into clinical care.

METHODS

Hospital staff provided input on implementation facilitators/barriers to inform toolkit development. Implementation was piloted in a four-arm effectiveness-implementation trial, with youth (ages 14-18 years) screening positive for past 3-month aggression randomized to either SafERteens (delivered remotely or in-person) or enhanced usual care (EUC; remote or in-person), with follow-up at post-test and 3 months. During maintenance, ED staff continued in-person SafERteens delivery and external facilitation was provided. Outcomes were measured using the RE-AIM implementation framework.

RESULTS

SafERteens completion rates were 77.6% (52/67) for remote and 49.1% (27/55) for in-person delivery. In addition to high acceptability ratings (e.g., helpfulness), post-test data demonstrated increased self-efficacy to avoid fighting among patients receiving remote (incidence rate ratio [IRR] 1.22, 95% confidence interval [CI] 1.09-1.36) and in-person (IRR 1.23, 95% CI 1.12-1.36) SafERteens, as well as decreased pro-violence attitudes among patients receiving remote (IRR 0.83, 95% CI 0.75-0.91) and in-person (IRR 0.87, 95% CI 0.77-0.99) SafERteens when compared with their respective EUC groups. At 3 months, youth receiving remote SafERteens reported less non-partner aggression (IRR 0.52, 95% CI 0.31-0.87, Cohen's d -0.39) and violence consequences (IRR 0.47, 95% CI 0.22-1.00, Cohen's d -0.49) compared with remote EUC; no differences were noted for in-person SafERteens delivery. Barriers to implementation maintenance included limited staff availability and a lack of reimbursement codes.

CONCLUSIONS

Implementing behavioral interventions such as SafERteens into routine ED care is feasible using remote delivery. Policymakers should consider reimbursement for violence prevention services to sustain long-term implementation.

Evidence on scaling in health and social care: protocol for a living umbrella review

BACKGROUND

There is a growing interest in scaling effective health innovations to promote equitable access to high-quality health services worldwide. However, multiple challenges persist in scaling innovations. In this study, we aim to summarize the scaling evidence in the health and social care literature and identify current knowledge gaps.

METHODS

We will conduct a living umbrella review according to the Joanna Briggs Institute Reviewers' Manual. We will consider all knowledge syntheses addressing scaling in health or social care (e.g., any setting, any clinical area) and conducted in a systematic way. We will search the following electronic databases: MEDLINE (Ovid), Embase, PsychINFO (Ovid), CINAHL (EBSCO), Web of Science, The Cochrane Library, Sociological Abstract (Proquest), Academic Search Premier (EBSCO), and Proquest Dissertations & Theses Global, from inception. Furthermore, we will conduct searches of the grey literature. No restriction regarding date or language will be applied. Each phase of the review will be processed by two independent reviewers. We will develop a data extraction form on Covidence. We will assess the methodological quality of the included reviews using AMSTAR2 and the risk of bias using ROBIS. Results will be presented in tabular form and accompanied by a narrative synthesis covering the traditional themes of scaling science that emerge from the analysis, such as coverage, range, and sustainability, as well as themes less covered in the literature, including reporting guidance, models, tools, barriers, and/or facilitators to scaling innovations, evidence regarding application in high-income or low-income countries, and end-user engagement. We will disseminate the findings via publications and through relevant networks.

DISCUSSION

The findings of the umbrella review will facilitate access to scaling evidence in the literature and help strengthen the science of scaling for researchers, policy makers, and program managers. Finally, this work will highlight important knowledge gaps and help prioritize future research questions.

SYSTEMATIC REVIEW REGISTRATION

This protocol was registered with the International Prospective Register of Systematic Reviews (PROSPERO) on November 11, 2020 (registration number: CRD42020183774 ).

Development and Pilot Test of a Culturally Relevant Toolkit to Enhance Advance Care Planning With Chinese American Patients

BACKGROUND

First-generation Chinese American patients have low engagement in advance care planning (ACP). Among the causes may be clinician uncertainty about traditional cultural values.

AIM

Based on a survey identifying barriers to ACP among older ethnic Chinese American patients, we created a toolkit to support clinicians in culturally relevant ACP practices and conducted a pilot test to evaluate usability, acceptability, and preliminary outcomes.

DESIGN/SETTING/PARTICIPANTS

The toolkit includes culturally relevant information and an ACP guideline with a prompt list of questions. Six clinicians (three physicians, two nurse practitioners, and one physician assistant) in two New York City-based practices piloted the toolkit through discussions with 66 patients.

RESULTS

Patients' age averaged 70.2 years (SD=12.4); 56.1% were women. Almost two-thirds had not finished high school and 53.0% spoke only Cantonese. More than three-quarters (78.8%) did not understand the purpose of ACP before the discussion. During the discussion, 58 patients (87.9%) completed a new proxy naming a health care agent, 21 (31.8%) requested a nonhospital DNR order, and two (3%) completed a living will. Topics discussed included treatment preferences (discussed with 80.3% of patients); health care values (77.3%); treatment decisions (72.7%); goals of care (68.2%), and hospice (1.5%). Five of the six clinicians expressed satisfaction ("very" or "somewhat") with the toolkit, four were "very" comfortable using it, and three stated that it helped them "a lot" with effective discussions.

CONCLUSIONS

An ACP toolkit may facilitate culturally relevant ACP discussions by increasing clinician competency and patient engagement. Further studies of this approach are needed.

Developing Healthcare Team Observations for Patient Safety (HTOPS): senior medical students capture everyday clinical moments

BACKGROUND

Aviation has used a real-time observation method to advance anonymised feedback to the front-line and improve safe practice. Using an experiential learning method, this pilot study aimed to develop an observation-based real-time learning tool for final-year medical students with potential wider use in clinical practice.

METHODS

Using participatory action research, we collected data on medical students' observations of real-time clinical practice. The observation data was analysed thematically and shared with a steering group of experts to agree a framework for recording observations. A sample of students (observers) and front-line clinical staff (observed) completed one-to-one interviews on their experiences. The interviews were analysed using thematic analysis.

RESULTS

Thirty-seven medical students identified 917 issues in wards, theatres and clinics in an acute hospital trust. These issues were grouped into the themes of human influences, work environment and systems. Aviation approaches were adapted to develop an app capable of recording real-time positive and negative clinical incidents. Five students and eleven clinical staff were interviewed and shared their views on the value of a process that helped them learn and has the potential to advance the quality of practice. Concerns were shared about how the observational process is managed.

CONCLUSION

The study developed an app (Healthcare Team Observations for Patient Safety-HTOPS), for recording good and poor clinical individual and team behaviour in acute-care practice. The process advanced medical student learning about patient safety. The tool can identify the totality of patient safety practice and illuminate strength and weakness. HTOPS offers the opportunity for collective ownership of safety concerns without blame and has been positively received by all stakeholders. The next steps will further refine the app for use in all clinical areas for capturing light noise.

Toolkit and distance coaching strategies: a mixed methods evaluation of a trial to implement care coordination quality improvement projects in primary care

Background

Care coordination tools and toolkits can be challenging to implement. Practice facilitation, an active but expensive strategy, may facilitate toolkit implementation. We evaluated the comparative effectiveness of distance coaching, a form of practice facilitation, for improving the implementation of care coordination quality improvement (QI) projects.

Methods

We conducted a mixed methods evaluation of the Coordination Toolkit and Coaching (CTAC) initiative. Twelve matched US Veterans Health Administration primary care clinics were randomized to receive coaching and an online care coordination toolkit (“coached”; n = 6) or access to the toolkit only (“non-coached”; n = 6). We did interviews at six, 12, and 18 months. For coached sites, we‘ly collected site visit fieldnotes, prospective coach logs, retrospective coach team debriefs, and project reports. We employed matrix analysis using constructs from the Consolidated Framework for Implementation Research and a taxonomy of outcomes. We assessed each site’s project(s) using an adapted Complexity Assessment Tool for Systematic Reviews.

Results

Eleven sites implemented a local CTAC project. Eight sites (5 coached, 3 non-coached) used at least one tool from the toolkit. Coached sites implemented significantly more complex projects than non-coached sites (11.5 vs 7.5, 95% confidence interval 1.75–6.25, p < 0.001); engaged in more formal implementation processes (planning, engaging, reflecting and evaluating); and generally had larger, more multidisciplinary QI teams. Regardless of coaching status, sites focused on internal organizational improvement and low-intensity educational projects rather than the full suite of care coordination tools. At 12 months, half the coached and non-coached sites had clinic-wide project implementation; the remaining coached sites had implemented most of their project(s), while the remaining non-coached sites had either not implemented anything or conducted limited pilots. At 18 months, coached sites reported ongoing effort to monitor, adapt, and spread their CTAC projects, while non-coached sites did not report much continuing work. Coached sites accrued benefits like improved clinic relationships and team QI skill building that non-coached sites did not describe.

Conclusions

Coaching had a positive influence on QI skills of (and relationships among) coached sites’ team members, and the scope and rigor of projects. However, a 12-month project period was potentially too short to ensure full project implementation or to address cross-setting or patient-partnered initiatives.

Trial registration

NCT03063294.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12913-021-06850-1.

From implementation to sustainment: A large-scale adverse event disclosure support program generated through embedded research in the Veterans Health Administration

In 2008, the Veterans Health Administration published a groundbreaking policy on disclosing large-scale adverse events to patients in order to promote transparent communication in cases where harm may not be obvious or even certain. Without embedded research, the evidence on whether or not implementation of this policy was generating more harm than good among Veteran patients was unknown. Through an embedded research-operations partnership, we conducted four research projects that led to the development of an evidence-based large-scale disclosure toolkit and disclosure support program, and its implementation across VA healthcare. Guided by the Consolidated Framework for Implementation Research, we identified specific activities corresponding to planning, engaging, executing, reflecting and evaluating phases in the process of implementation. These activities included planning with operational leaders to establish a shared research agenda; engaging with stakeholders to discuss early results, establishing buy-in of our efforts and receiving feedback; joining existing operational teams to execute the toolkit implementation; partnering with clinical operations to evaluate the toolkit during real-time disclosures; and redesigning the toolkit to meet stakeholders' needs. Critical lessons learned for implementation success included a need for stakeholder collaboration and engagement, an organizational culture involving a strong belief in evidence, a willingness to embed researchers in clinical operation activities, allowing for testing and evaluation of innovative practices, and researchers open to constructive feedback. At the conclusion of the research, VA operations worked with the researchers to continue to support efforts to spread, scale-up and sustain toolkit use across the VA healthcare system, with the final goal to establish long-term sustainability.

Development and rapid rollout of The QUiPP App Toolkit for women who arrive in threatened preterm labour

BACKGROUND

Often the first opportunity for clinicians to assess risk of preterm birth is when women present with threatened preterm labour symptoms (such as period-like pain, tightening's or back ache). However, threatened preterm labour symptoms are not a strong predictor of imminent birth. Clinicians are then faced with a complex clinical dilemma, the need to ameliorate the consequences of preterm birth requires consideration with the side-effects and costs. The QUiPP app is a validated app which can aid clinicians when they triage a women who is in threatened preterm labour.

AIM

Our aim was to produce a toolkit to promote a best practice pathway for women who arrive in threatened preterm labour.

METHODS

We worked with two hospitals in South London. This included the aid of a toolkit midwife at each hospital. We also undertook stakeholder focus groups and worked with two Maternity Voice Partnership groups to ensure a diverse range of voices was heard in the toolkit development. While we aimed to produce the toolkit in September 2020, we rapidly rolled out and produced the first version of the toolkit in April 2020 due to COVID-19. As the QUiPP app can reduce admissions and hospital transfers, there was a need to enable all hospitals in England to have access to the toolkit as soon as possible.

RESULTS

While the rapid rollout of The QUiPP App Toolkit due to COVID-19 was not planned, it has demonstrated that toolkits to improve clinical practice can be produced promptly. Through actively welcoming continued feedback meant the initial version of the toolkit could be continually and iteratively refined. The toolkit has been recommended nationally, with National Health Service England recommending the app and toolkit in their COVID-19 update to the Saving Babies Lives Care Bundle and in the British Association of Perinatal Medicine Antenatal Optimisation Toolkit.

Utilization and effects of mobile electronic clinical decision support on pediatric asthma care quality in the emergency department and inpatient setting

OBJECTIVE

To determine utilization and impacts of a mobile electronic clinical decision support (mECDS) on pediatric asthma care quality in emergency department and inpatient settings.

METHODS

We conducted an observational study of a mECDS tool that was deployed as part of a multi-dimensional, national quality improvement (QI) project focused on pediatric asthma. We quantified mECDS utilization using cumulative screen views over the study period in the city in which each participating site was located. We determined associations between mECDS utilization and pediatric asthma quality metrics using mixed-effect logistic regression models (adjusted for time, site characteristics, site-level QI project engagement, and patient characteristics).

RESULTS

The tool was offered to clinicians at 75 sites and used on 286 devices; cumulative screen views were 4191. Children's hospitals and sites with greater QI project engagement had higher cumulative mECDS utilization. Cumulative mECDS utilization was associated with significantly reduced odds of hospital admission (OR: 0.95, 95% CI: 0.92-0.98) and higher odds of caregiver referral to smoking cessation resources (OR: 1.08, 95% CI: 1.01-1.16).

DISCUSSION

We linked mECDS utilization to clinical outcomes using a national sample and controlling for important confounders (secular trends, patient case mix, and concomitant QI efforts). We found mECDS utilization was associated with improvements in multiple measures of pediatric asthma care quality.

CONCLUSION

mECDS has the potential to overcome barriers to dissemination and improve care on a broad scale. Important areas of future work include improving mECDS uptake/utilization, linking clinicians' mECDS usage to clinical practice, and studying mECDS's impacts on other common pediatric conditions.

Developing and implementing a culturally informed mily otivational ngagement trategy (FAMES) to increase family engagement in first episode psychosis programs: mixed methods pilot study protocol

INTRODUCTION

Despite the proven effectiveness of coordinated specialty care (CSC) programmes for first episode psychosis in the USA, CSC programmes often have low levels of engagement in family psychoeducation, and engagement of racial and ethnic minority family members is even lower than that for non-Latino white family members. The goal of this study is to develop and evaluate a culturally informed FAmily Motivational Engagement Strategy (FAMES) and implementation toolkit for CSC providers.

METHODS AND ANALYSIS

This protocol describes a mixed methods, multi-phase study that blends intervention mapping and the Promoting Action on Research in Health Services framework to develop, modify and pilot-test FAMES and an accompanying implementation toolkit. Phase 1 will convene a Stakeholder Advisory Committee to inform modifications based on findings from phases 1 and 2. During phase 1, we will also recruit approximately 200 family members to complete an online survey to assess barriers and motivation to engage in treatment. Phase 2 we will recruit five family members into a 3-month trial of the modified FAMES and implementation toolkit. Results will guide the advisory committee in refining the intervention and implementation toolkit. Phase 3 will involve a 16-month non-randomised, stepped-wedge trial with 50 family members from five CSC programmes in community-based mental health clinics to examine the acceptability, feasibility and initial impact of FAMES and the implementation toolkit.

ETHICS AND DISSEMINATION

This study received Institutional Review Board approval from Washington State University, protocol #17 812-001. Results will be disseminated via peer review publications, presentations at national and international conferences, and to local community mental health agencies and committees.

TRIAL REGISTRATION NUMBER

ClinicalTrials.gov Registry (NCT04188366).

Contextual factors favouring success in the accreditation process in Colombian hospitals: a nationwide observational study

Background

To identify context factors associated with and predicting success in the hospital accreditation process, and to contribute to the understanding of the relative relevance of context factors and their organizational level in the success of QI initiatives.

Methods

Analytical study of cases and controls in a sample of hospitals of medium and high complexity in Colombia. Cases (n = 16) are accredited hospitals by the time of preparation of the study (2016) and controls (n = 38) are similar facilities, which have not succeeded to obtain accreditation. Eligibility criteria for both groups included complexity (medium and high), having emergency services, an official quality assurance license, and being in operation for at least 15 years. Besides eligibility criteria, geographical location, and type of ownership (public/private) are used to select controls to match cases.

Context measures are assessed using a survey instrument based on the MUSIQ model (“Model for Understanding Success in Quality”) adapted and tested in Colombia. Statistical analysis includes descriptive measures for twenty-three context factors, testing for significant statistical differences between accredited and non-accredited hospitals, and assessing the influence and strength of association of context factors on the probability of success in the accreditation process. A multivariate model assesses the predictive probability of achieving accreditation.

Results

Eighteen (78.3%) of the twenty-three context factors are significantly different when comparing cases and controls hospitals, particularly at the Microsystem level; all factors are statistically significant in favor of accredited hospitals. Five context factors are strongly associated to the achievement of accreditation but in the logistic multivariable model, only two of them remain with significant OR, one in the Macrosystem, “Availability of economic resources for QI” (OR: 22.1, p: 0,005), and the other in the Microsystem, “Involvement of physicians” (OR: 4.9, p: 0,04).

Conclusion

This study has applied an instrument, based on the MUSIQ model, which allows assessing the relevance of different context factors and their organizational level in hospitals, to explain success in the accreditation process in Colombia. Internal macrosystem and microsystem seem to be more relevant than external environment factors.

Implementing Exercise in Healthcare Settings: The Potential of Implementation Science

Exercise is an efficacious therapy for many chronic diseases. Integrating efficacious evidence-based interventions (EBIs), such as exercise, into daily healthcare practice is a slow and complex pursuit. Implementation science seeks to understand and address this phenomenon by conducting studies about the methods used to promote the routine uptake of EBIs. The purpose of this article is to explore implementation science and a common conceptual framework in the discipline, the Consolidated Framework for Implementation Research (CFIR), as it applies to exercise EBI. We conclude by offering recommendations for future research that leverage implementation science priorities to highlight the potential of this research field for advancing the implementation of exercise EBI.

Review of Web-Based Toolkits for Health Care Practitioners Working With Women and Girls Affected by or at Risk of Female Genital Mutilation/Cutting

Increased migration has given rise to more advocacy efforts against female genital mutilation or cutting (FGM/C), legislation that criminalizes the practice, and guidance to the health sector for managing care of affected groups. More women and girls who have been cut or who are at risk of FGM/C are migrating from regions where it is common to countries where it is not and interacting with health professionals and other community practitioners in these host countries. Despite numerous studies on the negative health impacts of FGM/C, little is known about toolkits on FGM/C that providers can use in their prevention and response efforts. We sought to explore the nature of Internet-based products referenced as toolkits and materials characteristic of toolkits aimed at different service providers who may interact with women and girls affected by FGM/C. Through an online search, we identified 45 toolkits and collected data about each one. We found that the toolkits targeted different audiences and offered a diverse set of information and resources. The majority of toolkits were aimed at health professionals and provided factual and epidemiological-focused content, yet many did not include research evidence, skills development application, or approaches for implementing the toolkit in practice. This review is the first completed in the area of FGM/C to show a rich diversity of online materials. Future toolkits can be improved with the provision of evidence-based information and practical skills development for use by health professionals in implementing best practices in working with women and girls affected by FGM/C.