Evaluation of an automated feedback intervention to improve antibiotic prescribing among primary care physicians (OPEN Stewardship): a multinational controlled interrupted time-series study

Tools to advance antimicrobial stewardship in the primary health care setting, where most antimicrobials are prescribed, are urgently needed. The aim of this study was to evaluate OPEN Stewarship (Online Platform for Expanding aNtibiotic Stewardship), an automated feedback intervention, among a cohort of primary care physicians. We performed a controlled, interrupted time-series study of 32 intervention and 725 control participants, consisting of primary care physicians from Ontario, Canada and Southern Israel, from October 2020 to December 2021. Intervention participants received three personalized feedback reports targeting several aspects of antibiotic prescribing. Study outcomes (overall prescribing rate, prescribing rate for viral respiratory conditions, prescribing rate for acute sinusitis, and mean duration of therapy) were evaluated using multilevel regression models. We observed a decrease in the mean duration of antibiotic therapy (IRR = 0.94; 95% CI: 0.90, 0.99) in intervention participants during the intervention period. We did not observe a significant decline in overall antibiotic prescribing (OR = 1.01; 95% CI: 0.94, 1.07), prescribing for viral respiratory conditions (OR = 0.87; 95% CI: 0.73, 1.03), or prescribing for acute sinusitis (OR = 0.85; 95% CI: 0.67, 1.07). In this antimicrobial stewardship intervention among primary care physicians, we observed shorter durations of therapy per antibiotic prescription during the intervention period. The COVID-19 pandemic may have hampered recruitment; a dramatic reduction in antibiotic prescribing rates in the months before our intervention may have made physicians less amenable to further reductions in prescribing, limiting the generalizability of the estimates obtained.IMPORTANCEAntibiotic overprescribing contributes to antibiotic resistance, a major threat to our ability to treat infections. We developed the OPEN Stewardship (Online Platform for Expanding aNtibiotic Stewardship) platform to provide automated feedback on antibiotic prescribing in primary care, where most antibiotics for human use are prescribed but where the resources to improve antibiotic prescribing are limited. We evaluated the platform among a cohort of primary care physicians from Ontario, Canada and Southern Israel from October 2020 to December 2021. The results showed that physicians who received personalized feedback reports prescribed shorter courses of antibiotics compared to controls, although they did not write fewer antibiotic prescriptions. While the COVID-19 pandemic presented logistical and analytical challenges, our study suggests that our intervention meaningfully improved an important aspect of antibiotic prescribing. The OPEN Stewardship platform stands as an automated, scalable intervention for improving antibiotic prescribing in primary care, where needs are diverse and technical capacity is limited.

EASY-NET Program: Effectiveness of an Audit and Feedback Intervention in the Emergency Care for Acute Conditions in the Lazio Region

The EASY-NET network program (NET-2016-02364191)-effectiveness of audit and feedback (A&F) strategies to improve health practice and equity in various clinical and organizational settings), piloted a novel and more structured A&F strategy. This study compared the effectiveness of the novel strategy against the sole periodic dissemination of indicators in enhancing the appropriateness and timeliness of emergency health interventions for patients diagnosed with acute myocardial infarction (AMI) and ischemic stroke in the Lazio Region. The efficacy of the intervention was assessed through a prospective quasi-experimental design employing a pre- and post-intervention (2021-2022) comparison with a control group. Participating hospitals in the Lazio Region, where professional teams voluntarily engaged in the intervention, constituted the exposed group, while the control group exclusively engaged in routine reporting activities. Effectiveness analysis was conducted at the patient level, utilizing regional health information systems to compute process and outcome indicators. The effectiveness of the intervention was evaluated using difference-in-difference models, comparing pre- and post-intervention periods between exposed and control groups. Estimates were calculated in terms of the difference in percentage points (PP) between absolute risks. Sixteen facilities for the AMI pathway and thirteen for the stroke pathway participated in the intervention. The intervention yielded a reduction in the proportion of 30-day readmissions following hospitalization for ischemic stroke by 0.54 pp in the exposed patients demonstrating a significant difference of -3.80 pp (95% CI: -6.57; -1.03; 5453 patients, 63.7% cases) in the exposed group compared to controls. However, no statistically significant differences attributable to the implemented A&F intervention were observed in other indicators considered. These results represent the first evidence in Italy of the impact of A&F interventions in an emergency setting, utilizing aggregated data from hospitals involved in the Lazio Region's emergency network.

Implementing Enhanced Recovery After Surgery for hysterectomy in a hospital network with audit and feedback: A stepped-wedge cluster randomised trial

OBJECTIVE

To evaluate the effectiveness of implementing the Enhanced Recovery After Surgery (ERAS) protocol in patients undergoing elective hysterectomy in a network of regional hospitals, supported by an intensive audit-and-feedback (A&F) approach.

DESIGN

A multi-centre, stepped-wedge cluster randomised trial (ClinicalTrials.gov NCT04063072).

SETTING

Gynaecological units in the Piemonte region, Italy.

POPULATION

Patients undergoing elective hysterectomy, either for cancer or for benign conditions.

METHODS

Twenty-three units (clusters), stratified by surgical volume, were randomised into four sequences. At baseline (first 3 months), standard care was continued in all units. Subsequently, the four sequences implemented the ERAS protocol successively every 3 months, after specific training. By the end of the study, each unit had a period in which standard care was maintained (control) and a period in which the protocol, supported by feedback, was applied (experimental).

MAIN OUTCOME MEASURES

Length of hospital stay (LOS), without outliers (>98th percentile).

RESULTS

Between September 2019 and May 2021, 2086 patients were included in the main analysis with an intention-to-treat approach: 1104 (53%) in the control period and 982 (47%) in the ERAS period. Compliance with the ERAS protocol increased from 60% in the control period to 76% in the experimental period, with an adjusted absolute difference of +13.3% (95% CI 11.6% to 15.0%). LOS, moving from 3.5 to 3.2 days, did not show a significant reduction (-0.12 days; 95% CI -0.30 to 0.07 days). No difference was observed in the occurrence of complications.

CONCLUSIONS

Implementation of the ERAS protocol for hysterectomy at the regional level, supported by an A&F approach, resulted in a substantial improvement in compliance, but without meaningful effects on LOS and complications. This study confirms the effectiveness of A&F in promoting important innovations in an entire hospital network and suggests the need of a higher compliance with the ERAS protocol to obtain valuable improvements in clinical outcomes.

Development of theoretically informed audit and feedback: An exemplar from a complex implementation strategy to improve asthma self-management in UK primary care

RATIONALE

Audit and feedback is an evidence-based implementation strategy, but studies reporting the use of theory to guide design elements are limited.

AIMS AND OBJECTIVES

Within the context of a programme of research aiming to improve the implementation of supported asthma self-management in UK primary care (IMPlementing IMProved Asthma self-management as RouTine [IMP2 ART]), we aimed to design and develop theoretically-informed audit and feedback that highlighted supported asthma self-management provision and areas for improvement in primary care general practices.

METHOD

Aligned with the Medical Research Council (MRC) complex intervention framework, the audit and feedback was developed in three phases: (1) Development: literature and theory exploration, and prototype audit and feedback design; (2) Feasibility: eliciting feedback on the audit and feedback from general practice staff (n = 9); (3) Prepiloting: delivering the audit and feedback within the IMP2 ART implementation strategy (incorporating patient and professional resources and an asthma review template) and eliciting clinician feedback (n = 9).

RESULTS

Audit and feedback design was guided by and mapped to existing literature suggestions and theory (e.g., Theoretical Domains Framework, Behaviour Change Technique Taxonomy). Feedback on the prototype audit and feedback confirmed feasibility but identified some refinements (a need to highlight supporting self-management and importance of asthma action plans). Prepiloting informed integration with other IMP2 ART programme strategies (e.g., patient resources and professional education).

CONCLUSION

We conclude that a multistage development process including theory exploration and mapping, contributed to the design and delivery of the audit and feedback. Aligned with the MRC framework, the IMP2 ART strategy (incorporating the audit and feedback) is now being tested in a UK-wide cluster randomised controlled trial.

Harnessing the potential of data-driven strategies to optimise transfusion practice

No one doubts the significant variation in the practice of transfusion medicine. Common examples are the variability in transfusion thresholds and the use of tranexamic acid for surgery with likely high blood loss despite evidence-based standards. There is a long history of applying different strategies to address this variation, including education, clinical guidelines, audit and feedback, but the effectiveness and cost-effectiveness of these initiatives remains unclear. Advances in computerised decision support systems and the application of novel electronic capabilities offer alternative approaches to improving transfusion practice. In England, the National Institute for Health and Care Research funded a Blood and Transplant Research Unit (BTRU) programme focussing on 'A data-enabled programme of research to improve transfusion practices'. The overarching aim of the BTRU is to accelerate the development of data-driven methods to optimise the use of blood and transfusion alternatives, and to integrate them within routine practice to improve patient outcomes. One particular area of focus is implementation science to address variation in practice.

Developing an Audit and Feedback Dashboard for Family Physicians: User-Centered Design Process

BACKGROUND

Audit and feedback (A&F), the summary and provision of clinical performance data, is a common quality improvement strategy. Successful design and implementation of A&F-or any quality improvement strategy-should incorporate evidence-informed best practices as well as context-specific end user input.

OBJECTIVE

We used A&F theory and user-centered design to inform the development of a web-based primary care A&F dashboard. We describe the design process and how it influenced the design of the dashboard.

METHODS

Our design process included 3 phases: prototype development based on A&F theory and input from clinical improvement leaders; workshop with family physician quality improvement leaders to develop personas (ie, fictional users that represent an archetype character representative of our key users) and application of those personas to design decisions; and user-centered interviews with family physicians to learn about the physician's reactions to the revised dashboard.

RESULTS

The team applied A&F best practices to the dashboard prototype. Personas were used to identify target groups with challenges and behaviors as a tool for informed design decision-making. Our workshop produced 3 user personas, Dr Skeptic, Frazzled Physician, and Eager Implementer, representing common users based on the team's experience of A&F. Interviews were conducted to further validate findings from the persona workshop and found that (1) physicians were interested in how they compare with peers; however, if performance was above average, they were not motivated to improve even if gaps compared to other standards in their care remained; (2) burnout levels were high as physicians are trying to catch up on missed care during the pandemic and are therefore less motivated to act on the data; and (3) additional desired features included integration within the electronic medical record, and more up-to-date and accurate data.

CONCLUSIONS

We found that carefully incorporating data from user interviews helped operationalize generic best practices for A&F to achieve an acceptable dashboard that could meet the needs and goals of physicians. We demonstrate such a design process in this paper. A&F dashboards should address physicians' data skepticism, present data in a way that spurs action, and support physicians to have the time and capacity to engage in quality improvement work; the steps we followed may help those responsible for quality improvement strategy implementation achieve these aims.

[Antimicrobial stewardship program in an Intensive Care Unit: A retrospective observational analysis of the results 15 months after its implementation]

OBJECTIVE

We aim to evaluate the adherence rate to an Antimicrobial Stewardship Program (ASP) in an Intensive Care Unit (ICU), and to assess its effect on the use of antibiotics, quality indicators and clinical outcomes.

METHODS

Retrospective description of the interventions proposed by the ASP. We compared antimicrobial use, quality and safety indicators in an ASP versus a non-ASP period. The study was performed in a polyvalent ICU of a medium-size University Hospital (600 beds). We studied patients admitted to the ICU for any cause during the ASP period, provided that a microbiological sample aiming to diagnose a potential infection has been drawn, or antibiotics have been started. We elaborated and registered of non-mandatory recommendations to improve antimicrobial prescription (audit and feedback structure) and its registry during the ASP period (15 months, October 2018-December 2019). We compared indicators in a period with ASP (April-June 2019) and without ASP (April-June 2018).

RESULTS

We issued 241 recommendations on 117 patients, 67% of them classified as de-escalation type. The rate of adherence to the recommendations was high (96.3%). In the ASP period, the mean number of antibiotics per patient (3.3±4.1 vs 2.4±1.7, p=0.04) and the days of treatment (155 DOT/100 PD vs 94 DOT/100 PD, p <0.01) were reduced. The implementation of the ASP did not compromise patient safety or produce changes in clinical outcomes.

CONCLUSIONS

The implementation of an ASP is widely accepted in the ICU, reducing the consumption of antimicrobials, without compromising patient safety.

Twenty years of monitoring acute stroke care in Australia through the national stroke audit programme (1999-2019): A cross-sectional study

BACKGROUND

National organisational surveys and clinical audits to monitor and guide improvements to the delivery of evidence-based acute stroke care have been undertaken in Australia since 1999. This study aimed to determine the association between repeated national audit cycles on stroke service provision and care delivery from 1999 to 2019.

METHODS

Cross-sectional study using data from organisational surveys (1999, 2004, 2007-2019) and clinical data from the biennial National Stroke Acute Audit (2007-2019). Age-, sex-, and stroke severity-adjusted proportions were reported for adherence to guideline-recommended care processes. Multivariable, logistic regression models were performed to determine the association between repeated audit cycles and service provision (organisational) and care delivery (clinical).

RESULTS

Overall, 197 hospitals provided organisational survey data (1999-2019), with 24,996 clinical cases from 136 hospitals (around 40 cases per audit) (2007-2019). We found significant improvements in service organisation between 1999 and 2019 for access to stroke units (1999: 42%, 2019: 81%), thrombolysis services (1999: 6%, 2019: 85%), and rapid assessment/management for patients with transient ischaemic attack (1999: 11%, 2019: 61%). Analyses of patient-level audits for 2007 to 2019 found the odds of receiving care processes per audit cycle to have significantly increased for thrombolysis (2007: 3%, 2019: 11%; OR 1.15, 95% CI 1.13, 1.17), stroke unit access (2007: 52%, 2019: 69%; OR 1.15, 95% CI 1.14, 1.17), risk factor advice (2007: 40%, 2019: 63%; OR 1.10, 95% CI 1.09, 1.12), and carer training (2007: 24%, 2019: 51%; OR 1.12, 95% CI 1.10, 1.15).

CONCLUSIONS

Between 1999 and 2019, the quality of acute stroke care in Australia has improved in line with best practice evidence. Standardised monitoring of stroke care can inform targeted efforts to reduce identified gaps in best practice, and illustrate the evolution of the health system for stroke.

Optimizing the Relationship Between Perioperative Personnel and Infection Preventionists to Reduce Surgical Site Infections

Prevention of surgical site infections (SSIs) is a critical aspect of ensuring positive patient outcomes. One of the challenges of SSI prevention is the communication barrier between perioperative staff members and infection preventionists (IPs), which may lead to frontline staff members who are primarily responsible for infection prevention being unaware of pertinent hospital SSI data. To overcome this challenge, IPs and perioperative staff members should develop a partnership that facilitates the sharing of feedback on SSI case review data and effective key performance indicators. A partnership also can help engage perioperative staff members in quality improvement efforts and increase collaboration with IPs. Perioperative leaders should identify effective methods to improve data transparency, SSI case reviews, audit and feedback programs, and education for perioperative team members. A strong perioperative-IP partnership and increased sharing of data in accessible formats may improve engagement and interest in SSI prevention.

Establishing obstetrics-specific metrics and interventions for antimicrobial stewardship

Background

To describe baseline antimicrobial stewardship (AMS) metrics and apply AMS interventions in an inpatient obstetrical population.

Methods

From October 2018 to October 2019, our tertiary-care obstetrical center reviewed components of our AMS program, which included: (1) antimicrobial consumption data, (2) point prevalence surveys (PPS), and (3) prospective audit and feedback. We reviewed institutional data for antimicrobial consumption from the pharmacy database. Detailed point prevalence surveys were conducted for all antimicrobial prescriptions on two predefined dates each month. Daily audits and feedback assessed the appropriateness of all non-protocolized antimicrobials.

Results

Our average antimicrobial length of therapy (LOT) was 12 days per 100 patient-days, where erythromycin (2.33), amoxicillin (2.28), and ampicillin (1.81) were the greatest contributors. Point prevalence surveys revealed that 28.8% of obstetrical inpatients were on antimicrobials, of which 11.2% were inappropriate. Protocolized antimicrobials were 62% less likely (p = 0.027) to be inappropriate. From 565 audited prescriptions, 110 (19.5%) resulted in feedback, where 90% of recommendations were accepted and implemented. The most common reasons for interventions include incorrect dosage, recommending a diagnostic test before continuing antimicrobials, and changing antimicrobials based on specific culture and sensitivity.

Conclusions

Antimicrobial use in obstetrics is unique compared to general inpatients. We provide a baseline set of metrics for AMS at our obstetrical center intending to lay the groundwork for AMS programming in our discipline. Antimicrobial protocolization, as well as audit and feedback, are feasible interventions to improve antimicrobial prescribing patterns.

Development of a Set of Indicators for Measuring and Improving Quality of Rehabilitation Care after Ischemic Stroke

Stroke is the leading global cause of permanent disability and the second leading cause of dementia within the first year of the event. Systematic quality improvement interventions such as Audit & Feedback (A&F) can monitor and improve the performance of post-stroke care in conjunction with the use of quality indicators (QIs). The scientific literature shows limited studies on quality improvement and QIs design for poststroke rehabilitation. In Italy, the National Outcomes Evaluation Programme (PNE) annually provides several QIs concerning the acute wards. On the contrary, indicators for quality assessment of post-acute stroke rehabilitation are not available nationwide. In recent years, the Italian Ministry of Health has funded a national network project, the aim of which is to provide and evaluate the effectiveness of A&F strategies in healthcare improvement. Part of this project is the development of a set of IQs for ischemic stroke rehabilitation used to conduct an A&F. In this study, we describe the design and development process of these QIs from administrative databases and report the results of the pilot test conducted on a small sample of Sicilian rehabilitation facilities, comparing them from 2019 to 2021. Feedback from the participating centers was mainly positive, and the quality indicators were found to be comprehensible and appreciated. However, the study highlighted the need for better adherence to indicators measuring processes of rehabilitation care. The set of quality indicators presented in this study, relevant to inpatient settings, could be considered a starting point on which to base quality improvement initiatives both nationally and internationally.

Feedback on audit and action planning for dental caries control: a qualitative study to investigate the acceptability among interdisciplinary pediatric dental care teams

Introduction

American Indian and Alaska Native children suffer from the poorest oral health of all populational groups in the United States. Evidence-based practices (EBP) for caries control are well established, but systematically implementing such practices have proven difficult. Audit and feedback with goal setting, and action planning to implement these EBPs have not been tested or adapted for Alaska Native healthcare settings. The aim of this study was to investigate acceptability and perceived feasibility of an audit and feedback intervention for pediatric dental caries control among dental providers and patient stakeholders.

Methods

The pilot program was implemented in two dental clinics from a tribal healthcare consortium in Alaska. Key-informant interviews were conducted to investigate the contextual, organizational, and behavioral facilitators and barriers to the implementation and expansion of the program. Interview transcripts were analyzed by two researchers using thematic analysis.

Results

Eight key informants were interviewed twice (during and after the intervention period), and one once, for a total of 17 interviews. Patient stakeholders were not interviewed due to COVID-19 pandemic clinic closures and social isolation mandates. Three principal themes emerged: a positive organizational climate and culture fostered the acceptability of the program, the positive impacts of the program observed in the pediatric dental teams and the organization, and the challenges to implement the program including understanding the data reports, trusting the accuracy of the data, and competing priorities.

Conclusions

The intervention of audit and feedback with goal setting and action planning was well accepted and perceived as feasible by the study participants given the financial and human resources provided by the research project. This qualitative study can inform the design and evaluation of process-oriented implementation strategies geared towards decreasing health inequities and improving health outcomes, such as dental caries in American Indian and Alaska Native children and adolescents.

EASY-NET Program: Methods and Preliminary Results of an Audit and Feedback Intervention in the Emergency Care for Acute Myocardial Infarction in the Lazio Region, Italy

Within the EASY-NET network program (NET-2016-02364191), Work Package 1 Lazio evaluates the effectiveness of a structured audit and feedback (A&F) intervention compared with the web-based regional periodic publication of indicators in improving the appropriateness and timeliness of emergency healthcare for acute myocardial infarction (AMI). This work describes the A&F methodology and presents the results of the first feedback delivered. The intervention involves sending periodic reports via e-mail to participating hospitals. The feedback reports include a set of volume and quality (process and outcome) indicators, calculated by facility through the health information system of the Lazio Region and compared with regional mean, target values and values calculated for hospitals with similar volumes of activity. Health managers and clinicians of each participating hospital represent the "feedback recipients". They are invited to organize clinical and organizational audit meetings to identify possible critical issues in the care pathway and define, where necessary, improvement actions. A total of 16 facilities are involved. Twelve facilities present high volumes in all volume indicators, while three facilities present low volumes for each indicator. Concerning the quality indicators, four facilities do not present critical indicators or had average results, three facilities do not present critical indicators but show average results in at least one of the indicators and six facilities present a critical value for at least one of the indicators. The first report highlighted some critical issues in some facilities on several indicators. During the audit meetings, each facility analyzes these issues, defining appropriate improvement actions. The outcome of these actions will be monitored through subsequent reporting to support the continuous care quality improvement process.

An Electronic Dashboard to Improve Dosing of Hydroxychloroquine Within the Veterans Health Care System: Time Series Analysis

BACKGROUND

Hydroxychloroquine (HCQ) is commonly used for patients with autoimmune conditions. Long-term use of HCQ can cause retinal toxicity, but this risk can be reduced if high doses are avoided.

OBJECTIVE

We developed and piloted an electronic health record-based dashboard to improve the safe prescribing of HCQ within the Veterans Health Administration (VHA). We observed pilot facilities over a 1-year period to determine whether they were able to improve the proportion of patients receiving inappropriate doses of HCQ.

METHODS

Patients receiving HCQ were identified from the VHA corporate data warehouse. Using PowerBI (Microsoft Corp), we constructed a dashboard to display patient identifiers and the most recent HCQ dose and weight (flagged if ≥5.2 mg/kg/day). Six VHA pilot facilities were enlisted to test the dashboard and invited to participate in monthly webinars. We performed an interrupted time series analysis using synthetic controls to assess changes in the proportion of patients receiving HCQ ≥5.2 mg/kg/day between October 2020 and November 2021.

RESULTS

At the start of the study period, we identified 18,525 total users of HCQ nationwide at 128 facilities in the VHA, including 1365 patients at the 6 pilot facilities. Nationwide, at baseline, 19.8% (3671/18,525) of patients were receiving high doses of HCQ. We observed significant improvements in the proportion of HCQ prescribed at doses ≥5.2 mg/kg/day among pilot facilities after the dashboard was deployed (-0.06; 95% CI -0.08 to -0.04). The difference in the postintervention linear trend for pilot versus synthetic controls was also significant (-0.06; 95% CI -0.08 to -0.05).

CONCLUSIONS

The use of an electronic health record-based dashboard reduced the proportion of patients receiving higher than recommended doses of HCQ and significantly improved performance at 6 VHA facilities. National roll-out of the dashboard will enable further improvements in the safe prescribing of HCQ.

The rate of cesarean delivery changes after internal audit based on the Robson Ten Group Classification System in Lebanon

OBJECTIVE

To evaluate the efficiency of the Robson classification as an internal clinical audit and feedback of the high rate of cesarean delivery at Hotel Dieu de France, a tertiary referral hospital.

METHODS

A pre-post study was conducted, with a retrospective approach in 2018 and 2019, identified as the pre-period (before the implementation of the Robson classification), and with a prospective approach in 2020 and 2021, labeled the post-period.

RESULTS

The total number of deliveries during the study period was 2560; 1305 patients were included in the pre-period and 1255 patients delivered in the post-period. No significant differences between the two groups were found. No significant difference was found in the overall rate of cesarean delivery between the first and second periods (57.86% vs 56.72%; P = 0.2). However, a significant decrease in the absolute contribution of groups 3 and 4 (multiparous women without a previous uterine scar with a single cephalic pregnancy, ≥37 weeks of gestation, with spontaneous labor or induced labor) in the overall rate of cesarean delivery was remarked (P = 0.02 and 0.01, respectively).

CONCLUSION

The Robson classification seems to be appropriate to monitor and audit the rate of cesarean delivery, but not sufficient to decrease the rate and change the practice.

A cluster-randomized trial of two implementation strategies to deliver audit and feedback in the EQUIPPED medication safety program

OBJECTIVES

The Enhancing the Quality of Prescribing Practices for Older Adults Discharged from the Emergency Department (EQUIPPED) medication safety program involves three core components including provider education, clinical decision support, and audit and feedback using the American Geriatrics Society Beers Criteria to determine potentially inappropriate medications (PIMs). This study evaluated implementation of audit and feedback through a centralized informatics-based dashboard compared to academic detailing delivered one on one by an EQUIPPED champion.

METHODS

In a cluster-randomized study (October 2019-September 2021), eight VA emergency department (EDs) implemented either the academic detailing (n = 4) or the dashboard (n = 4) strategy for the audit and feedback component of EQUIPPED. The primary outcome was the monthly proportion of PIMs prescribed to Veterans 65 years or older at ED discharge. Poisson regression was used to evaluate the proportion of PIMs prescribed 6 months prior to EQUIPPED implementation compared to 12 months following implementation.

RESULTS

Eight VA ED sites successfully implemented the EQUIPPED program. During the 6-month baseline period, the academic detailing and dashboard sites had similar PIM prescribing rates of 8.01% for academic detailing versus 8.04% for dashboard (p = 0.90). Comparing 12 months of prescribing data after EQUIPPED implementation, the academic detailing group significantly improved PIM prescribing (7.07%) compared to the dashboard group (8.10%; odds ratio 1.14, 95% confidence interval 1.08-1.22, p ≤ 0.0001). Within the groups, two of the four academic detailing sites demonstrated statistically significant reductions in PIM prescribing. One of the four dashboard sites achieved nearly 50% relative reduction in PIM prescribing.

CONCLUSIONS

Eight VA EDs successfully implemented the core components of the EQUIPPED program amid the unprecedented challenges posed by the COVID-19 pandemic. While the academic detailing approach to EQUIPPED audit and feedback was more effective at the group level to improve safe prescribing for older Veterans discharged from the ED, the trial suggests that dashboard-based audit and feedback is a reasonable strategy in resource-limited settings.

Precision public-health intervention for care coordination: a real-world study

BACKGROUND

Health emergencies disproportionally affect vulnerable populations. Digital tools can help primary care providers find, and reach, the right patients.

AIM

To evaluate whether digital interventions delivered directly to GPs' clinical software were more effective at promoting primary care appointments during the COVID-19 pandemic than interventions delivered by post.

DESIGN AND SETTING

Real-world, non-randomised, interventional study involving GP practices in all Australian states.

METHOD

Intervention material was developed to promote care coordination for vulnerable older veterans during the COVID-19 pandemic, and sent to GPs either digitally to the clinical practice software system or in the post. The intervention material included patient-specific information sent to GPs to support care coordination, and education material sent via post to veterans identified in the administrative claims database. To evaluate the impact of intervention delivery modalities on outcomes, the time to first appointment with the primary GP was measured; a Cox proportional hazards model was used, adjusting for differences and accounting for pre-intervention appointment numbers.

RESULTS

The intervention took place in April 2020, during the first weeks of COVID-19 social distancing restrictions in Australia. GPs received digital messaging for 51 052 veterans and postal messaging for 26 859 veterans. The digital group was associated with earlier appointments (adjusted hazard ratio 1.38 [1.34 to 1.41]).

CONCLUSION

Data-driven digital solutions can promote care coordination at scale during national emergencies, opening up new perspectives for precision public-health initiatives.

Characterizing the Gaps Between Best-Practice Implementation Strategies and Real-world Implementation: Qualitative Study Among Family Physicians Who Engaged With Audit and Feedback Reports

BACKGROUND

In Ontario, Canada, a government agency known as Ontario Health is responsible for making audit and feedback reports available to all family physicians to encourage ongoing quality improvement. The confidential report provides summary data on 3 key areas of practice: safe prescription, cancer screening, and diabetes management.

OBJECTIVE

This report was redesigned to improve its usability in line with evidence. The objective of this study was to explore how the redesign was perceived, with an emphasis on recipients' understanding of the report and their engagement with it.

METHODS

We conducted qualitative semistructured interviews with family physicians who had experience with both versions of the report recruited through purposeful and snowball sampling. We analyzed the transcripts following an emergent and iterative approach.

RESULTS

Saturation was reached after 17 family physicians participated. In total, 2 key themes emerged as factors that affected the perceived usability of the report: alignment between the report and the recipients' expectations and capacity to engage in quality improvement. Family physicians expected the report and its quality indicators to reflect best practices and to be valid and accurate. They also expected the report to offer feedback on the clinical activities they perceived to be within their control to change. Furthermore, family physicians expected the goal of the report to be aligned with their perspective on feasible quality improvement activities. Most of these expectations were not met, limiting the perceived usability of the report. The capacity to engage with audit and feedback was hindered by several organizational and physician-level barriers, including the lack of fit with the existing workflow, competing priorities, time constraints, and insufficient skills for bridging the gaps between their data and the corresponding desired actions.

CONCLUSIONS

Despite recognized improvements in the design of the report to better align with best practices, it was not perceived as highly usable. Improvements in the presentation of the data could not overcome misalignment with family physicians' expectations or the limited capacity to engage with the report. Integrating iterative evaluations informed by user-centered design can complement evidence-based guidance for implementation strategies. Creating a space for bringing together audit and feedback designers and recipients may help improve usability and effectiveness.

Surfacing the causal assumptions and active ingredients of healthcare quality improvement interventions: An application to primary care opioid prescribing

Background

Efforts to maximize the impact of healthcare improvement interventions are hampered when intervention components are not well defined or described, precluding the ability to understand how and why interventions are expected to work.

Method

We partnered with two organizations delivering province-wide quality improvement interventions to establish how they envisaged their interventions lead to change (their underlying causal assumptions) and to identify active ingredients (behavior change techniques [BCTs]). The interventions assessed were an audit and feedback report and an academic detailing program. Both focused on supporting safer opioid prescribing in primary care in Ontario, Canada. Data collection involved semi-structured interviews with intervention developers (n = 8) and a content analysis of intervention documents. Analyses unpacked and articulated how the interventions were intended to achieve change and how this was operationalized.

Results

Developers anticipated that the feedback report would provide physicians with a clear understanding of their own prescribing patterns in comparison to others. In the feedback report, we found an emphasis on BCTs consistent with that assumption (feedback on behavior; social comparison). The detailing was designed to provide tailored support to enable physicians to overcome barriers to change and to gradually enact specific practice changes for patients based on improved communication. In the detailing materials, we found an emphasis on instructions on how to perform the behavior, for a range of behaviors (e.g., tapering opioids, treating opioid use disorder). The materials were supplemented by detailer-enacted BCTs (e.g., social support [practical]; goal setting [behavior]; review behavioral goal[s]).

Conclusions

The interventions included a small range of BCTs addressing various clinical behaviors. This work provides a methodological example of how to apply a behavioral lens to surface the active ingredients, target clinical behaviors, and causal assumptions of existing large-scale improvement interventions that could be applied in other contexts to optimize effectiveness and facilitate scale and spread.

Audit and Feedback in the Hospitals of the Emergency Networks in the Lazio Region, Italy: A Cross-Sectional Evaluation of the State of Implementation

Audit and Feedback (A&F) is an effective multidimensional strategy for improving the quality of care. The optimal methods for its implementation remain unclear. This study aimed to map the state of art of A&F strategies in the hospitals involved in a time-dependent emergency network. For these purposes, a structured questionnaire was defined and discussed within the research group. This consists of 29 questions in three sections: (1) characteristics of the structure, (2) internal feedback systems, and (3) external feedback systems. All structures involved in the network were invited to participate in the e-survey by indicating a Health Management representative and a clinical representative for the Cardiovascular (CaV) and/or for the Cerebrovascular area (CeV). Of 20 structures invited, a total of 13 (65%) responded to the survey, 11 for the CaV area and 8 for the CeV area. A total of 10 of 11 (91%) facilities for the CaV area and 8/11 (75%) for the CeV area reported that they perform A&F activities. All facilities perform at least one of the activities defined as "assimilating A&F procedures." The most frequent is the presentation and discussion of clinical cases (82% CaV and 88% CeV) and the least is the identification of responsible for improvement actions (45% CaV and 38% CeV). In 4/10 (40%) facilities for the CaV area and 4/8 (50%) for the CEV area, corrective actions are suggested or planned when the feedback is returned. These results confirm the need to define, in a synergistic way with the relevant stakeholders, an effective and agreed A&F intervention to improve the level of implementation of A&F strategies.

Development and pilot evaluation of an educational session to support sparing opioid prescriptions to opioid naïve patients in a Canadian primary care setting

BACKGROUND

Prescribing rates of some analgesics decreased during the public health crisis. Yet, up to a quarter of opioid-naïve persons prescribed opioids for noncancer pain develop prescription opioid use disorder. We, therefore, sought to evaluate a pilot educational session to support primary care-based sparing of opioid analgesics for noncancer pain among opioid-naïve patients in British Columbia (BC).

METHODS

Therapeutics Initiative in BC has launched an audit and feedback intervention. Individual prescribing portraits were mailed to opioid prescribers, followed by academic detailing webinars. The webinars' learning outcomes included defining the terms opioid naïve and opioid sparing, and educating attendees on the (lack of) evidence for opioid analgesics to treat noncancer pain. The primary outcome was change in knowledge measured by four multiple-choice questions at the outset and conclusion of the webinar.

RESULTS

Two hundred participants attended four webinars; 124 (62%) responded to the knowledge questions. Community-based primary care professionals (80/65%) from mostly urban settings (77/62%) self-identified as family physicians (46/37%), residents (22/18%), nurse practitioners (24/19%), and others (32/26%). Twelve participants (10%) recalled receiving the individualized portraits. While the correct identification of opioid naïve definitions increased by 23%, the correct identification of opioid sparing declined by 7%. Knowledge of the gaps in high-quality evidence supporting opioid analgesics and risk tools increased by 26% and 35%, respectively.

CONCLUSION

The educational session outlined in this pilot yielded mixed results but appeared acceptable to learners and may need further refinement to become a feasible way to train professionals to help tackle the current toxic drugs crisis.

Use of the reach, effectiveness, adoption, implementation, and maintenance (RE-AIM) framework to guide iterative adaptations: Applications, lessons learned, and future directions

Introduction

Implementation science frameworks have been used widely for planning and evaluation, but seldom to guide adaptations during program implementation. There is great potential for these frameworks to be used to inform conceptual and data-driven decisions about adaptations.

Methods

We summarize recent applications using Iterative RE-AIM to capture and guide adaptations. Iterative RE-AIM can be repeated at multiple time points customized to each project and involves the following activities: identification of key implementation partners; rating importance of and progress on each RE-AIM dimension (reach, effectiveness, adoption, implementation, and maintenance); use of summary data on ratings to identify one or two RE-AIM dimensions for adaptations and implementation strategies; and evaluation of progress and impact of adaptations. We summarize recent and ongoing Iterative RE-AIM applications across multiple care coordination and pain management projects within the Veterans Health Administration, a hypertension control trial in Guatemala, a hospital-based lung ultrasound implementation pilot, and a colorectal cancer screening program in underserved communities.

Results

Iterative RE-AIM appears feasible, helpful, and broadly applicable across diverse health care issues, interventions, contexts, and populations. In general, the RE-AIM dimension showing the largest gap between importance and progress has been Reach. The dimensions most frequently selected for improvement have been Reach and Implementation. We discuss commonalities, differences and lessons learned across these various applications of Iterative RE-AIM. Challenges include having objective real time data on which to make decisions, having key implementation staff available for all assessments, and rapidly scoring and providing actionable feedback. We discuss print and online resources and materials to support Iterative RE-AIM.

Conclusions

The use of Iterative RE-AIM to guide and support understanding of adaptations has proven feasible across diverse projects and in multiple case studies, but there are still questions about its strengths, limitations, essential components, efficiency, comparative effectiveness, and delivery details. Future directions include investigating the optimal frequency and timing for iterative applications; adding contextual assessments; developing more continuous and rapid data on which to make adaptation decisions; identifying opportunities to enhance health equity; and determining the level of facilitation that is most cost-effective.

Audit and feedback in cardio- and cerebrovascular setting: Toward a path of high reliability in Italian healthcare

Adopting audit and feedback (A&F) strategies could be a suitable healthcare intervention to fulfill the challenge of monitoring and improving clinical guidelines in evidence-based medicine. Indeed, A&F is used to encourage professionals to better adhere to standard guidelines to improve healthcare performance. Briefly, an audit is an inspection of professional practice in comparison to professional standards or targets whose results are subsequently communicated to professionals in a structured manner. Although A&F strategies have been adopted in several time-dependent settings, such as for acute myocardial infarction (AMI) and stroke, interest of audits in rehabilitation care is also emerging. Recently, the Italian Ministry of Health has funded a national network project called EASY-NET, whose main objective is to evaluate the effectiveness of A&F strategies to improve healthcare practice and equity in various clinical and organizational settings in seven Italian regions. Last but not the least of these regions is the Sicily, represented within the project by the IRCCS Centro Neurolesi Bonino-Pulejo of Messina as the work package 7 (WP7). The EASY-NET WP7 is focused on the effectiveness of A&F strategies in both AMI and ischemic stroke setting, from acute to rehabilitation process of care. In this study, we described the study protocol, including the study design and methodology, providing a detailed description of the new model of A&F based on telemedicine, and discussing the possible challenges of this project.

Effectiveness of clinical dashboards as audit and feedback or clinical decision support tools on medication use and test ordering: a systematic review of randomized controlled trials

BACKGROUND

Clinical dashboards used as audit and feedback (A&F) or clinical decision support systems (CDSS) are increasingly adopted in healthcare. However, their effectiveness in changing the behavior of clinicians or patients is still unclear. This systematic review aims to investigate the effectiveness of clinical dashboards used as CDSS or A&F tools (as a standalone intervention or part of a multifaceted intervention) in primary care or hospital settings on medication prescription/adherence and test ordering.

METHODS

Seven major databases were searched for relevant studies, from inception to August 2021. Two authors independently extracted data, assessed the risk of bias using the Cochrane RoB II scale, and evaluated the certainty of evidence using GRADE. Data on trial characteristics and intervention effect sizes were extracted. A narrative synthesis was performed to summarize the findings of the included trials.

RESULTS

Eleven randomized trials were included. Eight trials evaluated clinical dashboards as standalone interventions and provided conflicting evidence on changes in antibiotic prescribing and no effects on statin prescribing compared to usual care. Dashboards increased medication adherence in patients with inflammatory arthritis but not in kidney transplant recipients. Three trials investigated dashboards as part of multicomponent interventions revealing decreased use of opioids for low back pain, increased proportion of patients receiving cardiovascular risk screening, and reduced antibiotic prescribing for upper respiratory tract infections.

CONCLUSION

There is limited evidence that dashboards integrated into electronic medical record systems and used as feedback or decision support tools may be associated with improvements in medication use and test ordering.

A Scalable Service to Improve Health Care Quality Through Precision Audit and Feedback: Proposal for a Randomized Controlled Trial

BACKGROUND

Health care delivery organizations lack evidence-based strategies for using quality measurement data to improve performance. Audit and feedback (A&F), the delivery of clinical performance summaries to providers, demonstrates the potential for large effects on clinical practice but is currently implemented as a blunt one size fits most intervention. Each provider in a care setting typically receives a performance summary of identical metrics in a common format despite the growing recognition that precisionizing interventions hold significant promise in improving their impact. A precision approach to A&F prioritizes the display of information in a single metric that, for each recipient, carries the highest value for performance improvement, such as when the metric's level drops below a peer benchmark or minimum standard for the first time, thereby revealing an actionable performance gap. Furthermore, precision A&F uses an optimal message format (including framing and visual displays) based on what is known about the recipient and the intended gist meaning being communicated to improve message interpretation while reducing the cognitive processing burden. Well-established psychological principles, frameworks, and theories form a feedback intervention knowledge base to achieve precision A&F. From an informatics perspective, precision A&F requires a knowledge-based system that enables mass customization by representing knowledge configurable at the group and individual levels.

OBJECTIVE

This study aims to implement and evaluate a demonstration system for precision A&F in anesthesia care and to assess the effect of precision feedback emails on care quality and outcomes in a national quality improvement consortium.

METHODS

We propose to achieve our aims by conducting 3 studies: a requirements analysis and preferences elicitation study using human-centered design and conjoint analysis methods, a software service development and implementation study, and a cluster randomized controlled trial of a precision A&F service with a concurrent process evaluation. This study will be conducted with the Multicenter Perioperative Outcomes Group, a national anesthesia quality improvement consortium with >60 member hospitals in >20 US states. This study will extend the Multicenter Perioperative Outcomes Group quality improvement infrastructure by using existing data and performance measurement processes.

RESULTS

The proposal was funded in September 2021 with a 4-year timeline. Data collection for Aim 1 began in March 2022. We plan for a 24-month trial timeline, with the intervention period of the trial beginning in March 2024.

CONCLUSIONS

The proposed aims will collectively demonstrate a precision feedback service developed using an open-source technical infrastructure for computable knowledge management. By implementing and evaluating a demonstration system for precision feedback, we create the potential to observe the conditions under which feedback interventions are effective.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

PRR1-10.2196/34990.

What works to improve school lunch nutritional quality - legislation or self-audit?

OBJECTIVE

Sweden updated its legislation on universal free school meals in 2011 and nutrition was explicitly mentioned. This study i) describes cross-sectional changes in school lunch nutritional quality during the following eight years, and ii) examines if repeated self-auditing, using a fully automated, online tool (School Food Sweden), based on the implementation strategy of audit and feedback, was associated with improvements.

DESIGN

Both repeated cross-sectional and longitudinal design. Factors associated with meeting nutritional criteria were examined using variance weighted least squares regression and logistic regression.

SETTING

Sweden.

PARTICIPANTS

Primary schools who self-selected to audit meal quality between March 2012 and July 2019.

RESULTS

Almost half of all (ca 4800) primary schools signed up to use the tool, and 1500 audited nutritional quality at least once. Repeated cross-sectional analyses showed the proportion meeting the nutritional criteria increased significantly between 2012/13 (11%) and 2018/19 (34%). Longitudinally, each additional audit completed increased the odds of meeting the nutritional criteria by 1.30 (CI 1.20-1.41), controlling for region and time elapsed since the legislative change. In 774 schools with repeat audits, both number of audits and frequency of accessing feedback predicted meeting the nutritional criteria (OR 2.02, CI 1.23-3.31), even after adjusting for time since the legislative change and days elapsed since previous audit.

CONCLUSIONS

Both legislation and self-audit with automatic feedback appear effective in helping schools to improve school meal quality. Self-audit with feedback may be an effective complement to legislation, or a promising alternative in settings where regulation is not an option.

Improving the Development and Implementation of Audit and Feedback Systems to Support Health Care Workers in Limiting Antimicrobial Resistance in the Hospital: Scoping Review

Background

For eHealth technologies in general and audit and feedback (AF) systems specifically, integrating interdisciplinary theoretical underpinnings is essential, as it increases the likelihood of achieving desired outcomes by ensuring a fit among eHealth technology, stakeholders, and their context. In addition, reporting on the development and implementation process of AF systems, including substantiations of choices, enables the identification of best practices and accumulation of knowledge across studies but is often not elaborated on in publications.

Objective

This scoping review aims to provide insights into the development and implementation strategies for AF systems for a real-world problem that threatens modern health care—antimicrobial resistance—and provide an interdisciplinary conceptual framework that can serve as a checklist and guidance for making informed choices in the development and implementation of future AF systems.

Methods

A scoping review was conducted by querying PubMed, Scopus, Web of Science, IEEE Xplore Digital Library, and Embase (≥2010) for studies describing either the development or implementation process, or both, of an AF system for antimicrobial resistance or infections in hospitals. Studies reporting only on effectiveness or impact were excluded. A total of 3 independent reviewers performed the study selection, and 2 reviewers constructed the conceptual framework through the axial and selective coding of often-used theories, models, and frameworks (TMFs) from the literature on AF and eHealth development and implementation. Subsequently, the conceptual framework was used for the systematic extraction and interpretation of the studies’ descriptions of AF systems and their development and implementation.

Results

The search resulted in 2125 studies that were screened for eligibility, of which 12 (0.56%); 2012-2020) were included. These studies described the development and implementation processes heterogeneously in terms of study aims, study targets, target groups, methods, and theoretical underpinnings. Few studies have explicitly explained how choices for the development and implementation of AF systems were substantiated by the TMFs. The conceptual framework provided insights into what is reported on the development and implementation process and revealed underreported AF system constructs (eg, AF system design; engagement with the AF system; and comparison, goal setting, and action planning) and development and implementation (eg, champions) constructs.

Conclusions

This scoping review showed the current heterogeneous reporting of AF systems and their development and implementation processes and exemplified how interdisciplinary TMFs can (and should) be balanced in a conceptual framework to capture relevant AF systems and development and implementation constructs. Thereby, it provides a concrete checklist and overall guidance that supports the professionalization and harmonization of AF system development and implementation. For the development and implementation of future AF systems and other eHealth technologies, researchers and health care workers should be supported in selecting and integrating TMFs into their development and implementation process and encouraged to explicitly report on theoretical underpinnings and the substantiation of choices.

Evaluating a community respiratory physiotherapy service for children with neurodisability

BACKGROUND

Children with neurodisability are at an increased risk of respiratory problems and complications, which often result in prolonged, frequent hospital admissions and are the biggest cause of mortality in this client group. The Children's Community Respiratory Physiotherapy Service (CCRPS) was established in 2010 to support children with severe neurodisabilities at home during acute chest infections and to prevent emergency department attendances and hospital admissions. This service evaluation looked at patient/parent satisfaction and prevented admissions to ensure clinical and cost-effectiveness, despite the rising demand for the service.

METHODS

Over a 3-month period, patients and parents/carers on the CCRPS caseload were given a Picker feedback survey following 100 emergency visits from the team. The number of prevented hospital admissions for respiratory tract infection over 12 months (April 2019-March 2020) was identified from existing CCRPS data and hospital admissions costs saved were estimated.

RESULTS

The Picker survey responses were extremely positive with all respondents reporting that they felt well looked after and that the main reason for the emergency visit was dealt with well. Based on key indicators, the CCRPS prevented 182 hospital admissions for respiratory tract infection in 2019/2020, equating to 1638 bed days and estimated cost savings ranging between £751 728 and £1 009 986.

CONCLUSIONS

The Picker survey response demonstrates the positive impact that the CCRPS has on both quality of life and experience for patients and families. The CCRPS rapid response service prevents hospital admissions for respiratory tract infections in children and young people with severe neurodisability and the cost savings from admissions prevented allows the service to more than pay for itself.

Individualized Provider Feedback Increased HIV and HCV Screening and Identification in a New York City Emergency Department

Efforts to end the HIV and hepatitis C virus (HCV) epidemics begin with ascertainment of a person's infection status through screening. Despite its importance as a site of testing, missed opportunities for screening in the Emergency Department (ED) are common. We describe the impact of implementing an individualized provider feedback intervention on HIV and HCV testing in a quaternary ED. We conducted an interrupted time series analysis to evaluate the impact of the intervention on weekly HIV and HCV screening in an observational cohort of patients seeking care in the ED. The intervention included a physician champion individualized feedback with peer comparisons to all providers in the ED and an existing HIV/HCV testing and response team. Data were abstracted from the electronic medical record (EMR) for 30 weeks before, during, and after implementing the intervention. We used Poisson regression analysis to estimate changes in the weekly counts and rates of HIV and HCV testing. The incidence rate ratios (IRRs) of HIV testing were 1.94 [95% confidence interval (CI) 1.85-2.04] and 1.38 (95% CI 1.31-1.45) times higher for the intervention and post-intervention period compared with the pre-intervention period. The IRRs of HCV testing was 6.96 (95% CI 6.40-7.58) and 4.70 (95% CI 4.31-5.13) for the intervention and post-intervention periods. There were no meaningful differences in demographic characteristics during the observation period. The intervention meaningfully increased HIV and HCV testing volume and positive case detection, including testing in high-risk groups like young adults and individuals without prior testing. Although diminished, the intervention effect sustained in the 30-week period following implementation.

Use of Feedback Data to Reduce Surgical Site Infections and Optimize Antibiotic Use in Surgery: A Systematic Scoping Review

OBJECTIVE

Surgical site infection (SSI) prevention remains significant, particularly in the era of antimicrobial resistance. Feedback on practices and outcomes is known to be key to reduce SSI rates and optimize antibiotic usage. However, the optimal method, format and frequency of feedback for surgical teams remains unclear. The objective of the study is to understand how data from surveillance and audit are fed back in routine surgical practice.

METHODS

A systematic scoping review was conducted, using well-established implementation science frameworks to code the data. Two electronic health-oriented databases (MEDLINE, EMBASE) were searched to September 2019. We included studies that assessed the use of feedback as a strategy either in the prevention and management of SSI and/or in the use of antibiotics perioperatively.

RESULTS

We identified 21 studies: 17 focused on SSI rates and outcomes and 10 studies described antimicrobial stewardship for SSI (with some overlap in focus). Several interventions were reported, mostly multimodal with feedback as a component. Feedback was often provided in written format (62%), either individualized (38%) or in group (48%). Only 25% of the studies reported that feedback cascaded down to the frontline perioperative staff. In 65% of the studies, 1 to 5 implementation strategies were used while only 5% of the studies reported to have utilized more than 15 implementation strategies. Among studies reporting antibiotic usage in surgery, most (71%) discussed compliance with surgical antibiotic prophylaxis.

CONCLUSIONS

Our findings highlight the need to provide feedback to all levels of perioperative care providers involved in patient care. Future research in this area should report implementation parameters in more detail.

Prevalence of Effective Audit-and-Feedback Practices in Primary Care Settings: A Qualitative Examination Within Veterans Health Administration

OBJECTIVE

The purpose of this study is to uncover and catalog the various practices for delivering and disseminating clinical performance in various Veterans Affairs (VA) locations and to evaluate their quality against evidence-based models of effective feedback as reported in the literature.

BACKGROUND

Feedback can enhance clinical performance in subsequent performance episodes. However, evidence is clear that the way in which feedback is delivered determines whether performance is harmed or improved.

METHOD

We purposively sampled 16 geographically dispersed VA hospitals based on high, low, consistently moderate, and moderately average highly variable performance on a set of 17 outpatient clinical performance measures. We excluded four sites due to insufficient interview data. We interviewed four key personnel from each location (n = 48) to uncover effective and ineffective audit and feedback strategies. Interviews were transcribed and analyzed qualitatively using a framework-based content analysis approach to identify emergent themes.

RESULTS

We identified 102 unique strategies used to deliver feedback. Of these strategies, 64 (62.74%) have been found to be ineffective according to the audit-and-feedback research literature. Comparing features common to effective (e.g., individually tailored, computerized feedback reports) versus ineffective (e.g., large staff meetings) strategies, most ineffective strategies delivered feedback in meetings, whereas strategies receiving the highest effectiveness scores delivered feedback via visually understood reports that did not occur in a group setting.

CONCLUSIONS

Findings show that current practices are leveraging largely ineffective feedback strategies. Future research should seek to identify the longitudinal impact of current feedback and audit practices on clinical performance.

APPLICATION

Feedback in primary care has little standardization and does not follow available evidence for effective feedback design. Future research in this area is warranted.

Knowledge and insights from a maturing international clinical quality registry

Since 2017, the TrueNTH Global Registry (TNGR) has aimed to drive improvement in patient outcomes for individuals with localized prostate cancer by collating data from healthcare institutions across 13 countries. As TNGR matures, a systematic evaluation of existing processes and documents is necessary to evaluate whether the registry is operating as intended. The main supporting documents: protocol and data dictionary, were comprehensively reviewed in a series of meetings over a 10-month period by an international working group. In parallel, individual consultations with local institutions regarding a benchmarking quality-of-care report were conducted. Four consensus areas for improvement emerged: updating operational definitions, appraisal of the recruitment process, refinement of data elements, and improvement of data quality and reporting. Recommendations presented were drawn from our collective experience and accumulated knowledge in operating an international registry. These can be readily generalized to other health-related reporting programs beyond clinical registries.

Quality improvement project to improve patient outcomes by reducing door to CT and door to needle time and increasing appropriate referrals for endovascular thrombectomy

This paper describes a stroke quality improvement (QI) project in a primary stroke centre in a 431-bed hospital serving a local population of 114 000 people. Approximately 170 acute strokes are treated each year in a seven-bed stroke unit managed by three geriatricians with a subspecialty interest in stroke. 24-hour CT radiology service is available. Endovascular thrombectomy (EVT) is performed by neuro-interventional radiology at one of two comprehensive stroke centres located 90–120 min away.

In 2018, as part of a national collaborative QI initiative a new national thrombectomy referral pathway was introduced with an aim that all eligible patients be referred for EVT. This initiative included maximising timely access to CT and thrombolysis. Review of local data highlighted significant deficits in these areas.

A local QI team convened and a multidisciplinary approach was employed to map the existing process for CT access and time to thrombolysis decision.

We describe how focused timesaving interventions such as; new emergency and radiology department ‘pre-alerts’, dedicated acute stroke pagers, new ‘FAST’ registration by clerical staff, new CT ordering codes and new ‘FAST packs’ (including tissue plasminogen activator, paper National Institute of Health Stroke Scale scoring tools, consent forms and EVT patient selection tools) were created and incorporated into a multidisciplinary detailed clinical stroke care pathway.

We describe how we achieved our SMART aims; to reduce our door to CT time and to reduce our door to needle time to the national target of less than 30 min. A third aim was to increase the number of patients referred for EVT from our centre.

This project is an accurate description of how a multidisciplinary approach combined with teamwork and effective communication can create sustainable improved patient care and is generalisable to all institutions that require timely referral to external centres for EVT.

Implementation and Evaluation of a Digitally Enabled Precision Public Health Intervention to Reduce Inappropriate Gabapentinoid Prescription: Cluster Randomized Controlled Trial

Background

Digital technologies can enable rapid targeted delivery of audit and feedback interventions at scale. Few studies have evaluated how mode of delivery affects clinical professional behavior change and none have assessed the feasibility of such an initiative at a national scale.

Objective

The aim of this study was to develop and evaluate the effect of audit and feedback by digital versus postal (letter) mode of delivery on primary care physician behavior.

Methods

This study was developed as part of the Veterans’ Medicines Advice and Therapeutics Education Services (MATES) program, an intervention funded by the Australian Government Department of Veterans’ Affairs that provides targeted education and patient-specific audit with feedback to Australian general practitioners, as well as educational material to veterans and other health professionals. We performed a cluster randomized controlled trial of a multifaceted intervention to reduce inappropriate gabapentinoid prescription, comparing digital and postal mode of delivery. All veteran patients targeted also received an educational intervention (postal delivery). Efficacy was measured using a linear mixed-effects model as the average number of gabapentinoid prescriptions standardized by defined daily dose (individual level), and number of veterans visiting a psychologist in the 6 and 12 months following the intervention.

Results

The trial involved 2552 general practitioners in Australia and took place in March 2020. Both intervention groups had a significant reduction in total gabapentinoid prescription by the end of the study period (digital: mean reduction of 11.2%, P=.004; postal: mean reduction of 11.2%, P=.001). We found no difference between digital and postal mode of delivery in reduction of gabapentinoid prescriptions at 12 months (digital: –0.058, postal: –0.058, P=.98). Digital delivery increased initiations to psychologists at 12 months (digital: 3.8%, postal: 2.0%, P=.02).

Conclusions

Our digitally delivered professional behavior change intervention was feasible, had comparable effectiveness to the postal intervention with regard to changes in medicine use, and had increased effectiveness with regard to referrals to a psychologist. Given the logistical benefits of digital delivery in nationwide programs, the results encourage exploration of this mode in future interventions.

Using a dark logic model to explore adverse effects in audit and feedback: a qualitative study of gaming in colonoscopy

BACKGROUND

Audit and feedback (A&F) interventions improve patient care but may result in unintended consequences. To evaluate plausible harms and maximise benefits, theorisation using logic models can be useful. We aimed to explore the adverse effects of colonoscopy A&F using a feedback intervention theory (FIT) dark logic model before the National Endoscopy Database Automated Performance Reports to Improve Quality Outcomes Trial study.

METHODS

We undertook a qualitative study exploring A&F practices in colonoscopy. Interviews were undertaken with endoscopists from six English National Health Service endoscopy centres, purposively sampled for professional background and experience. A thematic framework analysis was performed, mapping paradoxical effects and harms using FIT and the theory of planned behaviour.

RESULTS

Data saturation was achieved on the 19th participant, with participants from nursing, surgical and medical backgrounds and a median of 7 years' experience.When performance was below aspirational targets participants were falsely reassured by social comparisons. Participants described confidence as a requirement for colonoscopy. Negative feedback without a plan to improve risked reducing confidence and impeding performance (cognitive interference). Unmet targets increased anxiety and prompted participants to question messages' motives and consider gaming.Participants described inaccurate documentation of subjective measures, including patient comfort, to achieve targets perceived as important. Participants described causing harm from persevering to complete procedures despite patient discomfort and removing insignificant polyps to improve detection rates without benefiting the patient.

CONCLUSION

Our dark logic model highlighted that A&F interventions may create both desired and adverse effects. Without a priori theorisation evaluations may disregard potential harms. In colonoscopy, improved patient experience measures may reduce harm. To address cognitive interference the motivation of feedback to support improvement should always be clear, with plans targeting specific behaviours and offering face-to-face support for confidence.

TRIAL REGISTRATION NUMBER

ISRCTN11126923.

Nurse-run preanaesthesia assessment clinics: an initiative towards improving the quality of perioperative care at the ambulatory care centre

Introduction

Nurse-run preanaesthesia assessment is well established in ambulatory surgery. However, in the Middle East the implementation of such a service is new and needed careful preparation. Aim of this audit is to assess the feasibility and the quality of preoperative assessments by the specially trained nurses, patient and nurse satisfaction and overall perioperative quality of recovery.

Methods

The nurses were selected and trained first in an accredited programme. Then an implementation period of 3 month was used for them to gain experience. Hereafter, we performed a four-step audit on the quality of preassessment, the patient’s satisfaction, the quality of recovery and adverse events if any. Finally, we also monitored the nurse’s satisfaction of their new advanced role.

Results

The quality of preanaesthesia assessment was high as with 95% compliance to the accepted standards. In the patient satisfaction survey, all 152 patients were either highly satisfied or satisfied with the nurse-run service. The nurses were also highly satisfied and felt that they were either highly or moderately valued. All the patients who were operated at the ambulatory care services were followed up postoperatively by telephone calls which revealed that most of them were highly satisfied. No major or minor adverse events occurred.

Conclusion

Our specially trained nurses perform preoperative assessments on high standard without adverse events, while patient and staff satisfaction is very high. Future projects will focus on reducing the rate of cancellation of surgeries, investigating the cost-effectiveness of this approach as well as training the specialised nurses for paediatric preoperative anaesthesia assessments. This model of care could induce further nurse-run models of care in the Middle East.

Emilia-Romagna Regional Blood System accreditation as an example of improvement through application of specific requirements: a retrospective analysis

BACKGROUND

Institutional accreditation in Italy represents the license given by a region to a public or private facility to provide services in the name and on behalf of the National Health Service. This study aims to evaluate the improvement of the Emilia-Romagna Regional Blood System and to highlight its unresolved issues, analysing non-conformities observed during accreditation and maintenance inspections between 2013 and 2018.

METHODS

All the Emilia-Romagna Regional Blood facilities were invited to participate in this study voluntarily and anonymously. Participants had to access a web application that we developed specifically. For each of the three inspections evaluated in this study, they had to enter data about the state of their organisation branches and non-conformities observed by regional inspectors. All data entered were finally exported from the web application database and analysed with spreadsheets. Statistical analysis was performed using Wilcoxon signed-rank test with continuity correction.

RESULTS

17 structures took part in the study, with a total of 174 organisation branches. The number of branches changed over the years because of new openings and closures due to reorganisations or non-conformities that were too difficult to correct. Inspectors observed 2381 non-conformities (291 structural, 611 technological and 1479 organisational). As a result of accreditation inspections and consequent improvement actions, non-conformities were reduced by 88%. The most frequent non-conformities concerned the management software and the transportation of blood and blood components.

CONCLUSION

An improvement in the Emilia-Romagna Regional Blood System over time is evident: institutional accreditation certainly pushed it to change and overcome its problems to comply with specific requirements. The remaining non-conformities after the three inspections were mostly organisational and management software was the most critical issue. Despite these non-conformities, all currently active structures are accredited and guarantee high standards of quality and safety of products and services.

Early prescribing outcomes after exporting the EQUIPPED medication safety improvement programme

Enhancing quality of prescribing practices for older adults discharged from the Emergency Department (EQUIPPED) aims to reduce the monthly proportion of potentially inappropriate medications (PIMs) prescribed to older adults discharged from the ED to 5% or less. We describe prescribing outcomes at three academic health systems adapting and sequentially implementing the EQUIPPED medication safety programme.

EQUIPPED was adapted from a model developed in the Veterans Health Administration (VA) and sequentially implemented in one academic health system per year over a 3-year period. The monthly proportion of PIMs, as defined by the 2015 American Geriatrics Beers Criteria, of all medications prescribed to adults aged 65 years and older at discharge was assessed for 6 months preimplementation until 12 months postimplementation using a generalised linear time series model with a Poisson distribution.

The EQUIPPED programme was translated from the VA health system and its electronic medical record into three health systems each using a version of the Epic electronic medical record. Adaptation occurred through local modification of order sets and in the generation and delivery of provider prescribing reports by local champions. Baseline monthly PIM proportions 6 months prior to implementation at the three sites were 5.6% (95% CI 5.0% to 6.3%), 5.8% (95% CI 5.0% to 6.6%) and 7.3% (95% CI 6.4% to 9.2%), respectively. Evaluation of monthly prescribing including the twelve months post-EQUIPPED implementation demonstrated significant reduction in PIMs at one of the three sites. In exploratory analyses, the proportion of benzodiazepine prescriptions decreased across all sites from approximately 17% of PIMs at baseline to 9.5%–12% postimplementation, although not all reached statistical significance.

EQUIPPED is feasible to implement outside the VA system. While the impact of the EQUIPPED model may vary across different health systems, results from this initial translation suggest significant reduction in specific high-risk drug classes may be an appropriate target for improvement at sites with relatively low baseline PIM prescribing rates.

A Realist Evaluation of a 72-Hour Readmission Audit and Feedback (A&F) Intervention in Emergency Medicine

Introduction

Audit and feedback (A&F) interventions are intended to increase accountability and improve the quality of care; however, their impact can vary significantly. As performance feedback is implemented in healthcare, there is a growing need to determine how users interact with the data and how systems can achieve more consistent performance outcomes. This study aimed to understand the contexts, mechanisms, and outcomes of an emergency department 72-hour readmission A&F intervention.

Methods

Semi-structured interviews with key stakeholders were conducted and analyzed using thematic and template analysis techniques specifically aimed at identifying context, mechanism, and outcome configurations.

Results

Seventeen (17) physician interviews were conducted. We identified five outcomes of the intervention and the contexts and mechanisms contributing to them. Importantly, we identified that this A&F strategy could potentially have positive (improved follow-up of cases, improved discharge communication) and negative impacts (increased physician anxiety, potentially increased resource use) on physicians and departmental efficiency.

Conclusion

The 72-hour readmission alert A&F intervention generates a number of distinct outcome patterns that result from a variety of mechanisms acting in different contexts. Knowledge of these context-mechanism-outcome relationships may help implementers design and tailor performance feedback strategies.

Acceptability and effectiveness of antimicrobial stewardship implementation strategies on fluoroquinolone prescribing

OBJECTIVE

To assess the effectiveness and acceptability of antimicrobial stewardship-focused implementation strategies on inpatient fluoroquinolones.

METHODS

Stewardship champions at 15 hospitals were surveyed regarding the use and acceptability of strategies to improve fluoroquinolone prescribing. Antibiotic days of therapy (DOT) per 1,000 days present (DP) for sites with and without prospective audit and feedback (PAF) and/or prior approval were compared.

RESULTS

Among all of the sites, 60% had PAF or prior approval implemented for fluoroquinolones. Compared to sites using neither strategy (64.2 ± 34.4 DOT/DP), fluoroquinolone prescribing rates were lower for sites that employed PAF and/or prior approval (35.5 ± 9.8; P = .03) and decreased from 2017 to 2018 (P < .001). This decrease occurred without an increase in advanced-generation cephalosporins. Total antibiotic rates were 13% lower for sites with PAF and/or prior approval, but this difference did not reach statistical significance (P = .20). Sites reporting that PAF and/or prior approval were "completely" accepted had lower fluoroquinolone rates than sites where it was "moderately" accepted (34.2 ± 5.7 vs 48.7 ± 4.5; P < .01). Sites reported that clinical pathways and/or local guidelines (93%), prior approval (93%), and order forms (80%) "would" or "may" be effective in improving fluoroquinolone use. Although most sites (73%) indicated that requiring infectious disease consults would or may be effective in improving fluoroquinolones, 87% perceived implementation to be difficult.

CONCLUSIONS

PAF and prior approval implementation strategies focused on fluoroquinolones were associated with significantly lower fluoroquinolone prescribing rates and nonsignificant decreases in total antibiotic use, suggesting limited evidence for class substitution. The association of acceptability of strategies with lower rates highlights the importance of culture. These results may indicate increased acceptability of implementation strategies and/or sensitivity to FDA warnings.

Harnessing the full potential of hospital-based data to support surgical quality improvement

Surgical departments commonly rely on third-party quality improvement registries. As electronic health data become increasingly integrated and accessible within an institution, alternatives to these platforms arise. We present the conceptualization and implementation of an in-house quality improvement platform that provides real-time reports, is less onerous on clinicians and is tailored to an institution’s priorities of care.

Population-Wide Peer Comparison Audit and Feedback to Reduce Antibiotic Initiation and Duration in Long-Term Care Facilities with Embedded Randomized Controlled Trial

BACKGROUND

Antibiotic overprescribing in long-term care settings is driven by prescriber preferences and is associated with preventable harms for residents. We aimed to determine whether peer comparison audit and feedback reporting for physicians reduces antibiotic overprescribing among residents.

METHODS

We employed a province wide, difference-in-differences study of antibiotic prescribing audit and feedback, with an embedded pragmatic randomized controlled trial (RCT) across all long-term care facilities in Ontario, Canada, in 2019. The study year included 1238 physicians caring for 96 185 residents. In total, 895 (72%) physicians received no feedback; 343 (28%) were enrolled to receive audit and feedback and randomized 1:1 to static or dynamic reports. The primary outcomes were proportion of residents initiated on an antibiotic and proportion of antibiotics prolonged beyond 7 days per quarter.

RESULTS

Among all residents, between the first quarter of 2018 and last quarter of 2019, there were temporal declines in antibiotic initiation (28.4% to 21.3%) and prolonged duration (34.4% to 29.0%). Difference-in-differences analysis confirmed that feedback was associated with a greater decline in prolonged antibiotics (adjusted difference -2.65%, 95% confidence interval [CI]: -4.93 to -.28%, P = .026), but there was no significant difference in antibiotic initiation. The reduction in antibiotic durations was associated with 335 912 fewer days of treatment. The embedded RCT detected no differences in outcomes between the dynamic and static reports.

CONCLUSIONS

Peer comparison audit and feedback is a pragmatic intervention that can generate small relative reductions in the use of antibiotics for prolonged durations that translate to large reductions in antibiotic days of treatment across populations. Clinical Trials Registration. NCT03807466.

Impact of an educational intervention on WHO surgical safety checklist and pre-operative antibiotic use at a referral hospital in southwestern Uganda

INTRODUCTION

The World Health Organization (WHO) recommends adherence to its surgical safety checklist (SSC) to optimize patient safety and reduce cesarean surgical site infection (SSI). Educational interventions combined with audit and feedback mechanisms on the checklist use by clinicians have the potential to improve adherence and clinical outcomes. Despite the increase in cesarean delivery rates, there is a paucity of data on how such interventions can improve adherence in resource-limited settings.

OBJECTIVE

We performed a quality improvement project to measure the impact of an educational intervention with daily audit and feedback procedures on rates of WHO SSC adherence, including pre-operative antibiotic administration and SSI at Mbarara Regional Referral Hospital maternity ward in Uganda.

METHODS

The study involved chart abstraction of WHO SSC and pre-operative antibiotic use during cesarean deliveries and signs of subsequent SSI in three phases. First, we conducted a retrospective review of all charts from May to June 2018 (pre-intervention phase). Second, we instituted an educational intervention on the WHO SSC and pre-operative antibiotics use, followed by a daily audit of charts and feedback to clinicians from July to August 2018 (the intervention phase). Third, we reviewed charts from September to October 2018 (the post-intervention phase). The WHO SSC adherence, pre-operative antibiotic administration and SSI rates were measured as the proportion of the total cesarean deliveries per study phase and then compared across the three phases.

RESULTS

We reviewed 678 patients' charts (200 in the pre-intervention phase, 230 in the intervention phase and 248 in the post-intervention phase). The mean patient age was 25 years. The use of the WHO SSC was 7% in the pre-intervention phase compared to 92% in the intervention phase (P < 0.001), and 77% in the post-intervention phase (P < 0.001). Pre-intervention antibiotic receipt was 18% compared to 90% in the intervention phase (P < 0.001) and 84% in the post-intervention phase (P < 0.001). The documented SSI rate in the pre-intervention phase was 15% compared to 7% in the intervention phase (P = 0.02) and 11% in the post-intervention phase (P = 0.20).

CONCLUSIONS

An educational intervention, daily audit and feedback to clinicians increased the use of the WHO SSC and prophylactic antibiotics for cesarean delivery-although the rates waned with time. Research to understand factors influencing the checklist use and antibiotic prophylaxis including prescriber knowledge, motivation and clinical process is required. Implementation interventions to sustain usage and impact on clinical outcomes need to be explored.

Reducing Decision to Incision Time Interval for Emergency Cesarean Sections: 24 Months' Experience from Rural Sierra Leone

Background: This study aimed at describing the changes in the completeness of documentation and changes in decision to incision time interval of emergency cesarean sections after an audit and feedback project a rural hospital in Sierra Leone. Methods: We documented and monitored the decision and incision times for emergency cesarean sections over the course of two years. Year one focused on the introduction of the project and year two focused on the continuous monitoring of the project. We compared the completeness of decision to incision data and used the 30-min benchmark as target for the decision to incision time interval. Results: A total of 762 emergency cesarean sections were included. While the completion of decision time data (72%) did not change between the two reporting periods, documentation of incision time increased from 95% to 98% (p < 0.001). Complete documentation for both decision and incision time was available for 540 (70.9%) emergency cesarean sections. The decision to incision time interval decreased from 105 min to 42 min (p < 0.001). The proportion of cesarean sections started within 30 min increased from 8.5% to 37% (p < 0.001). Conclusion: Although not all cesarean sections were performed within the 30-min threshold, the decision to incision interval decreased significantly. Improvements in documentation and routine reporting of the decision to incision time interval is recommended.

Evaluating the Implementation of a Pilot Quality Improvement Program to Support Appropriate Antimicrobial Prescribing in General Practice

Inappropriate antimicrobial prescribing contributes to increasing antimicrobial resistance. An antimicrobial stewardship (AMS) program in the form of quality improvement activities that included audit and feedback, clinical decision support and education was developed to help optimise prescribing in general practice. The aim of this study was to evaluate the implementation of this program (Guidance GP) in three general practices in Melbourne, Australia, between November 2019 and August 2020. Thirty-one general practitioners (GPs) participated in the program, with 11 GPs and three practice managers participating in follow-up focus groups and interviews to explore the acceptability and feasibility of the program. Our findings showed that the quality improvement activities were acceptable to GPs, if they accurately fit GPs' decision-making process and workflow. It was also important that they provided clinically meaningful information in the form of audit and feedback to GPs. The time needed to coordinate the program, and costs to implement the program were some of the potential barriers identified. Facilitators of success were a "whole of practice" approach with enthusiastic GPs and practice staff, and an identified practice champion. The findings of this research will inform implementation strategies for both the Guidance GP program and AMS programs more broadly in Australian general practice, which will be critical for general practice participation and engagement.

Operationalising outpatient antimicrobial stewardship to reduce system-wide antibiotics for acute bronchitis

BACKGROUND

Antibiotics are not recommended for treatment of acute uncomplicated bronchitis (AUB), but are often prescribed (85% of AUB visits within the Veterans Affairs nationally). This quality improvement project aimed to decrease antibiotic prescribing for AUB in community-based outpatient centres from 65% to <32% by April 2020.

METHODS

From January to December 2018, community-based outpatient clinics' 6 months' average of prescribed antibiotics for AUB and upper respiratory infections was 63% (667 of 1054) and 64.6% (314 of 486) when reviewing the last 6 months. Seven plan-do-study-act (PDSA) cycles were implemented by an interprofessional antimicrobial stewardship team between January 2019 and March 2020. Balancing measures were a return patient phone call or visit within 4 weeks for the same complaint. Χ² tests and statistical process control charts using Western Electric rules were used to analyse intervention data.

RESULTS

The AUB antibiotic prescribing rate decreased from 64.6% (314 of 486) in the 6 months prior to the intervention to 36.8% (154 of 418) in the final 6 months of the intervention. No change was seen in balancing measures. The largest reduction in antibiotic prescribing was seen after implementation of PDSA 6 in which 14 high prescribers were identified and targeted for individualised reviews of encounters of patients with AUB with an antimicrobial steward.

CONCLUSIONS

Operational implementation of successful stewardship interventions is challenging and differs from the traditional implementation study environment. As a nascent outpatient stewardship programme with limited resources and no additional intervention funding, we successfully reduced antibiotic prescribing from 64.6% to 36.8%, a reduction of 43% from baseline. The most success was seen with targeted education of high prescribers.

Improving team coordination in primary-care settings via multifaceted team-based feedback: a non-randomised controlled trial study

Background

Coordination is critical to successful team-based health care. Most clinicians, however, are not trained in effective coordination or teamwork. Audit and feedback (A&F) could improve team coordination, if designed with teams in mind.

Aim

The effectiveness of a multifaceted, A&F-plus-debrief intervention was tested to establish whether it improved coordination in primary care teams compared with controls.

Design & setting

Case-control trial within US Veterans Health Administration medical centres.

Method

Thirty-four primary care teams selected from four geographically distinct hospitals were compared with 34 administratively matched control teams. Intervention-arm teams received monthly A&F reports about key coordination behaviours and structured debriefings over 7 months. Control teams were followed exclusively via their clinical records. Outcome measures included a coordination composite and its component indicators (appointments starting on time, timely recall scheduling, emergency department utilisation, and electronic patient portal enrolment). Predictors included intervention arm, extent of exposure to intervention, and degree of multiple team membership (MTM).

Results

Intervention teams did not significantly improve over control teams, even after adjusting for MTM. Follow-up analyses indicated cross-team variability in intervention fidelity; although all intervention teams received feedback reports, not all teams attended all debriefings. Compared with their respective baselines, teams with high debriefing exposure improved significantly. Teams with high debriefing exposure improved significantly more than teams with low exposure. Low exposure teams significantly increased patient portal enrolment.

Conclusion

Team-based A&F, including adequate reflection time, can improve coordination; however, the effect is dose dependent. Consistency of debriefing appears more critical than proportion of team members attending a debriefing for ensuring implementation fidelity and effectiveness.

Improving intravenous-to-oral antibiotic switch in children: a team-based audit and implementation approach

Children in hospital are frequently prescribed intravenous antibiotics for longer than needed. Programmes to optimise timely intravenous-to-oral antibiotic switch may limit excessive in-hospital antibiotic use, minimise complications of intravenous therapy and allow children to go home faster. Here, we describe a quality improvement approach to implement a guideline, with team-based education, audit and feedback, for timely, safe switch from intravenous-to-oral antibiotics in hospitalised children. Eligibility for switch was based on evidence-based guidelines and supported by education and feedback. The project was conducted over 12 months in a tertiary paediatric hospital. Primary outcomes assessed were the proportion of eligible children admitted under paediatric and surgical teams switched within 24 hours, and switch timing prior to and after guideline launch. Secondary outcomes were hospital length of stay, recommencement of intravenous therapy or readmission. The percentage of children switched within 24 hours of eligibility significantly increased from 32/50 (64%) at baseline to 203/249 (82%) post-implementation (p=0.006). The median time to switch fell from 15 hours 42 min to 4 hours 20 min (p=0.0006). In addition, there was a 14-hour median reduction in hospital length of stay (p=0.008). Readmission to hospital and recommencement of intravenous therapy did not significantly change postimplementation. This education, audit and feedback approach improved timely intravenous-to-oral switch in children and also allowed for more timely discharge from hospital. The study demonstrates proof of concept for this implementation with a methodology that can be readily adapted to other paediatric inpatient settings.

Knowledge translation intervention increased the use of outcome measures by physical therapists in inpatient rehabilitation

Background and Purpose: Outcome measures (OMs) have been emphasized by healthcare professions to optimize patient examination; however, a lack of regular use of OMs exists. The purpose of this study was to describe the outcome of a knowledge translation (KT) intervention to increase the use of OMs by physical therapists in an inpatient rehabilitation setting.Methods: A quasi-experimental pre-post study design was used. A multi-component KT intervention including education, organizational support, documentation, and environmental changes to increase the use of five OMs was implemented. Audit and feedback (A&F) was added to the KT intervention at month 6. Documented use of OMs was determined through manual chart audit (n = 864) and electronically (n = 2599). Regression analyses were used to identify factors associated with OMs use across time and diagnoses.Results: Following the addition of A&F to the KT intervention at month 6, there was a significant increase in the odds of OMs use across all time intervals (months 6-12, 12-18, 18-24)(Odds Ratio (OR) 5.9, 95% Confidence Interval (CI) 4.1-8.5; OR 8.5, 95% CI 6.0-12.1; OR 10.8, 95% CI 7.6-15). There was also a significant increase in the odds of documenting OMs on individuals with neurological diagnoses (OR 0.3, 95% CI 0.5-0.8).Conclusions: This KT intervention increased and sustained OMs use over 24-months. This intervention can be replicated to improve the evidence-based practices of physical therapists.