Audit and feedback: effects on professional practice and healthcare outcomes

Longitudinal evaluation of an electronic audit and feedback system for patient safety in a large tertiary hospital setting

Objective: This study sought to assess the impact of a novel electronic audit and feedback (e-A&F) system on patient outcomes. Methods: The e-A&F intervention was implemented in a tertiary hospital and involved near real-time feedback via web-based dashboards. We used a segmented regression analysis of interrupted time series. We modelled the pre-post change in outcomes for the (1) announcement of this priority list, and (2) implementation of the e-A&F intervention to have affected patient outcomes. Results: Across the study period there were 222,792 episodes of inpatient care, of which 13,904 episodes were found to contain one or more HACs, a risk of 6.24%. From the point of the first intervention until the end of the study the overall risk of a HAC reduced from 8.57% to 4.12% - a 51.93% reduction. Of this reduction the proportion attributed to each of these interventions was found to be 29.99% for the announcement of the priority list and 21.93% for the implementation of the e-A&F intervention. Discussion: Our findings lend evidence to a mechanism that the announcement of a measurement framework, at a national level, can lead to local strategies, such as e-A&F, that lead to significant continued improvements over time.

Implementing routine paediatric height/length and weight screening and weight management advice by clinicians: an evaluation

OBJECTIVE

To determine the views of health care professionals (HCPs) in South Western Sydney Local Health District (SWSLHD) about the effectiveness of implementation strategies used to increase routine height/length and weight screening, advice, and referral for children and adolescents. A secondary aim was to explore the prevalence of weight bias among HCPs.

METHODS

A questionnaire was sent to all HCPs who had undertaken online or face-to-face training between December 2018 and June 2020 in SWSLHD (n=840). The questionnaire collected data on their experience of routine height and weight screening and the effectiveness of strategies used in the implementation. It also included a weight bias assessment. Data were provided by the New South Wales (NSW) Ministry of Health on the performance of routine height/length and weight measures entered into the electronic medical records (eMR) in SWSLHD.

RESULTS

Of the 840 questionnaires sent, 87 were undeliverable; of the remaining 753, 285 were returned (38% response rate). More than half (53%, 151/285) of the participants were nurses. Most HCPs agreed that there was a need for routine screening and reported that education, training, and access to resources were the most helpful implementation strategies. Most HCPs were confident in performing routine screening but were less confident in raising the issue of weight with children and their families. Barriers to implementation were lack of time, equipment, appropriate clinical setting, and HCPs' perceptions and beliefs about obesity.

CONCLUSION

Routine screening is the first step in identifying children and adolescents at risk of overweight and obesity, but many HCP found it challenging to incorporate into daily practice. Multifaceted strategies are effective in increasing routine screening across diverse healthcare settings so that children and adolescents receive timely and appropriate intervention.

Early ambulation protocol after diagnostic transfemoral cerebral angiography: an evidence-based practice project

BACKGROUND

No uniform consensus has been achieved regarding the ambulation protocol after transfemoral cerebral angiography (TFA). Until now, in most hospitals patients are prescribed 8-12 h strict immobilization along with bed rest in the supine position after TFA in China, which causes great discomfort to patients.

OBJECTIVE

To evaluate the effect of an evidence-based early ambulation protocol on the prevention of vascular complications and general discomfort in patients following transfemoral cerebral angiography (TFA).

METHODS

A prospective quasi-experimental study was conducted on 214 patients undergoing TFA with manual compression. Patients in the experimental group were placed supine position for 2 h with a sandbag placed on the wound dressing, followed by a semi-seated position for another 2 h. After this period, patients took 2 h bed rest (move freely) with the sandbag removed, and were allowed to get out of bed 6 h after TFA. Patients in the control group were restricted to an 8 h bed rest in a supine position with the affected leg straight and immobilized. The vascular complications (bleeding, hematoma, ecchymosis) and levels of comfort (low back pain, leg pain, and blood pressure) were evaluated after the procedure. Numeric Rating Scale (NRS) pain scores, systolic blood pressure (SBP); diastolic blood pressure (DBP) were measured hourly for 8 h after TFA.

RESULTS

There was no significant difference in the two groups with regard to vascular complications including bleeding events (P = 0.621), bleeding volume (P = 0.321), and area of hematoma (P = 0.156). The area of ecchymosis in the experimental group was significantly smaller than the control group (P = 0.031). Compared with the control group, the NRS score for low back pain in the 4th, 5th, 6th, 7th, and 8th hour after TFA were significantly lower (P < 0.05), and the NRS score for leg pain in the 5th, 6th, 7th, 8th hour after TFA were significantly lower (P < 0.05). The SBP and DBP in the 6th, 7th, and 8th hour after TFA were significantly lower than the control group (all P < 0.05).

CONCLUSIONS

The evidence-based early ambulation protocol can effectively and safely increase comfort and decrease the pain level for patients undergoing TFA, without change in the incidence of vascular complications.

Reconsidering performance management to support innovative changes in health care services

PURPOSE

A large number of studies indicate that coercive forms of organizational control and performance management in health care services often backfire and initiate dysfunctional consequences. The purpose of this article is to discuss new approaches to performance management in health care services when the purpose is to support innovative changes in the delivery of services.

DESIGN/METHODOLOGY/APPROACH

The article represents cross-boundary work as the theoretical and empirical material used to discuss and reconsider performance management comes from several relevant research disciplines, including systematic reviews of audit and feedback interventions in health care and extant theories of human motivation and organizational control.

FINDINGS

An enabling approach to performance management in health care services can potentially contribute to innovative changes. Key design elements to operationalize such an approach are a formative and learning-oriented use of performance measures, an appeal to self- and social-approval mechanisms when providing feedback and support for local goals and action plans that fit specific conditions and challenges.

ORIGINALITY/VALUE

The article suggests how to operationalize an enabling approach to performance management in health care services. The framework is consistent with new governance and managerial approaches emerging in public sector organizations more generally, supporting a higher degree of professional autonomy and the use of nonfinancial incentives.

Developing and testing a reflection method for implementation of the informal care guideline in community nursing: Design-based research

AIM

To develop a reflection method for community nurses and certified nursing assistants to support the implementation of the Dutch Informal Care guideline in daily care.

DESIGN

Design-based research.

METHODS

A design group and four test groups of community nurses and nursing assistants were formed to develop a reflection method that aligns with the needs and preferences of its end-users. The design and test group meetings were video recorded. The video data were iteratively discussed and analysed thematically to adapt and refine the method and to identify its key features.

RESULTS

A final reflection method was developed. Five main themes were identified from the analysis: the group, reflective triggers, knowledge about the guidelines, the coach and preconditions. The themes are linked to nine key features representing the building blocks of the reflection method. The key features are group size, participants with different (educational) backgrounds, pairs of participants, expressing thoughts, video feedback, reflection game, making the connection with the guideline, coaching as a process facilitator and meeting organizational and contextual conditions for implementation.

CONCLUSION

An evidence- and practice-based reflection method for community nurses and certified nursing assistants is developed to support the implementation. By involving community nurses and certified nursing assistants, the method closely matches their needs and preferences. Critical elements of the reflection method are a game element, video feedback and working in pairs in a group of participants from different (educational) backgrounds. Guidance is needed to make the transfer from theory to practice.

IMPACT

A reflection method for community nurses and certified nursing assistants was developed to enhance care work according to guideline recommendations, aiming to improve the care provided by informal caregivers.

REPORT METHOD

The COREQ guideline was used.

PATIENT OR PUBLIC CONTRIBUTION

This reflection method was developed in close collaboration with all stakeholders during the entire study.

An assessment of adaptation and fidelity in the implementation of an audit and feedback-based intervention to improve transition to adult type 1 diabetes care in Ontario, Canada

BACKGROUND

The fit between an intervention and its local context may affect its implementation and effectiveness. Researchers have stated that both fidelity (the degree to which an intervention is delivered, enacted, and received as intended) and adaptation to the local context are necessary for high-quality implementation. This study describes the implementation of an audit and feedback (AF)-based intervention to improve transition to type 1 diabetes adult care, at five sites, in terms of adaptation and fidelity.

METHODS

An audit and feedback (AF)-based intervention for healthcare teams to improve transition to adult care for patients with type 1 diabetes was studied at five pediatric sites. The Framework for Reporting Adaptations and Modifications to Evidence-based Implementation Strategies (FRAME-IS) was used to document the adaptations made during the study. Fidelity was determined on three different levels: delivery, enactment, and receipt.

RESULTS

Fidelity of delivery, receipt, and enactment were preserved during the implementation of the intervention. Of the five sites, three changed their chosen quality improvement initiative, however, within the parameters of the study protocol; therefore, fidelity was preserved while still enabling participants to adapt accordingly.

CONCLUSIONS

We describe implementing a multi-center AF-based intervention across five sites in Ontario to improve the transition from pediatric to adult diabetes care for youth with type 1 diabetes. This intervention adopted a balanced approach considering both adaptation and fidelity to foster a community of practice to facilitate implementing quality improvement initiatives for improving transition to adult diabetes care. This approach may be adapted for improving transition care for youth with other chronic conditions and to other complex AF-based interventions.

TRIAL REGISTRATION

ClinicalTrials.gov NCT03781973. Registered 13 December 2018. Date of enrolment of the first participant to the trial: June 1, 2019.

Prescribing Portraits to Optimize Prescribing of Proton Pump Inhibitors in Long-Term Care: PPI-T STOP Study

Background

Proton pump inhibitors (PPIs) are among the most commonly prescribed medications in Canada, particularly for older adults (at least 65 years of age). Overprescribing of long-term PPIs leads to health care system waste and is associated with adverse effects, including infections and fractures. The high prevalence of PPI prescribing in long-term care (LTC) facilities prompted an evaluation of systematic approaches to PPI deprescribing.

Objective

To assess the impact of individualized prescribing portraits, a type of audit-and-feedback quality improvement intervention, on PPI deprescribing in the LTC setting.

Methods

This prospective, nonblinded, uncontrolled, pre-post quality improvement study was conducted from December 2021 to April 2022 at a 126-bed LTC facility in Vancouver, British Columbia. A PPI prescribing portrait was developed for each prescriber (n = 5) at the LTC facility, containing the prescriber's personal PPI prescribing metrics as compared with those of their peers across all LTC facilities within the same health authority; an evidence summary for PPI deprescribing; and a personalized list of the prescriber's PPI-treated residents, along with their respective PPI indications and strategies for PPI deprescribing. Three months after the prescribers received their PPI prescribing portraits, the number and types of PPI deprescribing orders were recorded.

Results

The implementation of prescribing portraits resulted in 17 (61%) of 28 PPI-treated residents receiving a deprescribing order by the end of the study period. Of the 28 PPI-treated residents, 20 were determined to be eligible for PPI deprescribing according to the evidence summary presented in the prescribing portrait; of these 20 residents, 16 (80%) appropriately received PPI deprescribing.

Conclusions

Individualized prescribing portraits had the potential to increase evidence-based PPI deprescribing among LTC residents, beyond the extent of deprescribing previously achieved through standard of care.

Identifying the impact of audit and feedback on the professional role of the nurse and psychological well-being: An integrative systematic review

This systematic review aimed to critically synthesis evidence to identify the impact that audit and feedback processes have on the professional role of the nurse and psychological well-being. Little is known about the extent to which audit and feedback processes can positively or negatively impact the professional role of the nurse and psychological well-being. An integrative systematic review was conducted. Covidence systematic review software was used to manage the screening process. Data extraction and methodological quality appraisal were conducted in parallel, and a narrative synthesis was conducted. Nurse participation and responsiveness to audit and feedback processes depended on self-perceived motivation, content, and delivery; and nurses viewed it as an opportunity for professional development. However, audit was reported to negatively impact nurses' psychological well-being, with impacts on burnout, stress, and demotivation in the workplace. Targeting framing, delivery, and content of audit and feedback is critical to nurses' satisfaction and successful quality improvement.

Perceptions of the effectiveness of using patient encounter data as an education and reflection tool in general practice training

Introduction Patient encounter tools provide feedback and potentially reflection on general practitioner (GP) registrars' in-practice learning and may contribute to the formative assessment of clinical competencies. However, little is known about the perceived utility of such tools. Aim To investigate the perceived utility of a patient encounter tool by GP registrars, their supervisors, and medical educators (MEs). Methods General practice registrars, supervisors and MEs from two Australian regional training organisations completed a cross-sectional questionnaire. Registrars rated how Registrar Clinical Encounters in Training (ReCEnT), a patient encounter tool, influenced their reflection on, and change in, clinical practice, learning and training. Supervisors' and MEs' perceptions provided contextual information about understanding their registrars' clinical practice, learning and training needs. Results Questionnaires were completed by 48% of registrars (n  = 90), 22% of supervisors (n  = 182), and 61% of MEs (n  = 62). Most registrars agreed that ReCEnT helped them reflect on their clinical practice (79%), learning needs (69%) and training needs (72%). Many registrars reported changing their clinical practice (54%) and learning approaches (51%). Fewer (37%) agreed that ReCEnT influenced them to change their training plans. Most supervisors (68%) and MEs (82%) agreed ReCEnT reports helped them better understand their registrars' clinical practice. Similarly, most supervisors (63%) and MEs (68%) agreed ReCEnT reports helped them better understand their registrars' learning and training needs. Discussion ReCEnT can prompt self-reflection among registrars, leading to changes in clinical practice, learning approaches and training plans. Reaching its potential as an assessment for learning (as opposed to an assessment of learning) requires effective engagement between registrars, their supervisors and MEs.

A Virtual Hospital Model of Care for Low Back Pain, Back@Home: Protocol for a Hybrid Effectiveness-Implementation Type-I Study

BACKGROUND

Low back pain (LBP) was the fifth most common reason for an emergency department (ED) visit in 2020-2021 in Australia, with >145,000 presentations. A total of one-third of these patients were subsequently admitted to the hospital. The admitted patient care accounts for half of the total health care expenditure on LBP in Australia.

OBJECTIVE

The primary aim of the Back@Home study is to assess the effectiveness of a virtual hospital model of care to reduce the length of admission in people presenting to ED with musculoskeletal LBP. A secondary aim is to evaluate the acceptability and feasibility of the virtual hospital and our implementation strategy. We will also investigate rates of traditional hospital admission from the ED, representations and readmissions to the traditional hospital, demonstrate noninferiority of patient-reported outcomes, and assess cost-effectiveness of the new model.

METHODS

This is a hybrid effectiveness-implementation type-I study. To evaluate effectiveness, we plan to conduct an interrupted time-series study at 3 metropolitan hospitals in Sydney, New South Wales, Australia. Eligible patients will include those aged 16 years or older with a primary diagnosis of musculoskeletal LBP presenting to the ED. The implementation strategy includes clinician education using multimedia resources, staff champions, and an "audit and feedback" process. The implementation of "Back@Home" will be evaluated over 12 months and compared to a 48-month preimplementation period using monthly time-series trends in the average length of hospital stay as the primary outcome. We will construct a plot of the observed and expected lines of trend based on the preimplementation period. Linear segmented regression will identify changes in the level and slope of fitted lines, indicating immediate effects of the intervention, as well as effects over time. The data will be fully anonymized, with informed consent collected for patient-reported outcomes.

RESULTS

As of December 6, 2023, a total of 108 patients have been cared for through Back@Home. A total of 6 patients have completed semistructured interviews regarding their experience of virtual hospital care for nonserious back pain. All outcomes will be evaluated at 6 months (August 2023) and 12 months post implementation (February 2024).

CONCLUSIONS

This study will serve to inform ongoing care delivery and implementation strategies of a novel model of care. If found to be effective, it may be adopted by other health districts, adapting the model to their unique local contexts.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

PRR1-10.2196/50146.

Implementing ward-based practice books to increase the amount of practice completed during inpatient stroke rehabilitation: a mixed-methods process evaluation

PURPOSE

Stroke survivors must complete large amounts of practice to achieve functional improvements but spend many hours inactive during their rehabilitation. We conducted a mixed methods process evaluation exploring factors affecting the success of a 6-month behaviour change intervention to increase use of ward-based practice books.

METHODS

Audits of the presence, quality and use of ward based-practice books were conducted, alongside focus groups with staff (n = 19), and interviews with stroke survivors (n = 3) and family members (n = 4). Quantitative data were analysed descriptively. Focus group and interview transcripts were analysed using qualitative analysis.

RESULTS

Personal (patient-related) factors (including severe weakness, cognitive and communication deficits of stroke survivors), staff coaching skills, understanding and beliefs about their role, affected practice book use. Staff turnover, nursing shift work and a lack of action planning reduced success of the behaviour change intervention.

CONCLUSIONS

Staff with the necessary skills and understanding of their role in implementing ward practice overcame personal (patient-related) factors and assisted stroke survivors to successfully practice on the ward. To improve success of the intervention, repeated training of new staff is required. In addition to audit and feedback, team action planning is needed around the presence, quality, and use of ward practice books.

Knowledge translation strategies used for sustainability of an evidence-based intervention in child health: a multimethod qualitative study

BACKGROUND

Sustainability of evidence-based interventions (EBIs) is suboptimal in healthcare. Evidence on how knowledge translation (KT) strategies are used for the sustainability of EBIs in practice is lacking. This study examined what and how KT strategies were used to facilitate the sustainability of Alberta Family Integrated Care (FICare)™, a psychoeducational model of care scaled and spread across 14 neonatal intensive care units, in Alberta, Canada.

METHODS

First, we conducted an environmental scan of relevant documents to determine the use of KT strategies to support the sustainability of Alberta FICare™. Second, we conducted semi-structured interviews with decision makers and operational leaders to explore what and how KT strategies were used for the sustainability of Alberta FICare™, as well as barriers and facilitators to using the KT strategies for sustainability. We used the Expert Recommendations for Implementation Change (ERIC) taxonomy to code the strategies. Lastly, we facilitated consultation meetings with the Alberta FICare™ leads to share and gain insights and clarification on our findings.

RESULTS

We identified nine KT strategies to facilitate the sustainability of Alberta FICare™: Conduct ongoing training; Identify and prepare local champions; Research co-production; Remind clinicians; Audit and provide feedback; Change record systems; Promote adaptability; Access new funding; and Involve patients/consumers and family members. A significant barrier to the sustainability of Alberta FICare™ was a lack of clarity on who was responsible for the ongoing maintenance of the intervention. A key facilitator to sustainability of Alberta FICare was its alignment with the Maternal, Newborn, Child & Youth Strategic Clinical Network (MNCY SCN) priorities. Co-production between researchers and health system partners in the design, implementation, and scale and spread of Alberta FICare™ was critical to sustainability.

CONCLUSION

This research highlights the importance of clearly articulating who is responsible for continued championing for the sustainability of EBIs. Additionally, our research demonstrates that the adaptation of interventions must be considered from the onset of implementation so interventions can be tailored to align with contextual barriers for sustainability. Clear guidance is needed to continually support researchers and health system leaders in co-producing strategies that facilitate the long-term sustainability of effective EBIs in practice.

Effects of a team Quality Improvement method in a national clinical audit programme of four clinical specialties in Ministry of Health hospitals in Saudi Arabia

In 2018, the Ministry of Health (MoH) in Saudi Arabia developed a clinical excellence strategy. An objective was to reduce variation in clinical practices in MoH hospitals, particularly for conditions with high mortality in Saudi Arabia, by applying best practice clinical standards and using the clinical audit process to measure clinical practice. The strategy included working with multiprofessional teams in hospitals to implement improvements needed in clinical practice. To test the feasibility of carrying out national clinical audits in MoH hospitals, audits were carried out in 16 MoH hospitals on four clinical subjects-acute myocardial infarction, major trauma, sepsis, and stroke. Clinical expert groups, including Saudi clinicians and an international clinical expert, developed clinical care standards for the four conditions from analyses of international and Saudi clinical guidelines. The audits were designed with the expert groups. Multiprofessional teams were appointed to carry out the audits in designated MoH hospitals. Data collectors in each hospital were trained to collect data. Workshops were held with the teams on the clinical care standards and how data would be collected for the audits, and later, on the findings of data collection and how to use the improvement process to implement changes to improve compliance with the standards. After 4 months, data collection was repeated to determine if compliance with the clinical care standards had improved. Data collected from each hospital for both cycles of data collection were independently reliably tested. All designated hospitals participated in the audits, collecting and submitting data for two rounds of data collection and implementing improvement plans after the first round of data collection. All hospitals made substantial improvements in clinical practices. Of a total of 84 measures used to assess compliance with a total of 52 clinical care standards for the four clinical conditions, improvements were made by hospital teams in 58 (69.1%) measures. Improvements were statistically significant for 34 (40.5%) measures. The project demonstrated that well-designed and executed audits using evidence-based clinical care standards can result in substantial improvements in clinical practices in MoH hospitals in Saudi Arabia. Keys to success were the improvement methodology built into the audit process and the requirement for hospitals to appoint multiprofessional teams to carry out the audits. The approach adds to evidence on the effectiveness of clinical audits in achieving improvements in clinical quality and can be replicated in national audit programmes.

Implementation outcomes of the integrated district evidence to action (IDEAs) program to reduce neonatal mortality in central Mozambique: an application of the RE-AIM evaluation framework

BACKGROUND

Scarce evidence exists on audit and feedback implementation processes in low-resource health systems. The Integrated District Evidence to Action (IDEAs) is a multi-component audit and feedback strategy designed to improve the implementation of maternal and child guidelines in Mozambique. We report IDEAs implementation outcomes.

METHODS

IDEAs was implemented in 154 health facilities across 12 districts in Manica and Sofala provinces between 2016 and 2020 and evaluated using a quasi-experimental design guided by the Reach, Effectiveness, Adoption, Implementation, and Maintenance (RE-AIM) framework. Reach is the proportion of pregnant women attending IDEAs facilities. Adoption is the proportion of facilities initiating audit and feedback meetings. Implementation is the fidelity to the strategy components, including readiness assessments, meetings (frequency, participation, action plan development), and targeted financial support and supervision. Maintenance is the sustainment at 12, 24, and 54 months.

RESULTS

Across both provinces, 56% of facilities were exposed to IDEAs (target 57%). Sixty-nine and 73% of pregnant women attended those facilities' first and fourth antenatal consultations (target 70%). All facilities adopted the intervention. 99% of the expected meetings occurred with an average interval of 5.9 out of 6 months. Participation of maternal and child managers was high, with 3076 attending meetings, of which 64% were from the facility, 29% from the district, and 7% from the province level. 97% of expected action plans were created, and 41 specific problems were identified. "Weak diagnosis or management of obstetric complications" was identified as the main problem, and "actions to reinforce norms and protocols" was the dominant subcategory of micro-interventions selected. Fidelity to semiannual readiness assessments was low (52% of expected facilities), and in completing micro-interventions (17% were completed). Ninety-six and 95% of facilities sustained the intervention at 12 and 24 months, respectively, and 71% had completed nine cycles at 54 months.

CONCLUSION

Maternal and child managers can lead audit and feedback processes in primary health care in Mozambique with high reach, adoption, and maintenance. The IDEAs strategy should be adapted to promote higher fidelity around implementing action plans and conducting readiness assessments. Adding effectiveness to these findings will help to inform strategy scale-up.

Performance Data Advocacy for Continuing Professional Development in Health Professions

ABSTRACT

Efforts to optimize continuing professional development (CPD) are ongoing and include advocacy for the use of clinician performance data. Several educational and quality-based frameworks support the use of performance data to achieve intended improvement outcomes. Although intuitively appealing, the role of performance data for CPD has been uncertain and its utility mainly assumed. In this Scholarly Perspective, the authors briefly review and trace arguments that have led to the conclusion that performance data are essential for CPD. In addition, they summarize and synthesize a recent and ongoing research program exploring the relationship physicians have with performance data. They draw on Collins, Onwuegbuzie, and Johnson's legitimacy model and Dixon-Woods' integrative approach to generate inferences and ways of moving forward. This interpretive approach encourages questioning or raising of assumptions about related concepts and draws on the perspectives (i.e., interpretive work) of the research team to identify the most salient points to guide future work. The authors identify 6 stimuli for future programs of research intended to support broader and better integration of performance data for CPD. Their aims are to contribute to the discourse on data advocacy for CPD by linking conceptual, methodologic, and analytic processes and to stimulate discussion on how to proceed on the issue of performance data for CPD purposes. They hope to move the field from a discussion on the utility of data for CPD to deeper integration of relevant conceptual frameworks.

Statewide Initiative to Reduce Patient Radiation Doses During Percutaneous Coronary Intervention

BACKGROUND

Improved radiation safety practices are needed across hospitals performing percutaneous coronary intervention (PCI). This study was performed to assess the temporal trend in PCI radiation doses concurrent with the conduct of a statewide radiation safety initiative.

METHODS

A statewide initiative to reduce PCI radiation doses was conducted in Michigan between 2017 and 2021 and included focused radiation safety education, reporting of institutional radiation doses, and implementation of radiation performance metrics for hospitals. Using data from a large statewide registry, PCI discharges between July 1, 2016, and July 1, 2022, having a procedural air kerma (AK) recorded were analyzed for temporal trends. A multivariable regression analysis was performed to determine whether declines in procedural AK over time were attributable to changes in known predictors of radiation doses.

RESULTS

Among 131 619 PCI procedures performed during the study period, a reduction in procedural AK was observed over time, from a median dose of 1.46 (0.86-2.37) Gy in the first year of the study to 0.97 (0.56-1.64) Gy in the last year of the study (P<0.001). The proportion of cases with an AK ≥5 Gy declined from 4.24% to 0.86% over the same time period (P<0.0001). After adjusting for variables known to impact radiation doses, a 1-year increase in the date of PCI was associated with a 7.61% (95% CI, 7.38%-7.84%) reduction in procedural AK (P<0.0001).

CONCLUSIONS

Concurrent with the conduct of a statewide initiative to reduce procedural radiation doses, a progressive and significant decline in procedural radiation doses was observed among patients undergoing PCI in the state of Michigan.

Development of theoretically informed audit and feedback: An exemplar from a complex implementation strategy to improve asthma self-management in UK primary care

RATIONALE

Audit and feedback is an evidence-based implementation strategy, but studies reporting the use of theory to guide design elements are limited.

AIMS AND OBJECTIVES

Within the context of a programme of research aiming to improve the implementation of supported asthma self-management in UK primary care (IMPlementing IMProved Asthma self-management as RouTine [IMP2 ART]), we aimed to design and develop theoretically-informed audit and feedback that highlighted supported asthma self-management provision and areas for improvement in primary care general practices.

METHOD

Aligned with the Medical Research Council (MRC) complex intervention framework, the audit and feedback was developed in three phases: (1) Development: literature and theory exploration, and prototype audit and feedback design; (2) Feasibility: eliciting feedback on the audit and feedback from general practice staff (n = 9); (3) Prepiloting: delivering the audit and feedback within the IMP2 ART implementation strategy (incorporating patient and professional resources and an asthma review template) and eliciting clinician feedback (n = 9).

RESULTS

Audit and feedback design was guided by and mapped to existing literature suggestions and theory (e.g., Theoretical Domains Framework, Behaviour Change Technique Taxonomy). Feedback on the prototype audit and feedback confirmed feasibility but identified some refinements (a need to highlight supporting self-management and importance of asthma action plans). Prepiloting informed integration with other IMP2 ART programme strategies (e.g., patient resources and professional education).

CONCLUSION

We conclude that a multistage development process including theory exploration and mapping, contributed to the design and delivery of the audit and feedback. Aligned with the MRC framework, the IMP2 ART strategy (incorporating the audit and feedback) is now being tested in a UK-wide cluster randomised controlled trial.

The Role of Clinical Audits in Advancing Quality and Safety in Healthcare Services: A Multiproject Analysis From a Jordanian Hospital

Introduction Clinical audits have become essential instruments for evaluating and improving the standard of patient care in healthcare services. While individual clinical audits focus on particular aspects of care, multiple clinical audits across various domains, specialties, or departments provide a more comprehensive understanding of clinical practice and encourage systemic improvements. Methodology This study employed a mixed-methods approach to review and assess various clinical audits and quality improvement initiatives conducted at Al-Karak Governmental Hospital in southern Jordan. The study aimed to identify obstacles and possibilities of conducting clinical audits and provide suggestions for enhancing audit procedures and results. Data were collected from both retrospective and prospective sources and analyzed using descriptive and inferential statistics. Results The study comprised 11 audits conducted in three medical departments, namely surgery, obstetrics and gynecology (OB/GYN), and pediatrics, with a total of 618 participants. The improvements in adherence to guidelines after the second loop of all the audits were significant and showed significant improvements in adherence to guidelines, demonstrating the efficacy of clinical audits in improving clinical practice and outcomes. Conclusions Clinical audits are essential for maintaining and improving quality and safety in healthcare services, particularly in developing nations where emergency obstetric care is lacking. Multiple clinical audits provide a comprehensive understanding of clinical practice and encourage systemic improvements. The findings of our study suggest that clinical audits can lead to significant improvements in adherence to guidelines and better clinical outcomes. Future research should focus on identifying best practices for conducting clinical audits and evaluating their long-term viability and expandability.

Exercise-based cardiac rehabilitation after acute myocardial infarction in Sweden - standards, costs, and adherence to European guidelines (The Perfect-CR study)

AIMS

Information on standards including structure- and process-based metrics and how exercise-based cardiac rehabilitation (EBCR) is delivered in relation to guidelines is lacking. The aims of the study were to evaluate standards and adherence to guidelines at Swedish CR centers and to conduct a cost analysis of the physiotherapy-related activities of EBCR.

METHODS AND RESULTS

EBCR standards at all 78 CR centers in Sweden in 2016 were surveyed. The questions were based on guideline-recommended core components of EBCR for patients after a myocardial infarction (MI). The cost analysis included the identification, quantification, and valuation of EBCR-related cost items. Patients were offered a pre-discharge consultation with a physiotherapist at n = 61, 78% of the centers. A pre-exercise screening visit was routinely offered at n = 64, 82% of the centers, at which a test of aerobic capacity was offered in n = 58, 91% of cases, most often as a cycle ergometer exercise test n = 55, 86%. A post-exercise assessment was offered at n = 44, 56% of the centers, with a functional test performed at n = 30, 68%. Almost all the centers n = 76, 97% offered supervised EBCR programs. The total cost of delivering physiotherapy-related activities of EBCR according to guidelines was approximately 437 euro (4,371 SEK) per patient. Delivering EBCR to one MI patient required 11.25 hours of physiotherapy time.

CONCLUSION

While the overall quality of EBCR programs in Sweden is high, there are several areas of potential improvement to reach the recommended European standards across all centers. To improve the quality of EBCR, further compliance with guidelines is warranted.

Feasibility and perceptions of a benzodiazepine deprescribing quality improvement initiative for primary care providers in Japan

BACKGROUND

Quality improvement (QI) initiatives in primary care in Japan are rare. One crucial area for QI is the appropriate prescription of benzodiazepines due to the large and growing elderly population in the country.

OBJECTIVE

This study aimed to determine the feasibility and other perceptions of a Benzodiazepine receptor agonist medications (BZRAs) deprescribing QI initiative for primary care providers (PCPs) in Japanese primary care clinics.

DESIGN

A qualitative study within a QI initiative.

PARTICIPANTS

We recruited 11 semi-public clinics and 13 providers in Japan to participate in a BZRAs deprescribing initiative from 2020 to 2021. After stratifying the clinics according to size, we randomly allocated implementation clinics to either an Audit only or an Audit plus Coaching group.

INTERVENTIONS

For the Audit, we presented clinics with two BZRAs-related indicators. We provided monthly web-based meetings for the Coaching to support their QI activities.

APPROACH

After the nine-month initiative, we conducted semi-structured interviews and used content analysis to identify themes. We organized the themes and assessed the key factors of implementation using the Consolidated Framework for Implementation Research (CFIR) framework.

KEY RESULTS

Audit plus Coaching was perceived as more valuable than Audit only intervention. Participants expressed intellectual curiosity about the QI initiative from resources outside their clinic. However, adopting a team-based QI approach in a small clinic was perceived as challenging, and selecting the indicators was important for meaningful QI.

CONCLUSION

The small size of the clinic could be a potential barrier, but enhancing academic curiosity may facilitate QI initiatives in primary care in Japan. Further implementation trials are needed to evaluate the possibility of QI with more various indicators and a more extended period of time.

Access to automated comparative feedback reports in primary care - a study of intensity of use and relationship with clinical performance among Swedish primary care practices

BACKGROUND

Digital applications that automatically extract information from electronic medical records and provide comparative visualizations of the data in the form of quality indicators to primary care practices may facilitate local quality improvement (QI). A necessary condition for such QI to work is that practices actively access the data. The purpose of this study was to explore the use of an application that visualizes quality indicators in Swedish primary care, developed by a profession-led QI initiative ("Primärvårdskvalitet"). We also describe the characteristics of practices that used the application more or less extensively, and the relationships between the intensity of use and changes in selected performance indicators.

METHODS

We studied longitudinal data on 122 primary care practices' visits to pages (page views) in the application over a period up to 5 years. We compared high and low users, classified by the average number of monthly page views, with respect to practice and patient characteristics as well as baseline measurements of a subset of the performance indicators. We estimated linear associations between visits to pages with diabetes-related indicators and the change in measurements of selected diabetes indicators over 1.5 years.

RESULTS

Less than half of all practices accessed the data in a given month, although most practices accessed the data during at least one third of the observed months. High and low users were similar in terms of most studied characteristics. We found statistically significant positive associations between use of the diabetes indicators and changes in measurements of three diabetes indicators.

CONCLUSIONS

Although most practices in this study indicated an interest in the automated feedback reports, the intensity of use can be described as varying and on average limited. The positive associations between the use and changes in performance suggest that policymakers should increase their support of practices' QI efforts. Such support may include providing a formalized structure for peer group discussions of data, facilitating both understanding of the data and possible action points to improve performance, while maintaining a profession-led use of applications.

Healthcare professional communication behaviours, skills, barriers, and enablers: Exploring the perspectives of people living with Inflammatory Bowel Disease

This qualitative study conceptualised effective communication behaviours of healthcare professionals (gastroenterologists, surgeons, nurses, and general practitioners) and explored communication barriers and facilitators from the perspective of adults with Inflammatory Bowel Disease (IBD). Seventeen qualitative interviews were conducted with people living with IBD in the UK or USA (n = 17) and their spouses (n = 4). An inductive content analysis was firstly applied to participants' accounts to define which healthcare professionals' behaviours and skills were perceived as essential for effective communication. An inductive reflexive thematic analysis elucidated themes of perceived barriers and facilitators experienced when communicating with their IBD healthcare professionals. Thirty-three provider communication behaviours were grouped into nine healthcare professional skills. Five themes encompassed 11 barriers and facilitators: professionals' knowledge and behaviour, unequal power, patient navigation skills, time constraints and demand, and continuity and collaboration of care. For patients and some spouses, enhancing communication in IBD services means increasing patient, family, and health professional knowledge, encouraging collaborative partnership working, and promoting healthcare professional skills to communicate effectively within the reality of time restraints.

Quality Review Committee Audit Improves Thoracic Enhanced Recovery After Surgery Protocol Compliance

INTRODUCTION

Compliance with thoracic Enhanced Recovery After Surgery (ERAS) protocols is critical to achieving their maximum benefits. We sought to examine utilization of quality review meetings as a method to improve protocol compliance through identification and resolution of barriers with compliance.

METHODS

A multidisciplinary committee implemented a thoracic ERAS protocol for anatomic lung resections across five hospitals within our health system. Compliance data at one institution were tracked for 4 mo after initiation of the ERAS protocol; a quality review meeting was held at one hospital, and two additional months of compliance data were recorded. Outcomes of interest were compliance changes to five protocol elements. Pathway elements deferred due to "mindful deviation" were excluded. Chi-square and Fisher's exact tests were used to compare compliance differences.

RESULTS

We included 81 patients: 53 patients before the quality review meeting and 28 after. There were 405 compliance opportunities; 68 (17%) were excluded for mindful deviation, leaving 337 (83%) for inclusion. Overall compliance improved from 53% before to 84% after the quality review meeting. Compliance to avoiding intraoperative urinary catheters, placing chest tubes to water seal in postanesthesia care unit, liberal chest tube removal, and postoperative multimodal pain regimen use improved after the quality review meeting (P values <0.05). Use of preoperative pain bundles was not significantly different (87% versus 96%, P = 0.25).

CONCLUSIONS

Conducting a quality review meeting significantly improved ERAS protocol element use at our intervention healthcare region. This methodology should be considered at other institutions implementing surgical protocols.

Implementation and evaluation of a nurse-led intervention to augment an existing residential aged care facility outreach service with a visual telehealth consultation: stepped-wedge cluster randomised controlled trial

BACKGROUND

Up to 75% of residents from residential aged care facilities (RACF) are transferred to emergency departments (ED) annually to access assessment and care for unplanned or acute health events. Emergency department presentations of RACF residents can be both expensive and risky, and many are unnecessary and preventable. Processes or triage systems to assess residents with a health event, prior to transfer, may reduce unnecessary ED transfer. The Aged Care Emergency (ACE) service is a nurse-led ED outreach service that provides telephone support to RACF nurses regarding residents' health events. This service is available Monday to Friday, 8am to 4 pm (ED ACE hours). The primary objective of this study was to assess whether the augmentation of the phone-based ED ACE service with the addition of a visual telehealth consultation (VTC) would reduce RACF rate of ED presentations compared to usual care. The secondary objectives were to 1) monitor presentations to ED within 48 h post VTC to detect any adverse events and 2) measure RACF staff perceptions of VTC useability and acceptability.

METHODS

This implementation study used a stepped wedge cluster randomised controlled trial design. Study settings were four public hospital EDs and 16 RACFs in two Local Health Districts. Each ED was linked to 4 RACFs with approximately 350 RACF beds, totalling 1435 beds across 16 participating RACFs. Facilities were randomised into eight clusters with each cluster comprising one ED and two RACFs.

RESULTS

A negative binomial regression demonstrated a 29% post-implementation reduction in the rate of ED presentations (per 100 RACF beds), within ED ACE hours (IRR [95% CI]: 0.71 [0.46, 1. 09]; p = 0.122). A 29% reduction, whilst not statistically significant, is still clinically important and impactful for residents and EDs. A post-hoc logistic regression demonstrated a statistically significant 69% reduction in the probability that an episode of care resulted in an ED presentation within ED ACE hours post-implementation compared to pre-implementation (OR [95% CI]: 0.31 [0.11, 0.87]; p = 0.025).

CONCLUSION

Findings have shown the positive impact of augmenting ACE with a VTC. Any reduction of resident presentations to a busy ED is beneficial to healthcare overall, but more so to the individual older person who can recover safely and comfortably in their own RACF.

TRIAL REGISTRATION

Australian New Zealand Clinical Trials Registry (ID ACTR N12619001692123) (02/12/2019) https://www.anzctr.org.au/Trial/Registration/TrialReview.aspx?id=378629andisReview=true.

What are the features of high-performing quality improvement collaboratives? A qualitative case study of a state-wide collaboratives programme

OBJECTIVES

Despite their widespread use, the evidence base for the effectiveness of quality improvement collaboratives remains mixed. Lack of clarity about 'what good looks like' in collaboratives remains a persistent problem. We aimed to identify the distinctive features of a state-wide collaboratives programme that has demonstrated sustained improvements in quality of care in a range of clinical specialties over a long period.

DESIGN

Qualitative case study involving interviews with purposively sampled participants, observations and analysis of documents.

SETTING

The Michigan Collaborative Quality Initiatives programme.

PARTICIPANTS

38 participants, including clinicians and managers from 10 collaboratives, and staff from the University of Michigan and Blue Cross Blue Shield of Michigan.

RESULTS

We identified five features that characterised success in the collaboratives programme: learning from positive deviance; high-quality coordination; high-quality measurement and comparative performance feedback; careful use of motivational levers; and mobilising professional leadership and building community. Rigorous measurement, securing professional leadership and engagement, cultivating a collaborative culture, creating accountability for quality, and relieving participating sites of unnecessary burdens associated with programme participation were all important to high performance.

CONCLUSIONS

Our findings offer valuable learning for optimising collaboration-based approaches to improvement in healthcare, with implications for the design, structure and resourcing of quality improvement collaboratives. These findings are likely to be useful to clinicians, managers, policy-makers and health system leaders engaged in multiorganisational approaches to improving quality and safety.

Audit and feedback to reduce unwarranted clinical variation at scale: a realist study of implementation strategy mechanisms

BACKGROUND

Unwarranted clinical variation in hospital care includes the underuse, overuse, or misuse of services. Audit and feedback is a common strategy to reduce unwarranted variation, but its effectiveness varies widely across contexts. We aimed to identify implementation strategies, mechanisms, and contextual circumstances contributing to the impact of audit and feedback on unwarranted clinical variation.

METHODS

Realist study examining a state-wide value-based healthcare program implemented between 2017 and 2021 in New South Wales, Australia. Three initiatives within the program included audit and feedback to reduce unwarranted variation in inpatient care for different conditions. Multiple data sources were used to formulate the initial audit and feedback program theory: a systematic review, realist review, program document review, and informal discussions with key program stakeholders. Semi-structured interviews were then conducted with 56 participants to refute, refine, or confirm the initial program theories. Data were analysed retroductively using a context-mechanism-outcome framework for 11 transcripts which were coded into the audit and feedback program theory. The program theory was validated with three expert panels: senior health leaders (n = 19), Agency for Clinical Innovation (n = 11), and Ministry of Health (n = 21) staff.

RESULTS

The program's audit and feedback implementation strategy operated through eight mechanistic processes. The strategy worked well when clinicians (1) felt ownership and buy-in, (2) could make sense of the information provided, (3) were motivated by social influence, and (4) accepted responsibility and accountability for proposed changes. The success of the strategy was constrained when the audit process led to (5) rationalising current practice instead of creating a learning opportunity, (6) perceptions of unfairness and concerns about data integrity, 7) development of improvement plans that were not followed, and (8) perceived intrusions on professional autonomy.

CONCLUSIONS

Audit and feedback strategies may help reduce unwarranted clinical variation in care where there is engagement between auditors and local clinicians, meaningful audit indicators, clear improvement plans, and respect for clinical expertise. We contribute theoretical development for audit and feedback by proposing a Model for Audit and Feedback Implementation at Scale. Recommendations include limiting the number of audit indicators, involving clinical staff and local leaders in feedback, and providing opportunities for reflection.

Excess Bed Days and Hospitalization Costs Associated With 30-Day Complications Following Catheter Ablation of Atrial Fibrillation

BACKGROUND

The incidence and type of complications following catheter ablation of atrial fibrillation have been extensively examined, but the impact associated with these complications on the length of stay and hospitalization costs is unknown.

METHODS AND RESULTS

This cohort study included 20 117 adult patients (mean age 62.6±11.4 years, 30.3% women, median length of stay 1 day [interquartile range 1-2 days]) undergoing atrial fibrillation ablation in financial years 2011 to 2017 in Australia with available cost data from the National Hospital Cost Data Collection, which determines government reimbursement of health services provided. The primary outcome was the costs associated with complications occurring up to 30 days postdischarge adjusted for inflation to 2021 Australian dollars. We used generalized linear models to estimate the increase in length of stay and cost associated with complications, adjusting for patient characteristics. Within 30 days of hospital discharge, 1151 (5.72%) patients experienced a complication with bleeding (3.35%) and pericardial effusion (0.75%) being the most common. On average, the occurrence of a complication was associated with an adjusted 3.3 (95% CI, 3.1-3.6) excess bed days of hospital care (totaling 3851 days), and a $7812 (95% CI, $6754-$8870) increase in hospitalization cost (totaling $9.0 million). Most of the total excess cost was attributable to bleeding ($3.8 million, 41.9% of total excess cost) and pericardial effusion ($1.6 million, 18.2%).

CONCLUSIONS

Complications following atrial fibrillation ablation were associated with significant increase in length of stay and hospitalization costs, most of which were attributable to bleeding and pericardial effusion. Strategies to improve procedural safety and reduce health care costs should focus on these complications.

Alarm with care-a de-implementation strategy to reduce fall prevention alarm use in US hospitals: a study protocol for a hybrid 2 effectiveness-implementation trial

BACKGROUND

Fall prevention alarms are commonly used among US hospitals as a fall prevention strategy despite limited evidence of effectiveness. Further, fall prevention alarms are harmful to healthcare staff (e.g., alarm fatigue) and patients (e.g., sleep disturbance, mobility restriction). There is a need for research to develop and test strategies for reducing use of fall prevention alarms in US hospitals.

METHODS

To address this gap, we propose testing the effectiveness and implementation of Alarm with Care, a de-implementation strategy to reduce fall prevention alarm use using a stepped-wedge randomized controlled trial among 30 adult medical or medical surgical units from nonfederal US acute care hospitals. Guided by the Choosing Wisely De-Implementation Framework, we will (1) identify barriers to fall prevention alarm de-implementation and develop tailored de-implementation strategies for each unit and (2) compare the implementation and effectiveness of high- versus low-intensity coaching to support site-specific de-implementation of fall prevention alarms. We will evaluate effectiveness and implementation outcomes and examine the effect of multi-level (e.g., hospital, unit, and patient) factors on effectiveness and implementation. Rate of fall prevention alarm use is the primary outcome. Balancing measures will include fall rates and fall-related injuries. Implementation outcomes will include feasibility, acceptability, appropriateness, and fidelity.

DISCUSSION

Findings from this line of research could be used to support scale-up of fall prevention alarm de-implementation in other healthcare settings. Further, research generated from this proposal will advance the field of de-implementation science by determining the extent to which low-intensity coaching is an effective and feasible de-implementation strategy.

TRIAL REGISTRATION

ClinicalTrials.gov identifier: NCT06089239 . Date of registration: October 17, 2023.

Knowledge translation strategies to support the sustainability of evidence-based interventions in healthcare: a scoping review

BACKGROUND

Knowledge translation (KT) strategies are widely used to facilitate the implementation of EBIs into healthcare practices. However, it is unknown what and how KT strategies are used to facilitate the sustainability of EBIs in institutional healthcare settings.

OBJECTIVES

This scoping review aimed to consolidate the current evidence on (i) what and how KT strategies are being used for the sustainability of EBIs in institutional healthcare settings; (ii) the reported KT strategy outcomes (e.g., acceptability) for EBI sustainability, and (iii) the reported EBI sustainability outcomes (e.g., EBI activities or component of the intervention continue).

METHODS

We conducted a scoping review of five electronic databases. We included studies describing the use of specific KT strategies to facilitate the sustainability of EBIs (more than 1-year post-implementation). We coded KT strategies using the clustered ERIC taxonomy and AIMD framework, we coded KT strategy outcomes using Tierney et al.'s measures, and EBI sustainability outcomes using Scheirer and Dearing's and Lennox's taxonomy. We conducted descriptive numerical summaries and a narrative synthesis to analyze the results.

RESULTS

The search identified 3776 studies for review. Following the screening, 25 studies (reported in 27 papers due to two companion reports) met the final inclusion criteria. Most studies used multi-component KT strategies for EBI sustainability (n = 24). The most common ERIC KT strategy clusters were to train and educate stakeholders (n = 38) and develop stakeholder interrelationships (n = 34). Education was the most widely used KT strategy (n = 17). Many studies (n = 11) did not clearly report whether they used different or the same KT strategies between EBI implementation and sustainability. Seven studies adapted KT strategies from implementation to sustainability efforts. Only two studies reported using a new KT strategy for EBI sustainability. The most reported KT strategy outcomes were acceptability (n = 10), sustainability (n = 5); and adoption (n = 4). The most commonly measured EBI sustainability outcome was the continuation of EBI activities or components (n = 23), followed by continued benefits for patients, staff, and stakeholders (n = 22).

CONCLUSIONS

Our review provides insight into a conceptual problem where initial EBI implementation and sustainability are considered as two discrete time periods. Our findings show we need to consider EBI implementation and sustainability as a continuum and design and select KT strategies with this in mind. Our review has emphasized areas that require further research (e.g., KT strategy adaptation for EBI sustainability). To advance understanding of how to employ KT strategies for EBI sustainability, we recommend clearly reporting the dose, frequency, adaptations, fidelity, and cost of KT strategies. Advancing our understanding in this area would facilitate better design, selection, tailored, and adapted use of KT strategies for EBI sustainability, thereby contributing to improved patient, provider, and health system outcomes.

Measuring and monitoring patient safety in hospitals in the Republic of Ireland

BACKGROUND

Measuring and monitoring safety (MMS) is critical to the success of safety improvement efforts in healthcare. However, a major challenge to improving safety is the lack of high quality information to support performance evaluation.

AIMS

The aim of this study was to use Vincent et al.'s MMS framework to evaluate the methods used to MMS in Irish hospitals and make recommendations for improvement.

METHODS

The first phase of this qualitative study used document analysis to review national guidance on MMS in Ireland. The second phase consisted of semi-structured interviews with key stakeholders on their understanding of MMS. The MMS framework was used to classify the methods identified.

RESULTS

Six documents were included for analysis, and 24 semi-structured interviews were conducted with key stakeholders working in the Irish healthcare system. A total of 162 methods of MMS were identified, with one method of MMS addressing two dimensions. Of these MMS methods, 30 (18.4%) were concerned with past harm, 40 (24.5%) were concerned with the reliability of safety critical processes, 16 (9.8%) were concerned with sensitivity to operations, 28 (17.2%) were concerned with anticipation and preparedness, and 49 (30%) were concerned with integration and learning.

CONCLUSIONS

There are a wide range of methods of MMS in Irish hospitals. It is suggested that there is a need to identify those methods of MMS that are particularly useful in reducing harm and supporting action and improvement and do not place a large burden on healthcare staff to either use or interpret.

What would other emergency stroke teams do? Using explainable machine learning to understand variation in thrombolysis practice

INTRODUCTION

The aim of this work was to understand between-hospital variation in thrombolysis use among emergency stroke admissions in England and Wales.

PATIENTS

A total of 88,928 patients who arrived at all 132 emergency stroke hospitals in England Wales within 4 h of stroke onset, from 2016 to 2018.

METHODS

Machine learning was applied to the Sentinel Stroke National Audit Programme (SSNAP) data set, to learn which patients in each hospital would likely receive thrombolysis. We used XGBoost machine learning models, coupled with a SHAP model for explainability; Shapley (SHAP) values, providing estimates of how patient features, and hospital identity, influence the odds of receiving thrombolysis.

RESULTS

Thrombolysis use in patients arriving within 4 h of known or estimated stroke onset ranged 7% -49% between hospitals. The odds of receiving thrombolysis reduced 9-fold over the first 120 min of arrival-to-scan time, varied 30-fold with stroke severity, reduced 3-fold with estimated rather than precise stroke onset time, fell 6-fold with increasing pre-stroke disability, fell 4-fold with onset during sleep, fell 5-fold with use of anticoagulants, fell 2-fold between 80 and 110 years of age, reduced 3-fold between 120 and 240 min of onset-to-arrival time and varied 13-fold between hospitals. The majority of between-hospital variance was explained by the hospital, rather than the differences in local patient populations.

CONCLUSIONS

Using explainable machine learning, we identified that the majority of the between-hospital variation in thrombolysis use in England and Wales may be explained by differences in in-hospital processes and differences in attitudes to judging suitability for thrombolysis.

Identifying behaviour change techniques in 287 randomized controlled trials of audit and feedback interventions targeting practice change among healthcare professionals

BACKGROUND

Audit and feedback (A&F) is among the most widely used implementation strategies, providing healthcare professionals with summaries of their practice performance to prompt behaviour change and optimize care. Wide variability in effectiveness of A&F has spurred efforts to explore why some A&F interventions are more effective than others. Unpacking the variability of the content of A&F interventions in terms of their component behaviours change techniques (BCTs) may help advance our understanding of how A&F works best. This study aimed to systematically specify BCTs in A&F interventions targeting healthcare professional practice change.

METHODS

We conducted a directed content analysis of intervention descriptions in 287 randomized trials included in an ongoing Cochrane systematic review update of A&F interventions (searched up to June 2020). Three trained researchers identified and categorized BCTs in all trial arms (treatment & control/comparator) using the 93-item BCT Taxonomy version 1. The original BCT definitions and examples in the taxonomy were adapted to include A&F-specific decision rules and examples. Two additional BCTs ('Education (unspecified)' and 'Feedback (unspecified)') were added, such that 95 BCTs were considered for coding.

RESULTS

In total, 47/95 BCTs (49%) were identified across 360 treatment arms at least once (median = 5.0, IQR = 2.3, range = 129 per arm). The most common BCTs were 'Feedback on behaviour' (present 89% of the time; e.g. feedback on drug prescribing), 'Instruction on how to perform the behaviour' (71%; e.g. issuing a clinical guideline), 'Social comparison' (52%; e.g. feedback on performance of peers), 'Credible source' (41%; e.g. endorsements from respected professional body), and 'Education (unspecified)' (31%; e.g. giving a lecture to staff). A total of 130/287 (45%) control/comparator arms contained at least one BCT (median = 2.0, IQR = 3.0, range = 0-15 per arm), of which the most common were identical to those identified in treatment arms.

CONCLUSIONS

A&F interventions to improve healthcare professional practice include a moderate range of BCTs, focusing predominantly on providing behavioural feedback, sharing guidelines, peer comparison data, education, and leveraging credible sources. We encourage the use of our A&F-specific list of BCTs to improve knowledge of what is being delivered in A&F interventions. Our study provides a basis for exploring which BCTs are associated with intervention effectiveness.

TRIAL REGISTRATIONS

N/A.

Managing unwarranted variation in hospital care - findings from a regional audit in Norway

BACKGROUND/AIM

There has been increasing focus and research over the past decades on defining, identifying, visualizing and reducing unwarranted clinical variation in clinical practice. Both clinician-driven initiatives such as the US based "Choosing Wisely" campaign and the top-down driven "Evidence-based intervention programme (EBI)" launched by NHS UK to improve quality of care by reducing unnecessary interventions have shown marginal results. We present the findings from a mixed-methods audit performed to evaluate the compliance by senior hospital leaders of a new regional strategy to reduce unwarranted variation in outcomes and utilization rates.

METHODS

Seventy-five mid- to senior-division and department leaders from eight hospital trusts in South-Eastern Norway Regional Trust (HSO) were invited to participate in evaluating the response and compliance of the regional leadership strategy for reducing unwarranted variation in patient outcomes and service utilization rates.

RESULTS

The audit revealed that the aim of reducing unwanted variation was not clearly communicated by senior HSO management. There was varying use of data from the national quality registers and health atlases for quality improvement. One third of the clinical leaders reported a lack of scrutiny of their work and were insufficiently aware of the HSO's top-management and the hospital's Boards strategic expectations about the importance of reducing unwarranted variation in their hospital utilization.

CONCLUSIONS

We found that the strategic aim of reducing unwanted clinical variation was not clearly communicated by senior HSO management to hospital boards and senior management. The hospitals could benefit from a better understanding of causes of variation by strengthening their efforts to reduce unwarranted variation in utilization rates as a key element in improving health care quality and patient safety. The findings of the audit are relevant for other healthcare organizations trying to improve their quality and reduce unnecessary variation.

Evaluation of an implementation support package to increase community mental health clinicians' routine delivery of preventive care for multiple health behaviours: a non-randomised controlled trial

BACKGROUND

People with a mental health condition are more likely to engage in risk behaviours compared to people without. Delivery of preventive care to improve such behaviours is recommended for community mental health services, but inadequately implemented. This study assessed the effectiveness of an implementation support package on clinicians' delivery of preventive care (assessment, advice, referral) for four risk behaviours (tobacco smoking, harmful alcohol consumption, physical inactivity, inadequate fruit and vegetable intake) compared to no implementation support. The participatory approach to developing the support package, and fidelity of the implementation strategies, are also described.

METHODS

A non-randomised controlled trial was undertaken in 2019-2020 with two community mental health services (control and target) in one health district in New South Wales, Australia. A 4-month support package consisting of multiple implementation strategies was delivered to one site following a two-phase participatory design process. Five implementation strategies were proposed to service managers by researchers. After consultation with managers and clinicians, the final implementation support package included four strategies: training and education materials, enabling resources and prompts, client activation material, and audit and feedback. Client-reported receipt of the three elements of preventive care for the four risk behaviours was collected from a cross-sectional sample of clients who had recently attended the service at baseline (6 months) and follow-up (5 months). Logistic regression models examined change in receipt of preventive care to assess effectiveness.

RESULTS

A total of 860 client surveys were completed (control baseline n = 168; target baseline n = 261; control follow-up n = 164; and target follow-up n = 267). Analyses revealed no significant differential changes in preventive care receipt between the target and control sites from baseline to follow-up, including across the four primary outcomes: assessed for all behaviours (OR = 1.19; 95% CI 0.55, 2.57; p = 0.65); advised for all relevant risk behaviours (OR = 1.18; 95% CI 0.39, 3.61; p = 0.77); referred for any relevant risk behaviour (OR = 0.80; 95% CI 0.40, 1.63; p = 0.55); and complete care (OR = 3.11; 95% CI 0.62, 15.63; p = 0.17). Fidelity of the implementation strategies was limited as one of the four strategies (audit and feedback) was not delivered, components of two strategies (enabling resources and prompts, and client activation material) were not delivered as intended, and one strategy (education and training) was delivered as intended although some components were offered late in the implementation period.

CONCLUSIONS

The implementation support package was ineffective at increasing preventive care delivery. Further investigation is required to determine optimal participatory design methods to develop effective implementation strategies, including those that support delivery of care in community mental health settings within the ongoing context of uncertain environmental challenges.

TRIAL REGISTRATION

Australian and New Zealand Clinical Trials Registry ACTRN12619001379101.

IMP2ART: development of a multi-level programme theory integrating the COM-B model and the iPARIHS framework, to enhance implementation of supported self-management of asthma in primary care

BACKGROUND

Supported asthma self-management, incorporating an asthma action plan and annual clinical review, has been recommended by UK/global guidelines for over three decades. However, implementation remains poor, as only around a third of individuals receive basic asthma care, according to the UKs leading respiratory charity Asthma and Lung UK. A systematic review of implementation studies recommended that a whole systems approach targeting patients, healthcare professional education, and organisations is needed to improve implementation of supported asthma self-management in primary care. The IMPlementing IMProved Asthma self-management as RouTine (IMP2ART) is a national Hybrid-II implementation cluster randomised controlled trial that aims to evaluate such an approach. This paper describes the development of the implementation strategy for IMP2ART with particular focus on the integration of multiple level theories.

METHODS

The Medical Research Council design and evaluation of complex interventions framework and the Person-Based Approach to intervention development were used as guidance for stages of strategy development. Specifically, we (i) set up a multidisciplinary team (including practicing and academic clinicians, health psychologists, public health and patient colleagues), (ii) reviewed and integrated evidence and theory, (iii) developed guiding principles, (iv) developed prototype materials, and (v) conducted a pre-pilot study before final refinement.

RESULTS

The implementation strategy included resources for patients, team-based and individual healthcare professional education, practice audit and feedback, and an asthma review template, as well as a facilitator role accessible to primary care practices for 12 months. The synthesis of the integrated Promoting Action on Research Implementation in Health Services (iPARIHS) and Capability, Opportunity, Motivation and Behaviour (COM-B) frameworks led to an evolved framework bringing together important implementation and behaviour change elements which will be used as a basis for the study process evaluation.

CONCLUSIONS

A description of rigorous implementation strategy development for the IMP2ART study is provided along with newly theorised integration of implementation and behaviour change science which may be of benefit to others targeting implementation in primary care.

TRIAL REGISTRATION

ISRCTN15448074. Registered on 2nd December 2019.

Developing an Audit and Feedback Dashboard for Family Physicians: User-Centered Design Process

BACKGROUND

Audit and feedback (A&F), the summary and provision of clinical performance data, is a common quality improvement strategy. Successful design and implementation of A&F-or any quality improvement strategy-should incorporate evidence-informed best practices as well as context-specific end user input.

OBJECTIVE

We used A&F theory and user-centered design to inform the development of a web-based primary care A&F dashboard. We describe the design process and how it influenced the design of the dashboard.

METHODS

Our design process included 3 phases: prototype development based on A&F theory and input from clinical improvement leaders; workshop with family physician quality improvement leaders to develop personas (ie, fictional users that represent an archetype character representative of our key users) and application of those personas to design decisions; and user-centered interviews with family physicians to learn about the physician's reactions to the revised dashboard.

RESULTS

The team applied A&F best practices to the dashboard prototype. Personas were used to identify target groups with challenges and behaviors as a tool for informed design decision-making. Our workshop produced 3 user personas, Dr Skeptic, Frazzled Physician, and Eager Implementer, representing common users based on the team's experience of A&F. Interviews were conducted to further validate findings from the persona workshop and found that (1) physicians were interested in how they compare with peers; however, if performance was above average, they were not motivated to improve even if gaps compared to other standards in their care remained; (2) burnout levels were high as physicians are trying to catch up on missed care during the pandemic and are therefore less motivated to act on the data; and (3) additional desired features included integration within the electronic medical record, and more up-to-date and accurate data.

CONCLUSIONS

We found that carefully incorporating data from user interviews helped operationalize generic best practices for A&F to achieve an acceptable dashboard that could meet the needs and goals of physicians. We demonstrate such a design process in this paper. A&F dashboards should address physicians' data skepticism, present data in a way that spurs action, and support physicians to have the time and capacity to engage in quality improvement work; the steps we followed may help those responsible for quality improvement strategy implementation achieve these aims.

Adapting and implementing breast cancer follow-up in primary care: protocol for a mixed methods hybrid type 1 effectiveness-implementation cluster randomized study

BACKGROUND

Advances in detection and treatment for breast cancer have led to an increase in the number of individuals managing significant late and long-term treatment effects. Primary care has a role in caring for patients with a history of cancer, yet there is little guidance on how to effectively implement survivorship care evidence into primary care delivery.

METHODS

This protocol describes a multi-phase, mixed methods, stakeholder-driven research process that prioritizes actionable, evidence-based primary care improvements to enhance breast cancer survivorship care by integrating implementation and primary care transformation frameworks: the Exploration, Preparation, Implementation, and Sustainment (EPIS) framework and the Practice Change Model (PCM). Informed by depth interviews and a four round Delphi panel with diverse stakeholders from primary care and oncology, we will implement and evaluate an iterative clinical intervention in a hybrid type 1 effectiveness-implementation cluster randomized design in twenty-six primary care practices. Multi-component implementation strategies will include facilitation, audit and feedback, and learning collaboratives. Ongoing data collection and analysis will be performed to optimize adoption of the intervention. The primary clinical outcome to test effectiveness is comprehensive breast cancer follow-up care. Implementation will be assessed using mixed methods to explore how organizational and contextual variables affect adoption, implementation, and early sustainability for provision of follow-up care, symptom, and risk management activities at six- and 12-months post implementation.

DISCUSSION

Study findings are poised to inform development of scalable, high impact intervention processes to enhance long-term follow-up care for patients with a history of breast cancer in primary care. If successful, next steps would include working with a national primary care practice-based research network to implement a national dissemination study. Actionable activities and processes identified could also be applied to development of organizational and care delivery interventions for follow-up care for other cancer sites.

TRIAL REGISTRATION

Registered with ClinicalTrials.gov on June 2, 2022: NCT05400941.

A Peer Data Benchmarking Intervention to Reduce Opioid Overprescribing: A Randomized Controlled Trial

BACKGROUND

Driving physician behavior change has been an elusive goal for quality improvement efforts aimed at reducing low-value care. We proposed the use of "nudge" interventions at the surgeon level in order to reduce post-surgical opioid overprescribing in accordance with consensus guidelines.

METHODS

We used 2017 Medicare data to identify outlier surgeons. A peer data benchmarking report that showed each surgeon the average number of opioid tablets they prescribed for an open inguinal hernia repair procedure from January 1, 2017 to December 31, 2017. We conducted a 1:1 randomized controlled trial providing outlier surgeons a report of their opioid prescribing patterns for a standard operation compared to the national average and prescribing guidelines.

RESULTS

There were 489 surgeons randomized to the intervention, of which 180 (36.8%) had data in the post-intervention period. Data was available for 87 surgeons in the intervention group and 93 surgeons in the control group. 97.7% of surgeons in the intervention group reduced their opioid prescribing pattern compared to 95.7% in the control group. Surgeons who received the data benchmarking report intervention prescribed 14.3% less opioids than surgeons in the control group (10.54 (SD 5.34) vs. 12.30 (SD 6.02), P = .04). The intervention was associated with a 1.83 lower mean number of opioid tablets prescribed per patient in the multivariable linear regression model after controlling for other factors (Intervention group vs. control group 95% CI [-3.61, -.04], P = .04).

DISCUSSION

The implementation of a peer data benchmarking intervention can drive physician behavior change towards high-value care.

Effect of a Performance Feedback Dashboard on Hospitalist Laboratory Test Utilization

BACKGROUND

Healthcare spending continues to be an area of improvement across all forms of medicine. Overtreatment or low-value care, including overutilization of laboratory testing, has an estimated annual cost of waste of $75.7-$101.2 billion annually. Providing performance feedback to hospitalists has been shown to be an effective way to encourage the practice of quality-improvement-focused medicine. There remains limited data regarding the implementation of performance feedback and direct results on hospital laboratory testing spending in the short term.

OBJECTIVE

The objective of this project was to identify whether performance-based feedback on laboratory utilization between both hospitalists and resident teams results in more conservative utilization of laboratory testing.

DESIGN, SETTING, PARTICIPANTS

This quality improvement project was conducted at a tertiary academic medical center, including both direct-care and house-staff teams.

INTERVENTION OR EXPOSURE

A weekly performance feedback report was generated and distributed to providers detailing laboratory test utilization by all hospitalists in a ranked system, normalized by the census of patients, for 3 months.

MAIN OUTCOMES AND MEASURES

The outcome measure was cumulative laboratory utilization during the intervention period compared to baseline utilization during the corresponding 3 months in the year prior and the weekly trend in laboratory utilization over 52 weeks. The aggregate laboratory utilization rate during intervention and control time periods was defined as the total number of laboratory tests ordered divided by the total number of patient encounters. Additionally, the cost difference was averaged per quarter and reported. The week-by-week trend in laboratory utilization was evaluated using a statistical process control (SPC) chart.

RESULTS

We found that following intervention during January-March 2020, the cumulative complete blood count utilization rate decreased from 5.54 to 4.83 per patient encounter and the basic metabolic panels/CMP utilization rate decreased from 6.65 to 6.11 per patient encounter compared with January-March 2019. This equated to cost savings of ~$42,700 in total for the quarter. Nonrandom variation was seen on SPC charts in weekly laboratory utilization rates for common laboratory tests during the intervention period.

CONCLUSIONS

We found that our intervention did result in a decrease in laboratory test utilization rates across direct-care and house-staff teams. This study lays promising groundwork for one tool that can be used to eliminate a source of hospital waste and improve the quality and efficiency of patient care.

Enhancing the appropriateness of eyecare delivery: the iCaretrack approach

Optometrists play an integral role in primary eyecare services, including prevention, diagnosis, and management of acute and chronic eye conditions. Therefore, it remains essential that the care they provide be timely and appropriate to ensure the best patient outcomes and optimal utilisation of resources. However, optometrists continuously face many challenges that can affect their ability to provide appropriate care (i.e., the care in line with evidence-based clinical practice guidelines). To address any resulting evidence-to-practice gaps, programs are needed that support and enable optometrists to adopt and utilise the best evidence in clinical practice. Implementation science is a field of research that can be applied to improving the adoption and maintenance of evidence-based practices in routine care, through systematic development and application of strategies or interventions to address barriers to evidence-based practice. This paper demonstrates an approach using implementation science to enhance optometric eyecare delivery. A brief overview of the methods used to identify existing gaps in appropriate eyecare delivery is presented. An outline of the process used to understand the behavioural barriers responsible for such gaps follows, involving theoretical models and frameworks. The resulting development of an online program for optometrists to enhance their capability, motivation, and opportunity to provide evidence-based eyecare is described, using the Behaviour Change Model and co-design methods. The importance of and methods used in evaluating such programs are also discussed. Finally, reflections on the experience and key learnings from the project are shared. While the paper focuses on experiences in improving glaucoma and diabetic eyecare in the Australian optometry context, this approach can be adapted to other conditions and contexts.

Adapting a quality improvement collaborative to a new national context: a co-design and feasibility study to improve dementia care in Ireland

BACKGROUND

Adaptation seeks to increase intervention fit with context, an important influence upon implementation. People with dementia in acute hospitals in Ireland do not routinely receive best care. To improve care in Ireland, we sought to adapt an existing quality improvement collaborative, to support the improvement capabilities of recipients of feedback from the Irish National Audit of Dementia.

METHODS

The study followed a staged process to co-design adaptations to reflect contextual differences between the English and the Irish healthcare systems, and to explore feasibility of the adapted Quality Improvement Collaborative in Ireland. We used co-design group meetings involving dementia clinicians from three hospitals, delivered the intervention virtually and interviewed healthcare workers from seven hospitals to adapt and explore the fidelity, affective response and reported appropriateness of the intervention.

RESULTS

The intervention required adaptation to reflect differences in strategic intention, ways of working and hospital social structures. There was evidence that the adapted intervention generated a positive affective response, was perceived as appropriate and led to fidelity of receipt and response.

CONCLUSION

We describe implications for the adaptation of interventions to increase participants' quality improvement capabilities and highlight the importance of socio-adaptive work. We propose further work to explore antecedents of senior positional leader engagement, to describe the delivery of intra-participant behaviour change techniques and to adapt the intervention to other clinical domains.

Types and effects of feedback for emergency ambulance staff: a systematic mixed studies review and meta-analysis

BACKGROUND

Extensive research has been conducted into the effects of feedback interventions within many areas of healthcare, but prehospital emergency care has been relatively neglected. Exploratory work suggests that enhancing feedback and follow-up to emergency medical service (EMS) staff might provide staff with closure and improve clinical performance. Our aim was to summarise the literature on the types of feedback received by EMS professionals and its effects on the quality and safety of patient care, staff well-being and professional development.

METHODS

A systematic review and meta-analysis, including primary research studies of any method published in peer-reviewed journals. Studies were included if they contained information on systematic feedback to emergency ambulance staff regarding their performance. Databases searched from inception were MEDLINE, Embase, AMED, PsycINFO, HMIC, CINAHL and Web of Science, with searches last updated on 2 August 2022. Study quality was appraised using the Mixed Methods Appraisal Tool. Data analysis followed a convergent integrated design involving simultaneous narrative synthesis and random effects multilevel meta-analyses.

RESULTS

The search strategy yielded 3183 articles, with 48 studies meeting inclusion criteria after title/abstract screening and full-text review. Interventions were categorised as audit and feedback (n=31), peer-to-peer feedback (n=3), postevent debriefing (n=2), incident-prompted feedback (n=1), patient outcome feedback (n=1) or a combination thereof (n=4). Feedback was found to have a moderate positive effect on quality of care and professional development with a pooled effect of d=0.50 (95% CI 0.34, 0.67). Feedback to EMS professionals had large effects in improving documentation (d=0.73 (0.00, 1.45)) and protocol adherence (d=0.68 (0.12, 1.24)), as well as small effects in enhancing cardiac arrest performance (d=0.46 (0.06, 0.86)), clinical decision-making (d=0.47 (0.23, 0.72)), ambulance times (d=0.43 (0.12, 0.74)) and survival rates (d=0.22 (0.11, 0.33)). The between-study heterogeneity variance was estimated at σ2=0.32 (95% CI 0.22, 0.50), with an I2 value of 99% (95% CI 98%, 99%), indicating substantial statistical heterogeneity.

CONCLUSION

This review demonstrated that the evidence base currently does not support a clear single point estimate of the pooled effect of feedback to EMS staff as a single intervention type due to study heterogeneity. Further research is needed to provide guidance and frameworks supporting better design and evaluation of feedback interventions within EMS.

PROSPERO REGISTRATION NUMBER

CRD42020162600.

Addressing the end-of-life actions in the National Safety and Quality Health Service Standards (2nd edn): a national survey

Objectives To describe current and planned processes and outcome measures to address implementation of the six end-of-life actions in the National Safety and Quality Health Service (NSQHS) Standards (2nd edn) and explore associated barriers and enablers. Methods This study used an exploratory mixed methods national survey of acute healthcare facilities between September 2018 and March 2019. This study involved public and private facilities (N  = 765) that provided end-of-life care, which are required to be accredited to the NSQHS Standards. Participants include those responsible for reporting implementation of end-of-life care actions at a facility providing end-of-life care. Participants were asked what processes and outcome measures were implemented or being planned to address the end-of-life care actions, and the associated barriers and enablers. Results Fifty respondents (6.5% response rate) from across Australia contributed data, reporting greater confidence in addressing Actions 5.16: Clinicians have access to Specialist Palliative Care Services; 5.17: Advance care plans can be received from patients and stored in medical records; and 5.18: Supervision and support is available for workforce providing end-of-life care. Barriers associated with the actions that were the most challenging to address included: competing clinical priorities, and insufficient resources to provide best practice end-of-life care; and the burdensome nature of conducting audits. Enablers included: (1) local, jurisdictional, and national strategic plans and policies; (2) support from Specialist Palliative Care Services; (3) access to resources and data; (4) standardised approaches to implementation and measuring outcomes; and (5) clinician, consumer and community engagement and education on end-of-life care. Conclusion Enablers and barriers in implementing the six end-of-life care actions were identified. Respondents reported that high-level support and direction, system-wide approaches, practical clinical support, and widespread community and clinician engagement would enable their facility to better address the end-of-life actions.

A Self-Sustaining Antibiotic Prophylaxis Program to Reduce Surgical Site Infections

Background: Our multi-institutional healthcare system had a higher-than-expected surgical site infection (SSI) rate. We aimed to improve our peri-operative antibiotic administration process. Gap analysis identified three opportunities for process improvement: standardized antibiotic selection, standardized second-line antibiotic agents for patients with allergies, and feedback regarding antibiotic administration compliance. Hypothesis: Implementation of a multifaceted quality improvement initiative including a near-real-time pre-operative antibiotic compliance feedback tool will improve compliance with antibiotic administration protocols, subsequently lowering SSI rate. Methods: A compliance feedback tool designed to provide monthly reports to all anesthesia and surgical personnel was implemented at two facilities, in September 2017 and December 2018. Internal case data were tracked for antibiotic compliance through June 2021, and these data were merged with American College of Surgeons National Surgical Quality Improvement Program (ACS-NSQIP) data at the case level to provide process and outcome measures for SSIs. Implementation success was evaluated by comparing protocol compliance and risk-adjusted rates of superficial and deep SSI before and after the quality improvement implementation. Results: A total of 20,385 patients were included in this study; 11,548 patients in the pre-implementation and 8,837 in the post-implementation groups. Baseline patient and operative characteristics were similar between groups, except the post-implementation group had a higher median expected SSI rate (2.2% vs. 1.6%). Post-implementation, antibiotic protocol compliance increased from 86.3% to 97.6%, and superficial and deep SSIs decreased from 2.8% to 1.9% (p < 0.001). The odds of superficial and deep SSI in patients in the post-implementation group was 0.69 (0.57, 0.83) times the odds of superficial and deep SSI in pre-implementation patients while adjusting for age, gender, diabetes mellitus, American Society of Anesthesiologists Physical Status (ASA) classification, wound class, smoking, and chronic obstructive pulmonary disease (COPD). Observed-to-expected ratios of superficial and deep SSI decreased from 0.82 to 0.48 after the intervention. Conclusions: Surgical antibiotic prophylaxis standardization and providing near-real-time individualized feedback resulted in sustained improvement in peri-operative antibiotic compliance rates and reduced superficial and deep SSIs.

Feasibility and Acceptability of an Online Oncologist Training to Optimize Oncologist-Patient Communication and Value-Concordant Care in Advanced Cancer

Introduction: This pilot study tested the feasibility and acceptability of a low-resource-intensive scalable online communication training designed to improve oncologists' skills in prognostic and value-concordant care discussions with advanced cancer patients. Methods: The training consisted of on-demand videos on how to convey prognostic information, manage patient emotions, and elicit patient values and incorporate these values into treatment decision making. Post-intervention, oncologists reported on their perceptions of the training. Results: Fifteen oncologists were enrolled, of whom, 13 completed the training, and 14 completed post-intervention interviews. Most oncologists reported the intervention was acceptable: 92.9% indicated the intervention was "moderately" to "very helpful"; 78.6% rated it as "somewhat" to "very much" impactful on their communication with patients. Conclusions: The present self-paced online communication training was acceptable to oncologists, supporting additional research, including evaluating intervention efficacy for improving oncologists' communication skills and value-concordant care in advanced cancer.

Impact of nonphysician, technology-guided alert level selection on rates of appropriate trauma triage in the United States: a before and after study

Purpose

Overtriage and undertriage rates are critical metrics in trauma, influenced by both trauma team activation (TTA) criteria and compliance with these criteria. Analysis of undertriaged patients at a level I trauma center revealed suboptimal compliance with existing criteria. This study assessed triage patterns after implementing compliance-focused process interventions.

Methods

A physician-driven, free-text alert system was modified to a nonphysician, hospital dispatcher-guided system. The latter employed dropdown menus to maximize compliance with criteria. The preintervention period included patients who presented between May 12, 2020, and December 31, 2020. The postintervention period incorporated patients who presented from May 12, 2021, through December 31, 2021. We evaluated appropriate triage, overtriage, and undertriage using the Standardized Trauma Assessment Tool. Statistical analyses were conducted with an α level of 0.05.

Results

The new system was associated with improved compliance with existing TTA criteria (from 70.3% to 79.3%, P=0.023) and decreased undertriage (from 6.0% to 3.2%, P=0.002) at the expense of increasing overtriage (from 46.6% to 57.4%, P<0.001), ultimately decreasing the appropriate triage rate (from 78.4% to 74.6%, P=0.007).

Conclusions

This study assessed a workflow change designed to improve compliance with TTA criteria. Improved compliance decreased undertriage to below the target threshold of 5%, albeit at the expense of increased overtriage. The decrease in appropriate triage despite compliance improvements suggests that the current criteria at this institution are not adequately tailored to optimally balance the minimization of undertriage and overtriage. This finding underscores the importance of improved compliance in evaluating the efficacy of TTA criteria.