Comparison of Antibiotic Dosing Before and After Implementation of an Electronic Order Set

Effects of a Pharmacist-Designed Clinical Decision Support System on Antimicrobial Stewardship

BACKGROUND

 Clinical decision support systems (CDSSs) are computer applications, which can be applied to give guidance to practitioners in antimicrobial stewardship (AS) activities; however, further information is needed for their optimal use.

OBJECTIVES

 Our objective was to analyze the implementation of a CDSS program in a second-level hospital, describing alerts, recommendations, and the effects on consumption and clinical outcomes.

METHODS

 In October 2020, a pharmacist-driven CDSS designed for AS was implemented in a second-level hospital. The program provides a list of alerts related to antimicrobial treatment and microbiology, which were automatized for revision by the AS professionals. To analyze the implementation of the CDSS, a pre-post-intervention, retrospective study was designed. AS-triggered alerts and recommendations (total number and rate of acceptance) were compiled. The effect of the CDSS was measured using antimicrobial consumption, duration of antimicrobial treatments, in-hospital mortality, and length of stay (LOS) for patients admitted for infectious causes.

RESULTS

 The AS team revised a total of 7,543 alerts and 772 patients had at least one recommendation, with an acceptance rate of 79.3%. Antimicrobial consumption decreased from 691.1 to 656.8 defined daily doses (DDD)/1,000 beds-month (p = 0.04) and the duration of antimicrobial treatment from 3.6 to 3.3 days (p < 0.01). In-hospital mortality decreased from 6.6 to 6.2% (p = 0.46) and mean LOS from 7.2 to 6.2 days (p < 0.01).

CONCLUSION

 The implementation of a CDSS resulted in a significant reduction of antimicrobial DDD, duration of antimicrobial treatments, and hospital LOS. There was no significant difference in mortality.

A five-year quasi-experimental study to evaluate the impact of empiric antibiotic order sets on antibiotic use metrics among hospitalized adult patients

OBJECTIVE

Evaluation of adult antibiotic order sets (AOSs) on antibiotic stewardship metrics has been limited. The primary outcome was to evaluate the standardized antimicrobial administration ratio (SAAR). Secondary outcomes included antibiotic days of therapy (DOT) per 1,000 patient days (PD); selected antibiotic use; AOS utilization; Clostridioides difficile infection (CDI) cases; and clinicians' perceptions of the AOS via a survey following the final study phase.

DESIGN

This 5-year, single-center, quasi-experimental study comprised 5 phases from 2017 to 2022 over 10-month periods between August 1 and May 31.

SETTING

The study was conducted in a 752-bed tertiary care, academic medical center.

INTERVENTION

Our institution implemented AOSs in the electronic medical record (EMR) for common infections among hospitalized adults.

RESULTS

For the primary outcome, a statistically significant decreases in SAAR were detected from phase 1 to phase 5 (1.0 vs 0.90; P < .001). A statistically significant decreases were detected in DOT per 1,000 PD (4,884 vs 3,939; P = .001), fluoroquinolone orders (407 vs 175; P < .001), carbapenem orders (147 vs 106; P = .024), and clindamycin orders (113 vs 73; P = .01). No statistically significant change in mean vancomycin orders was detected (991 vs 902; P = .221). A statistically significant decrease in CDI cases was also detected (7.8, vs 2.4; P = .002) but may have been attributable to changes in CDI case diagnosis. Clinicians indicated that the AOSs were easy to use overall and that they helped them select the appropriate antibiotics.

CONCLUSIONS

Implementing AOS into the EMR was associated with a statistically significant reduction in SAAR, antibiotic DOT per 1,000 PD, selected antibiotic orders, and CDI cases.

Digital Antimicrobial Stewardship Decision Support to Improve Antimicrobial Management

OBJECTIVES

We sought to create a digital application to support clinicians in empiric and pathogen-directed antibiotic ordering based on local susceptibility patterns and evidence-based treatment durations, thereby promoting antimicrobial stewardship.

METHODS

We formed a multidisciplinary team that met bimonthly from 2017 to 2018 to design and construct a web-based antimicrobial stewardship platform called Antibiogram + . We used an iterative and agile technical development process with frequent feedback from clinicians.

RESULTS

Antibiogram+ is an online tool, accessible via the electronic health record and hospital intranet, which offers institutional antibiotic susceptibilities for major pathogens, recommendations for empiric antibiotic selection and treatment durations for common pediatric conditions, antimicrobial dosing and monitoring guidance, and links to other internal clinical decision support resources. The tool was accessed 11,823 times with 492 average monthly views during the first 2 years after release. Compared with use of a preexisting print antibiogram and dosing card, pediatric residents more frequently reported "often" being sure of antibiotic dosing with Antibiogram+ (58 vs. 15%, p < 0.01). Respondents also reported improved confidence in choice of antibiotic, but this finding did not reach statistical significance (55 vs. 35%, p = 0.26).

CONCLUSION

We report the successful development of a digital antimicrobial stewardship platform with consistent rates of access during the first 2 years following release and improved provider comfort with antibiotic management.

Antimicrobial stewardship using electronic prescribing systems in hospital settings: a scoping review of interventions and outcome measures

Objectives

To identify interventions implemented in hospital electronic prescribing systems and the outcome measures used to monitor their impact.

Methods

We systematically searched CINAHL, EMBASE, Google Scholar and Medline using keywords in three strands: (i) population: hospital inpatient or emergency department; (ii) intervention: electronic prescribing functionality; and (iii) outcome: antimicrobial stewardship. The interventions were grouped into six themes: alerts, order sets, restriction of access, mandated documentation, embedded guidelines and automatic prescription stop. The outcome measures were organized into those that measure the quality or quantity of prescribing or clinical decision support (CDS) activity. The impact of each intervention reported was grouped into a positive, negative or no change.

Results

A total of 28 studies were eligible for inclusion. There were 28 different interventions grouped into the six themes. Alerts visible to the practitioner in the electronic health record (EHR) were most frequently implemented (n = 11/28). Twenty different outcome measures were identified, divided into quality (n = 13/20) and quantity outcomes (n = 4/20) and CDS activity (n = 3/20). One-third of outcomes reported across the 28 studies showed positive change (34.4%, n = 42/122) and 61.4% (n = 75/122) showed no change.

Conclusions

The most frequently implemented interventions were alerts, the majority of which were to influence behaviour or decision-making of the practitioner within the EHR. Quality outcomes were most frequently selected by researchers. The review supports previous research that larger well-designed randomized studies are needed to investigate the impact of interventions on AMS and outcome measures to be standardized.

User-Centered Design in Pediatric Acute Care Settings Antimicrobial Stewardship

BACKGROUND

Antibiotic prescribing in ambulatory care centers is increasing. Previous research suggests that 20 to 50% of antibiotic prescriptions are either unnecessary or inappropriate. Unnecessary antibiotic consumption can harm patients by increasing antibiotic resistance and drug-associated toxicities, and the reasons for such use are multifactorial. Antimicrobial Stewardship Programs (ASP) were developed to guide better use of antibiotics. A core element of ASP is to provide feedback to clinical providers. To create clinically meaningful feedback, user-center design (UCD) is a robust approach to include end-users in the design process to improve systems.

OBJECTIVE

The study aimed to take a UCD approach to developing antibiotic prescribing feedback through input from clinicians in two ambulatory care settings.

METHODS

We conducted two group prototyping sessions with pediatric clinicians who practice in the emergency department and urgent care settings at a tertiary care children's hospital. Participants received background on the problem of antibiotic prescribing and then were interviewed about their information needs, perceived value, and desired incentives for a prescribing feedback system. Sessions concluded with their response and recommendations to sample sections of an antibiotic feedback report including orienting material, report detail, targeted education, and resources.

RESULTS

A UCD approach was found to be highly valuable in the development of a feedback mechanism that is viewed as desirable by clinicians. Clinicians preferred interpreting the data themselves with aids such as diagrams and charts over the researcher concluded statements about the clinician's behavior. Specific feedback that clinicians considered redundant were removed from the model if preexisting alerts were established.

CONCLUSION

Integrating a UCD approach in developing ASP feedback identified desirable report characteristics that substantially modified preliminary wireframes for feedback. Future research will evaluate the clinical effectiveness of our feedback reports in outpatient settings.

OrderRex clinical user testing: a randomized trial of recommender system decision support on simulated cases

OBJECTIVE

To assess usability and usefulness of a machine learning-based order recommender system applied to simulated clinical cases.

MATERIALS AND METHODS

43 physicians entered orders for 5 simulated clinical cases using a clinical order entry interface with or without access to a previously developed automated order recommender system. Cases were randomly allocated to the recommender system in a 3:2 ratio. A panel of clinicians scored whether the orders placed were clinically appropriate. Our primary outcome included the difference in clinical appropriateness scores. Secondary outcomes included total number of orders, case time, and survey responses.

RESULTS

Clinical appropriateness scores per order were comparable for cases randomized to the order recommender system (mean difference -0.11 order per score, 95% CI: [-0.41, 0.20]). Physicians using the recommender placed more orders (median 16 vs 15 orders, incidence rate ratio 1.09, 95%CI: [1.01-1.17]). Case times were comparable with the recommender system. Order suggestions generated from the recommender system were more likely to match physician needs than standard manual search options. Physicians used recommender suggestions in 98% of available cases. Approximately 95% of participants agreed the system would be useful for their workflows.

DISCUSSION

User testing with a simulated electronic medical record interface can assess the value of machine learning and clinical decision support tools for clinician usability and acceptance before live deployments.

CONCLUSIONS

Clinicians can use and accept machine learned clinical order recommendations integrated into an electronic order entry interface in a simulated setting. The clinical appropriateness of orders entered was comparable even when supported by automated recommendations.

Physician Usage and Acceptance of a Machine Learning Recommender System for Simulated Clinical Order Entry

Clinical decision support tools that automatically disseminate patterns of clinical orders have the potential to improve patient care by reducing errors of omission and streamlining physician workflows. However, it is unknown if physicians will accept such tools or how their behavior will be affected. In this randomized controlled study, we exposed 34 licensed physicians to a clinical order entry interface and five simulated emergency cases, with randomized availability of a previously developed clinical order recommender system. With the recommender available, physicians spent similar time per case (6.7 minutes), but placed more total orders (17.1 vs. 15.8). The recommender demonstrated superior recall (59% vs 41%) and precision (25% vs 17%) compared to manual search results, and was positively received by physicians recognizing workflow benefits. Further studies must assess the potential clinical impact towards a future where electronic health records automatically anticipate clinical needs.

Sustained Improvement in Inflammatory Bowel Disease Quality Measures Using an Electronic Health Record Intervention

BACKGROUND

Inflammatory bowel disease (IBD) is a chronic condition with wide variation in treatment and resource utilization because of many different disease presentations and treatment options. In an effort to standardize care and improve health outcomes, several organizations have created performance measures to monitor various aspects of IBD care.

OBJECTIVES

We aimed to assess longitudinal documentation adherence with physician quality reporting system's (PQRS) IBD performance measures before, immediately after, and 1 year following the implementation of a comprehensive electronic health record (EHR) IBD clinical documentation support tool intervention.

METHODS

We reviewed 50 patient charts that were randomly selected from consecutive outpatient IBD visits at our tertiary care center from September 1, 2015 to June 30, 2016, prior to implementation of an IBD-specific note template, order set, and patient education handout on September 1, 2016. Two additional cohorts of 50 patient charts were randomly selected from September 1, 2016 to June 30, 2017 and September 1, 2017 to June 30, 2018. These charts were reviewed to assess adherence of pertinent PQRS performance measures for outpatient IBD care. The project was deemed not human subjects research and received exempt approval by the Institutional Review Board (IRB#: IRB00040399).

RESULTS

The cohort immediately after the intervention showed significant increases in documentation rates of influenza immunization (19-59%, p < 0.001), pneumococcal immunizations (2-38%, p < 0.001), tobacco cessation (28.6-77.8%, p = 0.049), and proportion of all eligible measures (40.6-62.2%, p < 0.001) when compared with the preintervention group. Moreover, documentation rates were sustained in the 1-year follow-up group when compared with the postintervention group.

CONCLUSION

A multifaceted, EHR focused approach can significantly and sustainably improve documentation of outpatient IBD quality measures.