Considerations for Designing EHR-Embedded Clinical Decision Support Systems for Antimicrobial Stewardship in Pediatric Emergency Departments

Effects of a Pharmacist-Designed Clinical Decision Support System on Antimicrobial Stewardship

BACKGROUND

 Clinical decision support systems (CDSSs) are computer applications, which can be applied to give guidance to practitioners in antimicrobial stewardship (AS) activities; however, further information is needed for their optimal use.

OBJECTIVES

 Our objective was to analyze the implementation of a CDSS program in a second-level hospital, describing alerts, recommendations, and the effects on consumption and clinical outcomes.

METHODS

 In October 2020, a pharmacist-driven CDSS designed for AS was implemented in a second-level hospital. The program provides a list of alerts related to antimicrobial treatment and microbiology, which were automatized for revision by the AS professionals. To analyze the implementation of the CDSS, a pre-post-intervention, retrospective study was designed. AS-triggered alerts and recommendations (total number and rate of acceptance) were compiled. The effect of the CDSS was measured using antimicrobial consumption, duration of antimicrobial treatments, in-hospital mortality, and length of stay (LOS) for patients admitted for infectious causes.

RESULTS

 The AS team revised a total of 7,543 alerts and 772 patients had at least one recommendation, with an acceptance rate of 79.3%. Antimicrobial consumption decreased from 691.1 to 656.8 defined daily doses (DDD)/1,000 beds-month (p = 0.04) and the duration of antimicrobial treatment from 3.6 to 3.3 days (p < 0.01). In-hospital mortality decreased from 6.6 to 6.2% (p = 0.46) and mean LOS from 7.2 to 6.2 days (p < 0.01).

CONCLUSION

 The implementation of a CDSS resulted in a significant reduction of antimicrobial DDD, duration of antimicrobial treatments, and hospital LOS. There was no significant difference in mortality.

Clinical Pathway Adherence and Missed Diagnostic Opportunities Among Children with Musculoskeletal Infections

INTRODUCTION

Clinical care pathways (CPs) integrate best evidence into the local care delivery context to promote efficiency and patient safety. However, the impact of CPs on diagnostic performance remains poorly understood. The objectives of this study were to evaluate adherence to a musculoskeletal infection (MSKI) diagnostic CP and identify recurrent failure points leading to missed diagnostic opportunities (MDOs).

METHODS

Retrospective chart review was performed from January 2018 to February 2022 for children 6 months to 18 years of age who had an unplanned admission for MSKI after being evaluated and discharged from the pediatric emergency department (PED) for related complaints within the previous 10 days. MDOs were identified using the Revised Safer Dx. Demographic and clinical characteristics of children with and without MDOs were compared using bivariate descriptive statistics. An improvement team reviewed the diagnostic trajectories of MDOs for deviations from the MSKI CP and developed a fishbone diagram to describe contributing factors to CP deviations.

RESULTS

The study identified 21 children with and 13 children without MSKI-associated MDOs. Children with MDOs were more likely to have an initial C-reactive protein value > 2 mg/dL (90.0% vs. 0%, p = 0.01) and returned to care earlier than children without MDOs (median 2.8 days vs. 6.7 days, p = 0.004). Factors contributing to MDOs included failure to obtain screening laboratory tests, misinterpretation of laboratory values, failure to obtain orthopedic consultation, and failure to obtain definitive imaging.

CONCLUSION

Several recurrent deviations from an MSKI diagnostic CP were found to be associated with MDOs. Future quality improvement efforts to improve adherence to this MSKI CP may prevent MDOs.

Antibiotic clinical decision support for pneumonia in the ED: A randomized trial

BACKGROUND

Electronic health record-based clinical decision support (CDS) is a promising antibiotic stewardship strategy. Few studies have evaluated the effectiveness of antibiotic CDS in the pediatric emergency department (ED).

OBJECTIVE

To compare the effectiveness of antibiotic CDS vs. usual care for promoting guideline-concordant antibiotic prescribing for pneumonia in the pediatric ED.

DESIGN

Pragmatic randomized clinical trial.

SETTING AND PARTICIPANTS

Encounters for children (6 months-18 years) with pneumonia presenting to two tertiary care children s hospital EDs in the United States.

INTERVENTION

CDS or usual care was randomly assigned during 4-week periods within each site. The CDS intervention provided antibiotic recommendations tailored to each encounter and in accordance with national guidelines.

MAIN OUTCOME AND MEASURES

The primary outcome was exclusive guideline-concordant antibiotic prescribing within the first 24 h of care. Safety outcomes included time to first antibiotic order, encounter length of stay, delayed intensive care, and 3- and 7-day revisits.

RESULTS

1027 encounters were included, encompassing 478 randomized to usual care and 549 to CDS. Exclusive guideline-concordant prescribing did not differ at 24 h (CDS, 51.7% vs. usual care, 53.3%; odds ratio [OR] 0.94 [95% confidence interval [CI]: 0.73, 1.20]). In pre-specified stratified analyses, CDS was associated with guideline-concordant prescribing among encounters discharged from the ED (74.9% vs. 66.0%; OR 1.53 [95% CI: 1.01, 2.33]), but not among hospitalized encounters. Mean time to first antibiotic was shorter in the CDS group (3.0 vs 3.4 h; p = .024). There were no differences in safety outcomes.

CONCLUSIONS

Effectiveness of ED-based antibiotic CDS was greatest among those discharged from the ED. Longitudinal interventions designed to target both ED and inpatient clinicians and to address common implementation challenges may enhance the effectiveness of CDS as a stewardship tool.

Digital Antimicrobial Stewardship Decision Support to Improve Antimicrobial Management

OBJECTIVES

We sought to create a digital application to support clinicians in empiric and pathogen-directed antibiotic ordering based on local susceptibility patterns and evidence-based treatment durations, thereby promoting antimicrobial stewardship.

METHODS

We formed a multidisciplinary team that met bimonthly from 2017 to 2018 to design and construct a web-based antimicrobial stewardship platform called Antibiogram + . We used an iterative and agile technical development process with frequent feedback from clinicians.

RESULTS

Antibiogram+ is an online tool, accessible via the electronic health record and hospital intranet, which offers institutional antibiotic susceptibilities for major pathogens, recommendations for empiric antibiotic selection and treatment durations for common pediatric conditions, antimicrobial dosing and monitoring guidance, and links to other internal clinical decision support resources. The tool was accessed 11,823 times with 492 average monthly views during the first 2 years after release. Compared with use of a preexisting print antibiogram and dosing card, pediatric residents more frequently reported "often" being sure of antibiotic dosing with Antibiogram+ (58 vs. 15%, p < 0.01). Respondents also reported improved confidence in choice of antibiotic, but this finding did not reach statistical significance (55 vs. 35%, p = 0.26).

CONCLUSION

We report the successful development of a digital antimicrobial stewardship platform with consistent rates of access during the first 2 years following release and improved provider comfort with antibiotic management.

Evaluation of an Antimicrobial Stewardship Decision Support for Pediatric Infections

OBJECTIVES

Clinical decision support (CDS) has promise for the implementation of antimicrobial stewardship programs (ASPs) in the emergency department (ED). We sought to assess the usability of a newly developed automated CDS to improve guideline-adherent antibiotic prescribing for pediatric community-acquired pneumonia (CAP) and urinary tract infection (UTI).

METHODS

We conducted comparative usability testing between an automated, prototype CDS-enhanced discharge order set and standard order set, for pediatric CAP and UTI antibiotic prescribing. After an extensive user-centered design process, the prototype CDS was integrated into the electronic health record, used passive activation, and embedded locally adapted prescribing guidelines. Participants were randomized to interact with three simulated ED scenarios of children with CAP or UTI, across both systems. Measures included task completion, decision-making and usability errors, clinical actions (order set use and correct antibiotic selection), as well as objective measures of system usability, utility, and workload using the National Aeronautics and Space Administration Task Load Index (NASA-TLX). The prototype CDS was iteratively refined to optimize usability and workflow.

RESULTS

Usability testing in 21 ED clinical providers demonstrated that, compared to the standard order sets, providers preferred the prototype CDS, with improvements in domains such as explanations of suggested antibiotic choices (p < 0.001) and provision of additional resources on antibiotic prescription (p < 0.001). Simulated use of the CDS also led to overall improved guideline-adherent prescribing, with a 31% improvement for CAP. A trend was present toward absolute workload reduction. Using the NASA-TLX, workload scores for the current system were median 26, interquartile ranges (IQR): 11 to 41 versus median 25, and IQR: 10.5 to 39.5 for the CDS system (p = 0.117).

CONCLUSION

Our CDS-enhanced discharge order set for ED antibiotic prescribing was strongly preferred by users, improved the accuracy of antibiotic prescribing, and trended toward reduced provider workload. The CDS was optimized for impact on guideline-adherent antibiotic prescribing from the ED and end-user acceptability to support future evaluative trials of ED ASPs.

Usability and Acceptability of Clinical Decision Support Based on the KIIDS-TBI Tool for Children with Mild Traumatic Brain Injuries and Intracranial Injuries

BACKGROUND

 The Kids Intracranial Injury Decision Support tool for Traumatic Brain Injury (KIIDS-TBI) tool is a validated risk prediction model for managing children with mild traumatic brain injuries (mTBI) and intracranial injuries. Electronic clinical decision support (CDS) may facilitate the clinical implementation of this evidence-based guidance.

OBJECTIVE

 Our objective was to evaluate the acceptability and usability of an electronic CDS tool for managing children with mTBI and intracranial injuries.

METHODS

 Emergency medicine and neurosurgery physicians (10 each) from 10 hospitals in the United States were recruited to participate in usability testing of a novel CDS prototype in a simulated electronic health record environment. Testing included a think-aloud protocol, an acceptability and usability survey, and a semi-structured interview. The prototype was updated twice during testing to reflect user feedback. Usability problems recorded in the videos were categorized using content analysis. Interview transcripts were analyzed using thematic analysis.

RESULTS

 Among the 20 participants, most worked at teaching hospitals (80%), freestanding children's hospitals (95%), and level-1 trauma centers (75%). During the two prototype updates, problems with clarity of terminology and navigating through the CDS interface were identified and corrected. Corresponding to these changes, the number of usability problems decreased from 35 in phase 1 to 8 in phase 3 and the number of mistakes made decreased from 18 (phase 1) to 2 (phase 3). Through the survey, participants found the tool easy to use (90%), useful for determining a patient's level of care (95%), and likely to improve resource use (90%) and patient safety (79%). Interview themes related to the CDS's ability to support evidence-based decision-making and improve clinical workflow proposed implementation strategies and potential pitfalls.

CONCLUSION

 After iterative evaluation and refinement, the KIIDS-TBI CDS tool was found to be highly usable and useful for aiding the management of children with mTBI and intracranial injuries.

Point-of-care COVID-19 testing in the emergency department: current status and future prospects

INTRODUCTION

This expert review outlines current and future point-of-care technologies for the diagnosis of the SARS-CoV-2 virus, which is responsible for causing coronavirus disease COVID-19 in the emergency department. COVID-19 first emerged in late 2019 and is responsible for a range of presentations from minor upper respiratory tract symptoms to severe pneumonia and multisystem organ failure. Among the technologies available include the gold standard of molecular point-of-care tests as well as antigen detection tests.

AREAS COVERED

We discuss point-of-care molecular tests including multiplex, targeted, and single plex panels as well as various antigen testing methodologies in terms of availability and performance characteristics. In addition, we focus on current testing best practices and considerations for point-of-care testing in the emergency department based on a search of the literature available in PubMed to date and a review of FDA and CDC guidance.

EXPERT OPINION

While there have been many advances in SARS-CoV-2 point-of-care testing, there remain challenges to implementation in the emergency department setting. A paradigm shift is needed to improve diagnosis and clinical outcomes.

Human Factors and Organizational Issues in Health Informatics: Innovations and Opportunities

OBJECTIVE

Human factors and ergonomics (HF/E) frameworks and methods are becoming embedded in the health informatics community. There is now broad recognition that health informatics tools must account for the diverse needs, characteristics, and abilities of end users, as well as their context of use. The objective of this review is to synthesize the current nature and scope of HF/E integration into the health informatics community.

METHODS

Because the focus of this synthesis is on understanding the current integration of the HF/E and health informatics research communities, we manually reviewed all manuscripts published in primary HF/E and health informatics journals during 2020.

RESULTS

HF/E-focused health informatics studies included in this synthesis focused heavily on EHR customizations, specifically clinical decision support customizations and customized data displays, and on mobile health innovations. While HF/E methods aimed to jointly improve end user safety, performance, and satisfaction, most HF/E-focused health informatics studies measured only end user satisfaction.

CONCLUSION

HF/E-focused health informatics researchers need to identify and communicate methodological standards specific to health informatics, to better synthesize findings across resource intensive HF/E-focused health informatics studies. Important gaps in the HF/E design and evaluation process should be addressed in future work, including support for technology development platforms and training programs so that health informatics designers are as diverse as end users.

A Systematic Review of Design Workshops for Health Information Technologies

Background: Design workshops offer effective methods in eliciting end-user participation from design inception to completion. Workshops unite stakeholders in the utilization of participatory methods, coalescing in the best possible creative solutions. Objective: This systematic review aimed to identify design approaches whilst providing guidance to health information technology designers/researchers in devising and organizing workshops. Methods: A systematic literature search was conducted in five medical/library databases identifying 568 articles. The initial duplication removal resulted in 562 articles. A criteria-based screening of the title field, abstracts, and pre-full-texts reviews resulted in 72 records for full-text review. The final review resulted in 10 article exclusions. Results: 62 publications were included in the review. These studies focused on consumer facing and clinical health information technologies. The studied technologies involved both clinician and patients and encompassed an array of health conditions. Diverse workshop activities and deliverables were reported. Only seven publications reported workshop evaluation data. Discussion: This systematic review focused on workshops as a design and research activity in the health informatics domain. Our review revealed three themes: (1) There are a variety of ways of conducting design workshops; (2) Workshops are effective design and research approaches; (3) Various levels of workshop details were reported.

A Narrative Review of Clinical Decision Support for Inpatient Clinical Pharmacists

OBJECTIVE

Increasingly, pharmacists provide team-based care that impacts patient care; however, the extent of recent clinical decision support (CDS), targeted to support the evolving roles of pharmacists, is unknown. Our objective was to evaluate the literature to understand the impact of clinical pharmacists using CDS.

METHODS

We searched MEDLINE, EMBASE, and Cochrane Central for randomized controlled trials, nonrandomized trials, and quasi-experimental studies which evaluated CDS tools that were developed for inpatient pharmacists as a target user. The primary outcome of our analysis was the impact of CDS on patient safety, quality use of medication, and quality of care. Outcomes were scored as positive, negative, or neutral. The secondary outcome was the proportion of CDS developed for tasks other than medication order verification. Study quality was assessed using the Newcastle-Ottawa Scale.

RESULTS

Of 4,365 potentially relevant articles, 15 were included. Five studies were randomized controlled trials. All included studies were rated as good quality. Of the studies evaluating inpatient pharmacists using a CDS tool, four showed significantly improved quality use of medications, four showed significantly improved patient safety, and three showed significantly improved quality of care. Six studies (40%) supported expanded roles of clinical pharmacists.

CONCLUSION

These results suggest that CDS can support clinical inpatient pharmacists in preventing medication errors and optimizing pharmacotherapy. Moreover, an increasing number of CDS tools have been developed for pharmacists' roles outside of order verification, whereby further supporting and establishing pharmacists as leaders in safe and effective pharmacotherapy.