Drug-Drug Interactions and Actual Harm to Hospitalized Patients: A Multicentre Study Examining the Prevalence Pre- and Post-Electronic Medication System Implementation

INTRODUCTION

Drug-drug interactions (DDIs) have potential to cause patient harm, including lowering therapeutic efficacy. This study aimed to (i) determine the prevalence of potential DDIs (pDDIs); clinically relevant DDIs (cDDIs), that is, DDIs that could lead to patient harm, taking into account a patient's individual clinical profile, drug effects and severity of potential harmful outcome; and subsequent actual harm among hospitalized patients and (ii) examine the impact of transitioning from paper-based medication charts to electronic medication management (eMM) on DDIs and patient harms.

METHODS

This was a secondary analysis of the control arm of a controlled pre-post study. Patients were randomly selected from three Australian hospitals. Retrospective chart review was conducted before and after the implementation of an eMM system, without accompanying clinical decision support alerts for DDIs. Harm was assessed by an expert panel.

RESULTS

Of 1186 patient admissions, 70.1% (n = 831) experienced a pDDI, 42.6% (n = 505) a cDDI and 0.9% (n = 11) an actual harm in hospital. Of 15,860 pDDIs identified, 27.0% (n = 4285) were classified as cDDIs. The median number of pDDIs and cDDIs per 10 drugs were 6 [interquartile range (IQR) 2-13] and 0 (IQR 0-2), respectively. In cases where a cDDI was identified, both drugs were 44% less likely to be co-administered following eMM (adjusted odds ratio 0.56, 95% confidence interval 0.46-0.73).

CONCLUSION

Although most patients experienced a pDDI during their hospital stay, less than one-third of pDDIs were clinically relevant. The low prevalence of harm identified raises questions about the value of incorporating DDI decision support into systems given the potential negative impacts of DDI alerts.

A tale of 2 digital hospitals: A qualitative study of antimicrobial stewardship teams

AIMS

We aim to examine and understand the work processes of antimicrobial stewardship (AMS) teams across 2 hospitals that use the same digital intervention, and to identify the barriers and enablers to effective AMS in each setting.

METHODS

Employing a contextual inquiry approach informed by the Systems Engineering Initiative for Patient Safety (SEIPS) model, observations and semistructured interviews were conducted with AMS team members (n = 15) in 2 Australian hospitals. Qualitative data analysis was conducted, mapping themes to the SEIPS framework.

RESULTS

Both hospitals utilized similar systems, however, they displayed variations in AMS processes, particularly in postprescription review, interdepartmental AMS meetings and the utilization of digital tools. An antimicrobial dashboard was available at both hospitals but was utilized more at the hospital where the AMS team members were involved in the dashboard's development, and there were user champions. At the hospital where the dashboard was utilized less, participants were unaware of key features, and interoperability issues were observed. Establishing strong relationships between the AMS team and prescribers emerged as key to effective AMS at both hospitals. However, organizational and cultural differences were found, with 1 hospital reporting insufficient support from executive leadership, increased prescriber autonomy and resource constraints.

CONCLUSION

Organizational and cultural elements, such as executive support, resource allocation and interdepartmental relationships, played a crucial role in achieving AMS goals. System interoperability and user champions further promoted the adoption of digital tools, potentially improving AMS outcomes through increased user engagement and acceptance.

Antimicrobial Stewardship (AMS) During COVID-19: Eyes and Ears on the AMS Team

Antimicrobial stewardship (AMS) programs in hospitals comprise coordinated strategies to optimise antimicrobial use. The COVID-19 pandemic had a significant impact on the healthcare system, including AMS. This study aimed to understand the work processes of AMS teams during COVID-19 hospital restrictions and the role technology played in supporting AMS. Observations and interviews were conducted with AMS teams at two hospitals in Sydney, Australia. Participants reported an increase in antimicrobial use, a loss of resources for AMS activities, and reduced in-person interactions. Meetings were performed through videoconferencing, which resulted in greater access to information but led to poorer communication and impacted interdisciplinary relationships. As COVID-19 restrictions recede, AMS program changes should be evaluated to understand the most effective strategies to facilitate evidence-based AMS practices.

Is evidence of effectiveness a driver for clinical decision support selection? A qualitative descriptive study of senior hospital staff

Limited research has focused on understanding if and how evidence of health information technology (HIT) effectiveness drives the selection and implementation of technologies in practice. This study aimed to explore the views of senior hospital staff on the role evidence plays in the selection and implementation of HIT, with a particular focus on clinical decision support (CDS) alerts in electronic medication management systems. A qualitative descriptive design was used. Twenty senior hospital staff from six Australian hospitals in New South Wales and Queensland took part in a semistructured interview. Interviews were audio-recorded and transcribed, and a general inductive content analysis approach was used to identify themes. Participants acknowledged the importance of an evidence base, but reported that selection of CDS alerts, and HIT more broadly, was rarely underpinned by evidence that technologies improve patient care. Instead, investments in technologies were guided by the expectation that benefits will be achieved, bolstered by vendor assurances, and a perception that implementation of HIT is unavoidable. Postponing implementation of a technology until an evidence base is available was not always feasible. Although some technologies were seen as not requiring an evidence base, stakeholders viewed evidence as extremely valuable for informing decisions about selection of CDS alerts. In the absence of evidence, evaluation or monitoring of technologies postimplementation is critical, particularly to identify new errors or risks associated with HIT implementation and use. Increased transparency from vendors, with technology evaluation outcomes made directly available to healthcare organizations, may result in less reliance on logic, intuition, and vendor assertions and more evidence-based selection of HIT.

Digital interventions for antimicrobial prescribing and monitoring: a qualitative meta-synthesis of factors influencing user acceptance

OBJECTIVE

To understand and synthesize factors influencing user acceptance of digital interventions used for antimicrobial prescribing and monitoring in hospitals.

MATERIALS AND METHODS

A meta-synthesis was conducted to identify qualitative studies that explored user acceptance of digital interventions for antimicrobial prescribing and/or monitoring in hospitals. Databases were searched and qualitative data were extracted and systematically classified using the unified theory of acceptance and use of technology (UTAUT) model.

RESULTS

Fifteen qualitative studies met the inclusion criteria. Eleven papers used interviews and four used focus groups. Most digital interventions evaluated in studies were decision support for prescribing (n = 13). Majority of perceptions were classified in the UTAUT performance expectancy domain in perceived usefulness and relative advantage constructs. Key facilitators in this domain included systems being trusted and credible sources of information, improving performance of tasks and increasing efficiency. Reported barriers were that interventions were not considered useful for all settings or patient conditions. Facilitating conditions was the second largest domain, which highlights the importance of users having infrastructure to support system use. Digital interventions were viewed positively if they were compatible with values, needs, and experiences of users.

CONCLUSIONS

User perceptions that drive users to accept and utilize digital interventions for antimicrobial prescribing and monitoring were predominantly related to performance expectations and facilitating conditions. To ensure digital interventions for antimicrobial prescribing are accepted and used, we recommend organizations ensure systems are evaluated and benefits are conveyed to users, that utility meets expectations, and that appropriate infrastructure is in place to support use.

Prescribers’ reported acceptance and use of drug-drug interaction alerts: An Australian survey

Drug-drug interaction (DDI) alerts are frequently included in electronic medical record (eMR) systems to provide users with relevant information and guidance at the point of care. In this study, we aimed to examine views of DDI alerts among prescribers, including junior doctors, registrars and senior doctors, across Australia. A validated survey for assessing prescribers’ reported acceptance and use of DDI alerts was distributed among researcher networks and in newsletters. Fifty useable responses were received, more than half ( n = 28) from senior doctors. Prescribers at all levels expected DDI alerts to improve performance but junior doctors reported that this was at a high cost, with respect to time and effort. Senior doctors and registrars reported rarely reading alerts and rarely changing prescribing decisions based on alerts. Respondents identified a number of problems with current alerts including limited relevance, repetition, and poor design, highlighting some clear areas for alert improvement.

OUP accepted manuscript

Background

Antimicrobial stewardship (AMS) programmes in hospitals support optimal antimicrobial use by utilizing strategies such as restriction policies and education. Several systematic reviews on digital interventions supporting AMS have been conducted but they have focused on specific interventions and outcomes.

Objectives

To provide a systematic overview and synthesis of evidence on the effectiveness of digital interventions to improve antimicrobial prescribing and monitoring in hospitals.

Methods

Multiple databases were searched from 2010 onwards. Review papers were eligible if they included studies that examined the effectiveness of AMS digital interventions in an inpatient hospital setting. Papers were excluded if they were not systematic reviews, were limited to a paediatric setting, or were not in English.

Results

Eight systematic reviews were included for data extraction. A large number of digital interventions were evaluated, with a strong focus on clinical decision support. Due to the heterogeneity of the interventions and outcome measures, a meta-analysis could not be performed. The majority of reviews reported that digital interventions reduced antimicrobial use and improved antimicrobial appropriateness. The impact of digital interventions on clinical outcomes was inconsistent.

Conclusions

Digital interventions reduce antimicrobial use and improve antimicrobial appropriateness in hospitals, but no firm conclusions can be drawn about the degree to which different types of digital interventions achieve these outcomes. Evaluation of sociotechnical aspects of digital intervention implementation is limited, despite the critical role that user acceptance, uptake and feasibility play in ensuring improvements in AMS are achieved with digital health.

Optimizing clinical decision support alerts in electronic medical records: a systematic review of reported strategies adopted by hospitals

OBJECTIVE

To identify and summarize the current internal governance processes adopted by hospitals, as reported in the literature, for selecting, optimizing, and evaluating clinical decision support (CDS) alerts in order to identify effective approaches.

MATERIALS AND METHODS

Databases (Medline, Embase, CINAHL, Scopus, Web of Science, IEEE Xplore Digital Library, CADTH, and WorldCat) were searched to identify relevant papers published from January 2010 to April 2020. All paper types published in English that reported governance processes for selecting and/or optimizing CDS alerts in hospitals were included.

RESULTS

Eight papers were included in the review. Seven papers focused specifically on medication-related CDS alerts. All papers described the use of a multidisciplinary committee to optimize alerts. Other strategies included the use of clinician feedback, alert data, literature and drug references, and a visual dashboard. Six of the 8 papers reported evaluations of their CDS alert modifications following the adoption of optimization strategies, and of these, 5 reported a reduction in alert rate.

CONCLUSIONS

A multidisciplinary committee, often in combination with other approaches, was the most frequent strategy reported by hospitals to optimize their CDS alerts. Due to the limited number of published processes, variation in system changes, and evaluation results, we were unable to compare the effectiveness of different strategies, although employing multiple strategies appears to be an effective approach for reducing CDS alert numbers. We recommend hospitals report on descriptions and evaluations of governance processes to enable identification of effective strategies for optimization of CDS alerts in hospitals.

The impact of introducing automated dispensing cabinets, barcode medication administration, and closed-loop electronic medication management systems on work processes and safety of controlled medications in hospitals: A systematic review

BACKGROUND

Technology in the form of Automated Dispensing Cabinets (ADCs), Barcode Medication Administration (BCMA), and closed-loop Electronic Medication Management Systems (EMMS) are implemented in hospitals to assist with the supply, use and monitoring of medications. Although there is evidence to suggest that these technologies can reduce errors and improve monitoring of medications in general, little is known about their impact on controlled medications such as opioids.

OBJECTIVES

This review aimed to fill this knowledge gap by synthesising literature to determine the impact of ADCs, BCMA and closed-loop EMMS on clinical work processes, medication safety, and drug diversion associated with controlled medications in the inpatient setting.

METHODS

Eight databases (Medline, Pubmed, Embase, Scopus, Web of Science, PsycINFO, CINAHL, and ScienceDirect) were searched for relevant papers published between January 2000 and May 2019. Qualitative, quantitative, and mixed-methods empirical studies published in English that reported findings on the impact of ADCs, BCMA and/or closed-loop EMMS on controlled medications in the inpatient setting were included.

RESULTS

In total, 16 papers met the inclusion criteria. Eleven studies reported on ADCs, four on BCMA, and only one on closed-loop EMMS. Only four studies focused on controlled medications, with the remainder reporting only incidental findings. Studies reported the elimination of manual end-of-shift counts of controlled medications after ADC implementation but cases of drug diversion were reported despite introducing ADCs. Three quantitative studies reported reductions in medication errors after implementing BCMA, but medications labelled with wrong barcodes and unreadable barcodes led to confusion and administration errors.

CONCLUSIONS

More quality, targeted research is needed to provide evidence on the benefits and also risks of implementing technology to safeguard against inappropriate use of controlled medications in the inpatient setting. Processes need to be in place to supplement technological capabilities, and resources should be made available for post-implementation evaluations and interventions.

An experimental investigation of the impact of alert frequency and relevance on alert dwell time

AIM

This study aimed to determine the impact of alert frequency and relevance on alert dwell time.

METHOD

A 2 × 3 design was used where 127 university students completed 60 prescribing tasks and were presented with a variable frequency of computerized alerts (low, medium and high) with variable relevance (low and high). Participants were instructed to override an alert if it was not relevant to their prescription, and to cancel the order if the alert signalled an error in their order.

RESULTS

Participants presented with a small number of alerts spent more time attending to alert content than participants presented with a medium or high number of alerts (respectively median 15.6 s vs 10.8 vs 10.2 s). Alert relevance had no impact on alert dwell time. Alerts requiring an override response were 4.5 times more likely to be correctly actioned than alerts requiring the order to be cancelled.

DISCUSSION

Dwell time was influenced by alert frequency, with greater exposure to alerts associated with shorter dwell times. We hypothesize that this was because participants came to learn that spending time on alert information was unnecessary. We propose that when users experience no consequences or feedback from overriding alerts they quickly learn that this action is more efficient and so more rewarding than taking any other action.