Clinician Perceptions of Timing and Presentation of Drug-Drug Interaction Alerts

Interprofessional Evaluation of a Medication Clinical Decision Support System Prior to Implementation

BACKGROUND

 Computerized physician order entry (CPOE) and clinical decision support systems (CDSS) are widespread due to increasing digitalization of hospitals. They can be associated with reduced medication errors and improved patient safety, but also with well-known risks (e.g., overalerting, nonadoption).

OBJECTIVES

 Therefore, we aimed to evaluate a commonly used CDSS containing Medication-Safety-Validators (e.g., drug-drug interactions), which can be locally activated or deactivated, to identify limitations and thereby potentially optimize the use of the CDSS in clinical routine.

METHODS

 Within the implementation process of Meona (commercial CPOE/CDSS) at a German University hospital, we conducted an interprofessional evaluation of the CDSS and its included Medication-Safety-Validators following a defined algorithm: (1) general evaluation, (2) systematic technical and content-related validation, (3) decision of activation or deactivation, and possibly (4) choosing the activation mode (interruptive or passive). We completed the in-depth evaluation for exemplarily chosen Medication-Safety-Validators. Moreover, we performed a survey among 12 German University hospitals using Meona to compare their configurations.

RESULTS

 Based on the evaluation, we deactivated 3 of 10 Medication-Safety-Validators due to technical or content-related limitations. For the seven activated Medication-Safety-Validators, we chose the interruptive option ["PUSH-(&PULL)-modus"] four times (4/7), and a new, on-demand option ["only-PULL-modus"] three times (3/7). The site-specific configuration (activation or deactivation) differed across all participating hospitals in the survey and led to varying medication safety alerts for identical patient cases.

CONCLUSION

 An interprofessional evaluation of CPOE and CDSS prior to implementation in clinical routine is crucial to detect limitations. This can contribute to a sustainable utilization and thereby possibly increase medication safety.

Override rate of drug-drug interaction alerts in clinical decision support systems: A brief systematic review and meta-analysis

Primary studies have demonstrated that despite being useful, most of the drug-drug interaction (DDI) alerts generated by clinical decision support systems are overridden by prescribers. To provide more information about this issue, we conducted a systematic review and meta-analysis on the prevalence of DDI alerts generated by CDSS and alert overrides by physicians. The search strategy was implemented by applying the terms and MeSH headings and conducted in the MEDLINE/PubMed, EMBASE, Web of Science, Scopus, LILACS, and Google Scholar databases. Blinded reviewers screened 1873 records and 86 full studies, and 16 articles were included for analysis. The overall prevalence of alert generated by CDSS was 13% (CI95% 5-24%, p-value <0.0001, I^2 = 100%), and the overall prevalence of alert override by physicians was 90% (CI95% 85-95%, p-value <0.0001, I^2 = 100%). This systematic review and meta-analysis presents a high rate of alert overrides, even after CDSS adjustments that significantly reduced the number of alerts. After analyzing the articles included in this review, it was clear that the CDSS alerts physicians about potential DDI should be developed with a focus on the user experience, thus increasing their confidence and satisfaction, which may increase patient clinical safety.

PillHarmonics: An Orchestrated Pharmacogenetics Medication Clinical Decision Support Service

OBJECTIVES

 Pharmacogenetics (PGx) is increasingly important in individualizing therapeutic management plans, but is often implemented apart from other types of medication clinical decision support (CDS). The lack of integration of PGx into existing CDS may result in incomplete interaction information, which may pose patient safety concerns. We sought to develop a cloud-based orchestrated medication CDS service that integrates PGx with a broad set of drug screening alerts and evaluate it through a clinician utility study.

METHODS

 We developed the PillHarmonics service for implementation per the CDS Hooks protocol, algorithmically integrating a wide range of drug interaction knowledge using cloud-based screening services from First Databank (drug-drug/allergy/condition), PharmGKB (drug-gene), and locally curated content (drug-renal/hepatic/race). We performed a user study, presenting 13 clinicians and pharmacists with a prototype of the system's usage in synthetic patient scenarios. We collected feedback via a standard questionnaire and structured interview.

RESULTS

 Clinician assessment of PillHarmonics via the Technology Acceptance Model questionnaire shows significant evidence of perceived utility. Thematic analysis of structured interviews revealed that aggregated knowledge, concise actionable summaries, and information accessibility were highly valued, and that clinicians would use the service in their practice.

CONCLUSION

 Medication safety and optimizing efficacy of therapy regimens remain significant issues. A comprehensive medication CDS system that leverages patient clinical and genomic data to perform a wide range of interaction checking and presents a concise and holistic view of medication knowledge back to the clinician is feasible and perceived as highly valuable for more informed decision-making. Such a system can potentially address many of the challenges identified with current medication-related CDS.

Barriers to Adoption of Tailored Drug-Drug Interaction Clinical Decision Support

OBJECTIVE

Despite the benefits of the tailored drug-drug interaction (DDI) alerts and the broad dissemination strategy, the uptake of our tailored DDI alert algorithms that are enhanced with patient-specific and context-specific factors has been limited. The goal of the study was to examine barriers and health care system dynamics related to implementing tailored DDI alerts and identify the factors that would drive optimization and improvement of DDI alerts.

METHODS

We employed a qualitative research approach, conducting interviews with a participant interview guide framed based on Proctor's taxonomy of implementation outcomes and informed by the Theoretical Domains Framework. Participants included pharmacists with informatics roles within hospitals, chief medical informatics officers, and associate medical informatics directors/officers. Our data analysis was informed by the technique used in grounded theory analysis, and the reporting of open coding results was based on a modified version of the Safety-Related Electronic Health Record Research Reporting Framework.

RESULTS

Our analysis generated 15 barriers, and we mapped the interconnections of these barriers, which clustered around three entities (i.e., users, organizations, and technical stakeholders). Our findings revealed that misaligned interests regarding DDI alert performance and misaligned expectations regarding DDI alert optimizations among these entities within health care organizations could result in system inertia in implementing tailored DDI alerts.

CONCLUSION

Health care organizations primarily determine the implementation and optimization of DDI alerts, and it is essential to identify and demonstrate value metrics that health care organizations prioritize to enable tailored DDI alert implementation. This could be achieved via a multifaceted approach, such as partnering with health care organizations that have the capacity to adopt tailored DDI alerts and identifying specialists who know users' needs, liaise with organizations and vendors, and facilitate technical stakeholders' work. In the future, researchers can adopt the systematic approach to study tailored DDI implementation problems from other system perspectives (e.g., the vendors' system).

Effect of Replacing Vendor QTc Alerts with a Custom QTc Risk Alert in Inpatients

OBJECTIVE

The aim of the study is to implement a customized QTc interval clinical decision support (CDS) alert strategy in our electronic health record for hospitalized patients and aimed at providers with the following objectives: minimize QTc prolongation, minimize exposure to QTc prolonging medications, and decrease overall QTc-related alerts. A strategy that was based on the validated QTc risk scoring tool and replacing medication knowledge vendor alerts with custom QTc prolongation alerts was implemented.

METHODS

This is a retrospective quasi-experimental study with a pre-intervention period (August 2019 to October 2019) and post-intervention period (December 2019 to February 2020). The custom alert was implemented in November 2019.

RESULTS

In the pre-implementation group, 361 (19.3%) patients developed QTc prolongation, and in the post-implementation group, 357 (19.6%) patients developed QTc prolongation (OR: 1.02, 95% CI: 0.87-1.20, p = 0.81). The odds ratio of an action taken post-implementation compared with pre-implementation was 18.90 (95% CI: 14.03-25.47, p <0. 001). There was also a decrease in total orders for QTc prolonging medications from 7,921 (5.5%) to 7,566 (5.3%) with an odds ratio of 0.96 (95% CI: 0.93-0.99, p = 0.01).

CONCLUSION

We were able to decrease patient exposure to QTc prolonging medications while not increasing the rate of QTc prolongation as well as improving alert action rate. Additionally, there was a decrease in QTc prolonging medication orders which illustrates the benefit of using a validated risk score with a customized CDS approach compared with a traditional vendor-based strategy. Further research is needed to confirm if an approach implemented at our organization can reduce QTc prolongation rates.

The appropriateness of clinical decision support systems alerts in supporting clinical workflows: A systematic review

A CDSS generates a high number of inappropriate alerts that interrupt the clinical workflow. As a result, clinicians silence, disable, or ignore alerts, thereby undermining patient safety. Therefore, the effectiveness and appropriateness of CDSS alerts need to be evaluated. A systematic review was carried out to identify the factors that affect CDSS alert appropriateness in supporting clinical workflow. Seven electronic databases (PubMed, Scopus, ACM, Science Direct, IEEE, Ovid Medline, and Ebscohost) were searched for English language articles published between 1997 and 2018. Seventy six papers met the inclusion criteria, of which 26, 24, 15, and 11 papers are retrospective cohort, qualitative, quantitative, and mixed-method studies, respectively. The review highlights various factors influencing the appropriateness and efficiencies of CDSS alerts. These factors are categorized into technology, human, organization, and process aspects using a combination of approaches, including socio-technical framework, five rights of CDSS, and Lean. Most CDSS alerts were not properly designed based on human factor methods and principles, explaining high alert overrides in clinical practices. The identified factors and recommendations from the review may offer valuable insights into how CDSS alerts can be designed appropriately to support clinical workflow.

Human Factors and Organizational Issues in Health Informatics: Innovations and Opportunities

OBJECTIVE

Human factors and ergonomics (HF/E) frameworks and methods are becoming embedded in the health informatics community. There is now broad recognition that health informatics tools must account for the diverse needs, characteristics, and abilities of end users, as well as their context of use. The objective of this review is to synthesize the current nature and scope of HF/E integration into the health informatics community.

METHODS

Because the focus of this synthesis is on understanding the current integration of the HF/E and health informatics research communities, we manually reviewed all manuscripts published in primary HF/E and health informatics journals during 2020.

RESULTS

HF/E-focused health informatics studies included in this synthesis focused heavily on EHR customizations, specifically clinical decision support customizations and customized data displays, and on mobile health innovations. While HF/E methods aimed to jointly improve end user safety, performance, and satisfaction, most HF/E-focused health informatics studies measured only end user satisfaction.

CONCLUSION

HF/E-focused health informatics researchers need to identify and communicate methodological standards specific to health informatics, to better synthesize findings across resource intensive HF/E-focused health informatics studies. Important gaps in the HF/E design and evaluation process should be addressed in future work, including support for technology development platforms and training programs so that health informatics designers are as diverse as end users.

Evaluation of Clinical Decision Support to Reduce Sedative-Hypnotic Prescribing in Older Adults

OBJECTIVE

We sought to characterize the performance of inpatient and outpatient computerized clinical decision support (CDS) alerts aimed at reducing inappropriate benzodiazepine and nonbenzodiazepine sedative medication prescribing in older adults 18 months after implementation.

METHODS

We reviewed the performance of two CDS alerts in the outpatient and inpatient settings in 2019. To examine the alerts' effectiveness, we analyzed metrics including overall alert adherence, provider-level adherence, and reasons for alert trigger and override.

RESULTS

In 2019, we identified a total of 14,534 and 4,834 alerts triggered in the outpatient and inpatient settings, respectively. Providers followed only 1% of outpatient and 3% of inpatient alerts. Most alerts were ignored (68% outpatient and 60% inpatient), while providers selected to override the remaining alerts. In each setting, the top 2% of clinicians were responsible for approximately 25% of all ignored or overridden alerts. However, a small proportion of clinicians (2% outpatient and 4% inpatient) followed the alert at least half of the time and accounted for a disproportionally large fraction of the total followed alerts. Our analysis of the free-text comments revealed that many alerts were to continue outpatient prescriptions or for situational anxiety.

CONCLUSION

Our findings highlight the importance of evaluation of CDS performance after implementation. We found large variation in response to the inpatient and outpatient alerts, both with respect to follow and ignore rates. Reevaluating the alert design by providing decision support by indication may be more helpful and may reduce alert fatigue.

Assessing Prescriber Behavior with a Clinical Decision Support Tool to Prevent Drug-Induced Long QT Syndrome

OBJECTIVE

Clinical decision support (CDS) alerts built into the electronic health record (EHR) have the potential to reduce the risk of drug-induced long QT syndrome (diLQTS) in susceptible patients. However, the degree to which providers incorporate this information into prescription behavior and the impact on patient outcomes is often unknown.

METHODS

We examined provider response data over a period from October 8, 2016 until November 8, 2018 for a CDS alert deployed within the EHR from a 13-hospital integrated health care system that fires when a patient with a QTc ≥ 500 ms within the past 14 days is prescribed a known QT-prolonging medication. We used multivariate generalized estimating equations to analyze the impact of therapeutic alternatives, relative risk of diLQTS for specific medications, and patient characteristics on provider response to the CDS and overall patient mortality.

RESULTS

The CDS alert fired 15,002 times for 7,510 patients for which the most common response (51.0%) was to override the alert and order the culprit medication. In multivariate models, we found that patient age, relative risk of diLQTS, and presence of alternative agents were significant predictors of adherence to the CDS alerts and that nonadherence itself was a predictor of mortality. Risk of diLQTS and presence of an alternative agent are major factors in provider adherence to a CDS to prevent diLQTS; however, provider nonadherence was associated with a decreased risk of mortality.

CONCLUSION

Surrogate endpoints, such as provider adherence, can be useful measures of CDS value but attention to hard outcomes, such as mortality, is likely needed.

Reducing Inappropriate Outpatient Medication Prescribing in Older Adults across Electronic Health Record Systems

BACKGROUND

The American Geriatrics Society recommends against the use of certain potentially inappropriate medications (PIMs) in older adults. Prescribing of these medications correlates with higher rates of hospital readmissions, morbidity, and mortality. Vanderbilt University Medical Center previously deployed clinical decision support (CDS) to decrease PIM prescribing rates, but recently transitioned to a new electronic health record (EHR).

OBJECTIVE

The goal of this study was to evaluate PIM prescribing rates for older adults before and after migration to the new EHR system.

METHODS

We reviewed prescribing rates of PIMs in adults 65 years and older, normalized per 100 total prescriptions from the legacy and new EHR systems between July 1, 2014 and December 31, 2019. The PIM prescribing rates before and after EHR migration during November 2017 were compared using a U-chart and Poisson regression model. Secondary analysis descriptively evaluated the frequency of prescriber acceptance rates in the new EHR.

RESULTS

Prescribing rates of PIMs decreased 5.2% (13.5 per 100 prescriptions to 12.8 per 100 prescriptions; p < 0.0001) corresponding to the implementation of alternatives CDS in the legacy EHR. After migration of the alternative CDS from the legacy to the new EHR system, PIM prescribing rates dropped an additional 18.8% (10.4 per 100 prescriptions; p < 0.0001). Acceptance rates of the alternative recommendations for PIMs was low overall at 11.1%.

CONCLUSION

The prescribing rate of PIMs in adults aged 65 years and older was successfully decreased with the implementation of prescribing CDS. This decrease was not only maintained but strengthened by the transition to a new EHR system.