Impact of non-interruptive medication laboratory monitoring alerts in ambulatory care

Impact of implementing alerts about medication black-box warnings in electronic health records

BACKGROUND

The Food and Drug Administration issues black-box warnings (BBWs) regarding medications with serious risks, yet physician adherence to the warnings is low.

METHODS

We evaluated the impact of delivering BBW-based alerts about drug-drug, drug-disease, and drug-laboratory interactions for prescription medications in outpatients in an electronic health record with clinical decision support. We compared the frequency of non-adherence to all BBWs about drug-drug, drug-disease, and drug-laboratory interactions for 30 drugs/drug classes, and by individual drugs/drug groups with BBWs between the pre- and post-intervention periods. We used multivariate analysis to identify independent risk factors for non-adherence to BBWs.

RESULTS

There was a slightly higher frequency of non-adherence to BBWs after the intervention (4.8% vs. 5.1%, p=0.045). In multivariate analyses, after adjustment for patient and provider characteristics and site of care, medications prescribed during the pre-intervention period were less likely to violate BBWs compared to those prescribed during the post-intervention period (OR 0.67, 95% CI, 0.47-0.96). However, black-box warning violations did decrease after the intervention for BBWs about drug-drug interactions (6.1% vs. 1.8%, p<0.0001) and drug-pregnancy interactions (5.1% vs. 3.6%, p=0.01).

CONCLUSIONS

Ambulatory care computerized order entry with prescribing alerts about BBWs did not improve clinicians' overall adherence to BBWs, though it did improve adherence for specific clinically important subcategories.

Doctors' perceptions of laboratory monitoring in office practice

BACKGROUND

Laboratory monitoring has been increasingly recognized as an important area for improving patient safety in ambulatory care. Little is known about doctors' attitudes towards laboratory monitoring and potential ways to improve it.

METHODS

Six focus groups and one individual interview with 20 primary care doctors and nine specialists from three Massachusetts communities.

RESULTS

Participants viewed laboratory monitoring as a critical, time-consuming task integral to their practice of medicine. Most believed they commit few laboratory monitoring errors and were surprised at the error rates reported in the literature. They listed various barriers to monitoring, including not knowing which doctor was responsible for ensuring the completion of laboratory monitoring, uncertainty regarding the necessity of monitoring, lack of alerts/reminders and patient non-adherence with recommended monitoring. The primary facilitator of monitoring was ordering laboratory tests while the patient is in the office. Primary care doctors felt more strongly than specialists that computerized alerts could improve laboratory monitoring. Participants wanted to individualize alerts for their practices and warned that alerts must not interrupt work flow or require too many clicks.

CONCLUSIONS

Doctors in community practice recognized the potential of computerized alerts to enhance their monitoring protocols for some medications. They viewed patient non-adherence as a barrier to optimal monitoring. Interventions to improve laboratory monitoring should address doctor workflow issues, in addition to patients' awareness of the importance of fulfilling recommended therapeutic monitoring to prevent adverse drug events.

Improving Patient Safety through Medical Alert Management: An Automated Decision Tool to Reduce Alert Fatigue

Drug safety alerts, a feature of electronic medical records (EMRs), are increasingly recognized as valuable tools for reducing adverse drug events and improving patient safety. However, there has also been increased understanding that alert fatigue, a state in which users become overwhelmed and unresponsive to alerts in general, is a threat to patient safety. In this paper, we seek to mitigate alert fatigue by filtering superfluous alerts. We design a method of predicting alert overrides based on past alert override rate, range in override rate, and sample size. Using a dataset from a large pediatric network, we retroactively test and validate our method. For the test implementation, alerts are filtered with 91-96% accuracy, depending on the parameter values selected. By filtering these alerts, we reduce alert fatigue and allow users to refocus resources to potentially vital alerts, reducing the occurrence of adverse drug events.

Venous thromboembolism prevention: a systematic review of methods to improve prophylaxis and decrease events in the hospitalized patient

Prevention of venous thromboembolism (VTE) is currently a key initiative internationally and in US hospitals, where there has been a recent focus on national quality initiatives to prevent hospital-acquired VTE. Multiple strategies exist to prevent VTE by increasing prophylaxis rates in the hospitalized setting. Active, multifaceted interventions, including provider education, an active reminder to the provider, and regular audit and feedback to medical and hospital staff, appear to be the most effective current interventions. Active intervention programs have been validated both as electronic alerts, with or without computerized clinical decision support software and, more recently, human alerts, many of which utilize in-hospital pharmacists. A passive strategy, such as guideline dissemination, should not be used as a lone method. Although inappropriate duration remains a key reason as to why at-risk patients do not receive appropriate thromboprophylaxis within the hospital (defined by type, dose, and duration of prophylaxis), few studies address duration compared with hospital length of stay. Preventable VTE is a new quality outcome measure for hospitals but is measured in few studies. Future studies should focus on comparing various multifaceted interventions to assess their effect over time, including endpoints of bleeding for safety, appropriate type, dose, and duration of prophylaxis, overall and preventable VTE, and the impact on unnecessary prophylaxis for patients not at risk.

Effectiveness of interruptive alerts in increasing application functionality utilization: a controlled trial

Medical applications frequently contain a wide range of functionalities. Users are often unaware of all of the functionalities available. More effective ways of delivering information about available functionalities to the users are needed. We conducted a pseudo-randomized controlled trial to determine whether interruptive alerts will increase utilization of several functionalities by the users of the Pre-Admission Medication List (PAML) Builder application at two academic medical centers. In a log-linear model, alerts increased total utilization of the promoted functionalities per PAML built by 70% compared to the controls at the site level (p<0.0001). At the user level, frequency of utilization of the PAML Builder functionalities by individual users increased by 0.03 for every extra alert shown to the user (p<0.0001). Alerts led to a nearly 2-fold increase in utilization of the promoted functionalities. Interruptive alerts are an effective method of delivering information about application functionalities to users.

Using health information technology to improve drug monitoring: a systematic review

PURPOSE

To conduct a systematic review of current evidence regarding the use of health information technology (HIT) interventions to improve drug monitoring in ambulatory care.

METHODS

We searched PubMed, CINAHL, the Cochrane Library, and other computerized databases from 1 January 1998 to 30 June 2008 using the key words "drug monitoring," "medical records systems, computerized," "ambulatory care," and "outpatients." We manually reviewed reference lists of articles identified through computer searches and asked experts in the field to review our search strategy and results for completeness.

RESULTS

Seven relevant studies were identified. Four of these studies assessed real-time interventions that used alerts to physicians at the time of medication ordering to ensure adequate monitoring, only one of which showed an improvement in monitoring. Of three studies using HIT outside the physician encounter, two suggested some improvement in monitoring rates. Methodological limitations were apparent in all studies identified.

CONCLUSIONS

Few studies have assessed the effectiveness of HIT interventions to improve drug monitoring, and among them, there is no clear consensus regarding the most consistently effective approaches to reducing drug monitoring errors. There is a clear need for well designed randomized trials to evaluate possible interventions to reduce drug monitoring errors. Such studies should incorporate health outcomes and detailed cost analyses to further characterize the feasibility of successful interventions.

Physician compliance with advanced electronic alerts for preventing venous thromboembolism among hospitalized medical patients

BACKGROUND

Worldwide, more than half of the hospitalized medical patients at high risk do not receive venous thromboembolism (VTE) prophylaxis. Although VTE among hospitalized patients at risk is reduced with electronic alerts (eAlerts), the majority of eAlerts are being ignored by the responsible physician.

METHODS

We investigated physician compliance with an advanced eAlert system in 1027 (age 59 +/- 17 years) hospitalized medical patients. A continuously flashing non-interruptive eAlert, visible to all healthcare professionals, was issued in the electronic patient chart 6 h after admission if the physician did not order prophylaxis.

RESULTS

The rate of appropriate prophylaxis increased from 44% before to 76% after the implementation of the eAlert system. Although the patients whose physicians cared for > or = 20 patients during the study period had a more frequent physician response to the eAlert than patients whose physicians cared for fewer patients (69% vs. 40%, P < 0.001), they received appropriate prophylaxis less often (72% vs. 81%, P = 0.016). After adjustment for significant patient predictors of appropriate prophylaxis, including cancer, age, duration of hospital stay, and thrombocytopenia, patients whose physicians cared for > or = 20 patients during the study period were less likely to receive appropriate prophylaxis (odds ratio 0.65, 95% confidence interval 0.44-0.96; P = 0.032) than patients whose physicians cared for fewer patients.

CONCLUSIONS

The introduction of an advanced eAlert system accompanied by continuing medical education for the prevention of VTE resulted in a substantial increase in the rate of appropriate prophylaxis among hospitalized medical patients. However, many eAlerts may cause decreased physician compliance owing to 'alert fatigue'.

The effects of on-screen, point of care computer reminders on processes and outcomes of care

BACKGROUND

The opportunity to improve care by delivering decision support to clinicians at the point of care represents one of the main incentives for implementing sophisticated clinical information systems. Previous reviews of computer reminder and decision support systems have reported mixed effects, possibly because they did not distinguish point of care computer reminders from e-mail alerts, computer-generated paper reminders, and other modes of delivering 'computer reminders'.

OBJECTIVES

To evaluate the effects on processes and outcomes of care attributable to on-screen computer reminders delivered to clinicians at the point of care.

SEARCH STRATEGY

We searched the Cochrane EPOC Group Trials register, MEDLINE, EMBASE and CINAHL and CENTRAL to July 2008, and scanned bibliographies from key articles.

SELECTION CRITERIA

Studies of a reminder delivered via a computer system routinely used by clinicians, with a randomised or quasi-randomised design and reporting at least one outcome involving a clinical endpoint or adherence to a recommended process of care.

DATA COLLECTION AND ANALYSIS

Two authors independently screened studies for eligibility and abstracted data. For each study, we calculated the median improvement in adherence to target processes of care and also identified the outcome with the largest such improvement. We then calculated the median absolute improvement in process adherence across all studies using both the median outcome from each study and the best outcome.

MAIN RESULTS

Twenty-eight studies (reporting a total of thirty-two comparisons) were included. Computer reminders achieved a median improvement in process adherence of 4.2% (interquartile range (IQR): 0.8% to 18.8%) across all reported process outcomes, 3.3% (IQR: 0.5% to 10.6%) for medication ordering, 3.8% (IQR: 0.5% to 6.6%) for vaccinations, and 3.8% (IQR: 0.4% to 16.3%) for test ordering. In a sensitivity analysis using the best outcome from each study, the median improvement was 5.6% (IQR: 2.0% to 19.2%) across all process measures and 6.2% (IQR: 3.0% to 28.0%) across measures of medication ordering. In the eight comparisons that reported dichotomous clinical endpoints, intervention patients experienced a median absolute improvement of 2.5% (IQR: 1.3% to 4.2%). Blood pressure was the most commonly reported clinical endpoint, with intervention patients experiencing a median reduction in their systolic blood pressure of 1.0 mmHg (IQR: 2.3 mmHg reduction to 2.0 mmHg increase).

AUTHORS' CONCLUSIONS

Point of care computer reminders generally achieve small to modest improvements in provider behaviour. A minority of interventions showed larger effects, but no specific reminder or contextual features were significantly associated with effect magnitude. Further research must identify design features and contextual factors consistently associated with larger improvements in provider behaviour if computer reminders are to succeed on more than a trial and error basis.