Just what the doctor ordered. Review of the evidence of the impact of computerized physician order entry system on medication errors

A Practical Approach to Optimize Computerized Provider Order Entry Systems and Reduce Clinician Burden: Pre-Post Evaluation of Vendor-Derived "Order Friction" Data

Computerized provider order entry (CPOE) systems have been cited as a significant contributor to clinician burden. Vendor-derived measures and data sets have been developed to help with optimization of CPOE systems. We describe how we analyzed vendor-derived Order Friction (OF) EHR log data at our health system and propose a practical approach for optimizing CPOE systems by reducing OF. We also conducted a pre-post intervention study using OF data to evaluate the impact of defaulting the frequency of urine, stool and nasal swab tests and found that all modified orders had significantly fewer changes required per order (p<0.01). Our proposed approach is a six-step process: 1) understand the ordering process, 2) understand OF data elements contextually, 3) explore ordering user-level factors, 4) evaluate order volume and friction from different order sources, 5) optimize order-level design, 6) identify high volume alerts to evaluate for appropriateness.

Computer programs used in the field of hospital pharmacy for the management of dangerous drugs: systematic review of literature

Background

This review wants to highlight the importance of computer programs used to control the steps in the management of dangerous drugs. It must be taken into account that there are phases in the process of handling dangerous medicines in pharmacy services that pose a risk to the healthcare personnel who handle them. Objective: To review the scientific literature to determine what computer programs have been used in the field of hospital pharmacy for the management of dangerous drugs (HDs).

Methods

The following electronic databases were searched from inception to July 30, 2021: MEDLINE (via PubMed), Embase, Cochrane Library, Scopus, Web of Science, Latin American and Caribbean Literature in Health Sciences (LILACS) and Medicine in Spanish (MEDES). The following terms were used in the search strategy: "Antineoplastic Agents," "Cytostatic Agents," "Hazardous Substances," "Medical Informatics Applications," "Mobile Applications," "Software," "Software Design," and "Pharmacy Service, Hospital."

Results

A total of 104 studies were retrieved form the databases, and 18 additional studies were obtained by manually searching the reference lists of the included studies and by consulting experts. Once the inclusion and exclusion criteria were applied, 26 studies were ultimately included in this review. Most of the applications described in the included studies were used for the management of antineoplastic drugs. The most commonly controlled stage was electronic prescription; 18 studies and 7 interventions carried out in the preparation stage focused on evaluating the accuracy of chemotherapy preparations.

Conclusion

Antineoplastic electronic prescription software was the most widely implemented software at the hospital level. No software was found to control the entire HD process. Only one of the selected studies measured safety events in workers who handle HDs. Moreover, health personnel were found to be satisfied with the implementation of this type of technology for daily work with these medications. All studies reviewed herein considered patient safety as their final objective. However, none of the studies evaluated the risk of HD exposure among workers.

Impact of Computerized Provider Order Entry on Chemotherapy Medication Errors: A Systematic Review

Context: Chemotherapy errors are considered the second most common cause of fatal medication errors (ME). Currently, computerized provider order entry (CPOE) is increasingly used to prevent or decrease ME and improve the safety of the medication process. Objectives: This study was conducted to systematically review the impacts of CPOE on the incidence of chemotherapy ME, the severity of errors, and adverse drug events (ADEs) in cancer care units. Data Sources: The literature search was conducted, using 5 databases of PubMed, EMBASE, Scopus, Web of Science, and ScienceDirect between 2000 and 2020. Search terms included keywords and MESH terms related to CPOE, ME, chemotherapy, and cancer care unit. Study Selection: Articles were included in this research if they investigated the CPOE system, reported ME, and were carried out in the oncology department. Non-English papers, duplications, review studies, and conference papers were excluded. Data Extraction: The selected papers were read repeatedly and related papers were extracted. All eligible articles were qualitatively evaluated with a tool provided by Downs. The extracted information included the author’s name, year of publication, study location, type of study, study objectives, and main findings. Results: A total of 829 studies were retrieved. Fourteen articles met the inclusion criteria. Ten studies (71%) reported the impact of CPOE on chemotherapy ME in comparison with the paper-based ordering method. In 4 studies (29%), researchers developed a CPOE for the oncology department, and the system was, then, assessed concerning user experience, safety challenges as well as the effects of CPOE on ME. Nine articles (64%) reported the impact of the CPOE system on ME only in the prescribing phase, and 5 studies (36%) examined ME in all phases of the chemotherapy process. Five studies (36%) reported the impact of the CPOE system on ADEs and the severity of errors. Conclusions: Implementing CPOE is associated with a significant reduction in ME in all phases of the chemotherapy process. However, the CPOE does not prevent all MEs and may cause new errors. The rigorous analysis of the chemotherapy process and considering the designing principles could help develop the CPOE systems and minimize ME.

Renal medication-related clinical decision support (CDS) alerts and overrides in the inpatient setting following implementation of a commercial electronic health record: implications for designing more effective alerts

Objective

To assess the appropriateness of medication-related clinical decision support (CDS) alerts associated with renal insufficiency and the potential/actual harm from overriding the alerts.

Materials and Methods

Override rate frequency was recorded for all inpatients who had a renal CDS alert trigger between 05/2017 and 04/2018. Two random samples of 300 for each of 2 types of medication-related CDS alerts associated with renal insufficiency—“dose change” and “avoid medication”—were evaluated by 2 independent reviewers using predetermined criteria for appropriateness of alert trigger, appropriateness of override, and patient harm.

Results

We identified 37 100 “dose change” and 5095 “avoid medication” alerts in the population evaluated, and 100% of each were overridden. Dose change triggers were classified as 12.5% appropriate and overrides of these alerts classified as 90.5% appropriate. Avoid medication triggers were classified as 29.6% appropriate and overrides 76.5% appropriate. We identified 5 adverse drug events, and, of these, 4 of the 5 were due to inappropriately overridden alerts.

Conclusion

Alerts were nearly always presented inappropriately and were all overridden during the 1-year period studied. Alert fatigue resulting from receiving too many poor-quality alerts may result in failure to recognize errors that could lead to patient harm. Although medication-related CDS alerts associated with renal insufficiency had previously been found to be the most clinically beneficial alerts in a legacy system, in this system they were ineffective. These findings underscore the need for improvements in alert design, implementation, and monitoring of alert performance to make alerts more patient-specific and clinically appropriate.

How effective are electronic medication systems in reducing medication error rates and associated harm among hospital inpatients? A systematic review and meta-analysis

OBJECTIVE

To conduct a systematic review and meta-analysis to assess: 1) changes in medication error rates and associated patient harm following electronic medication system (EMS) implementation; and 2) evidence of system-related medication errors facilitated by the use of an EMS.

MATERIALS AND METHODS

We searched Medline, Scopus, Embase, and CINAHL for studies published between January 2005 and March 2019, comparing medication errors rates with or without assessments of related harm (actual or potential) before and after EMS implementation. EMS was defined as a computer-based system enabling the prescribing, supply, and/or administration of medicines. Study quality was assessed.

RESULTS

There was substantial heterogeneity in outcomes of the 18 included studies. Only 2 were strong quality. Meta-analysis of 5 studies reporting change in actual harm post-EMS showed no reduced risk (RR: 1.22, 95% CI: 0.18-8.38, P = .8) and meta-analysis of 3 studies reporting change in administration errors found a significant reduction in error rates (RR: 0.77, 95% CI: 0.72-0.83, P = .004). Of 10 studies of prescribing error rates, 9 reported a reduction but variable denominators precluded meta-analysis. Twelve studies provided specific examples of system-related medication errors; 5 quantified their occurrence.

DISCUSSION AND CONCLUSION

Despite the wide-scale adoption of EMS in hospitals around the world, the quality of evidence about their effectiveness in medication error and associated harm reduction is variable. Some confidence can be placed in the ability of systems to reduce prescribing error rates. However, much is still unknown about mechanisms which may be most effective in improving medication safety and design features which facilitate new error risks.

Comparison of Medication Alerts from Two Commercial Applications in the USA

Introduction

Medication organizations across the USA have adopted electronic health records, and one of the most anticipated benefits of these was improved medication safety, but alert fatigue has been a major issue.

Objective

We compared the appropriateness of medication-related clinical decision support alerts triggered by two commercial applications: EPIC and Seegnal’s platform.

Methods

This was a retrospective comparison of two commercial applications. We provided Seegnal with deidentified inpatient, outpatient, and inpatient genetic electronic medical record (EMR)-extracted datasets for 657, 2731, and 413 patients, respectively. Seegnal then provided the alerts that would have triggered, which we compared with those triggered by EPIC in clinical care. A random sample of the alerts triggered were reviewed for appropriateness, and the positive predictive value (PPV) and negative predictive value (NPV) were calculated. We also reviewed all the inpatient and outpatient charts for patients within our cohort who were receiving ten or more concomitant medications with alerts we found to be appropriate to assess whether any adverse events had occurred and whether Seegnal’s platform could have prevented them.

Results

Results from EPIC and the Seegnal platform were compared based on alert load, PPV, NPV, and potential adverse events. Overall, compared with EPIC, the Seegnal platform triggered fewer alerts in the inpatient (1697 vs. 27,540), outpatient (2341 vs. 35,134), and inpatient genetic (1493 vs. 20,975) cohorts. The Seegnal platform had higher specificity in the inpatient (99 vs. 0.3%; p < 0.0001), outpatient (99 vs. 0.3%; p < 0.0001), and inpatient genetic (97.9 vs. 1.2%; p < 0.0001) groups and higher sensitivity in the inpatient (100 vs. 68.8%; p < 0.0001) and outpatient (88.6 vs.78.3%; p < 0.0001) groups but not in the inpatient genetic cohort (81 vs. 78.5%; p = 0.11). We identified 16 adverse events that occurred in the inpatient setting, 11 (69%) of which potentially could have been prevented with the Seegnal platform.

Conclusions

Overall, the Seegnal platform triggered 94% fewer alerts than EPIC in the inpatient setting and 93% fewer in the outpatient setting, with much higher sensitivity and specificity. This application could substantially reduce alert fatigue and improve medication safety at the same time.

Supplementary Information

The online version of this article (10.1007/s40264-021-01048-0) contains supplementary material, which is available to authorized users.

Interventions to ensure medication safety in acute care: an umbrella review

BACKGROUND

Medication errors are one of the leading avoidable sources of harm to hospital patients. In hospitals, a range of interventions have been used to reduce the risk of errors at each of the points they may occur, such as prescription, dispensing and/or administration. Systematic reviews have been conducted on many of these interventions; however, it is difficult to compare the clinical utility of any of the separate interventions without the use of a rigorous umbrella review methodology.

OBJECTIVES

The aim of this umbrella review was to synthesize the evidence from all systematic reviews investigating the effectiveness of medication safety interventions, in comparison to any or no comparator, for preventing medication errors, medication-related harms and death in acute care patients.

METHOD

The review considered quantitative systematic reviews with participants who were healthcare workers involved in prescribing, dispensing or administering medications. These healthcare workers were registered nurses, enrolled or licensed vocational nurses, midwives, pharmacists or medical doctors. Interventions of interest were those designed to prevent medication error in acute care settings. Eligible systematic reviews reported medication errors, medication-related harms and medication-related death as measured by error rates, numbers of adverse events and numbers of medication-related deaths. To qualify for inclusion, systematic reviews needed to provide a clearly articulated and comprehensive search strategy, and evidence of critical appraisal of the included studies using a standardized tool. Systematic reviews published in English since 2007 were included until present (March 2020). We searched a range of databases such MEDLINE, CINAHL, Web of Science, EMBASE, and The Cochrane Library for potentially eligible reviews. Identified citations were screened by two reviewers working independently. Potentially eligible articles were retrieved and assessed against the inclusion criteria and those meeting the criteria were then critically appraised using the JBI SUMARI instrument for assessing the methodological quality of systematic reviews and research syntheses. A predetermined quality threshold was used to exclude studies based on their reported methods. Following critical appraisal, data were extracted from the included studies by two independent reviewers using the relevant instrument in JBI SUMARI. Extracted findings were synthesized narratively and presented in tables to illustrate the reported outcomes for each intervention. The strength of the evidence for each intervention was indicated using 'traffic light' colors: green for effective interventions, amber for interventions with no evidence of an effect and red for interventions less effective than the comparison.

RESULTS

A total of 23 systematic reviews were included in this umbrella review. Most reviews did not report the number of participants in their included studies. Interventions targeted pharmacists, medical doctors, medical students and nurses, or were nonspecific about the participants. The majority of included reviews examined single interventions. All reviews were published and in English. Four interventions, medication administration education, medication reconciliation or review, specialist pharmacists' roles and physical or design modifications, reported effectiveness in reducing errors; however, heterogeneity between the included studies in these reviews was high.

CONCLUSION

For some interventions, there are strong indications of effectiveness in reducing medication errors in the inpatient setting. Government initiatives, policy makers and practitioners interested in improving medication safety are encouraged to adopt those interventions.

Using change management to implement barcode medicines administration technology

Confirming the patient's identity is one of the most important elements in medicines administration, with research showing that medication errors are one of the most common sources of harm caused to patients. This article discusses the implementation of a barcode medicines administration system using two change management models. A complex project such as the implementation of barcode medicines administration technology, requires staff engagement at all levels. The adoption rates of the new workflow patterns in this project showed the benefits of using various change management models during different phases of a project. The project also demonstrated how nurse leaders must use a range of resources to effectively implement a new project.

Publication and related bias in quantitative health services and delivery research: a multimethod study

Background

Bias in the publication and reporting of research findings (referred to as publication and related bias here) poses a major threat in evidence synthesis and evidence-based decision-making. Although this bias has been well documented in clinical research, little is known about its occurrence and magnitude in health services and delivery research.

Objectives

To obtain empirical evidence on publication and related bias in quantitative health services and delivery research; to examine current practice in detecting/mitigating this bias in health services and delivery research systematic reviews; and to explore stakeholders’ perception and experiences concerning such bias.

Methods

The project included five distinct but interrelated work packages. Work package 1 was a systematic review of empirical and methodological studies. Work package 2 involved a survey (meta-epidemiological study) of randomly selected systematic reviews of health services and delivery research topics (n = 200) to evaluate current practice in the assessment of publication and outcome reporting bias during evidence synthesis. Work package 3 included four case studies to explore the applicability of statistical methods for detecting such bias in health services and delivery research. In work package 4 we followed up four cohorts of health services and delivery research studies (total n = 300) to ascertain their publication status, and examined whether publication status was associated with statistical significance or perceived ‘positivity’ of study findings. Work package 5 involved key informant interviews with diverse health services and delivery research stakeholders (n = 24), and a focus group discussion with patient and service user representatives (n = 8).

Results

We identified only four studies that set out to investigate publication and related bias in health services and delivery research in work package 1. Three of these studies focused on health informatics research and one concerned health economics. All four studies reported evidence of the existence of this bias, but had methodological weaknesses. We also identified three health services and delivery research systematic reviews in which findings were compared between published and grey/unpublished literature. These reviews found that the quality and volume of evidence and effect estimates sometimes differed significantly between published and unpublished literature. Work package 2 showed low prevalence of considering/assessing publication (43%) and outcome reporting (17%) bias in health services and delivery research systematic reviews. The prevalence was lower among reviews of associations than among reviews of interventions. The case studies in work package 3 highlighted limitations in current methods for detecting these biases due to heterogeneity and potential confounders. Follow-up of health services and delivery research cohorts in work package 4 showed positive association between publication status and having statistically significant or positive findings. Diverse views concerning publication and related bias and insights into how features of health services and delivery research might influence its occurrence were uncovered through the interviews with health services and delivery research stakeholders and focus group discussion conducted in work package 5.

Conclusions

This study provided prima facie evidence on publication and related bias in quantitative health services and delivery research. This bias does appear to exist, but its prevalence and impact may vary depending on study characteristics, such as study design, and motivation for conducting the evaluation. Emphasis on methodological novelty and focus beyond summative assessments may mitigate/lessen the risk of such bias in health services and delivery research. Methodological and epistemological diversity in health services and delivery research and changing landscape in research publication need to be considered when interpreting the evidence. Collection of further empirical evidence and exploration of optimal health services and delivery research practice are required.

Study registration

This study is registered as PROSPERO CRD42016052333 and CRD42016052366.

Funding

This project was funded by the National Institute for Health Research (NIHR) Health Services and Delivery Research programme and will be published in full in Health Services and Delivery Research; Vol. 8, No. 33. See the NIHR Journals Library website for further project information.

Health Care Utilization and Expenditure in War Survivors

Background: To describe the utilization and out-of-pocket (OOP) payments of war survivors receiving health care services and its determinants. Methods: A cross-sectional study was carried out by systematic random sampling at national level (n = 3079) on healthcare utilization in war survivors on their last received services. A validated questionnaire was used to gather the information of inpatient and outpatient healthcare services and OOP payment. The data were analyzed to indicate the determinants of health utilization and expenses. Results: Health care utilization was reported in 91.6% (n = 2822). The majority (82.5%) received one or two services in their last visits, mostly related to physician visits and medications (65.97%). Health care utilization was higher than general population annually, especially in physician visit (6.6 versus 4.89), medication (5.1 versus 3.6), and hospitalization (0.78 versus 0.15). About 20.2% (n = 599) of the study population paid out of their pocket for their last medical care services. The frequency of OOP payment was greater for physician visit and medication. Payment for hospitalization, imaging, and lab tests were more significantly associated with proceeding to reimburse the expenses (P<0.001). The median OOP payment was US$10.8 (interquartile range US$20.6). Gender (P=0.003), area of residence (P=0.01) and being war victims (P=0.005) were the significant determinants for both OOP payments and reclaiming the expenditure. Higher amount of payments (P<0.001) and more received health services (P=0.002) were also important factors in reclaiming the expenditure. Conclusion: Both outpatient services and hospital admission are more frequent among war survivors compared to the general Iranian population. Future studies should attempt to explore the reasons.

Unexpected Increase in Benzodiazepine Prescriptions Related to the Introduction of an Electronic Prescribing Tool: Evidence from Multicenter Hospital Data

Electronic Prescribing tools (e-prescribing) have shown several benefits in terms of prescribing process adequacy and health care quality in hospital settings. We hypothesize however, that an undesired effect of digitalisation, due to the easier and faster prescribing process allowing patients to skip face-to-face conversations with patients and nurses, is that it could facilitate the prescription of medications at high risk of overuse or abuse, such as benzodiazepines (BZDs). We conducted a panel data study to investigate, the impact of the introduction of an e-prescribing system on new BZD prescriptions in hospitalised patients in a network of five teaching hospitals. During the observation period 1 July 2014-30 April 2019, 43,320 admissions were analysed. A fixed-effects model was adopted to estimate the effect of e-prescribing on new BZD prescriptions. E-prescribing implementation was associated with a significant increase of new BZD prescriptions: absolute +1.5%, and relative +43% (p < 0.001). The effect was similar in males and females (respectively, absolute +2.3%, relative +65% (p < 0.001); absolute +1.8%, relative +58% (p = 0.01)) and in patients ≥70 years old (absolute +1.6%, relative +59% (p < 0.001)). After controlling for time-varying explanatory variables, the implementation of the e-prescribing tool showed similar significant effects. E-prescribing implementation was associated with a significant increase of new in-hospital BZD prescriptions. For classes of drugs at risk of overuse or abuse, e-prescribing should be used cautiously, to minimize the risk of over-prescriptions. Further research in other settings and countries is needed to analyse causal interactions between e-prescribing and BZD prescriptions in the hospital setting, and to promote the ultimate goal of high-value care.

Does a parenteral nutrition decision support system for total nutrients improve prescription procedure and neonatal growth?

Background and objectives: Parenteral nutrition (PN) is an integral part of the nutritional support of critically ill neonates in the intensive care units (ICU). The evaluation of a decision support system for total nutrients (DSSFTN) is of great importance for clinical practice. This study's aim was to evaluate the impact caused by implementation of a DSSFTN on PN support and neonatal growth. This pilot work was supported by the hospital PN team (PNT) in order to assess possible benefits stemming from the use of DSSFTN.Materials and methods: DSSFTN development is based on the incorporation of pharmaceutical and therapeutic protocols. Thirty-eight neonates were recruited. Inclusion criteria included: patients should (a) be hospitalized in ICU, (b) receive PN support at least for 15 days, (c) have birth weight 550-1600 g. One exclusion criterion was applied: patients should have no inborn error of metabolism. 15 doctors prescribed PN for two groups of neonates. PN was calculated by doctors for Group 1 (19 neonates) and respectively was calculated by the DSSFTN (and checked by doctors) for Group 2 (19 neonates). A questionnaire was completed later by doctors to evaluate DSSFTN.Results: The implementation of DSSFTN led to appropriate composition and administration of PN. Growth was not significantly different between the study groups. Compliance with guidelines was observed. DSSFTN ameliorated intercommunication among doctors.Conclusions: The implementation of DSSFTN enables health professionals to facilitate the complex task of prescribing. It ensures the consistency of PN prescriptions, as it leads to appropriate dosing in all nutrients. DSSFTN provides real-time PN interventions (clinical conditions and enteral amounts are included additionally) and minimizes exposure to human errors.

The Role of Computerized Clinical Decision Support in Reducing Inappropriate Medication Administration During Epidural Therapy

Background: The use of epidural anesthesia has been shown to improve outcomes in the postoperative setting. To minimize risk of complications, avoiding certain medications with epidural anesthesia is advised. Objective: This study sought to determine the role of a computerized clinical decision support module implemented into the computerized physician order entry (CPOE) system on the incidence of administration of medications known to increase complications with epidural anesthesia. Methods: This study was a retrospective cohort chart review in adult patients receiving epidural anesthesia for at least 1 day. Patients were identified retrospectively and divided into 2 cohorts, those receiving an epidural 3 months prior to initiation of the module and those receiving an epidural 3 months following implementation. The primary end point was incidence of inappropriate medication administration before and after implementation. Complications of therapy were collected as secondary end points. Results: There was a reduction in the incidence of inappropriate medication administration in the postimplementation group versus the preimplementation group (6.3% vs 12.8%) although statistical significance was not achieved. In addition, the incidence of enoxaparin administration was significantly lower postimplementation than the preimplementation (0% vs 3.9%). There were no significant differences in other complications of therapy. Conclusions: This study demonstrated that application of decision support for this high-risk procedural population was able to eliminate the incidence of the most common inappropriate medication for epidural analgesia, enoxaparin. A reduction in incidence of other inappropriate medications was also observed; however, statistical significance was not reached. The use of computerized clinical decision support can be a powerful tool in reducing or ameliorating medication errors, and further study will be required to determine the most appropriate and effective implementation strategies.

Using drug knowledgebase information to distinguish between look-alike-sound-alike drugs

Objective

To extract drug indications from a commercial drug knowledgebase and determine to what extent drug indications can discriminate between look-alike-sound-alike (LASA) drugs.

Methods

We extracted drug indications disease concepts from the MedKnowledge Indications module from First Databank Inc. (South San Francisco, CA) and associated them with drugs on the Institute for Safe Medication Practices (ISMP) list of commonly confused drug names. We used high-level concepts (rather than granular concepts) to represent the general indications for each drug. Two pharmacists reviewed each drug's association with its high-level indications concepts for accuracy and clinical relevance. We compared the high-level indications for each commonly confused drug pair and categorized each pair as having a complete overlap, partial overlap or no overlap in high-level indications.

Results

Of 278 LASA drug pairs, 165 (59%) had no overlap and 58 (21%) had partial overlap in high-level indications. Fifty-five pairs (20%) had complete overlap in high-level indications; nearly half of these were comprised of drugs with the same active ingredient and route of administration (e.g., Adderall, Adderall XR).

Conclusions

Drug indications data from a drug knowledgebase can discriminate between many LASA drugs.

Impact of a commercial order entry system on prescribing errors amenable to computerised decision support in the hospital setting: a prospective pre-post study

Background

In this UK study, we investigated the impact of computerised physician order entry (CPOE) and clinical decision support (CDS) implementation on the rate of 78 high-risk prescribing errors amenable to CDS.

Methods

We conducted a preintervention/postintervention study in three acute hospitals in England. A predefined list of prescribing errors was incorporated into an audit tool. At each site, approximately 4000 prescriptions were reviewed both pre-CPOE and 6 months post-CPOE implementation. The number of opportunities for error and the number of errors that occurred were collated. Error rates were then calculated and compared between periods, as well as by the level of CDS.

Results

The prescriptions of 1244 patients were audited pre-CPOE and 1178 post-CPOE implementation. A total of 28 526 prescriptions were reviewed, with 21 138 opportunities for error identified based on 78 defined errors. Across the three sites, for those prescriptions where opportunities for error were identified, the error rate was found to reduce significantly post-CPOE implementation, from 5.0% to 4.0% (P<0.001). CDS implementation by error type was found to differ significantly between sites, ranging from 0% to 88% across clinical contraindication, dose/frequency, drug interactions and other error types (P<0.001). Overall, 43/78 (55%) of the errors had some degree of CDS implemented in at least one of the hospitals.

Conclusions

Implementation of CPOE with CDS was associated with clinically important reductions in the rate of high-risk prescribing errors. Given the pre-post design, these findings however need to be interpreted with caution. The occurrence of errors was found to be highly dependent on the level of restriction of CDS presented to the prescriber, with the effect that different configurations of the same CPOE system can produce very different results.

Drug-drug interactions and their harmful effects in hospitalised patients: a systematic review and meta-analysis

PURPOSE

Drug-drug interactions (DDIs) are often avoidable and, if undetected, can lead to patient harm. This review aimed to determine the prevalence of potential DDIs (pDDIs), clinically relevant DDIs (DDIs that could lead to measurable patient harm, taking into account the patient's individual clinical profile) and DDIs that resulted in actual patient harm during hospitalisation.

METHOD

Four databases were scanned for English papers published from 2000 to 2016. Papers that reported prevalence of DDIs in the outpatient setting, at admission or discharge, involving only specific drugs, or in specific disease populations or age groups were excluded.

RESULTS

Twenty-seven papers met the inclusion criteria and were graded for quality using the Critical Appraisal Skills Programme (CASP) cohort study checklist. Ten papers were rated as 'poor', 14 as 'fair' and only three papers as 'good'. Overall, the meta-analysis revealed that 33% of general patients and 67% of intensive care patients experienced a pDDI during their hospital stay. It was not possible to determine the prevalence of clinically relevant DDIs or DDIs that resulted in actual patient harm as data on these categories were limited. Of the very few studies that reported on harm, only a small proportion of DDIs were found to have resulted in actual patient harm.

CONCLUSIONS

Standardisation of DDI definitions and research methods are required to allow meaningful prevalence rates to be obtained and compared. Studies that go further than measuring pDDIs are critically needed to determine the impact of DDIs on patient safety.

The impact of a hospital electronic prescribing and medication administration system on medication administration safety: an observational study

Background

The aim of the study was to explore the impact of the implementation of an electronic prescribing and medication administration system (ePA) on the safety of medication administration in an inpatient hospital setting. Objectives were to compare the prevalence and types of: 1) medication administration errors, and 2) documentation discrepancies, between a paper and an ePA system. Additionally, we wanted to describe any observed changes to medication administration practices.

Methods

The study was based on an elderly medicine ward in an English hospital. From December 2014 to June 2015, nurses’ medication administration rounds were observed every 5 days before and after ePA implementation using an interrupted time-series approach. Medication administration error and documentation discrepancy rates pre- versus post-ePA were analysed descriptively and chi-squared tests used to test for any difference; segmented regression analysis was used to determine changes in longitudinal trend.

Results

Observations were made at 15 pre- and 15 post-ePA implementation time-points. Pre-ePA on paper, there were 18 medication administration errors in 428 opportunities for error (4.2%; 95% confidence interval 2.3–6.1%), and with ePA there were 18 in 528 (3.4%; 95% confidence interval 1.9–5.0%; p = 0.64). Regarding documentation, pre-ePA on paper there were 5 discrepancies in 460 observed documentations (1.1%; 95% confidence interval 0.1–2.0%); with ePA there were 18 in 557 (3.2%; 95% confidence interval 1.8–4.7%; p = 0.04). The most common electronic documentation discrepancy was documentation that a dose had been administered when it had not. Segmented regression analysis was unable to detect any significant longitudinal changes. Changes to working practices post-ePA were observed, such as nurses demonstrating less-consistent self-checking when preparing and administering medications.

Conclusions

Findings suggest no change in medication error rate, although ePA encourages certain types of errors and mitigates others. There was a statistically significant increase in documentation discrepancies which is likely to be due to adoption of new working practices with ePA.

Electronic supplementary material

The online version of this article (doi:10.1186/s12913-017-2462-2) contains supplementary material, which is available to authorized users.

Ambulatory Computerized Prescribing and Preventable Adverse Drug Events

BACKGROUND

Adverse drug events (ADEs) represent a significant cause of injury in the ambulatory care setting. Computerized physician order entry reduces rates of serious medication errors that can lead to ADEs in the inpatient setting, but few studies have evaluated whether computerized prescribing in the ambulatory setting reduces preventable ADE rates in ambulatory care.

OBJECTIVE

To determine the rates of preventable ADEs before and after the implementation of computerized prescribing with basic clinical decision support for ordering medications.

DESIGN

Before-after study of ADE rates in practices implementing computer order entry.

PARTICIPANTS

Adult patients seeking care in primary care practices at academic medical centers in Boston, Massachusetts (n = 41,819), and Indianapolis, Indiana (n = 9128).

MAIN MEASURES

We attempted to standardize the medication-related decision support knowledge base provided at the 2 sites, although the electronic records and presentation layers used at the 2 sites differed. The primary outcome was preventable ADEs identified based on structured results or symptoms defined by extracting symptom concepts from provider notes; potential ADEs were a secondary outcome.

RESULTS

Computerized prescribing did not significantly change the rate of preventable ADEs at either site. Compared with Boston practices, the rate of potential ADEs was more than seven-fold greater at Indianapolis (6.4/10,000 patient-months vs. 49.5/10,000 patient-months, P < 0.001). Computerized prescribing was associated with a 56% decrease in the potential ADE rate at Indianapolis (49.5 to 21.9/10,000 patient-months, P < 0.001) but a 104% increase at Boston (6.4 to 13.0/10,000 patient-months, P < 0.001). Preventable ADEs that occurred after computerized prescribing was implemented were due to patient education issues, physicians ignoring feedback from CDSS, and incomplete computerized knowledge base was incomplete (34%, 33%, and 33% in Indianapolis and 44%, 28%, and 28% in Boston).

CONCLUSIONS

The implementation of computerized prescribing in the ambulatory setting was not associated with any change in preventable ADEs but was associated with a decrease in potential ADEs at Indianapolis but an increase at Boston, although the absolute rate of ADEs was much lower in Boston.

The Effects of Clinical Decision Support Systems on Medication Safety: An Overview

BACKGROUND

The clinical decision support system(CDSS) has potential to improving medication safety. However, the effects of the intervention were conflicting and uncertain. Meanwhile, the reporting and methodological quality of this field were unknown.

OBJECTIVE

The aim of this overview is to evaluate the effects of CDSS on medication safety and to examine the methodological and reporting quality.

METHODS

PubMed, Embase and Cochrane Library were searched to August 2015. Systematic reviews (SRs) investigating the effects of CDSS on medication safety were included. Outcomes were determined in advance and assessed separately for process of care and patient outcomes. The methodological quality was assessed by Assessment of Multiple Systematic Reviews (AMSTAR) and the reporting quality was examined by Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA).

RESULTS

Twenty systematic reviews, consisting of 237 unique randomized controlled trials(RCTs) and 176 non-RCTs were included. Evidence that CDSS significantly impacted process of care was found in 108 out of 143 unique studies of the 16 SRs examining this effect (75%). Only 18 out of 90 unique studies of the 13 SRs reported significantly evidence that CDSS positively impacted patient outcomes (20%). Ratings for the overall scores of AMSTAR resulted in a mean score of 8.3 with a range of scores from 7.5 to 10.5. The reporting quality was varied. Some contents were particularly strong. However, some contents were poor.

CONCLUSIONS

CDSS reduces medication error by obviously improving process of care and inconsistently improving patient outcomes. Larger samples and longer-term studies are required to ensure more reliable evidence base on the effects of CDSS on patient outcomes. The methodological and reporting quality were varied and some realms need to be improved.

Evaluating the Potential Severity of Look-Alike, Sound-Alike Drug Substitution Errors in Children

OBJECTIVE

Look-alike, sound-alike (LASA) drug name substitution errors in children may pose potentially severe consequences. Our objective was to determine the degree of potential harm pediatricians ascribe to specific ambulatory LASA drug substitution errors.

METHODS

We developed a unified list of LASA pairs from published sources, removing selected drugs on the basis of preparation type (eg, injectable drugs). Using a modified Delphi method over 3 rounds, 38 practicing pediatricians estimated degree of potential harm that might occur should a patient receive the delivered drug in error and the degree of potential harm that might occur from not receiving the intended drug.

RESULTS

We identified 3550 published LASA drug pairs. A total of 1834 pairs were retained for the Delphi surveys, and 608 drug pairs were retained for round 3. Final scoring demonstrated that participants were able to identify pairs where the substitutions represented high risk of harm for receiving the delivered drug in error (eg, did not receive methylphenidate/received methadone), high risk of harm for not receiving the intended drug (eg, did not receive furosemide/received fosinopril), and pairs where the potential harm was high from not receiving the intended drug and from erroneously receiving the delivered drug (eg, did not receive albuterol/received labetalol).

CONCLUSIONS

Pediatricians have identified LASA drug substitutions that pose a high potential risk of harm to children. These results will allow future efforts to prioritize pediatric LASA errors that can be screened prospectively in outpatient pharmacies.

Small Effort, Big Payoff: Automated Maximum Dose Alerts With Hard Stops

Automated dose alerts with hard stops aid patient safety.

Modest Associations Between Electronic Health Record Use and Acute Myocardial Infarction Quality of Care and Outcomes: Results From the National Cardiovascular Data Registry

BACKGROUND

In 2009, national legislation promoted wide-spread adoption of electronic health records (EHRs) across US hospitals; however, the association of EHR use with quality of care and outcomes after acute myocardial infarction (AMI) remains unclear.

METHODS AND RESULTS

Data on EHR use were collected from the American Hospital Association Annual Surveys (2007-2010) and data on AMI care and outcomes from the National Cardiovascular Data Registry Acute Coronary Treatment and Interventions Outcomes Network Registry-Get With The Guidelines. Comparisons were made between patients treated at hospitals with fully implemented EHR (n=43 527), partially implemented EHR (n=72 029), and no EHR (n=9270). Overall EHR use increased from 82.1% (183/223) hospitals in 2007 to 99.3% (275/277) hospitals in 2010. Patients treated at hospitals with fully implemented EHRs had fewer heparin overdosing errors (45.7% versus 72.8%; P<0.01) and a higher likelihood of guideline-recommended care (adjusted odds ratio, 1.40 [confidence interval, 1.07-1.84]) compared with patients treated at hospitals with no EHR. In non-ST-segment-elevation AMI, fully implemented EHR use was associated with lower risk of major bleeding (adjusted odds ratio, 0.78 [confidence interval, 0.67-0.91]) and mortality (adjusted odds ratio, 0.82 [confidence interval, 0.69-0.97]) compared with no EHR. In ST-segment-elevation MI, outcomes did not significantly differ by EHR status.

CONCLUSIONS

EHR use has risen to high levels among hospitals in the National Cardiovascular Data Registry. EHR use was associated with less frequent heparin overdosing and modestly greater adherence to acute MI guideline-recommended therapies. In non-ST-segment-elevation MI, slightly lower adjusted risk of major bleeding and mortality were seen in hospitals implemented with full EHRs; however, in ST-segment-elevation MI, differences in outcomes were not seen.

An Evaluation of the Effects of Human Factors and Ergonomics on Health Care and Patient Safety Practices: A Systematic Review

Background

From the viewpoint of human factors and ergonomics (HFE), errors often occur because of the mismatch between the system, technique and characteristics of the human body. HFE is a scientific discipline concerned with understanding interactions between human behavior, system design and safety.

Objective

To evaluate the effectiveness of HFE interventions in improving health care workers’ outcomes and patient safety and to assess the quality of the available evidence.

Methods

We searched databases, including MEDLINE, EMBASE, BIOSIS Previews and the CBM (Chinese BioMedical Literature Database), for articles published from 1996 to Mar.2015. The quality assessment tool was based on the risk of bias criteria developed by the Cochrane Effective Practice and Organization of Care (EPOC) Group. The interventions of the included studies were categorized into four relevant domains, as defined by the International Ergonomics Association.

Results

For this descriptive study, we identified 8, 949 studies based on our initial search. Finally, 28 studies with 3,227 participants were included. Among the 28 included studies, 20 studies were controlled studies, two of which were randomized controlled trials. The other eight studies were before/after surveys, without controls. Most of the studies were of moderate or low quality. Five broad categories of outcomes were identified in this study: 1) medical errors or patient safety, 2) health care workers’ quality of working life (e.g. reduced fatigue, discomfort, workload, pain and injury), 3) user performance (e.g., efficiency or accuracy), 4) health care workers’ attitudes towards the interventions(e.g., satisfaction and preference), and 5) economic evaluations.

Conclusion

The results showed that the interventions positively affected the outcomes of health care workers. Few studies considered the financial merits of these interventions. Most of the included studies were of moderate quality. This review highlights the need for scientific and standardized guidelines regarding how HFE should be implemented in health care.

Comprehensive electronic medical record implementation levels not associated with 30-day all-cause readmissions within Medicare beneficiaries with heart failure

BACKGROUND

Regulatory standards for 30-day readmissions incentivize hospitals to improve quality of care. Implementing comprehensive electronic health record systems potentially decreases readmission rates by improving medication reconciliation at discharge, demonstrating the additional benefits of inpatient EHRs beyond improved safety and decreased errors.

OBJECTIVE

To compare 30-day all-cause readmission incidence rates within Medicare fee-for-service with heart failure discharged from hospitals with full implementation levels of comprehensive EHR systems versus those without.

METHODS

This retrospective cohort study uses data from the American Hospital Association Health IT survey and Medicare Part A claims to measure associations between hospital EHR implementation levels and beneficiary readmissions. Multivariable Cox regressions estimate the hazard ratio of 30-day all-cause readmissions within beneficiaries discharged from hospitals implementing comprehensive EHRs versus those without, controlling for beneficiary health status and hospital organizational factors. Propensity scores are used to account for selection bias.

RESULTS

The proportion of heart failure patients with 30-day all-cause readmissions was 30%, 29%, and 32% for those discharged from hospitals with full, some, and no comprehensive EHR systems. Heart failure patients discharged from hospitals with fully implemented comprehensive EHRs compared to those with no comprehensive EHR systems had equivalent 30-day readmission incidence rates (HR = 0.97, 95% CI 0.73 - 1.3).

CONCLUSIONS

Implementation of comprehensive electronic health record systems does not necessarily improve a hospital's ability to decrease 30-day readmission rates. Improving the efficiency of post-acute care will require more coordination of information systems between inpatient and ambulatory providers.

Computerized prescriber order entry in the outpatient oncology setting: from evidence to meaningful use

BACKGROUND

Chemotherapy is an effective treatment in the fight against many cancers. Medication errors in oncology can be particularly serious given the narrow therapeutic window of antineoplastic drugs and their high toxicities. Computerized prescriber order entry (cpoe) has consistently been shown to reduce medication errors and adverse drug events in various settings, but its use in the oncology setting has not been well established. To gain a better understanding of the meaningful use of cpoe systems in the outpatient chemotherapy setting, we undertook a systematic review of systemic therapy cpoe.

METHODS

A province-wide expert panel consisting of clinical experts, health information professionals, and specialists in human factors design provided guidance in the development of the research questions, search terms, databases, and inclusion criteria. The systematic review was undertaken by a core team consisting of a medical oncologist, nurse, pharmacist, and methodologist. The medline, embase, cinahl, and compendex databases were searched for relevant evidence.

RESULTS

The database searches resulted in 5642 hits, of which 9 met the inclusion criteria and were retained. In the oncology setting, cpoe systems generally reduce chemotherapy medication errors; however, specific types of errors increase with the use of cpoe. These systems affect practice both positively and negatively with respect to time, workload, and productivity.

CONCLUSIONS

Despite the paucity of oncology-specific research, cpoe should be used in outpatient chemotherapy delivery to reduce chemotherapy-related medication errors. Adoption by clinicians will be enhanced by cpoe processes that complement current practice and workflow processes.

Temporal and other factors that influence the time doctors take to prescribe using an electronic prescribing system

BACKGROUND

A computerized physician order entry (CPOE) system with embedded clinical decision support can reduce medication errors in hospitals, but might increase the time taken to generate orders.

AIMS

We aimed to quantify the effects of temporal (month, day of week, hour of shift) and other factors (grade of doctor, prior experience with the system, alert characteristics, and shift type) on the time taken to generate a prescription order.

SETTING

A large university teaching hospital using a locally developed CPOE system with an extensive audit database.

DESIGN

We retrospectively analyzed prescription orders from the audit database between August 2011 and July 2012.

RESULTS

The geometric mean time taken to generate a prescription order within the CPOE system was 11.75 s (95% CI 11.72 to 11.78). Time to prescribe was most affected by the display of high-level (24.59 s (24.43 to 24.76); p<0.001) or previously unseen (18.87 s (18.78 to 18.96); p<0.001) alerts. Prescribers took significantly less time at weekends (11.29 s (11.23 to 11.35)) than on weekdays (11.88 s (11.84 to 11.91); p<0.001), in the first (11.25 s (11.16 to 11.34); p<0.001) and final (11.56 s (11.47 to 11.66); p<0.001) hour of their shifts, and after the first month of using the system.

CONCLUSIONS

The display of alerts, prescribing experience, system familiarity, and environment all affect the time taken to generate a prescription order. Our study reinforces the need for appropriate alerts to be presented to individuals at an appropriate place in the workflow, in order to improve prescribing efficiency.

[Medical treatment of the elderly in residential care: a multicenter cross-sectional study]

OBJECTIVE

To retrospectively assess the quality of prescriptions in elderly patients prior the distribution of guidelines for geriatric drug prescriptions.

METHODS

A cross-sectional study was conducted for one day in 2012 to investigate the quality of the prescriptions in 495 residents of 8 nursing homes. A 6 items-quality score was calculated, ranging from 0 (lowest quality) to 6 (highest quality).

RESULTS

The median number of prescribed drugs was 8,5 per resident. Over a total of 4311 prescribed drugs, the average quality score was 4,96 ± 0,45; 4,54 ± 0,70 in computerized orders and 3,4 ± 1,02 in handwritten orders. Among 939 drugs considered as at high risk of inducing serious adverse reactions, monitoring was prescribed 154 times only (16,4%).

CONCLUSIONS

A lack of drug monitoring was highlighted, especially for high risk drugs. The quality of prescription may be improved by the use of computerized orders.

An internal performance assessment of CancerGene Connect: an electronic tool to streamline, measure and improve the genetic counseling process

CancerGene Connect (CGC) is a web-based program that combines the collection of family and medical history, cancer risk assessment, psychosocial assessment, report templates, a result tracking system, and a patient follow up system. The performance of CGC was assessed in several ways: pre-appointment completion data analyzed for demographic and health variables; a time study to assess overall time per case and to compare the data entry by the genetic counselor compared to the patient, and a measured quality assessment of the program via observation and interview of patients. Prior to their appointment, 52.3% of 2,414 patients completed the online patient questionnaire section of CGC. There were significant differences in completion rates among racial and ethnic groups. County hospital patients were less likely to complete the questionnaire than insured patients (p < 0.0001); and likewise uninsured patients and patients with Medicare/Medicaid were less likely to complete the questionnaire than private patients (p < 0.0001). The average genetic counseling time per case was 82 min, with no significant differences whether the counselor or the patient completed CGC. CGC reduces genetic counselor time by approximately 14-46% compared to average time per case using traditional risk assessment and documentation methods previously reported. All surveyed users felt the questionnaire was easy to understand. CGC is an effective tool that streamlines workflow, and provides a standardized data collection tool that can be used to evaluate and improve the genetic counseling process.

The effectiveness of computerized order entry at reducing preventable adverse drug events and medication errors in hospital settings: a systematic review and meta-analysis

BACKGROUND

The Health Information Technology for Economic and Clinical Health (HITECH) Act subsidizes implementation by hospitals of electronic health records with computerized provider order entry (CPOE), which may reduce patient injuries caused by medication errors (preventable adverse drug events, pADEs). Effects on pADEs have not been rigorously quantified, and effects on medication errors have been variable. The objectives of this analysis were to assess the effectiveness of CPOE at reducing pADEs in hospital-related settings, and examine reasons for heterogeneous effects on medication errors.

METHODS

Articles were identified using MEDLINE, Cochrane Library, Econlit, web-based databases, and bibliographies of previous systematic reviews (September 2013). Eligible studies compared CPOE with paper-order entry in acute care hospitals, and examined diverse pADEs or medication errors. Studies on children or with limited event-detection methods were excluded. Two investigators extracted data on events and factors potentially associated with effectiveness. We used random effects models to pool data.

RESULTS

Sixteen studies addressing medication errors met pooling criteria; six also addressed pADEs. Thirteen studies used pre-post designs. Compared with paper-order entry, CPOE was associated with half as many pADEs (pooled risk ratio (RR) = 0.47, 95% CI 0.31 to 0.71) and medication errors (RR = 0.46, 95% CI 0.35 to 0.60). Regarding reasons for heterogeneous effects on medication errors, five intervention factors and two contextual factors were sufficiently reported to support subgroup analyses or meta-regression. Differences between commercial versus homegrown systems, presence and sophistication of clinical decision support, hospital-wide versus limited implementation, and US versus non-US studies were not significant, nor was timing of publication. Higher baseline rates of medication errors predicted greater reductions (P < 0.001). Other context and implementation variables were seldom reported.

CONCLUSIONS

In hospital-related settings, implementing CPOE is associated with a greater than 50% decline in pADEs, although the studies used weak designs. Decreases in medication errors are similar and robust to variations in important aspects of intervention design and context. This suggests that CPOE implementation, as subsidized under the HITECH Act, may benefit public health. More detailed reporting of the context and process of implementation could shed light on factors associated with greater effectiveness.

Cost-effectiveness of a computerized provider order entry system in improving medication safety ambulatory care

BACKGROUND

Computerized provider order entry (CPOE) is the process of entering physician orders directly into an electronic health record. Although CPOE has been shown to improve medication safety and reduce health care costs, these improvements have been demonstrated largely in the inpatient setting; the cost-effectiveness in the ambulatory setting remains uncertain.

OBJECTIVE

The objective was to estimate the cost-effectiveness of CPOE in reducing medication errors and adverse drug events (ADEs) in the ambulatory setting.

METHODS

We created a decision-analytic model to estimate the cost-effectiveness of CPOE in a midsized (400 providers) multidisciplinary medical group over a 5-year time horizon- 2010 to 2014-the time frame during which health systems are implementing CPOE to meet Meaningful Use criteria. We adopted the medical group's perspective and utilized their costs, changes in efficiency, and actual number of medication errors and ADEs. One-way and probabilistic sensitivity analyses were conducted. Scenario analyses were explored.

RESULTS

In the base case, CPOE dominated paper prescribing, that is, CPOE cost $18 million less than paper prescribing, and was associated with 1.5 million and 14,500 fewer medication errors and ADEs, respectively, over 5 years. In the scenario that reflected a practice group of five providers, CPOE cost $265,000 less than paper prescribing, was associated with 3875 and 39 fewer medication errors and ADEs, respectively, over 5 years, and was dominant in 80% of the simulations.

CONCLUSIONS

Our model suggests that the adoption of CPOE in the ambulatory setting provides excellent value for the investment, and is a cost-effective strategy to improve medication safety over a wide range of practice sizes.

Cost-effectiveness of an electronic medication ordering system (CPOE/CDSS) in hospitalized patients

INTRODUCTION

Prescribing medication is an important aspect of almost all in-hospital treatment regimes. Besides their obviously beneficial effects, medicines can also cause adverse drug events (ADE), which increase morbidity, mortality and health care costs. Partially, these ADEs arise from medication errors, e.g. at the prescribing stage. ADEs caused by medication errors are preventable ADEs. Until now, medication ordering was primarily a paper-based process and consequently, it was error prone. Computerized Physician Order Entry, combined with basic Clinical Decision Support System (CPOE/CDSS) is considered to enhance patient safety. Limited information is available on the balance between the health gains and the costs that need to be invested in order to achieve these positive effects. Aim of this study was to study the balance between the effects and costs of CPOE/CDSS compared to the traditional paper-based medication ordering.

METHODS

The economic evaluation was performed alongside a clinical study (interrupted time series design) on the effectiveness of CPOE/CDSS, including a cost minimization and a cost-effectiveness analysis. Data collection took place between 2005 and 2008. Analyses were performed from a hospital perspective. The study was performed in a general teaching hospital and a University Medical Centre on general internal medicine, gastroenterology and geriatric wards. Computerized Physician Order Entry, combined with basic Clinical Decision Support System (CPOE/CDSS) was compared to a traditional paper based system. All costs of both medication ordering systems are based on resources used and time invested. Prices were expressed in Euros (price level 2009). Effectiveness outcomes were medication errors and preventable adverse drug events.

RESULTS

During the paper-based prescribing period 592 patients were included, and during the CPOE/CDSS period 603. Total costs of the paper-based system and CPOE/CDSS amounted to €12.37 and €14.91 per patient/day respectively. The Incremental Cost-Effectiveness Ratio (ICER) for medication errors was 3.54 and for preventable adverse drug events 322.70, indicating the extra amount (€) that has to be invested in order to prevent one medication error or one pADE.

CONCLUSIONS

CPOE with basic CDSS contributes to a decreased risk of preventable harm. Overall, the extra costs of CPOE/CDSS needed to prevent one ME or one pADE seem to be acceptable.

We work with them? Healthcare workers interpretation of organizational relations mined from electronic health records

OBJECTIVE

Models of healthcare organizations (HCOs) are often defined up front by a select few administrative officials and managers. However, given the size and complexity of modern healthcare systems, this practice does not scale easily. The goal of this work is to investigate the extent to which organizational relationships can be automatically learned from utilization patterns of electronic health record (EHR) systems.

METHOD

We designed an online survey to solicit the perspectives of employees of a large academic medical center. We surveyed employees from two administrative areas: (1) Coding & Charge Entry and (2) Medical Information Services and two clinical areas: (3) Anesthesiology and (4) Psychiatry. To test our hypotheses we selected two administrative units that have work-related responsibilities with electronic records; however, for the clinical areas we selected two disciplines with very different patient responsibilities and whose accesses and people who accessed were similar. We provided each group of employees with questions regarding the chance of interaction between areas in the medical center in the form of association rules (e.g., Given someone from Coding & Charge Entry accessed a patient's record, what is the chance that someone from Medical Information Services access the same record?). We compared the respondent predictions with the rules learned from actual EHR utilization using linear-mixed effects regression models.

RESULTS

The findings from our survey confirm that medical center employees can distinguish between association rules of high and non-high likelihood when their own area is involved. Moreover, they can make such distinctions between for any HCO area in this survey. It was further observed that, with respect to highly likely interactions, respondents from certain areas were significantly better than other respondents at making such distinctions and certain areas' associations were more distinguishable than others.

CONCLUSIONS

These results illustrate that EHR utilization patterns may be consistent with the expectations of HCO employees. Our findings show that certain areas in the HCO are easier than others for employees to assess, which suggests that automated learning strategies may yield more accurate models of healthcare organizations than those based on the perspectives of a select few individuals.

Product diversity and spectrum of choice in hospital ePrescribing Systems in England

Background

ePrescribing systems have considerable potential for improving healthcare quality and safety. With growing expectations about the benefits of such systems, there is evidence of widespread plans to implement these systems in hospitals in England where hitherto they have had a low uptake. Given the international drive away from developing home-grown to systems to procuring commercial applications, we aimed to identify available ePrescribing systems in England and to use the findings to develop a taxonomy of the systems offered by suppliers.

Methods and Findings

We undertook a scoping review of the published and grey literature, and conducted expert interviews with vendors, healthcare organisations and national ePrescribing experts in order to identify the spectrum of available systems, identify and map their key features, and then iteratively develop and validate a taxonomy of commercial ePrescribing systems available to English hospitals. There is a wide range of available systems including 13 hospital-wide applications and a range of specialty systems. These commercial applications can be grouped into four sub-categories: standalone systems, modules within integrated systems, functionalities spread over several modules, and specialty systems. The findings also reveal that apart from four packaged applications (two of which are specialty systems), all other systems have none or less than two live implementations across England.

Conclusions

The wide range of products developed in the last few years by different national and international suppliers, and the low uptake of these products by English hospitals indicate that the English ePrescribing market is still in its infancy. This market is undergoing rapid cycles of change, both with respect to the number of suppliers and their diversity of offerings. Constant renewal of knowledge is needed on the status of this evolving market, encompassing the products development and adoption, to assist implementation decisions and facilitate market maturity.

Evaluation of medium-term consequences of implementing commercial computerized physician order entry and clinical decision support prescribing systems in two 'early adopter' hospitals

OBJECTIVE

To understand the medium-term consequences of implementing commercially procured computerized physician order entry (CPOE) and clinical decision support (CDS) systems in 'early adopter' hospitals.

MATERIALS AND METHODS

In-depth, qualitative case study in two hospitals using a CPOE or a CDS system for at least 2 years. Both hospitals had implemented commercially available systems. Hospital A had implemented a CPOE system (with basic decision support), whereas hospital B invested additional resources in a CDS system that facilitated order entry but which was integrated with electronic health records and offered more advanced CDS. We used a combination of documentary analysis of the implementation plans, audiorecorded semistructured interviews with system users, and observations of strategic meetings and systems usage.

RESULTS

We collected 11 documents, conducted 43 interviews, and conducted a total of 21.5 h of observations. We identified three major themes: (1) impacts on individual users, including greater legibility of prescriptions, but also some accounts of increased workloads; (2) the introduction of perceived new safety risks related to accessibility and usability of hardware and software, with users expressing concerns that some problems such as duplicate prescribing were more likely to occur; and (3) realizing organizational benefits through secondary uses of data.

CONCLUSIONS

We identified little difference in the medium-term consequences of a CPOE and a CDS system. It is important that future studies investigate the medium- and longer-term consequences of CPOE and CDS systems in a wider range of hospitals.

Chemotherapy prescribing errors: an observational study on the role of information technology and computerized physician order entry systems

BACKGROUND

Chemotherapy administration is a high-risk process. Aim of this study was to evaluate the frequency, type, preventability, as well as potential and actual severity of outpatient chemotherapy prescribing errors in an Oncology Department where electronic prescribing is used.

METHODS

Up to three electronic prescriptions per patient record were selected from the clinical records of consecutive patients who received cytotoxic chemotherapy between January 2007 and December 2008. Wrong prescriptions were classified as incomplete, incorrect or inappropriate. Error preventability was classified using a four-point scale. Severity was defined according to the Healthcare Failure Mode and Effect Analysis Severity Scale.

RESULTS

Eight hundred and thirty-five prescriptions were eligible. The overall error rate was 20%. Excluding systematic errors (i.e. errors due to an initially faulty implementation of chemotherapy protocols into computerized dictionaries) from the analysis, the error rate decreased to 8%. Incomplete prescriptions were the majority. Most errors were deemed definitely preventable. According to error presumptive potential for damage, 72% were classified as minor; only 3% had the potential to produce major or catastrophic injury. Sixty-eight percent were classified as near misses; adverse drug events had no or little effect on clinical outcome.

CONCLUSIONS

Chemotherapy prescribing errors may arise even using electronic prescribing. Although periodic audits may be useful to detect common errors and guide corrective actions, it is crucial to get the computerized physician order entry system and set-ups correct before implementation.

On the alert: future priorities for alerts in clinical decision support for computerized physician order entry identified from a European workshop

BACKGROUND

Clinical decision support (CDS) for electronic prescribing systems (computerized physician order entry) should help prescribers in the safe and rational use of medicines. However, the best ways to alert users to unsafe or irrational prescribing are uncertain. Specifically, CDS systems may generate too many alerts, producing unwelcome distractions for prescribers, or too few alerts running the risk of overlooking possible harms. Obtaining the right balance of alerting to adequately improve patient safety should be a priority.

METHODS

A workshop funded through the European Regional Development Fund was convened by the University Hospitals Birmingham NHS Foundation Trust to assess current knowledge on alerts in CDS and to reach a consensus on a future research agenda on this topic. Leading European researchers in CDS and alerts in electronic prescribing systems were invited to the workshop.

RESULTS

We identified important knowledge gaps and suggest research priorities including (1) the need to determine the optimal sensitivity and specificity of alerts; (2) whether adaptation to the environment or characteristics of the user may improve alerts; and (3) whether modifying the timing and number of alerts will lead to improvements. We have also discussed the challenges and benefits of using naturalistic or experimental studies in the evaluation of alerts and suggested appropriate outcome measures.

CONCLUSIONS

We have identified critical problems in CDS, which should help to guide priorities in research to evaluate alerts. It is hoped that this will spark the next generation of novel research from which practical steps can be taken to implement changes to CDS systems that will ultimately reduce alert fatigue and improve the design of future systems.

Prescribing errors in hospital practice

Prescribing errors that occur in hospitals have been a source of concern for decades. This narrative review describes some of the recent work in this field. There is considerable heterogeneity in definitions and methods used in research on prescribing errors. There are three definitions that are used most frequently (one for prescribing errors specifically and two for the broader arena of medication errors), although many others have also been used. Research methods used focus primarily on investigating either the prescribing process (such as errors in the dose prescribed) or the outcomes for the patient (such as preventable adverse drug events). This complicates attempts to calculate the overall prevalence or incidence of errors. Errors have been reported in handwritten descriptions of almost 15% and with electronic prescribing of up to 8% of orders. Errors are more likely to be identified on admission to hospital than at any other time (usually failure to continue ongoing medication) and errors of dose occur most commonly throughout the patients' stay. Although there is evidence that electronic prescribing reduces the number of errors, new types of errors also occur. The literature on causes of error shows some commonality with both handwritten and electronic prescribing but there are also causes that are unique to each. A greater understanding of the prevalence of the complex causal pathways found and the differences between the pathways of minor and severe errors is necessary. Such an understanding would underpin theoretically-based interventions to reduce the occurrence of prescribing errors.

The effect of an electronic "hard-stop" alert on HIV testing rates in the emergency department

Use of electronic alerts in clinical practice has had mixed effects on providers' prescribing practices. Little research has explored the use of electronic alerts for improving screening practices. New York City has one of the highest rates of HIV in the United States. Recent New York State legislation requires healthcare providers to offer an HIV test to patients aged 13-64 years during a clinical encounter. Adhering to this requirement is particularly challenging in emergency department (ED) settings, which are frequently overcrowded and under-resourced. The purpose of this study was to evaluate the effect of an electronic "hard-stop" alert on HIV testing rates in the ED. Approximately four months of data were reviewed before and after the implementation of the alert. We found that use of the electronic alert significantly increased documentation of offering an HIV test (O.R. = 267.27, p&lt;0.001) and resulted in a significant increase in HIV testing. Findings from this study add to the current knowledge about the use of electronic alertsfor improving disease screening.

How to improve drug dosing for patients with renal impairment in primary care - a cluster-randomized controlled trial

Background

Patients with chronic kidney disease (CKD) are at increased risk for inappropriate or potentially harmful prescribing. The aim of this study was to examine whether a multifaceted intervention including the use of a software programme for the estimation of creatinine clearance and recommendation of individual dosage requirements may improve correct dosage adjustment of relevant medications for patients with CKD in primary care.

Methods

A cluster-randomized controlled trial was conducted between January and December 2007 in small primary care practices in Germany. Practices were randomly allocated to intervention or control groups. In each practice, we included patients with known CKD and elderly patients (≥70 years) suffering from hypertension. The practices in the intervention group received interactive training and were provided a software programme to assist with individual dose adjustment. The control group performed usual care. Data were collected at baseline and at 6 months. The outcome measures, analyzed across individual patients, included prescriptions exceeding recommended maximum daily doses, with the primary outcome being prescriptions exceeding recommended standard daily doses by more than 30%.

Results

Data from 44 general practitioners and 404 patients are included. The intervention was effective in reducing prescriptions exceeding the maximum daily dose per patients, with a trend in reducing prescriptions exceeding the standard daily dose by more than 30%.

Conclusions

A multifaceted intervention including the use of a software program effectively reduced inappropriately high doses of renally excreted medications in patients with CKD in the setting of small primary care practices.

Trial registration

Current Controlled Trials ISRCTN02900734

Associations between the concurrent use of clinical decision support and computerized provider order entry and the rates of appropriate prescribing at discharge

INTRODUCTION

Electronic health record systems used in conjunction with clinical decision support (CDS) or computerized provider order entry (CPOE) have shown potential in improving quality of care, yet less is known about the effects of combination use of CDS and CPOE on prescribing rates at discharge.

OBJECTIVES

This study investigates the effectiveness of combination use of CDS and CPOE on appropriate drug prescribing rates at discharge for AMI or HF patients.

METHODS

Combination use of CDS and CPOE is defined as hospitals self-reporting full implementation across all hospital units of CDS reminders, CDS guidelines, and CPOE. Appropriate prescribing rates of aspirin, ACEI/ARBs, or beta blockers are defined using quality measures from Hospital Compare. Multivariate linear regressions are used to test for differences in mean appropriate prescribing rates between hospitals reporting combination use of CDS and CPOE, compared to those reporting the singular use of one or the other, or the absence of both. Covariates include hospital size, region, and ownership status.

RESULTS

Approximately 10% of the sample reported full implementation of both CDS and CPOE, while 7% and 17% reported full use of only CPOE or only CDS, respectively. Hospitals reporting full use of CDS only reported between 0.2% (95% CI 0.04 - 1.0) and 1.6% (95% CI 0.6 - 2.6) higher appropriate prescribing rates compared to hospitals reporting use of neither system. Rates of prescribing by hospitals reporting full use of both CPOE and CDS did not significantly differ from the control group.

CONCLUSIONS

Although associations found between full implementation of CDS and appropriate prescribing rates suggest that clinical decision tools are sufficient compared to basic EHR systems in improving prescribing at discharge, the modest differences raise doubt about the clinical relevance of the findings. Future studies need to continue investigating the causal nature and clinical relevance of these associations.

Nurses' practice environments, error interception practices, and inpatient medication errors

PURPOSE

Medication errors remain a threat to patient safety. Therefore, the purpose of this study was to determine the relationships among characteristics of the nursing practice environment, nurse staffing levels, nurses' error interception practices, and rates of nonintercepted medication errors in acute care hospitals.

DESIGN

This study, using a nonexperimental design, was conducted in a sample of 82 medical-surgical units recruited from 14 U.S. acute care hospitals. Registered nurses (RNs) on the 82 units were surveyed, producing a sample of 686 staff nurses.

METHODS

Data collected for the 8-month study period included the number of medication errors per 1,000 patient days and the number of RN hours per patient day. Nurse survey data included the Practice Environment Scale of the Nursing Work Index as a measure of environmental characteristics; a metric of nurses' interception practices was developed for the study. All survey measures were aggregated to the unit level prior to analysis with hierarchical linear modeling.

FINDINGS

A supportive practice environment was positively associated with error interception practices among nurses in the sample of medical-surgical units. Importantly, nurses' interception practices were inversely associated with medication error rates.

CONCLUSIONS

A supportive practice environment enhances nurses' error interception practices. These interception practices play a role in reducing medication errors.

CLINICAL RELEVANCE

When supported by their practice environments, nurses employ practices that can assist in interrupting medication errors before they reach the patients.