Impact of a passive clinical decision support tool on potentially inappropriate medications (PIM) use in older adult patients

BACKGROUND

Medication related clinical decision support (CDS) interventions may improve patient safety. In older patient populations, there has been effort placed in reducing exposure to potentially inappropriate medications (PIMs). After years of reducing exposure of older adults in our hospitals to PIMs through multi-component interventions, our system chose to expand the scope and attempt a new strategy to lessen alert burden for providers and pharmacists. Based on the American Geriatric Society Beers Criteria and internal data, a passive CDS approach, termed "geriatric context" was established to recommend appropriate medication selection including lower dosage amounts and frequency of administration in older adults.

METHODS

Retrospective descriptive study examining change in a pre and post implementation analysis of medication usage patterns between two 9-month time periods in 2019 and 2021 in patients age ≥65 years across an 8-hospital health system. The primary endpoint is the percentage of each medication intervened with an ordered dose and frequency outside of alignment with recommended context parameters. Secondary endpoints include total daily dose (TDD) and average dose (AD) per patient of the individual PIMs. Exploratory endpoints include frequency of active alerts fired by the CPOE and overridden by providers.

RESULTS

A total of 62,738 older adult hospital admissions are included in the overall study period, with 32,969 pre-implementation and 29,769 post-implementation. Haloperidol showed the greatest reduction in inappropriate doses from 41.5% to 21.4% (p < 0.001) of orders, followed by reduction in inappropriate frequencies in orders for diphenhydramine from 57.2% to 39.7% (p < 0.001). Secondary endpoints showed favorable reductions across 11 of the 16 medications in both TDD and AD administered. Exploratory analysis with select medications showed reductions in frequency of alerts fired and overridden.

CONCLUSIONS

Utilization of a passive CDS positively influences prescribing patterns for older adults and reduces the alert burden to ordering providers.

A systematic review of data elements of computerized physician order entry (CPOE): mapping the data to FHIR

OBJECTIVE

Medication errors are the third leading cause of death. There are several methods to prevent prescription errors, one of which is to use a Computerized Physician Order Entry system (CPOE). In a CPOE system, necessary data needs to be collected so that making decisions about prescribing medications and treatment plans could be made. Although many CPOE systems have been developed worldwide, studies have yet to identify the necessary data and data elements of CPOE systems. This study aims to identify data elements of CPOE and standardize these data with Fast Healthcare Interoperability Resources (FHIR) to facilitate data sharing and integration with the electronic health record (EHR) system and reduce data diversity.

METHODS

PubMed, Web of Science, Embase, and Scopus databases for studies up to October 2019 were searched. Two reviewers independently assessed original articles to determine eligibility for inclusion in this review. All articles describing data elements of a COPE system were included. Data elements were obtained from the included articles' text, tables, and figures.Classification of the extracted data elements and mapping them to FHIR was done to facilitate data sharing and integration with the electronic health record (EHR) system and reduce data diversity. The final data elements of CPOE were categorized into five main categories of FHIR (foundation, base, clinical, financial, and specialized) and 146 resources, where possible. One of the researchers did mapping and checked and verified by the second researcher. If a data element could not be mapped to any FHIR resources, this data element was considered an extension to the most relevant resource.

RESULTS

We retrieved 5162 articles through database searches. After the full-text assessment, 21 articles were included. In total, 270 data elements were identified and mapped to the FHIR standard. These elements have been reported in 26 FHIR resources of 146 ones (18%). In total, 71 data elements were considered an extension.

CONCLUSIONS

The results of this study showed that the same data elements were not used in the CPOE systems, and the degree of homogeneity of these systems is limited. The mapping of extracted data with data elements used in the FHIR standard shows the extent to which these systems comply with existing standards. Considering the standards in these systems' design helps developers design more coherent systems that can share data with other systems.

Developing a minimum data set for cardiovascular Computerized Physician Order Entry (CPOE) and mapping the data set to FHIR: A multi-method approach

Many medical errors occur in the process of treating cardiovascular patients, and most of these errors are related to prescription errors. There are several, one of the methods to prevent prescription errors is the use of a computerized physician order entry (CPOE) system. One of the obstacles of implementing this system is improper design and non-compliance with user needs. one of the issues that should be considered in designing information systems is having a standard minimum data set (MDS). Although many computerized physicians order entry (CPOE) systems have been developed in the world, no study has identified the necessary data and minimum data set (MDS) of CPOE system, and published the process of creating this MDS. This study aimed to develop an MDS for cardiovascular CPOE and standardize it with Fast Healthcare Interoperability Resources (FHIR). A multi-method approach including systematic review for identifying data elements of CPOE, reviewing the content of medical records, validation of the data elements using the expert panel and, determination of the necessary data elements using a survey was conducted. Classification of the data elements and mapping them to FHIR were done to facilitate data sharing and integration with the electronic health record (EHR) system as well as to reduce data diversity. The final data elements of MDS were categorized into 5 main categories of FHIR (foundation, base, clinical, financial, and specialized) and 146 resources, where possible. Mapping was done by one of the researchers and checked and verified by the second researcher. Non-mapped data elements were added to relevant resources as extensions of existing FHIR resources. In total, 270 data elements were identified from the systematic review. After reviewing the content of 20 patients' medical records, 28 data elements were identified. After combination of data elements of two previous phases and removing duplication, 282 data elements remained. Data elements that were considered necessary to be included in CPOE by conducting a survey among cardiovascular physicians were 109 elements. From 146 resources of FHIR, the data elements of this MDS are covered by 5 resources. This study introduced an MDS for cardiovascular CPOE by combining suggested data elements of previous research, and the practical and local requirements identified in patients' medical records. To facilitate data sharing and integration with EHR, reduce data diversity, and also to categorize data, this MDS was standardized with FHIR. The steps we used to develop this MDS could be a model for creating MDS in other CPOEs and health information systems. This is the first time that the process of developing an MDS for cardiovascular CPOE has been presented in the literature.

Prescribing errors in children: what is the impact of a computerized physician order entry?

Prescribing errors represent a safety risk for hospitalized patients, especially in pediatrics. Computerized physician order entry (CPOE) might reduce prescribing errors, although its effect has not yet been thoroughly studied on pediatric general wards. This study investigated the impact of a CPOE on prescribing errors in children on general wards at the University Children's Hospital Zurich. We performed medication reviews on a total of 1000 patients before and after the implementation of a CPOE. The CPOE included limited clinical decision support (CDS) such as drug-drug interaction check and checks for duplicates. Prescribing errors, their type according to the PCNE classification, their severity (adapted NCC MERP index), as well as the interrater reliability (Cohen's kappa), were analyzed. Potentially harmful errors were significantly reduced from 18 errors/100 prescriptions (95% CI: 17-20) to 11 errors/100 prescriptions (95% CI: 9-12) after CPOE implementation. A large number of errors with low potential for harm (e.g., "missing information") was reduced after the introduction of the CPOE, and consequently, the overall severity of potential harm increased post-CPOE. Despite general error rate reduction, medication reconciliation problems (PCNE error 8), such as drugs prescribed on paper as well as electronically, significantly increased after the introduction of the CPOE. The most common pediatric prescribing errors, the dosing errors (PCNE errors 3), were not altered on a statistically significant level after the introduction of the CPOE. Interrater reliability showed moderate agreement (Κ = 0.48).  Conclusion: Patient safety increased by reducing the rate of prescribing errors after CPOE implementation. The reason for the observed increase in medication reconciliation problems might be the hybrid system with remaining paper prescriptions for special medication. The lacking effect on dosing errors could be explained by the fact that a web application CDS covering dosing recommendations (PEDeDose) was already in use before the implementation of the CPOE. Further investigations should focus on eliminating hybrid systems, interventions to increase the usability of the CPOE, and full integration of CDS tools such as automated dose checks into the CPOE. What is Known: • Prescribing errors, especially dosing errors, are a common safety threat for pediatric inpatients. •The introduction of a CPOE may reduce prescribing errors, though pediatric general wards are poorly studied. What is New: •To our knowledge, this is the first study on prescribing errors in pediatric general wards in Switzerland investigating the impact of a CPOE. •We found that the overall error rate was significantly reduced after the implementation of the CPOE. The severity of potential harm was higher in the post-CPOE period, which implies that low-severity errors were substantially reduced after CPOE implementation. Dosing errors were not reduced, but missing information errors and drug selection errors were reduced. On the other hand, medication reconciliation problems increased.

Key factors of clinicians' acceptance of CPOE system and their link to change management

The successful implementation of a Computerized Provider Order Entry (CPOE) system is a challenging process for any healthcare organization. It requires a dramatic change not only to the way the care is provided but also to the way clinicians work. Because of the required change complexity, organizations must consider key factors of clinicians' acceptance to avoid resistance and maximize chances of success. This paper aims to identify the different factors that affect clinicians' acceptance of CPOE systems and their relation to existing change management models. A systematic literature review was conducted to identify barriers and recommendations to the clinicians' acceptance of CPOE systems. Then, a comparative analysis was used to explain the relationship between the discovered factors and change management, with a focus on Kotter's model. The review included 23 articles. A total of 28 barriers and 25 recommendations have been identified. In conclusion, factors of clinicians' acceptance fall into two categories: one related to the used implementation strategy and the other related to how the system was designed. Most of the factors are similar to change management principles. The systematic incorporation of change management principles during CPOE implementation would likely improve clinicians' acceptance of the system.

Design, Implementation, and Evaluation of Compliance With Pharmacy Workflow During a Pediatric Oncology Computerized Provider Order Entry (CPOE) Launch

OBJECTIVE

There is a lack of published literature detailing how computerized physician order entry (CPOE) pharmacy workflow is designed and implemented. The intent of this project was to design, implement, and assess compliance with the pharmacy workflow required for launching CPOE to improve the safety and efficiency of chemotherapy order entry for pediatric patients.

METHODS

This process implementation project took place in 2 phases, which included the design and implementation of pharmacy workflow education, and retrospective chart review of patients who received chemotherapy ordered through CPOE. An anonymous survey was also distributed to pharmacy staff, nurses, and physicians, and an assessment of any CPOE-related safety reports was completed.

RESULTS

Eighty-three patients received intravenous and/or intrathecal chemotherapy ordered via the CPOE software, Beacon, within the electronic medical record system, Epic, in the first 30 days post-launch across both the inpatient and outpatient settings. Overall compliance with the CPOE workflow for entering chemotherapy plans was 77% and >66% compliance with the order preparation process. Pharmacists provided an average of 1.6 interventions per review. The pharmacy was able to prepare chemotherapy within the allotted institutional time benchmarks in most cases. An overall combined multidisciplinary survey response rate of 30.6% was achieved. Twenty-eight Beacon-related patient safety reports were filed in the first 2 weeks post-launch.

CONCLUSIONS

The Beacon launch at this single pediatric institution was successful, and the pharmacy workflow was shown to greatly affect the overall success of the launch of CPOE. The careful prospective design, education, implementation, and retrospective review of the pharmacy workflow is key to process implementation related to chemotherapy CPOE.

Risk factors associated with medication ordering errors

OBJECTIVE

We utilized a computerized order entry system-integrated function referred to as "void" to identify erroneous orders (ie, a "void" order). Using voided orders, we aimed to (1) identify the nature and characteristics of medication ordering errors, (2) investigate the risk factors associated with medication ordering errors, and (3) explore potential strategies to mitigate these risk factors.

MATERIALS AND METHODS

We collected data on voided orders using clinician interviews and surveys within 24 hours of the voided order and using chart reviews. Interviews were informed by the human factors-based SEIPS (Systems Engineering Initiative for Patient Safety) model to characterize the work systems-based risk factors contributing to ordering errors; chart reviews were used to establish whether a voided order was a true medication ordering error and ascertain its impact on patient safety.

RESULTS

During the 16-month study period (August 25, 2017, to December 31, 2018), 1074 medication orders were voided; 842 voided orders were true medication errors (positive predictive value = 78.3 ± 1.2%). A total of 22% (n = 190) of the medication ordering errors reached the patient, with at least a single administration, without causing patient harm. Interviews were conducted on 355 voided orders (33% response). Errors were not uniquely associated with a single risk factor, but the causal contributors of medication ordering errors were multifactorial, arising from a combination of technological-, cognitive-, environmental-, social-, and organizational-level factors.

CONCLUSIONS

The void function offers a practical, standardized method to create a rich database of medication ordering errors. We highlight implications for utilizing the void function for future research, practice and learning opportunities.

Implementation of a Computerized Provider Order Entry System in a Pediatric Hospital in Canada

The Centre Hospitalier Universitaire Sainte-Justine (Montreal, Canada) is a pediatric academic tertiary hospital that has begun the implementation of a commercial computerized provider order entry system (CPOE) in October 2019. The objectives of this paper are 1) to estimate the impact of the CPOE system on medication errors, and 2) to identify vulnerability issues related to the configuration of the CPOE system's design. Using a pre-post implementation methodology measuring medication errors captured by clinical pharmacists revealed that the implementation of a CPOE has eliminated all prescription conformity (e.g., missing fields) and legibility errors. Pharmacists have continued to detect medication errors, especially inappropriate dosing instructions, and to intervene in similar clinical situations (medication reconciliation, deprescribing, adjusting orders). Additionally, the vulnerability analysis, based on typical clinical order test cases in an inpatient pediatric setting, highlighted the need to configure a clinical decision support system that can identify inappropriate dosing instructions for pediatric patients.

Physicians' Use of the Computerized Physician Order Entry System for Medication Prescribing: Systematic Review

BACKGROUND

Computerized physician order entry (CPOE) systems in health care settings have many benefits for prescribing medication, such as improved quality of patient care and patient safety. However, to achieve their full potential, the factors influencing the usage of CPOE systems by physicians must be identified and understood.

OBJECTIVE

The aim of this study is to identify the factors influencing the usage of CPOE systems by physicians for medication prescribing in their clinical practice.

METHODS

We conducted a systematic search of the literature on this topic using four databases: PubMed, CINAHL, Ovid MEDLINE, and Embase. Searches were performed from September 2019 to December 2019. The retrieved papers were screened by examining the titles and abstracts of relevant studies; two reviewers screened the full text of potentially relevant papers for inclusion in the review. Qualitative, quantitative, and mixed methods studies with the aim of conducting assessments or investigations of factors influencing the use of CPOE for medication prescribing among physicians were included. The identified factors were grouped based on constructs from two models: the unified theory of acceptance and use of technology model and the Delone and McLean Information System Success Model. We used the Mixed Method Appraisal Tool to assess the quality of the included studies and narrative synthesis to report the results.

RESULTS

A total of 11 articles were included in the review, and 37 factors related to the usage of CPOE systems were identified as the factors influencing how physicians used CPOE for medication prescribing. These factors represented three main themes: individual, technological, and organizational.

CONCLUSIONS

This study identified the common factors that influenced the usage of CPOE systems by physicians for medication prescribing regardless of the type of setting or the duration of the use of a system by participants. Our findings can be used to inform implementation and support the usage of the CPOE system by physicians.

Impact of computerised physician order entry (CPOE) on the incidence of chemotherapy-related medication errors: a systematic review

Purpose

Computerised prescriber (or physician) order entry (CPOE) implementation is one of the strategies to reduce medication errors. The extent to which CPOE influences the incidence of chemotherapy-related medication errors (CMEs) was not previously collated and systematically reviewed. Hence, this study was designed to collect, collate, and systematically review studies to evaluate the effect of CPOE on the incidence of CMEs.

Methods

A search was performed of four databases from 1 January 1995 until 1 August 2019. English-language studies evaluating the effect of CPOE on CMEs were selected as per inclusion and exclusion criteria. The total CMEs normalised to total prescriptions pre- and post-CPOE were extracted and collated to perform a meta-analysis using the ‘meta’ package in R. The systematic review was registered with PROSPERO CRD42018104220.

Results

The database search identified 1621 studies. After screening, 19 studies were selected for full-text review, of which 11 studies fulfilled the selection criteria. The meta-analysis of eight studies with a random effects model showed a risk ratio of 0.19 (95% confidence interval: 0.08–0.44) favouring CPOE (I² = 99%).

Conclusion

The studies have shown consistent reduction in CMEs after CPOE implementation, except one study that showed an increase in CMEs. The random effects model in the meta-analysis of eight studies showed that CPOE implementation reduced CMEs by 81%.

Supplementary Information

The online version contains supplementary material available at 10.1007/s00228-021-03099-9.

Antibiotics Prescription Over Three Years in a French Benchmarking Network of 23 Level 3 Neonatal Wards

Introduction: Prescribing antibiotics to newborns is challenging, as excess antibiotics are a risk factor for increased morbidity and mortality. The objective of this study was to describe the evolution of antibiotic exposure over three years in a large network of level 3 neonatal wards where each center is informed yearly of its own results and the results of other centers and has full autonomy to improve its performance.

Patients and Methods: This is a prospective, observational study of antibiotics prescriptions over the 2017–2019 period in a network of 23 French level 3 neonatal wards. The network relied on an internal benchmarking program based on a computerized prescription ordering system. Among others, antibiotics exposure, treatment duration, and antibiotics spectrum index were analyzed.

Results: The population consisted of 39,971 neonates (51.5% preterm), 44.3% of which were treated with antibiotics. Of the treated patients, 78.5% started their first antibiotic treatment in the first three days of life. Antibiotic exposure rate significantly declined from 2017 to 2019 (from 46.8% to 42.8%, p < 0.0001); this decline was significant in groups with gestational age >26 weeks, but not in the group with extremely low gestational age <27 weeks. Gentamicin, cefotaxime, amoxicillin (ampicillin), vancomycin, and amikacin were the antibiotics most prescribed. The lower the gestational age, the higher the exposure for cefotaxime, vancomycin, and amikacin. Compared to 2017, cefotaxime exposure in 2019 declined by 12.6%, but the change was only significant in the gestational age group of 32–36 weeks (17.4%) and at term (20.3%). The triple combination of antibiotics in the first three days decreased by 28.8% from 2017 to 2019, and this was significant in each gestational age group. During the study, the delayed ending of antibiotics in unconfirmed early-onset neonatal infection increased from 9.6% to 11.9%.

Conclusion: This study showed that a strategy characterized by the collection of information via a computerized order-entry system, analysis of the results by a steering committee representative of all neonatal wards, and complete autonomy of neonatal wards in the choice of prescription modalities, is associated with a significant reduction in the use of antibiotics in newborns with gestational age greater than 26 weeks.

The impact of health information technology on prescribing errors in hospitals: a systematic review and behaviour change technique analysis

BACKGROUND

Health information technology (HIT) is known to reduce prescribing errors but may also cause new types of technology-generated errors (TGE) related to data entry, duplicate prescribing, and prescriber alert fatigue. It is unclear which component behaviour change techniques (BCTs) contribute to the effectiveness of prescribing HIT implementations and optimisation. This study aimed to (i) quantitatively assess the HIT that reduces prescribing errors in hospitals and (ii) identify the BCTs associated with effective interventions.

METHODS

Articles were identified using CINAHL, EMBASE, MEDLINE, and Web of Science to May 2020. Eligible studies compared prescribing HIT with paper-order entry and examined prescribing error rates. Studies were excluded if prescribing error rates could not be extracted, if HIT use was non-compulsory or designed for one class of medication. The Newcastle-Ottawa scale was used to assess study quality. The review was reported in accordance with the PRISMA and SWiM guidelines. Odds ratios (OR) with 95% confidence intervals (CI) were calculated across the studies. Descriptive statistics were used to summarise effect estimates. Two researchers examined studies for BCTs using a validated taxonomy. Effectiveness ratios (ER) were used to determine the potential impact of individual BCTs.

RESULTS

Thirty-five studies of variable risk of bias and limited intervention reporting were included. TGE were identified in 31 studies. Compared with paper-order entry, prescribing HIT of varying sophistication was associated with decreased rates of prescribing errors (median OR 0.24, IQR 0.03-0.57). Ten BCTs were present in at least two successful interventions and may be effective components of prescribing HIT implementation and optimisation including prescriber involvement in system design, clinical colleagues as trainers, modification of HIT in response to feedback, direct observation of prescriber workflow, monitoring of electronic orders to detect errors, and system alerts that prompt the prescriber.

CONCLUSIONS

Prescribing HIT is associated with a reduction in prescribing errors in a variety of hospital settings. Poor reporting of intervention delivery and content limited the BCT analysis. More detailed reporting may have identified additional effective intervention components. Effective BCTs may be considered in the design and development of prescribing HIT and in the reporting and evaluation of future studies in this area.

A qualitative study of prescribing errors among multi-professional prescribers within an e-prescribing system

Background Computerised Physician Order Entry (CPOE) is considered to enhance the safety of prescribing. However, it can have unintended consequences and new forms of prescribing error have been reported. Objective The aim of this study was to explore the causes and contributing factors associated with prescribing errors reported by multidisciplinary prescribers working within a CPOE system. Main Outcome Measure Multidisciplinary prescribers experience of prescribing errors in an CPOE system. Method This qualitative study was conducted in a hospital with a well-established CPOE system. Semi-structured qualitative interviews were conducted with prescribers from the professions of pharmacy, nursing, and medicine. Interviews analysed using a mixed inductive and deductive approach to develop a framework for the causes of error. Results Twenty-three prescribers were interviewed. Six main themes influencing prescribing were found: the system, the prescriber, the patient, the team, the task of prescribing and the work environment. Prominent issues related to CPOE included, incorrect drug name picking, default auto-population of dosages, alert fatigue and remote prescribing. These interacted within a complex prescribing environment. No substantial differences in the experience of CPOE were found between the professions. Conclusion Medical and non-medical prescribers have similar experiences of prescribing errors when using CPOE, aligned with existing published literature about medical prescribing. Causes of electronic prescribing errors are multifactorial in nature and prescribers describe how factors interact to create the conditions errors. While interventions should focus on direct CPOE issues, such as training and design, socio-technical, and environmental aspects of practice remain important.

Impact of an electronic health record on task time distribution in a neonatal intensive care unit

BACKGROUND

An Electronic Health Record (EHR) has been introduced to four Irish maternity units, with further implementations planned. Previous studies indicate that healthcare professionals are concerned that EHRs may increase time spent on documentation and medication-related tasks.

OBJECTIVE

To determine the impact of an EHR on task time distribution in a Neonatal Intensive Care Unit (NICU).

METHODS

A pre-post, time and motion study. An electronic data collection tool was used to collate time spent on direct care, professional communication, reviewing charts, documentation, and medication-related tasks. Interruptions and contact with the patient zone were quantified. Statistical significance was assessed using two-sample proportion tests, two-sample t-tests, and two-sample Wilcoxon rank-sum tests. A Bonferroni correction set significance at p ≤ 0.0025.

RESULTS

63 doctors and nurses participated, with 169.23 h of data collected. There were no significant changes to nurses' task time distribution. The proportion of time spent by doctors on professional communication increased from 15.4% to 26.0% (p < 0.001). Significant increases to median task times were seen for both doctors and nurses. Interruptions to tasks decreased post-implementation (p < 0.001), as did frequency of contact with the patient zone (p < 0.001).

CONCLUSION

The EHR did not redistribute time towards documentation and medication-related tasks. A reduction in interruptions to tasks may streamline workflow. Decreased contact with the patient zone may improve patient safety through reduced potential for pathogen transmission.

Trends in the use of computerized physician order entry by health-system affiliated ambulatory clinics in the United States, 2014-2016

BACKGROUND

Computerized provider order entry (CPOE) can help providers deliver better quality care. We aimed to understand recent trends in use of CPOE by health system-affiliated ambulatory clinics.

METHODS

We analyzed longitudinal data (2014-2016) for 19,109 ambulatory clinics that participated in all 3 years of the Healthcare Information and Management Systems Society Analytics survey to assess use of CPOE and identify characteristics of clinics associated with CPOE use. We calculated descriptive statistics to examine overall trends in use, location of order entry (bedside vs. clinical station), and system-level use CPOE across all clinics. We used linear probability models to explore the association between clinic characteristics (practice size, practice type, and health system type) and two outcomes of interest: CPOE use at any point between 2014 and 2016, and CPOE use beginning in 2015 or 2016.

RESULTS

Between 2014 and 2016, use of CPOE increased more than 9 percentage points from 58 to 67%. Larger clinics and those affiliated with multi-hospital health systems were more likely to have reported use of CPOE. We found no difference in CPOE use by primary care versus specialty care clinics. When used, most clinics reported using CPOE for most or all of their orders. Health systems that used CPOE usually did so for all system-affiliated clinics.

CONCLUSIONS

Small practice size or not being part of a multi-hospital system are associated with lower use of CPOE between 2014 and 2016. Less than optimal use in these environments may be harming patient outcomes.

Challenges of In-House Development and Implementation of a CPOE for Oncology

Hospital Italiano de Buenos Aires (HIBA) is an academic tertiary care hospital highly specialized that has started the process of informatization of chemotherapy protocols. The objective is to describe the development of a computerized physician order entry (CPOE) oriented to the oncology adult patient and the members of the healthcare team that works with him (physicians, pharmacists, nurses and administrative staf) to improve the process and prevent errors at a critical point in the patient's health care: during prescription, preparation and / or administration. The development of this system consisted of several stages: inquiries about the usual work and perception of needs of the potential users; user-centered design; interoperability with the electronic health record (EHR) and development of a final prototype.

How often do prescribers include indications in drug orders? Analysis of 4 million outpatient prescriptions

PURPOSE

To examine the extent to which outpatient clinicians currently document drug indications in prescription instructions.

METHODS

Free-text sigs were extracted from all outpatient prescriptions generated by the computerized prescriber order entry system of a major academic institution during a 5-year period. Natural language processing was used to identify drug indications. The data set was analyzed to determine the rates at which prescribers included indications. It was stratified by provider specialty, drug class, and specific medications, to determine how often these indications were in prescriptions for as-needed (PRN) versus non-PRN medications.

RESULTS

During the study period, 4,356,086 prescriptions were ordered. Indications were included in 322,961 orders (7.41%). From these orders, 249,262 indications (77.18%) were written for PRN orders. Although internal medicine prescribers generated the highest number of medication orders, they included indications in only 6.26% of their prescriptions, whereas orthopedic surgery providers had the highest rate of documenting indications (33.41%). Pain was the most common indication, accounting for 30.35% of all documented indications. The drug class with the highest number of sigs-containing indications was narcotic analgesics. Non-PRN chronic medication prescriptions rarely included the indication.

CONCLUSION

Prescribers rarely included drug indications in electronic free-text prescription instructions, and, when they did, it was mostly for PRN uses such as pain.

An experimental investigation of the impact of alert frequency and relevance on alert dwell time

AIM

This study aimed to determine the impact of alert frequency and relevance on alert dwell time.

METHOD

A 2 × 3 design was used where 127 university students completed 60 prescribing tasks and were presented with a variable frequency of computerized alerts (low, medium and high) with variable relevance (low and high). Participants were instructed to override an alert if it was not relevant to their prescription, and to cancel the order if the alert signalled an error in their order.

RESULTS

Participants presented with a small number of alerts spent more time attending to alert content than participants presented with a medium or high number of alerts (respectively median 15.6 s vs 10.8 vs 10.2 s). Alert relevance had no impact on alert dwell time. Alerts requiring an override response were 4.5 times more likely to be correctly actioned than alerts requiring the order to be cancelled.

DISCUSSION

Dwell time was influenced by alert frequency, with greater exposure to alerts associated with shorter dwell times. We hypothesize that this was because participants came to learn that spending time on alert information was unnecessary. We propose that when users experience no consequences or feedback from overriding alerts they quickly learn that this action is more efficient and so more rewarding than taking any other action.

Effect of Electronic Prescribing Strategies on Medication Error and Harm in Hospital: a Systematic Review and Meta-analysis

BACKGROUND

Computerized physician order entry and clinical decision support systems are electronic prescribing strategies that are increasingly used to improve patient safety. Previous reviews show limited effect on patient outcomes. Our objective was to assess the impact of electronic prescribing strategies on medication errors and patient harm in hospitalized patients.

METHODS

MEDLINE, EMBASE, CENTRAL, and CINAHL were searched from January 2007 to January 2018. We included prospective studies that compared hospital-based electronic prescribing strategies with control, and reported on medication error or patient harm. Data were abstracted by two reviewers and pooled using random effects model. Study quality was assessed using the Effective Practice and Organisation of Care and evidence quality was assessed using Grading of Recommendations Assessment, Development, and Evaluation.

RESULTS

Thirty-eight studies were included; comprised of 11 randomized control trials and 27 non-randomized interventional studies. Electronic prescribing strategies reduced medication errors (RR 0.24 (95% CI 0.13, 0.46), I² 98%, n = 11) and dosing errors (RR 0.17 (95% CI 0.08, 0.38), I² 96%, n = 9), with both risk ratios significantly affected by advancing year of publication. There was a significant effect of electronic prescribing strategies on adverse drug events (ADEs) (RR 0.52 (95% CI 0.40, 0.68), I² 0%, n = 2), but not on preventable ADEs (RR 0.55 (95% CI 0.30, 1.01), I² 78%, n = 3), hypoglycemia (RR 1.03 (95% CI 0.62-1.70), I² 28%, n = 7), length of stay (MD - 0.18 (95% - 1.42, 1.05), I² 94%, n = 7), or mortality (RR 0.97 (95% CI 0.79, 1.19), I² 74%, n = 9). The quality of evidence was rated very low.

DISCUSSION

Electronic prescribing strategies decrease medication errors and adverse drug events, but had no effect on other patient outcomes. Conservative interpretations of these findings are supported by significant heterogeneity and the preponderance of low-quality studies.

Ordering Patterns and Costs of Specialized Laboratory Testing by Hospitalists and House Staff in Hospitalized Patients With HIV at a County Hospital: An Opportunity for Diagnostic Stewardship

Background

Inpatient HIV care often requires specialized laboratory testing with which practitioners may not be familiar. In addition, computerized physician order entry allows for ordering tests without understanding test indications, but it can also provide a venue for education and diagnostic stewardship.

Methods

All charts of HIV-positive patients hospitalized at a tertiary care public safety net hospital in Houston, Texas, between January 1, 2014, and June 30, 2014, were reviewed for a set list of laboratory tests. Appropriateness of test ordering was assessed by 2 providers. Cost estimates for each test were obtained from Medicaid and a national nonprofit health care charge database.

Results

A total of 274 HIV-positive patients were admitted 429 times in the 6-month study period. During the study period, 45% of the study laboratory tests ordered were not indicated. A total of 532 hepatitis serologies were ordered, only 52% of which were indicated. Overall, 71 serum qualitative cytomegalovirus (CMV) polymerase chain reactions (PCRs) and eight CMV quantitative PCRs were ordered, with most (85%) qualitative PCRs ordered for nonspecific signs of infection (eg, fever). Other tests ordered without clear indications included Aspergillus IgE (7), serum Epstein-Barr virus (EBV) PCR (5), parvovirus serology (7), and Toxoplasma IgM (18). Overall, the estimated laboratory cost of inappropriate testing over the study period was between $14 000 and $92 000, depending on which cost database was used.

Conclusions

Many tests ordered in HIV-positive inpatients do not have indications, representing a substantial source of health care waste and cost and potentially leading to inappropriate treatment. Opportunities exist to decrease waste through education of trainees and hospitalists and through implementation of diagnostic stewardship via the electronic medical record.

Implementation of an integrated computerized prescriber order-entry system for chemotherapy in a multisite safety-net health system

PURPOSE

The development of a computerized prescriber order-entry (CPOE) system for chemotherapy in a multisite safety-net health system and the challenges to its successful implementation are described.

SUMMARY

Before CPOE for chemotherapy was first implemented and embedded in the electronic medical record system of Harris Health System (HHS), pharmacy personnel relied on regimen-specific preprinted order sets. However, due to differences in practice styles and workflow logistics, the paper orders across the 3 facilities were mostly site specific, with varying clinical content. Many of these order sets had not been approved by the oncology subcommittee. In addition, disparities in clinical knowledge and lack of communication contributed to inconsistencies in order set development. Led by medical directors from medical oncology departments at the 3 facilities, pharmacy administrators, and information technology representatives, HHS committed resources to supporting the adoption and use of a CPOE system for chemotherapy. Five practical lessons of broad applicability have been learned: engagement of interprofessional stakeholders, optimization of workflow before CPOE implementation, requirement of verification tool for CPOE, consolidation of protocols, and commitment to ongoing training and support. Evaluation of the CPOE system demonstrated a systemwide reduction in medication errors by 75% (p < 0.05). Satisfaction with the CPOE system varied among sites and was unchanged institutionwide 6 months after the CPOE implementation.

CONCLUSION

The development and implementation of CPOE for chemotherapy at a multisite safety-net health system created opportunities to optimize patient care and reduce variations through interprofessional collaborations. Initial evaluation suggested that CPOE reduced the medication-order error rate and improved user satisfaction in 1 of 3 facilities.

Orders on file but no labs drawn: investigation of machine and human errors caused by an interface idiosyncrasy

In this report, we describe 2 instances in which expert use of an electronic health record (EHR) system interfaced to an external clinical laboratory information system led to unintended consequences wherein 2 patients failed to have laboratory tests drawn in a timely manner. In both events, user actions combined with the lack of an acknowledgment message describing the order cancellation from the external clinical system were the root causes. In 1 case, rapid, near-simultaneous order entry was the culprit; in the second, astute order management by a clinician, unaware of the lack of proper 2-way interface messaging from the external clinical system, led to the confusion. Although testing had shown that the laboratory system would cancel duplicate laboratory orders, it was thought that duplicate alerting in the new order entry system would prevent such events.

Alert override as a habitual behavior - a new perspective on a persistent problem

Quantifying alert override has been the focus of much research in health informatics, with override rate traditionally viewed as a surrogate inverse indicator for alert effectiveness. However, relying on alert override to assess computerized alerts assumes that alerts are being read and determined to be irrelevant by users. Our research suggests that this is unlikely to be the case when users are experiencing alert overload. We propose that over time, alert override becomes habitual. The override response is activated by environmental cues and repeated automatically, with limited conscious intention. In this paper we outline this new perspective on understanding alert override. We present evidence consistent with the notion of alert override as a habitual behavior and discuss implications of this novel perspective for future research on alert override, a common and persistent problem accompanying decision support system implementation.

Automated identification of antibiotic overdoses and adverse drug events via analysis of prescribing alerts and medication administration records

Objectives

Electronic trigger detection tools hold promise to reduce Adverse drug event (ADEs) through efficiencies of scale and real-time reporting. We hypothesized that such a tool could automatically detect medication dosing errors as well as manage and evaluate dosing rule modifications.

Materials and Methods

We created an order and alert analysis system that identified antibiotic medication orders and evaluated user response to dosing alerts. Orders associated with overridden alerts were examined for evidence of administration and the delivered dose was compared to pharmacy-derived dosing rules to confirm true overdoses. True overdose cases were reviewed for association with known ADEs.

Results

Of 55 546 orders reviewed, 539 were true overdose orders, which lead to 1965 known overdose administrations. Documentation of loose stools and diarrhea was significantly increased following drug administration in the overdose group. Dosing rule thresholds were altered to reflect clinically accurate dosing. These rule changes decreased overall alert burden and improved the salience of alerts.

Discussion

Electronic algorithm-based detection systems can identify antibiotic overdoses that are clinically relevant and are associated with known ADEs. The system also serves as a platform for evaluating the effects of modifying electronic dosing rules. These modifications lead to decreased alert burden and improvements in response to decision support alerts.

Conclusion

The success of this test case suggests that gains are possible in reducing medication errors and improving patient safety with automated algorithm-based detection systems. Follow-up studies will determine if the positive effects of the system persist and if these changes lead to improved safety outcomes.

Impact of computerized provider order entry (CPOE) on length of stay and mortality

Objective: To examine changes in patient outcome variables, length of stay (LOS), and mortality after implementation of computerized provider order entry (CPOE).

Materials and Methods: A 5-year retrospective pre-post study evaluated 66 186 patients and 104 153 admissions (49 683 pre-CPOE, 54 470 post-CPOE) at an academic medical center. Generalized linear mixed statistical tests controlled for 17 potential confounders with 2 models per outcome.

Results: After controlling for covariates, CPOE remained a significant statistical predictor of decreased LOS and mortality. LOS decreased by 0.90 days, P < .0001. Mortality decrease varied by model: 1 death per 1000 admissions (pre = 0.006, post = 0.0005, P < .001) or 3 deaths (pre = 0.008, post = 0.005, P < .01). Mortality and LOS decreased in medical and surgical units but increased in intensive care units.

Discussion: This study examined CPOE at multiple levels. Given the inability to randomize CPOE assignment, these results may only be applicable to the local setting. Temporal trends found in this study suggest that hospital-wide implementations may have impacted nursing staff and new residents. Differences in the results were noted at the patient care unit and room levels. These differences may partly explain the mixed results from previous studies.

Conclusion: Controlling for confounders, CPOE implementation remained a statistically significant predictor of LOS and mortality at this site. Mortality appears to be a sensitive outcome indicator with regard to hospital-wide implementations and should be further studied.

Learning from errors: analysis of medication order voiding in CPOE systems

OBJECTIVE

Medication order voiding allows clinicians to indicate that an existing order was placed in error. We explored whether the order voiding function could be used to record and study medication ordering errors.

MATERIALS AND METHODS

We examined medication orders from an academic medical center for a 6-year period (2006-2011; n  = 5 804 150). We categorized orders based on status (void, not void) and clinician-provided reasons for voiding. We used multivariable logistic regression to investigate the association between order voiding and clinician, patient, and order characteristics. We conducted chart reviews on a random sample of voided orders ( n  = 198) to investigate the rate of medication ordering errors among voided orders, and the accuracy of clinician-provided reasons for voiding.

RESULTS

We found that 0.49% of all orders were voided. Order voiding was associated with clinician type (physician, pharmacist, nurse, student, other) and order type (inpatient, prescription, home medications by history). An estimated 70 ± 10% of voided orders were due to medication ordering errors. Clinician-provided reasons for voiding were reasonably predictive of the actual cause of error for duplicate orders (72%), but not for other reasons.

DISCUSSION AND CONCLUSION

Medication safety initiatives require availability of error data to create repositories for learning and training. The voiding function is available in several electronic health record systems, so order voiding could provide a low-effort mechanism for self-reporting of medication ordering errors. Additional clinician training could help increase the quality of such reporting.

Considering the Language of Computerized Order Entry Systems

Computerized Provider Order Entry (CPOE) systems have been shown to introduce new problems into clinical environments. Given the communication intensive nature of these systems considering the language(s) of communication can provide insight into their function and subsequent problems. The current (as November 2015) CPOE literature was reviewed using the language concepts of syntax, semantics, and pragmatics as a lens. In total, 202 articles were considered, of these only 46 received a full review. 145 results related to language concepts were extracted from these articles. These were categorized into five categories: syntax, semantics, system-pragmatics, syntax-pragmatics, and semantic-pragmatics. In total key themes were synthesized. The themes identified can be used to direct further research in the area of CPOE systems. It was found that current literature heavily favors pragmatics concerns of language at the expense of considering underlying factors (syntax and semantics). The results support the use of language as a means of analyzing interactions between actors in communication intensive systems.

The Association Between the STOPP/START Criteria and Gastro-Intestinal Track Bleedings in Elderly Patients

Potentially inappropriate prescribing is a common problem, especially in elderly care. To tackle this problem, Irish medical experts have developed a list of criteria when medication should be added or omitted based upon the patient's physical condition and medication use, known as the STOPP and START criteria. The STOPP and START criteria have been formulated to identify the prescribing of potentially inappropriate medicines (PIMs) and potential prescribing omissions (PPOs). One of the most common problems of inappropriate prescribing is gastro-intestinal track bleedings. For this purpose, nine of the 87 STOPP and START criteria are designed to prevent this. However, the prevalence of gastro-intestinal track bleedings has not been established when these nine STOPP and START criteria are violated. The database contained 182,000 patients belonging to 49 general practitioners in the region of Amsterdam, The Netherlands. We estimated both the incidence of PIMs and PPOs and whether harm, in this case a gastro-intestinal track bleeding, occurred. We found that although violation of the nine STOPP or START criteria were possibly associated with harm (OR = 1.30), this association was not statistically significant (p = 0.323). Searching for evidence for harm informs decision support design aimed at improving quality of medication prescription as it prioritizes the many suggested criteria based on their relevance.

Iterative Development and Evaluation of a Pharmacogenomic-Guided Clinical Decision Support System for Warfarin Dosing

OBJECTIVE

Pharmacogenomic-guided dosing has the potential to improve patient outcomes but its implementation has been met with clinical challenges. Our objective was to develop and evaluate a clinical decision support system (CDSS) for pharmacogenomic-guided warfarin dosing designed for physicians and pharmacists.

METHODS

Twelve physicians and pharmacists completed 6 prescribing tasks using simulated patient scenarios in two iterations (development and validation phases) of a newly developed pharmacogenomic-driven CDSS prototype. For each scenario, usability was measured via efficiency, recorded as time to task completion, and participants' perceived satisfaction which were compared using Kruskal-Wallis and Mann Whitney U tests, respectively. Debrief interviews were conducted and qualitatively analyzed. Usability findings from the first (i.e. development) iteration were incorporated into the CDSS design for the second (i.e. validation) iteration.

RESULTS

During the CDSS validation iteration, participants took more time to complete tasks with a median (IQR) of 183 (124-247) seconds versus 101 (73.5-197) seconds in the development iteration (p=0.01). This increase in time on task was due to the increase in time spent in the CDSS corresponding to several design changes. Efficiency differences that were observed between pharmacists and physicians in the development iteration were eliminated in the validation iteration. The increased use of the CDSS corresponded to a greater acceptance of CDSS recommended doses in the validation iteration (4% in the first iteration vs. 37.5% in the second iteration, p<0.001). Overall satisfaction did not change statistically between the iterations but the qualitative analysis revealed greater trust in the second prototype.

CONCLUSIONS

A pharmacogenomic-guided CDSS has been developed using warfarin as the test drug. The final CDSS prototype was trusted by prescribers and significantly increased the time using the tool and acceptance of the recommended doses. This study is an important step toward incorporating pharmacogenomics into CDSS design for clinical testing.

Does extended CPOE use reduce patient length of stay?

OBJECTIVE

This study compares use of Computerized Provider Order Entry (CPOE) and related clinical systems (i.e., extended CPOE) across 796 clinical teams caring for five distinct patient conditions. Our focus is the relationship between clinical teams' extended CPOE use and extent of prolonged stay (EPS), defined as the deviation in patients' observed length of stay from expected risk-adjusted length of stay.

MATERIALS AND METHODS

Using archival data from two affiliated hospitals in the Southeastern United States, we focused on five different patient conditions of varying mortality risk (vaginal birth, knee/hip replacement, cardiovascular surgery, organ transplant and pneumonia). For each patient, we (1) differentiated between the following three types of care team members-Responsible physician, Core team (excluding the responsible physician), and Support team, (2) created a composite of CPOE orders, documentation entries, patient record lookups, order set adherence, alert acknowledgement, and progress note entries to assess the deep structure use (DSU) of CPOE by the three types of members in the patients' care team, and (3) aggregated DSU of CPOE across all three types of care team members to calculate Total team DSU.

RESULTS

Teams with higher Total team DSU of CPOE had lower EPS for all five patient conditions. Patients of Core teams with higher DSU of CPOE had lower EPS in all conditions except organ transplant, comprising 93% of the patients studied. Higher DSU of CPOE by all three clinician types significantly reduced EPS for vaginal birth and knee/hip replacement, whereas higher DSU by two of the three types of care team members significantly reduced EPS for cardiovascular surgery and pneumonia.

CONCLUSIONS

Our results suggest that a clinician team that uses CPOE in a comprehensive manner is better informed enabling the team to coordinate care more effectively, resulting in reduced EPS.

Cloud-based BP system integrated with CPOE improves self-management of the hypertensive patients: A randomized controlled trial

BACKGROUND

Less than 50% of patients with hypertensive disease manage to maintain their blood pressure (BP) within normal levels.

OBJECTIVE

The aim of this study is to evaluate whether cloud BP system integrated with computerized physician order entry (CPOE) can improve BP management as compared with traditional care.

METHODS

A randomized controlled trial done on a random sample of 382 adults recruited from 786 patients who had been diagnosed with hypertension and receiving treatment for hypertension in two district hospitals in the north of Taiwan. Physicians had access to cloud BP data from CPOE. Neither patients nor physicians were blinded to group assignment. The study was conducted over a period of seven months.

RESULTS

At baseline, the enrollees were 50% male with a mean (SD) age of 58.18 (10.83) years. The mean sitting BP of both arms was no different. The proportion of patients with BP control at two, four and six months was significantly greater in the intervention group than in the control group. The average capture rates of blood pressure in the intervention group were also significantly higher than the control group in all three check-points.

CONCLUSIONS

Cloud-based BP system integrated with CPOE at the point of care achieved better BP control compared to traditional care. This system does not require any technical skills and is therefore suitable for every age group. The praise and assurance to the patients from the physicians after reviewing the Cloud BP records positively reinforced both BP measuring and medication adherence behaviors.

Optimized Computerized Order Entry can Reduce Errors in Electronic Prescriptions and Associated Pharmacy Calls to Clarify (CTC)

BACKGROUND

After implementation of a system-wide EMR within our university system, e-prescribing is now commonplace.

OBJECTIVE

The authors conducted a study to assess whether optimization of computerized provider order entry (CPOE) can reduce errors in these electronically transmitted prescriptions and would require less frequent interventions from pharmacists, in particular the need for them to "call to clarify" (CTC) details of particular prescriptions. Secondary analysis based on cost assumptions was preformed to presume cost differences before and after optimization changes.

MATERIALS AND METHODS

In order to generate complete, error-free prescriptions, optimization changes were implemented in the form of in line validation messages. These messages were generated if (1) an order did not specify a provider or pharmacy; (2) the DEA requirements were not met; (3) character limits were exceeded in patient sig or demographics or (4) administration instructions had breaks or had both discrete and free text elements. Retrospectively, prescriptions were randomly selected from a nine month period before and after implementing changes. These prescriptions were analyzed by a pharmacist and a nurse to identify types of errors that would require a CTC to a prescribing provider. Errors were compared statistically to determine effectiveness of changes pre and post optimization.

RESULTS

A total of 602 prescriptions were analyzed; 301 before changes and 301 after changes. Of these prescriptions, 20.27% had errors before changes and 12.96% had errors after changes. The decline in the error rate was considered statistically significant for p<0.05. The cost savings were estimated at $76 per 100 prescriptions for pharmacist and physician time-cost estimates combined.

CONCLUSIONS

Implementing optimization changes to the CPOE resulted in a reduction in error rate requiring pharmacist CTC. This study identifies effective optimization changes for electronic prescribing that can reduce prescribing errors and may result in cost saving.

Computerised Provider Order Entry Adoption Rates Favourably Impact Length of Stay

Background Research regarding return on investment for electronic health records (EHRs) is sparse.Objective To extend previously established research and examine rigorously whether increasing the adoption of computer-based provider/prescriber order entry (CPOE) leads to a decrease in length of stay (LOS), and to demonstrate that the two are inversely and bidirectionally proportional even while other efforts to decrease LOS are in place.Method The study assessed CPOE, LOS and case mix index (CMI) data in a community hospital in the United States, using a mature and nearly fully deployed vendor product EHR. CPOE rates and LOS over 7 years were determined on a per-patient, per-visit and per-discipline basis and compared with concomitant CMI data.Results An inverse relationship of CPOE to LOS was correlated for 13 disciplines out of 19, and organisation wide for all disciplines combined during the first 5 years of study. During the subsequent 2 years, both CPOE and LOS plateaued, except in eight disciplines where CPOE rates at first declined and LOS concurrently rose slightly, and then returned to the baseline plateau levels. CMI increased during the entire period of evaluation. An inflection point at approximately 60% CPOE adoption predicted the greatest improvement in lowering of LOS.Conclusions Rising and falling rates of CPOE correlated with reductions and rises in LOS, respectively. CPOE appeared statistically to be an independent factor in affecting LOS, over and above other efforts to shorten LOS, thus contributing to lower costs and improved efficiency outcomes as measured by LOS, even as CMI rises.

Toward the Elimination of Paper Orders: Managing the Challenge of Low Frequency Physician Users of Computerized Patient Order Entry (CPOE)

With the adoption of Computerized Patient Order Entry (CPOE), many physicians - particularly consultants and those who are affiliated with multiple hospital systems - are faced with the challenge of learning to navigate and commit to memory the details of multiple EHRs and CPOE software modules. These physicians may resist CPOE adoption, and their refusal to use CPOE presents a risk to patient safety when paper and electronic orders co-exist, as paper orders generated in an electronic ordering environment can be missed or acted upon after delay, are frequently illegible, and bypass the Clinical Decision Support (CDS) that is part of the evidence-based value of CPOE. We defined a category of CPOE Low Frequency Users (LFUs) - physicians issuing a total of less than 10 orders per month - and found that 50.4% of all physicians issuing orders in 3 urban/suburban hospitals were LFUs and actively issuing orders across all shifts and days of the week. Data are presented for 2013 on the number of LFUs by month, day of week, shift and facility, over 2.3 million orders issued. A menu of 6 options to assist LFUs in the use of CPOE, from which hospital leaders could select, was instituted so that paper orders could be increasingly eliminated. The options, along with their cost implications, are described, as is the initial option selected by hospital leaders. In practice, however, a mixed pattern involving several LFU support options emerged. We review data on how the option mix selected may have impacted CPOE adoption and physician use rates at the facilities. The challenge of engaging LFU physicians in CPOE adoption may be common in moderately sized hospitals, and these options can be deployed by other systems in advancing CPOE pervasiveness of use and the eventual elimination of paper orders.

Radiology order decision support: examination-indication appropriateness assessed using 2 electronic systems

PURPOSE

The goal of the study was to determine the effects of guideline implementation strategy using 2 commercial radiology clinical decision support (CDS) systems.

METHODS

The appropriateness and insurance dispositions of MRI and CT orders were evaluated using the Medicalis SmartReq and Nuance RadPort CDS systems during 2 different 3-month periods. Logistic regression was used to compare these outcomes between the 2 systems, after adjusting for patient-mix differences.

RESULTS

Approximately 2,000 consecutive outpatient MRI and CT orders were evaluated over 2 periods of 3 months each. Medicalis scored 60% of exams as "indeterminate" (insufficient information) or "not validated" (no guidelines). Excluding these cases, Nuance scored significantly more exams as appropriate than did Medicalis (80% versus 51%, P < .001) and predicted insurance outcome significantly more often (76% versus 58%, P < .001). Only when the Medicalis "indeterminate" and "not validated" categories were combined with the high- or moderate-utility categories did the 2 CDS systems have similar performance. Overall, 19% of examinations with low-utility ratings were reimbursed. Conversely, 0.8% of examinations with high- or moderate-utility ratings were denied reimbursement.

CONCLUSIONS

The chief difference between the 2 CDS systems, and the strongest influence on outcomes, was how exams without relevant guidelines or with insufficient information were handled. Nuance augmented published guidelines with clinical best practice; Medicalis requested additional information utilizing pop-up windows. Thus, guideline implementation choices contributed to decision making and outcomes. User interface, specifically, the number of screens and completeness of indication choices, controlled CDS interactions and, coupled with guidance implementation, influenced willingness to use the CDS system.

Safe Implementation of Computerized Provider Order Entry for Adult Oncology

BACKGROUND

Oncology has lagged in CPOE adoption due to the narrow therapeutic index of chemotherapy drugs, individualized dosing based on weight and height, regimen complexity, and workflows that include hard stops where safety checks are performed and documented.

OBJECTIVES

We sought to establish CPOE for chemotherapy ordering and administration in an academic teaching institution using a commercially available CPOE system.

METHODS

A commercially available CPOE system was implemented throughout the hospital. A multidisciplinary team identified key safety gaps that required the development of a customized complex order display and a verification documentation workflow. Staff reported safety events were monitored for two years and compared to the year prior to go live.

RESULTS

A workflow was enabled to capture real-time provider verification status during the time from ordering to the administration of chemotherapy. A customized display system was embedded in the EMR to provide a single screen view of the relevant parameters of chemotherapy doses including current and previous patient measurements of height and weight, dose adjustments, provider verifications, prior chemotherapy regimens, and a synopsis of the standard regimen for reference. Our system went live with 127 chemotherapy plans and has been expanded to 189. Staff reported safety events decreased following implementation, particularly in the area of prescribing and transcribing by the second year of use.

CONCLUSIONS

We observed reduced staff reported safety events following implementation of CPOE for inpatient chemotherapy using an electronic verification workflow and an embedded custom clinical decision support page. This implementation demonstrates that CPOE can be safely used for inpatient chemotherapy, even in an extremely complex environment.

Impact of CPOE usage on medication management process costs and quality outcomes

We assess the impact of computerized physician order entry (CPOE) systems usage on cost and process quality in the medication management process. Data are compiled from 1,014 U.S. acute-care hospitals that have already implemented CPOE. Data sources include the American Hospital Association, HIMSS Analytics, and the Centers for Medicare and Medicaid Services. We examine the association of CPOE usage with nursing and pharmacy salary costs, and evidence-based medication process compliance. Empirical findings controlling for endogeneity in usage show that benefits accrue even when 100 percent usage is not achieved. We demonstrate that the relationship of CPOE usage with cost and compliance is non-linear.

Cost-effectiveness analysis of a hospital electronic medication management system

Objective To conduct a cost–effectiveness analysis of a hospital electronic medication management system (eMMS).

Methods We compared costs and benefits of paper-based prescribing with a commercial eMMS (CSC MedChart) on one cardiology ward in a major 326-bed teaching hospital, assuming a 15-year time horizon and a health system perspective. The eMMS implementation and operating costs were obtained from the study site. We used data on eMMS effectiveness in reducing potential adverse drug events (ADEs), and potential ADEs intercepted, based on review of 1 202 patient charts before (n = 801) and after (n = 401) eMMS. These were combined with published estimates of actual ADEs and their costs.

Results The rate of potential ADEs following eMMS fell from 0.17 per admission to 0.05; a reduction of 71%. The annualized eMMS implementation, maintenance, and operating costs for the cardiology ward were A$61 741 (US$55 296). The estimated reduction in ADEs post eMMS was approximately 80 actual ADEs per year. The reduced costs associated with these ADEs were more than sufficient to offset the costs of the eMMS. Estimated savings resulting from eMMS implementation were A$63–66 (US$56–59) per admission (A$97 740–$102 000 per annum for this ward). Sensitivity analyses demonstrated results were robust when both eMMS effectiveness and costs of actual ADEs were varied substantially.

Conclusion The eMMS within this setting was more effective and less expensive than paper-based prescribing. Comparison with the few previous full economic evaluations available suggests a marked improvement in the cost–effectiveness of eMMS, largely driven by increased effectiveness of contemporary eMMs in reducing medication errors.

Drug-drug interaction checking assisted by clinical decision support: a return on investment analysis

BACKGROUND

Drug-drug interactions (DDIs) are very prevalent in hospitalized patients.

OBJECTIVES

To determine the number of DDI alerts, time saved, and time invested after suppressing clinically irrelevant alerts and adding clinical-decision support to relevant alerts.

MATERIALS AND METHODS

The most frequently occurring DDIs were evaluated for clinical relevance by a multidisciplinary expert panel. Pharmacist evaluation of relevant DDIs was facilitated using computerized decision support systems (CDSS). During Phase 1, only CDSS-assisted DDI checking was implemented. During Phase 2, CDSS-assisted DDI checking remained in place, and clinically irrelevant DDIs were suppressed. In each phase, the number of alerts and duration of pharmacist DDI checking were compared to conventional DDI checking. In addition, the time invested to implement and configure the CDSS was compared to the time saved using CDSS-assisted DDI checking.

RESULTS

CDSS-assisted DDI checking resulted in a daily decrease of DDI checking alerts from 65 to 47 alerts in Phase 1 (P = .03) and from 73 to 33 alerts in Phase 2 (P = .003). DDI checking duration decreased from 15 to 11 minutes (P = .044) and from 15½ to 8½ minutes (P = .001) in Phases 1 and 2, respectively. Almost 298 of the 392 hours required for implementation were invested by pharmacists. An annual timesaving of 30 hours yielded a return on investment of 9.8 years.

CONCLUSION

CDSS-assisted DDI checking resulted in a 55% reduction of the number of alerts and a 45% reduction in time spent on DDI checking, yielding a return on investment of almost 10 years. Our approach can be used to refine other drug safety checking modules, increasing the efficiency of checking for drug safety without the need to add more staff pharmacists.

Non-intercepted dose errors in prescribing anti-neoplastic treatment: a prospective, comparative cohort study

BACKGROUND

The incidence of non-intercepted prescription errors and the risk factors involved, including the impact of computerised order entry (CPOE) systems on such errors, are unknown. Our objective was to determine the incidence, type, severity, and related risk factors of non-intercepted prescription dose errors.

PATIENTS AND METHODS

A prospective, comparative cohort study in two clinical oncology units. One institution used a CPOE system with no connection to the electronic patient record system, while the other used paper-based prescription forms. All standard prescriptions were included and reviewed. Doses were recalculated according to the guidelines of each institution, using the patient data as documented in the patient record, the paper-based prescription form, or the CPOE system. A non-intercepted prescription dose error was defined as ≥10% difference between the administered and the recalculated dose.

RESULTS

Data were collected from 1 November 2012 to 15 January 2013. A total of 5767 prescriptions were evaluated, 2677 from the institution using CPOE and 3090 from the institution with paper-based prescription. Crude analysis showed an overall risk of a prescription dose error of 1.73 per 100 prescriptions. CPOE resulted in 1.60 and paper-based prescription forms in 1.84 errors per 100 prescriptions, i.e. odds ratio (OR) = 0.87 [95% confidence interval (CI) 0.59-1.29, P = 0.49]. Fifteen different types of errors and four potential risk factors were identified. None of the dose errors resulted in the death of the patient.

CONCLUSIONS

Non-intercepted prescribing dose errors occurred in <2% of the prescriptions. The parallel CPOE system did not significantly reduce the overall risk of dose errors, and although it reduced the risk of calculation errors, it introduced other errors. Strategies to prevent future prescription errors could usefully focus on integrated computerised systems that can aid dose calculations and reduce transcription errors between databases.

Health information technology in oncology practice: a literature review

The adoption and implementation of information technology are dramatically remodeling healthcare services all over the world, resulting in an unstoppable and sometimes overwhelming process. After the introduction of the main elements of electronic health records and a description of what every cancer-care professional should be familiar with, we present a narrative review focusing on the current use of computerized clinical information and decision systems in oncology practice. Following a detailed analysis of the many coveted goals that oncologists have reached while embracing informatics progress, the authors suggest how to overcome the main obstacles for a complete physicians' engagement and for a full information technology adoption, and try to forecast what the future holds.

Computerized provider order entry reduces length of stay in a community hospital

OBJECTIVE

Does computerized provider order entry (CPOE) improve clinical, cost, and efficiency outcomes as quantified in shortened hospital length of stay (LOS)? Most prior studies were done in university settings with home-grown electronic records, and are now 20 years old. This study asked whether CPOE exerts a downward force on LOS in the current era of HITECH incentives, using a vendor product in a community hospital.

METHODS

The methodology retrospectively evaluated correlation between CPOE and LOS on a perpatient, per-visit basis over 22 consecutive quarters, organized by discipline. All orders from all areas were eligible, except verbals, and medication orders in the emergency department which were not available via CPOE. These results were compared with quarterly case mix indices organized by discipline. Correlational and regression analyses were cross-checked to ensure validity of R-square coefficients, and data were smoothed for ease of display. Standard models were used to calculate the inflection point.

RESULTS

Gains in CPOE adoption occurred iteratively house-wide, and in each discipline. LOS decreased in a sigmoid shaped curve. The inflection point shows that once CPOE adoption approaches 60%, further lowering of LOS accelerates. Overall there was a 20.2% reduction in LOS correlated with adoption of CPOE. Case mix index increased during the study period showing that reductions in LOS occurred despite increased patient complexity and resource utilization.

CONCLUSIONS

There was a 20.2% reduction in LOS correlated with rising adoption of CPOE. CPOE contributes to improved clinical, cost, and efficiency outcomes as quantified in reduced LOS, over and above other processes introduced to lower LOS. CPOE enabled a reduction in LOS despite an increase in the case mix index during the time frame of this study.

A detailed description of the implementation of inpatient insulin orders with a commercial electronic health record system

In the setting of Meaningful Use laws and professional society guidelines, hospitals are rapidly implementing electronic glycemic management order sets. There are a number of best practices established in the literature for glycemic management protocols and programs. We believe that this is the first published account of the detailed steps to be taken to design, implement, and optimize glycemic management protocols in a commercial computerized provider order entry (CPOE) system. Prior to CPOE implementation, our hospital already had a mature glycemic management program. To transition to CPOE, we underwent the following 4 steps: (1) preparation and requirements gathering, (2) design and build, (3) implementation and dissemination, and (4) optimization. These steps required more than 2 years of coordinated work between physicians, nurses, pharmacists, and programmers. With the move to CPOE, our complex glycemic management order sets were successfully implemented without any significant interruptions in care. With feedback from users, we have continued to refine the order sets, and this remains an ongoing process. Successful implementation of glycemic management protocols in CPOE is dependent on broad stakeholder input and buy-in. When using a commercial CPOE system, there may be limitations of the system, necessitating workarounds. There should be an upfront plan to apply resources for continuous process improvement and optimization after implementation.

Impact of computerized provider order entry on pharmacist productivity

PURPOSE

To examine the impact of computerized provider order entry (CPOE) implementation on average time spent on medication order entry and the number of order actions processed.

METHODS

An observational time and motion study was conducted from March 1 to March 17, 2011. Two similar community hospital pharmacies were compared: one without CPOE implementation and the other with CPOE implementation. Pharmacists in the central pharmacy department of both hospitals were observed in blocks of 1 hour, with 24 hours of observation in each facility. Time spent by pharmacists on distributive, administrative, clinical, and miscellaneous activities associated with order entry were recorded using time and motion instrument documentation. Information on medication order actions and order entry/verifications was obtained using the pharmacy network system.

RESULTS

The mean ± SD time spent by pharmacists per hour in the CPOE pharmacy was significantly less than the non-CPOE pharmacy for distributive activities (43.37 ± 7.75 vs 48.07 ± 8.61) and significantly greater than the non-CPOE pharmacy for administrative (8.58 ± 5.59 vs 5.72 ± 6.99) and clinical (7.38 ± 4.27 vs 4.22 ± 3.26) activities. The CPOE pharmacy was associated with a significantly higher number of order actions per hour (191.00 ± 82.52 vs 111.63 ± 25.66) and significantly less time spent (in minutes per hour) on order entry and order verification combined (28.30 ± 9.25 vs 36.56 ± 9.14) than the non-CPOE pharmacy.

CONCLUSION

The implementation of CPOE facilitated pharmacists to allocate more time to clinical and administrative functions and increased the number of order actions processed per hour, thus enhancing workflow efficiency and productivity of the pharmacy department.

Personalised, predictive and preventive medication process in hospitals-still rather missing: professional opinion survey on medication safety in Czech hospitals (based on professional opinions of recognised Czech health care experts)

The survey had the following aims: (1) to rationalise the hypothesis that risks and losses relating to medication process' errors in Czech hospitals are at least comparable with the other developed countries and EU countries especially, (2) to get a valid professional opinion/estimate on the rate of adverse drug events happening in Czech hospitals, (3) to point out that medication errors represent real and serious risks and (4) to induce the hospital management readiness to execute fundamental changes and improvements to medication processes. We read through a lot of studies inquiring into hospitals' medication safety. Then, we selected the studies which brought reliable findings and formulated credible conclusions. Finally, we addressed reputable Czech experts in health care and asked them structured questions whether the studies' findings and conclusions corresponded with our respondents' own experience in the Czech hospital clinical practice and what their own estimates of adverse drug events' consequences were like. Based on the reputable Czech health care expert opinions/estimates, the rate of a false drug administration may exceed 5%, and over 7% of those cause serious health complications to Czech hospital inpatients. Measured by an average length of stay (ALOS), the Czech inpatients, harmed by a false drug administration, stay in hospital for more than 2.6 days longer than necessary. Any positive changes to a currently used, traditional, ways of drug dispensing and administration, along with computerisation, automation, electronic traceability, validation, or verification, must well pay off. Referring to the above results, it seems to be wise to follow the EU priorities in health and health care improvements. Thus, a right usage of the financial means provided by the EC—in terms of its new health programmes for the period 2014–2020 (e.g. Horizon 2020)—has a good chance of a good result in doing the right things right, at the right time and in the right way. All citizens of the EU may benefit using the best practice.

Bringing the "power" to Cerner's PowerChart for antimicrobial stewardship

The electronic medical record (EMR) has huge potential for facilitating antimicrobial stewardship efforts by directing providers to preferred antimicrobials. Cerner PowerChart currently holds the number 2 position in the EMR market. Although PowerChart has limited "out of the box" functionalities to optimize stewardship efforts, there are many potential utilities that can be developed to assist in stewardship practice. However, to harness the stewardship potential of the EMR system, significant hospital information technology resources are needed. Herein we describe the experiences of 3 large healthcare systems utilizing Cerner to facilitate prior authorization of antimicrobials, prospective audit and feedback of antimicrobials, and supplemental stewardship strategies.

Paving the COWpath: data-driven design of pediatric order sets

OBJECTIVE

Evidence indicates that users incur significant physical and cognitive costs in the use of order sets, a core feature of computerized provider order entry systems. This paper develops data-driven approaches for automating the construction of order sets that match closely with user preferences and workflow while minimizing physical and cognitive workload.

MATERIALS AND METHODS

We developed and tested optimization-based models embedded with clustering techniques using physical and cognitive click cost criteria. By judiciously learning from users' actual actions, our methods identify items for constituting order sets that are relevant according to historical ordering data and grouped on the basis of order similarity and ordering time. We evaluated performance of the methods using 47,099 orders from the year 2011 for asthma, appendectomy and pneumonia management in a pediatric inpatient setting.

RESULTS

In comparison with existing order sets, those developed using the new approach significantly reduce the physical and cognitive workload associated with usage by 14-52%. This approach is also capable of accommodating variations in clinical conditions that affect order set usage and development.

DISCUSSION

There is a critical need to investigate the cognitive complexity imposed on users by complex clinical information systems, and to design their features according to 'human factors' best practices. Optimizing order set generation using cognitive cost criteria introduces a new approach that can potentially improve ordering efficiency, reduce unintended variations in order placement, and enhance patient safety.

CONCLUSIONS

We demonstrate that data-driven methods offer a promising approach for designing order sets that are generalizable, data-driven, condition-based, and up to date with current best practices.

Analysis of electronic medication orders with large overdoses: opportunities for mitigating dosing errors

BACKGROUND

Users of electronic health record (EHR) systems frequently prescribe doses outside recommended dose ranges, and tend to ignore the alerts that result. Since some of these dosing errors are the result of system design flaws, analysis of large overdoses can lead to the discovery of needed system changes.

OBJECTIVES

To develop database techniques for detecting and extracting large overdose orders from our EHR. To identify and characterize users' responses to these large overdoses. To identify possible causes of large-overdose errors and to mitigate them.

METHODS

We constructed a data mart of medication-order and dosing-alert data from a quaternary pediatric hospital from June 2011 to May 2013. The data mart was used along with a test version of the EHR to explain how orders were processed and alerts were generated for large (>500%) and extreme (>10,000%) overdoses. User response was characterized by the dosing alert salience rate, which expresses the proportion of time users take corrective action.

RESULTS

We constructed an advanced analytic framework based on workflow analysis and order simulation, and evaluated all 5,402,504 medication orders placed within the 2 year timeframe as well as 2,232,492 dose alerts associated with some of the orders. 8% of orders generated a visible alert, with ¼ of these related to overdosing. Alerts presented to trainees had higher salience rates than those presented to senior colleagues. Salience rates were low, varying between 4-10%, and were lower with larger overdoses. Extreme overdoses fell into eight causal categories, each with a system design mitigation.

CONCLUSIONS

Novel analytic systems are required to accurately understand prescriber behavior and interactions with medication-dosing CDS. We described a novel analytic system that can detect apparent large overdoses (≥500%) and explain the sociotechnical factors that drove the error. Some of these large overdoses can be mitigated by system changes. EHR design should prospectively mitigate these errors.

Computerized physician order entry: promise, perils, and experience

Computerized physician order entry (CPOE) has been promoted as an important component of patient safety, quality improvement, and modernization of medical practice. In practice, however, CPOE affects health care delivery in complex ways, with benefits as well as risks. Every implementation of CPOE is associated with both generally recognized and unique local factors that can facilitate or confound its rollout, and neurohospitalists will often be at the forefront of such rollouts. In this article, we review the literature on CPOE, beginning with definitions and proceeding to comparisons to the standard of care. We then proceed to discuss clinical decision support systems, negative aspects of CPOE, and cultural context of CPOE implementation. Before concluding, we follow the experiences of a Chief Medical Information Officer and neurohospitalist who rolled out a CPOE system at his own health care organization and managed the resulting workflow changes and setbacks.