Showing Your Work: Impact of annotating electronic prescriptions with decision support results

The GUIDES checklist: development of a tool to improve the successful use of guideline-based computerised clinical decision support

Background

Computerised decision support (CDS) based on trustworthy clinical guidelines is a key component of a learning healthcare system. Research shows that the effectiveness of CDS is mixed.

Multifaceted context, system, recommendation and implementation factors may potentially affect the success of CDS interventions. This paper describes the development of a checklist that is intended to support professionals to implement CDS successfully.

Methods

We developed the checklist through an iterative process that involved a systematic review of evidence and frameworks, a synthesis of the success factors identified in the review, feedback from an international expert panel that evaluated the checklist in relation to a list of desirable framework attributes, consultations with patients and healthcare consumers and pilot testing of the checklist.

Results

We screened 5347 papers and selected 71 papers with relevant information on success factors for guideline-based CDS. From the selected papers, we developed a 16-factor checklist that is divided in four domains, i.e. the CDS context, content, system and implementation domains. The panel of experts evaluated the checklist positively as an instrument that could support people implementing guideline-based CDS across a wide range of settings globally. Patients and healthcare consumers identified guideline-based CDS as an important quality improvement intervention and perceived the GUIDES checklist as a suitable and useful strategy.

Conclusions

The GUIDES checklist can support professionals in considering the factors that affect the success of CDS interventions. It may facilitate a deeper and more accurate understanding of the factors shaping CDS effectiveness. Relying on a structured approach may prevent that important factors are missed.

Electronic supplementary material

The online version of this article (10.1186/s13012-018-0772-3) contains supplementary material, which is available to authorized users.

Meaningful Use of Electronic Health Records: Experiences From the Field and Future Opportunities

Background

With the aim of improving health care processes through health information technology (HIT), the US government has promulgated requirements for “meaningful use” (MU) of electronic health records (EHRs) as a condition for providers receiving financial incentives for the adoption and use of these systems. Considerable uncertainty remains about the impact of these requirements on the effective application of EHR systems.

Objective

The Agency for Healthcare Research and Quality (AHRQ)-sponsored Centers for Education and Research in Therapeutics (CERTs) critically examined the impact of the MU policy relating to the use of medications and jointly developed recommendations to help inform future HIT policy.

Methods

We gathered perspectives from a wide range of stakeholders (N=35) who had experience with MU requirements, including academicians, practitioners, and policy makers from different health care organizations including and beyond the CERTs. Specific issues and recommendations were discussed and agreed on as a group.

Results

Stakeholders’ knowledge and experiences from implementing MU requirements fell into 6 domains: (1) accuracy of medication lists and medication reconciliation, (2) problem list accuracy and the shift in HIT priorities, (3) accuracy of allergy lists and allergy-related standards development, (4) support of safer and effective prescribing for children, (5) considerations for rural communities, and (6) general issues with achieving MU. Standards are needed to better facilitate the exchange of data elements between health care settings. Several organizations felt that their preoccupation with fulfilling MU requirements stifled innovation. Greater emphasis should be placed on local HIT configurations that better address population health care needs.

Conclusions

Although MU has stimulated adoption of EHRs, its effects on quality and safety remain uncertain. Stakeholders felt that MU requirements should be more flexible and recognize that integrated models may achieve information-sharing goals in alternate ways. Future certification rules and requirements should enhance EHR functionalities critical for safer prescribing of medications in children.

Assessing the effect of providing a pharmacist with patient diagnosis on electronic prescription orders: a pilot study

BACKGROUND

As a result of the US Omnibus Reconciliation Act of 1990 (OBRA '90), pharmacists have the obligation to ensure that prescription orders are appropriate and are not likely to cause adverse events. However, patient diagnosis information is not a requirement for a legal prescription order in any state in the US.

OBJECTIVE

To compare a pharmacist's interventions before and after patient diagnosis is added by prescribers to their electronic prescription orders.

METHODS

This prospective, pre-post study was conducted during two consecutive 4-week periods in a community health center pharmacy. During the first data collection period, the clinical pharmacist prospectively evaluated e-prescriptions using a standard DUR protocol. All problematic prescriptions were documented using a medication intervention form. During the second data collection period, providers included the patient's diagnosis on each e-prescription and the same clinical pharmacist again evaluated prescribed therapy and documented interventions.

RESULTS

Pharmacist intervention rates on e-prescription orders were significantly lower following addition of the patient diagnosis information to the e-prescription order (3.9% pre- vs. 1.0% post-, P < 0.001).

CONCLUSIONS

While preliminary, the results of this pilot suggest that the addition of patient diagnosis to the e-prescription order can reduce confusion and uncertainty on the part of a DUR pharmacist, thereby decreasing the overall number of interventions and the subsequent number of contacts with prescribers.

Electronic prescribing in pediatrics: toward safer and more effective medication management

This technical report discusses recent advances in electronic prescribing (e-prescribing) systems, including the evidence base supporting their limitations and potential benefits. Specifically, this report acknowledges that there are limited but positive pediatric data supporting the role of e-prescribing in mitigating medication errors, improving communication with dispensing pharmacists, and improving medication adherence. On the basis of these data and on the basis of federal statutes that provide incentives for the use of e-prescribing systems, the American Academy of Pediatrics recommends the adoption of e-prescribing systems with pediatric functionality. This report supports the accompanying policy statement from the American Academy of Pediatrics recommending the adoption of e-prescribing by pediatric health care providers.

Design of decision support interventions for medication prescribing

OBJECTIVE

Describe optimal design attributes of clinical decision support (CDS) interventions for medication prescribing, emphasizing perceptual, cognitive and functional characteristics that improve human-computer interaction (HCI) and patient safety.

METHODS

Findings from published reports on success, failures and lessons learned during implementation of CDS systems were reviewed and interpreted with regard to HCI and software usability principles. We then formulated design recommendations for CDS alerts that would reduce unnecessary workflow interruptions and allow clinicians to make informed decisions quickly, accurately and without extraneous cognitive and interactive effort.

RESULTS

Excessive alerting that tends to distract clinicians rather than provide effective CDS can be reduced by designing only high severity alerts as interruptive dialog boxes and less severe warnings without explicit response requirement, by curating system knowledge bases to suppress warnings with low clinical utility and by integrating contextual patient data into the decision logic. Recommended design principles include parsimonious and consistent use of color and language, minimalist approach to the layout of information and controls, the use of font attributes to convey hierarchy and visual prominence of important data over supporting information, the inclusion of relevant patient data in the context of the alert and allowing clinicians to respond with one or two clicks.

CONCLUSION

Although HCI and usability principles are well established and robust, CDS and EHR system interfaces rarely conform to the best known design conventions and are seldom conceived and designed well enough to be truly versatile and dependable tools. These relatively novel interventions still require careful monitoring, research and analysis of its track record to mature. Clarity and specificity of alert content and optimal perceptual and cognitive attributes, for example, are essential for providing effective decision support to clinicians.

Computerized clinical decision support for medication prescribing and utilization in pediatrics

BACKGROUND AND OBJECTIVE

Accurate and informed prescribing is essential to ensure the safe and effective use of medications in pediatric patients. Computerized clinical decision support (CCDS) functionalities have been embedded into computerized physician order entry systems with the aim of ensuring accurate and informed medication prescribing. Owing to a lack of comprehensive analysis of the existing literature, this review was undertaken to analyze the effect of CCDS implementation on medication prescribing and use in pediatrics.

MATERIALS AND METHODS

A literature search was performed using keywords in PubMed to identify research studies with outcomes related to the implementation of medication-related CCDS functionalities.

RESULTS AND DISCUSSION

Various CCDS functionalities have been implemented in pediatric patients leading to different results. Medication dosing calculators have decreased calculation errors. Alert-based CCDS functionalities, such as duplicate therapy and medication allergy checking, may generate excessive alerts. Medication interaction CCDS has been minimally studied in pediatrics. Medication dosing support has decreased adverse drug events, but has also been associated with high override rates. Use of medication order sets have improved guideline adherence. Guideline-based treatment recommendations generated by CCDS functionalities have had variable influence on appropriate medication use, with few studies available demonstrating improved patient outcomes due to CCDS use.

CONCLUSION

Although certain medication-related CCDS functionalities have shown benefit in medication prescribing for pediatric patients, others have resulted in high override rates and inconsistent or unknown impact on patient care. Further studies analyzing the effect of individual CCDS functionalities on safe and effective prescribing and medication use are required.

E-prescribing: a focused review and new approach to addressing safety in pharmacies and primary care

E-prescribing, the health information technology (HIT) that enables prescribers to electronically transmit prescriptions to community pharmacies, has been touted as a solution for improving patient safety and overall quality of care. However, the impact of HIT, such as e-prescribing on medication errors in acute care settings, has been widely studied and shows that if poorly designed or implemented, HIT can pose a risk to patient safety by introducing a source of medication errors. Unlike acute care settings, safety issues related to e-prescribing in primary care settings (where e-prescriptions are generated and transmitted) and pharmacies (where e-prescriptions are received) have not received as much attention in the literature. This paper provides a focused review of patient safety issues related to using e-prescribing systems in primary care and pharmacies. In addition, the paper proposes using human factors engineering concepts to study e-prescribing safety in pharmacies and primary care settings to identify safety problems and possible mechanisms for improvement.

The effectiveness of integrated health information technologies across the phases of medication management: a systematic review of randomized controlled trials

OBJECTIVE

The US Agency for Healthcare Research and Quality funded an evidence report to address seven questions on multiple aspects of the effectiveness of medication management information technology (MMIT) and its components (prescribing, order communication, dispensing, administering, and monitoring).

MATERIALS AND METHODS

Medline and 11 other databases without language or date limitations to mid-2010. Randomized controlled trials (RCTs) assessing integrated MMIT were selected by two independent reviewers. Reviewers assessed study quality and extracted data. Senior staff checked accuracy.

RESULTS

Most of the 87 RCTs focused on clinical decision support and computerized provider order entry systems, were performed in hospitals and clinics, included primarily physicians and sometimes nurses but not other health professionals, and studied process changes related to prescribing and monitoring medication. Processes of care improved for prescribing and monitoring mostly in hospital settings, but the few studies measuring clinical outcomes showed small or no improvements. Studies were performed most frequently in the USA (n=63), Europe (n=16), and Canada (n=6).

DISCUSSION

Many studies had limited description of systems, installations, institutions, and targets of the intervention. Problems with methods and analyses were also found. Few studies addressed order communication, dispensing, or administering, non-physician prescribers or pharmacists and their MMIT tools, or patients and caregivers. Other study methods are also needed to completely understand the effects of MMIT.

CONCLUSIONS

Almost half of MMIT interventions improved the process of care, but few studies measured clinical outcomes. This large body of literature, although instructive, is not uniformly distributed across settings, people, medication phases, or outcomes.

The effects of on-screen, point of care computer reminders on processes and outcomes of care

BACKGROUND

The opportunity to improve care by delivering decision support to clinicians at the point of care represents one of the main incentives for implementing sophisticated clinical information systems. Previous reviews of computer reminder and decision support systems have reported mixed effects, possibly because they did not distinguish point of care computer reminders from e-mail alerts, computer-generated paper reminders, and other modes of delivering 'computer reminders'.

OBJECTIVES

To evaluate the effects on processes and outcomes of care attributable to on-screen computer reminders delivered to clinicians at the point of care.

SEARCH STRATEGY

We searched the Cochrane EPOC Group Trials register, MEDLINE, EMBASE and CINAHL and CENTRAL to July 2008, and scanned bibliographies from key articles.

SELECTION CRITERIA

Studies of a reminder delivered via a computer system routinely used by clinicians, with a randomised or quasi-randomised design and reporting at least one outcome involving a clinical endpoint or adherence to a recommended process of care.

DATA COLLECTION AND ANALYSIS

Two authors independently screened studies for eligibility and abstracted data. For each study, we calculated the median improvement in adherence to target processes of care and also identified the outcome with the largest such improvement. We then calculated the median absolute improvement in process adherence across all studies using both the median outcome from each study and the best outcome.

MAIN RESULTS

Twenty-eight studies (reporting a total of thirty-two comparisons) were included. Computer reminders achieved a median improvement in process adherence of 4.2% (interquartile range (IQR): 0.8% to 18.8%) across all reported process outcomes, 3.3% (IQR: 0.5% to 10.6%) for medication ordering, 3.8% (IQR: 0.5% to 6.6%) for vaccinations, and 3.8% (IQR: 0.4% to 16.3%) for test ordering. In a sensitivity analysis using the best outcome from each study, the median improvement was 5.6% (IQR: 2.0% to 19.2%) across all process measures and 6.2% (IQR: 3.0% to 28.0%) across measures of medication ordering. In the eight comparisons that reported dichotomous clinical endpoints, intervention patients experienced a median absolute improvement of 2.5% (IQR: 1.3% to 4.2%). Blood pressure was the most commonly reported clinical endpoint, with intervention patients experiencing a median reduction in their systolic blood pressure of 1.0 mmHg (IQR: 2.3 mmHg reduction to 2.0 mmHg increase).

AUTHORS' CONCLUSIONS

Point of care computer reminders generally achieve small to modest improvements in provider behaviour. A minority of interventions showed larger effects, but no specific reminder or contextual features were significantly associated with effect magnitude. Further research must identify design features and contextual factors consistently associated with larger improvements in provider behaviour if computer reminders are to succeed on more than a trial and error basis.