EHR-related alert fatigue: minimal progress to date, but much more can be done

Multidisciplinary user experience of a newly implemented electronic patient record in Ireland: An exploratory qualitative study

BACKGROUND

Implementation of an Electronic Patient Record (EPR) in a key milestone in the digital strategy of modern healthcare organisations. The implementation of EPR systems can be viewed as challenging and complex.

OBJECTIVE

The aim of the study was to investigate user perspectives and experiences of the implementation of an Electronic Medical Record in a major academic teaching hospital, with simultaneous 'go-live' across the whole hospital taking place.

METHODS

Focus groups and individual in-depth interviews were conducted with stakeholders and users (n = 105), approximately nine months post-EPR implementation. The study explored EPR users' perceptions using an extended theoretical framework of the DeLone and McLean Information Systems Success Model (2003), which measured information systems, system quality, information quality, service quality, use/perceived usefulness & user satisfaction and net benefits.

RESULTS

Staff engagement and satisfaction was high and the EPR is accepted as the new standard way of completing care. There was agreement that the EPR affords transparency, and greater accountability. There was some concern expressed regarding impact of the EPR on interprofessional and patient/provider interactions and communication. Physicians reported the inputting of social history through free text as an issue of concern and time consuming. The Big Bang approach with mandatory conversion was key to the successful adoption of EPR. There was consensus across professional and administrative respondents that there was no appetite to return to paper-based records.

CONCLUSION

The successful roll out of the EPR reflects the digital readiness of healthcare providers and organisations. The potential for unintended consequences on work process requires continual monitoring. A key future benefit of the EPR will be the capacity to reach a broader understanding and analysis of variation in processes and outcomes within healthcare organisations. It is clear that skills in data analytics will be needed to mine data successfully.

Characterization of pentosan polysulfate patients for development of an alert and screening system for ophthalmic monitoring

OBJECTIVE

Pentosan polysulfate (PPS; ELMIRON, Janssen Pharmaceuticals, Titusville, NJ) is a U.S. Food and Drug Administration-approved oral medication for interstitial cystitis. Numerous reports have been published detailing retinal toxicity with the use of PPS. Studies characterizing this condition are primarily retrospective, and consequently, alert and screening systems need to be developed to actively screen for this disease. The goal of this study was to characterize ophthalmic monitoring trends of a PPS-using patient sample to construct an alert and screening system for monitoring this condition.

METHODS

A single-institution retrospective chart review was conducted between January 2005 and November 2020 to characterize PPS use. An electronic medical record (EMR) alert was constructed to trigger based on new PPS prescriptions and renewals offering ophthalmology referral.

RESULTS

A total of 1407 PPS users over 15 years was available for characterization, with 1220 (86.7%) being female, the average duration of exposure being 71.2 ± 62.6 months, and the average medication cumulative exposure being 669.7 ± 569.2 g. A total of 151 patients (10.7%) had a recorded visit with an ophthalmologist, with 71 patients (5.0%) having optical coherence tomography imaging. The EMR alert fired for 88 patients over 1 year, with 34 patients (38.6%) either already being screened by an ophthalmologist or having been referred for screening.

CONCLUSIONS

An EMR support tool can improve referral rates of PPS maculopathy screening with an ophthalmologist and may serve as an efficient method for longitudinal screening of this condition with the added benefit of informing pentosan polysulfate prescribers about this condition. Effective screening and detection may help determine which patients are at high risk for this condition.

Comparing antibiotic prescribing between clinicians in UK primary care: an analysis in a cohort study of eight different measures of antibiotic prescribing

BACKGROUND

There is a need to reduce antimicrobial uses in humans. Previous studies have found variations in antibiotic (AB) prescribing between practices in primary care. This study assessed variability of AB prescribing between clinicians.

METHODS

Clinical Practice Research Datalink, which collects electronic health records in primary care, was used to select anonymised clinicians providing 500+ consultations during 2012-2017. Eight measures of AB prescribing were assessed, such as overall and incidental AB prescribing, repeat AB courses and extent of risk-based prescribing. Poisson regression models with random effect for clinicians were fitted.

RESULTS

6111 clinicians from 466 general practices were included. Considerable variability between individual clinicians was found for most AB measures. For example, the rate of AB prescribing varied between 77.4 and 350.3 per 1000 consultations; percentage of repeat AB courses within 30 days ranged from 13.1% to 34.3%; predicted patient risk of hospital admission for infection-related complications in those prescribed AB ranged from 0.03% to 0.32% (5th and 95th percentiles). The adjusted relative rate between clinicians in rates of AB prescribing was 5.23. Weak correlation coefficients (<0.5) were found between most AB measures. There was considerable variability in case mix seen by clinicians. The largest potential impact to reduce AB prescribing could be around encouraging risk-based prescribing and addressing repeat issues of ABs. Reduction of repeat AB courses to prescribing habit of median clinician would save 21 813 AB prescriptions per 1000 clinicians per year.

CONCLUSIONS

The wide variation seen in all measures of AB prescribing and weak correlation between them suggests that a single AB measure, such as prescribing rate, is not sufficient to underpin the optimisation of AB prescribing.

Universal HIV screening in the emergency department: an interrupted time series analysis

We performed a calendar-matched, 12-month, before (November 27, 2017 to November 26, 2018) and after (November 27, 2018 to November 26, 2019) study, to assess the utility of an emergency department-based HIV screening program. There were 710 and 14 335 patients screened for HIV during the pre and post-best practice alert (BPA) periods, respectively, representing more than a 20-fold increase in HIV screening following BPA implementation. Total HIV positive tests increased 5-fold following BPA implementation.

Alerting Clinicians to 1-Year Mortality Risk in Patients Hospitalized With Heart Failure: The REVEAL-HF Randomized Clinical Trial

Importance

Heart failure is a major cause of morbidity and mortality worldwide. The use of risk scores has the potential to improve targeted use of interventions by clinicians that improve patient outcomes, but this hypothesis has not been tested in a randomized trial.

Objective

To evaluate whether prognostic information in heart failure translates into improved decisions about initiation and intensity of treatment, more appropriate end-of-life care, and a subsequent reduction in rates of hospitalization or death.

Design, Setting, and Participants

This was a pragmatic, multicenter, electronic health record-based, randomized clinical trial across the Yale New Haven Health System, comprising small community hospitals and large tertiary care centers. Patients hospitalized for heart failure who had N-terminal pro-brain natriuretic peptide (NT-proBNP) levels of greater than 500 pg/mL and received intravenous diuretics within 24 hours of admission were automatically randomly assigned to the alert (intervention) or usual-care groups.

Interventions

The alert group had their risk of 1-year mortality calculated using an algorithm that was derived and validated using similar historic patients in the electronic health record. This estimate, including a categorical risk assessment, was presented to clinicians while they were interacting with a patient's electronic health record.

Main Outcomes and Measures

The primary outcome was a composite of 30-day hospital readmissions and all-cause mortality at 1 year.

Results

Between November 27, 2019, through March 7, 2021, 3124 patients were randomly assigned to the alert (1590 [50.9%]) or usual-care (1534 [49.1%]) group. The alert group had a median (IQR) age of 76.5 (65-86) years, and 796 were female patients (50.1%). Patients from the following race and ethnicity groups were included: 13 Asian (0.8%), 324 Black (20.4%), 136 Hispanic (8.6%), 1448 non-Hispanic (91.1%), 1126 White (70.8%), 6 other ethnicity (0.4%), and 127 other race (8.0%). The usual-care group had a median (IQR) age of 77 (65-86) years, and 788 were female patients (51.4%). Patients from the following race and ethnicity groups were included: 11 Asian (1.4%), 298 Black (19.4%), 162 Hispanic (10.6%), 1359 non-Hispanic (88.6%), 1077 White (70.2%), 13 other ethnicity (0.9%), and 137 other race (8.9%). Median (IQR) NT-proBNP levels were 3826 (1692-8241) pg/mL in the alert group and 3867 (1663-8917) pg/mL in the usual-care group. A total of 284 patients (17.9%) and 270 patients (17.6%) were admitted to the intensive care unit in the alert and usual-care groups, respectively. A total of 367 patients (23.1%) and 359 patients (23.4%) had a left ventricular ejection fraction of 40% or less in the alert and usual-care groups, respectively. The model achieved an area under the curve of 0.74 in the trial population. The primary outcome occurred in 619 patients (38.9%) in the alert group and 603 patients (39.3%) in the usual-care group (P = .89). There were no significant differences between study groups in the prescription of heart failure medications at discharge, the placement of an implantable cardioverter-defibrillator, or referral to palliative care.

Conclusions and Relevance

Provision of 1-year mortality estimates during heart failure hospitalization did not affect hospitalization or mortality, nor did it affect clinical decision-making.

Trial Registration

ClinicalTrials.gov Identifier NCT03845660.

Electronic Medication Management Systems: Analysis of Enhancements to Reduce Errors and Improve Workflow

BACKGROUND

Electronic medication management (eMM) has been shown to reduce medication errors; however, new safety risks have also been introduced that are associated with system use. No research has specifically examined the changes made to eMM systems to mitigate these risks.

OBJECTIVES

To (1) identify system-related medication errors or workflow blocks that were the target of eMM system updates, including the types of medications involved, and (2) describe and classify the system enhancements made to target these risks.

METHODS

In this retrospective qualitative study, documents detailing updates made from November 2014 to December 2019 to an eMM system were reviewed. Medication-related updates were classified according to "rationale for changes" and "changes made to the system."

RESULTS

One hundred and seventeen updates, totaling 147 individual changes, were made to the eMM system over the 4-year period. The most frequent reasons for changes being made to the eMM were to prevent medication errors (24% of reasons), optimize workflow (22%), and support "work as done" on paper (16%). The most frequent changes made to the eMM were options added to lists (14% of all changes), extra information made available on the screen (8%), and the wording or phrasing of text modified (8%). Approximately a third of the updates (37%) related to high-risk medications. The reasons for system changes appeared to vary over time, as eMM functionality and use expanded.

CONCLUSION

To our knowledge, this is the first study to systematically review and categorize system updates made to overcome new safety risks associated with eMM use. Optimization of eMM is an ongoing process, which changes over time as users become more familiar with the system and use is expanded to more sites. Continuous monitoring of the system is necessary to detect areas for improvement and capitalize on the benefits an electronic system can provide.

Data and HIT systems in primary care settings: an analysis of perceptions and use

PURPOSE

Electronic Health Records (EHRs) and other Health Information Technologies (HITs) pose significant challenges for clinicians, administrators and managers in the field of primary care. While there is an abundance of literature on the challenges of HIT systems in primary care, there are also practices where HITs are well-integrated and useful for care delivery. This study aims to (1) understand how exemplary primary care practices conceptualized data and HIT system use in their care delivery and (2) describe components that support and promote data and HIT system use in care delivery.

DESIGN/METHODOLOGY/APPROACH

This paper is a sub-analysis of a larger qualitative data set on exemplary primary care in which data was collected using in-depth interviews, observations, field notes and primary source documents from week-long site visits at each organization. Using a combination of qualitative analysis methods including elements of thematic analysis, discourse analysis, and qualitative comparison analysis, we examined HIT-related data across six exemplary primary care organizations.

FINDINGS

Three key components were identified that underlie engagement with data and HIT systems: data audience identification, defined data purpose and structures for participation in both data design and maintenance.

ORIGINALITY/VALUE

Within the context of primary care, these findings have implications for effective integration of HIT systems into primary care delivery.

What Oncologists Want: Identifying Challenges and Preferences on Diagnosis Data Entry to Reduce EHR-Induced Burden and Improve Clinical Data Quality

PURPOSE

Accurate recording of diagnosis (DX) data in electronic health records (EHRs) is important for clinical practice and learning health care. Previous studies show statistically stable patterns of data entry in EHRs that contribute to inaccurate DX, likely because of a lack of data entry support. We conducted qualitative research to characterize the preferences of oncological care providers on cancer DX data entry in EHRs during clinical practice.

METHODS

We conducted semistructured interviews and focus groups to uncover common themes on DX data entry preferences and barriers to accurate DX recording. Then, we developed a survey questionnaire sent to a cohort of oncologists to verify the generalizability of our initial findings. We constrained our participants to a single specialty and institution to ensure similar clinical backgrounds and clinical experience with a single EHR system.

RESULTS

A total of 12 neuro-oncologists and thoracic oncologists were involved in the interviews and focus groups. The survey developed from these two initial thrusts was distributed to 19 participants yielding a 94.7% survey response rate. Clinicians reported similar user interface experiences, barriers, and dissatisfaction with current DX entry systems including repetitive entry operations, difficulty in finding specific DX options, time-consuming interactions, and the need for workarounds to maintain efficiency. The survey revealed inefficient DX search interfaces and challenging entry processes as core barriers.

CONCLUSION

Oncologists seem to be divided between specific DX data entry and time efficiency because of current interfaces and feel hindered by the burdensome and repetitive nature of EHR data entry. Oncologists' top concern for adopting data entry support interventions is ensuring that it provides significant time-saving benefits and increasing workflow efficiency. Future interventions should account for time efficiency, beyond ensuring data entry effectiveness.

Neonatal mortality prediction with routinely collected data: a machine learning approach

BACKGROUND

Recent decreases in neonatal mortality have been slower than expected for most countries. This study aims to predict the risk of neonatal mortality using only data routinely available from birth records in the largest city of the Americas.

METHODS

A probabilistic linkage of every birth record occurring in the municipality of São Paulo, Brazil, between 2012 e 2017 was performed with the death records from 2012 to 2018 (1,202,843 births and 447,687 deaths), and a total of 7282 neonatal deaths were identified (a neonatal mortality rate of 6.46 per 1000 live births). Births from 2012 and 2016 (N = 941,308; or 83.44% of the total) were used to train five different machine learning algorithms, while births occurring in 2017 (N = 186,854; or 16.56% of the total) were used to test their predictive performance on new unseen data.

RESULTS

The best performance was obtained by the extreme gradient boosting trees (XGBoost) algorithm, with a very high AUC of 0.97 and F1-score of 0.55. The 5% births with the highest predicted risk of neonatal death included more than 90% of the actual neonatal deaths. On the other hand, there were no deaths among the 5% births with the lowest predicted risk. There were no significant differences in predictive performance for vulnerable subgroups. The use of a smaller number of variables (WHO's five minimum perinatal indicators) decreased overall performance but the results still remained high (AUC of 0.91). With the addition of only three more variables, we achieved the same predictive performance (AUC of 0.97) as using all the 23 variables originally available from the Brazilian birth records.

CONCLUSION

Machine learning algorithms were able to identify with very high predictive performance the neonatal mortality risk of newborns using only routinely collected data.

It's the Culture!-How systemic and societal constructs impact well-being

Pediatric anesthesiologists practice within a culture, a system, and a society. In this article, we provide an overview of the influence these have on the well-being or the unwellness of pediatric anesthesiologists. The scope of these issues is broad and far-reaching; thus, our goal has been to highlight those areas which would be likely to have the largest impact on well-being if addressed fully by society, institutions, and leaders in our field. We discuss the burnout-promoting aspects of medical education and training. We survey occupational factors, such as the high-stake pediatric anesthesia environment, occupational health hazards, time pressure, and the reduction in physician autonomy. We then describe societal barriers, such as the marginalization of certain populations, the US system of malpractice litigation, the stigma surrounding psychiatric care, and some of the issues related to physician reimbursement in the United States. We conclude that in order to move forward, improving physician wellness must be a focus of society, of the medical system as a whole, and of individual departments and leaders in pediatric anesthesia.

Factors determining the adherence to antimicrobial guidelines and the adoption of computerised decision support systems by physicians: A qualitative study in three European hospitals

BACKGROUND AND OBJECTIVES

Antimicrobial stewardship (AMS) programs aim to optimize antibiotic use and reduce inappropriate prescriptions through a panel of interventions. The implementation of clinical guidelines is a core strategy of AMS programs. Nevertheless, their dissemination and application remain low. Computerised decision support systems (CDSSs) offer new opportunities for semi-automated dissemination of guidelines. This qualitative study aimed at gaining an in-depth understanding of the determinants of adherence to antimicrobial prescribing guidelines and CDSSs adoption and is part of a larger project, the COMPASS trial, which aims to assess a CDSS for antimicrobial prescription. The final objective of this qualitative study is to 1) provide insights from end-users to assist in the design of the COMPASS CDSS, and to 2) help with the interpretation of the quantitative findings of the randomised controlled trial assessing the COMPASS CDSS, once data will be analysed.

METHODS

We conducted semi-structured individual interviews among in-hospital physicians in two hospitals in Switzerland and one hospital in France. Physicians were recruited by convenience sampling and snowballing until data saturation was achieved.

RESULTS

Twenty-nine physicians were interviewed. We identified three themes related to the potential barriers to guideline adherence: 1) insufficient clarity, accessibility and applicability of guidelines, 2) need of critical thinking skills to adhere to guidelines and 3) impact of the team prescribing process and peers on physicians in training. As to the perception of CDSSs, we identified four themes that could affect their adoption: 1) CDSSs are perceived as time-consuming, 2) CDSSs could reduce physicians' critical thinking and professional autonomy and raise new medico-legal issues, 3) effective CDSSs would require specific features, such as ease of use and speed, which affect usability and 4) CDSSs could improve physicians' adherence to guidelines and patient care.

DISCUSSION

CDSSs have the potential to overcome several barriers for adherence to guidelines by improving accessibility and providing individualised recommendations backed by patient data. When designing CDSSs, mixed clinical and information technology teams should focus on user-friendliness, ergonomics, workflow integration and transparency of the decision-making process.

A Late Attempt to Involve End Users in the Design of Medication-Related Alerts: Survey Study

Background

When users of electronic medical records (EMRs) are presented with large numbers of irrelevant computerized alerts, they experience alert fatigue, begin to ignore alert information, and override alerts without processing or heeding alert recommendations. Anecdotally, doctors at our study site were dissatisfied with the medication-related alerts being generated, both in terms of volume being experienced and clinical relevance.

Objective

This study aimed to involve end users in the redesign of medication-related alerts in a hospital EMR, 4 years post implementation.

Methods

This work was undertaken at a private not-for-profit teaching hospital in Sydney, Australia. Since EMR implementation in 2015, the organization elected to implement all medication-related alert types available in the system for prescribers: allergy and intolerance alerts, therapeutic duplication alerts, pregnancy alerts, and drug-drug interaction alerts. The EMR included no medication administration alerts for nurses. To obtain feedback on current alerts and suggestions for redesign, a Web-based survey was distributed to all doctors and nurses at the site via hospital mailing lists.

Results

Despite a general dissatisfaction with alerts, very few end users completed the survey. In total, only 3.37% (36/1066) of doctors and 14.5% (60/411) of nurses took part. Approximately 90% (30/33) of doctors who responded held the view that too many alerts were triggered in the EMR. Doctors suggested that most alerts be removed and that alerts be more specific and less sensitive. In contrast, 97% (58/60) of the nurse respondents indicated that they would like to receive medication administration alerts in the EMR. Most nurses indicated that they would like to receive all the alert types available at all severity levels.

Conclusions

Attempting to engage with end users several years post implementation was challenging. Involving users so late in the implementation process may lead to clinicians viewing the provision of feedback to be futile. Seeking user feedback on usefulness, volume, and design of alerts is extremely valuable; however, we suggest this is undertaken early, preferably before system implementation.

Reducing Alert Burden in Electronic Health Records: State of the Art Recommendations from Four Health Systems

BACKGROUND

Electronic health record (EHR) alert fatigue, while widely recognized as a concern nationally, lacks a corresponding comprehensive mitigation plan.

OBJECTIVES

The goal of this manuscript is to provide practical guidance to clinical informaticists and other health care leaders who are considering creating a program to manage EHR alerts.

METHODS

This manuscript synthesizes several approaches and recommendations for better alert management derived from four U.S. health care institutions that presented their experiences and recommendations at the American Medical Informatics Association 2019 Clinical Informatics Conference in Atlanta, Georgia, United States. The assembled health care institution leaders represent academic, pediatric, community, and specialized care domains. We describe governance and management, structural concepts and components, and human-computer interactions with alerts, and make recommendations regarding these domains based on our experience supplemented with literature review. This paper focuses on alerts that impact bedside clinicians.

RESULTS

The manuscript addresses the range of considerations relevant to alert management including a summary of the background literature about alerts, alert governance, alert metrics, starting an alert management program, approaches to evaluating alerts prior to deployment, and optimization of existing alerts. The manuscript includes examples of alert optimization successes at two of the represented institutions. In addition, we review limitations on the ability to evaluate alerts in the current state and identify opportunities for further scholarship.

CONCLUSION

Ultimately, alert management programs must strive to meet common goals of improving patient care, while at the same time decreasing the alert burden on clinicians. In so doing, organizations have an opportunity to promote the wellness of patients, clinicians, and EHRs themselves.

Patient-focused outcomes are infrequently reported in pediatric health information technology trials: a systematic review

OBJECTIVES

Billions of dollars have been invested in Health Information Technologies (HITs), and randomized controlled trials (RCTs) have been conducted to identify the effects of these interventions. Our objective was to identify the types of outcomes that were measured and reported in these RCTs.

STUDY DESIGN AND SETTING

We completed a systematic review (Medline, EMBASE, and CENTRAL databases) of RCTs involving children (<18 years) and utilizing HIT interventions.

RESULTS

We identified 45 RCTs involving 323,945 children. Most studies reported process outcomes (n = 40/45 (88.9%)) but did not include patient-focused outcomes such as patient/carer functioning (n = 12/45 (26.7%)), clinical/physiological health (n = 10/45, 22.2%), quality of life (n = 3/45, 6.7%), or mortality (n = 1/45, 2.2%). Only 3 of 45 (6.7%) studies reported an evaluation of adverse events. In only 14 of 45 (31.1%) studies was it clear that all outcomes that were measured were reported.

CONCLUSION

It is difficult to use RCTs to fully evaluate the benefits and risks of using HIT interventions in pediatric health care settings because patient-focused outcomes and adverse events are rarely reported. Measures to improve the quality of future trials may include the publication of study protocols and the development of an outcome reporting framework or core outcome set.

Delivering the right information to the right person at the right time to facilitate deprescribing in hospital: a mixed methods multisite study to inform decision support design in Australia

OBJECTIVES

To inform the design of electronic decision support (EDS) to facilitate deprescribing in hospitals we set out to (1) explore the current processes of in-hospital medicines review, deprescribing and communication of deprescribing decisions with the patient's general practitioner (GP), (2) identify barriers to undertaking these tasks and (3) determine user preferences for EDS.

DESIGN

Multimethod, multisite study comprising observations, semistructured interviews and focus groups.

SETTING

General medicine, geriatric medicine and rehabilitation wards at six hospitals in two local health districts in Sydney, Australia and primary care practices in one primary healthcare district in Sydney, Australia.

PARTICIPANTS

149 participants took part in observations, interviews and focus groups, including 69 hospital doctors, 13 nurses, 55 pharmacists and 12 GPs.

MAIN OUTCOME MEASURES

Observational data on who was involved in medicines review and deprescribing, when medicines review took place, and what artefacts (eg, forms) were used. Participants reported perceptions of medicines review, polypharmacy and deprescribing and preferences for EDS.

RESULTS

Deprescribing, undertaken during medicines review, was typically performed by a junior doctor, following a decision to deprescribe by a senior doctor. Key barriers to deprescribing included a perception that deprescribing was not the responsibility of hospital doctors, a lack of confidence among junior doctors and pharmacists in broaching this topic with senior doctors and a lack of patient engagement in the deprescribing process. In designing EDS, the tools, likely to be used by junior doctors, pharmacists and nurses, should be available throughout the hospitalisation and should comprise non-interruptive evidence-based guidance on why and how to deprescribe.

CONCLUSIONS

Deprescribing decisions are complex and influenced by multiple factors. The implementation of EDS alone is unlikely to address all barriers identified. To achieve sustained improvements in monitoring of polypharmacy and subsequent deprescribing, a multifaceted intervention is needed.

The safety of computerised prescribing in hospitals

The implementation of computerised prescribing can result in large reductions in prescribing error rates. The flow-on effects to patient outcomes are not well studied

The reduction in errors is dependent on prescribers becoming proficient in using the electronic prescribing system. All potential safety benefits are therefore not expected to be achieved immediately

Electronic prescribing systems introduce new types of errors, most frequently errors in selection. Some of these errors can be prevented if the system is well designed

Computerised decision support embedded in electronic prescribing systems has enormous potential to improve medication safety. However, current support systems have a limited capacity to provide context-relevant advice to prescribers