National Trends in the Safety Performance of Electronic Health Record Systems From 2009 to 2018

Implementation and delivery of electronic health records training programs for nurses working in inpatient settings: a scoping review

OBJECTIVES

Well-designed electronic health records (EHRs) training programs for clinical practice are known to be valuable. Training programs should be role-specific and there is a need to identify key implementation factors of EHR training programs for nurses. This scoping review (1) characterizes the EHR training programs used and (2) identifies their implementation facilitators and barriers.

MATERIALS AND METHODS

We searched MEDLINE, CINAHL, PsycINFO, and Web of Science on September 3, 2023, for peer-reviewed articles that described EHR training program implementation or delivery to nurses in inpatient settings without any date restrictions. We mapped implementation factors to the Consolidated Framework for Implementation Research. Additional themes were inductively identified by reviewing these findings.

RESULTS

This review included 30 articles. Healthcare systems' approaches to implementing and delivering EHR training programs were highly varied. For implementation factors, we observed themes in innovation (eg, ability to practice EHR skills after training is over, personalizing training, training pace), inner setting (eg, availability of computers, clear documentation requirements and expectations), individual (eg, computer literacy, learning preferences), and implementation process (eg, trainers and support staff hold nursing backgrounds, establishing process for dissemination of EHR updates). No themes in the outer setting were observed.

DISCUSSION

We found that multilevel factors can influence the implementation and delivery of EHR training programs for inpatient nurses. Several areas for future research were identified, such as evaluating nurse preceptorship models and developing training programs for ongoing EHR training (eg, in response to new EHR workflows or features).

CONCLUSIONS

This scoping review highlighted numerous factors pertaining to training interventions, healthcare systems, and implementation approaches. Meanwhile, it is unclear how external factors outside of a healthcare system influence EHR training programs. Additional studies are needed that focus on EHR retraining programs, comparing outcomes of different training models, and how to effectively disseminate updates with the EHR to nurses.

Exploring potential drivers of patient engagement with their health data through digital platforms: A scoping review

BACKGROUND

Patient engagement when providing patient access to health data results from an interaction between the available tools and individual capabilities. The recent digital advancements of the healthcare field have altered the manifestation and importance of patient engagement. However, a comprehensive assessment of what factors contribute to patient engagement remain absent. In this review article, we synthesised the most frequently discussed factors that can foster patient engagement with their health data.

METHODS

A scoping review was conducted in MEDLINE, Embase, and Google Scholar. Relevant data were synthesized within 7 layers using a thematic analysis: (1) social and demographic factors, (2) patient ability factors, (3) patient motivation factors, (4) factors related to healthcare professionals' attitudes and skills, (5) health system factors, (6) technological factors, and (7) policy factors.

RESULTS

We identified 5801 academic and 200 Gy literature records, and included 292 (4.83%) in this review. Overall, 44 factors that can affect patient engagement with their health data were extracted. We extracted 6 social and demographic factors, 6 patient ability factors, 12 patient motivation factors, 7 factors related to healthcare professionals' attitudes and skills, 4 health system factors, 6 technological factors, and 3 policy factors.

CONCLUSIONS

Improving patient engagement with their health data enables the development of patient-centered healthcare, though it can also exacerbate existing inequities. While expanding patient access to health data is an important step towards fostering shared decision-making in healthcare and subsequently empowering patients, it is important to ensure that these developments reach all sectors of the community.

Electronic Health Record Usability, Satisfaction, and Burnout for Family Physicians

Importance

Electronic health record (EHR) work has been associated with decreased physician well-being. Understanding the association between EHR usability and physician satisfaction and burnout, and whether team and technology strategies moderate this association, is critical to informing efforts to address EHR-associated physician burnout.

Objectives

To measure family physician satisfaction with their EHR and EHR usability across functions and evaluate the association of EHR usability with satisfaction and burnout, as well as the moderating association of 4 team and technology EHR efficiency strategies.

Design, Setting, and Participants

This study uses data from a cross-sectional survey conducted from December 12, 2021, to October 17, 2022, of all family physicians seeking American Board of Family Medicine recertification in 2022.

Exposure

Physicians perceived EHR usability across 6 domains, as well as adoption of 4 EHR efficiency strategies: scribes, support from other staff, templated text, and voice recognition or transcription.

Main Outcomes and Measures

Physician EHR satisfaction and frequency of experiencing burnout measured with a single survey item ("I feel burned out from my work"), with answers ranging from "never" to "every day."

Results

Of the 2067 physicians (1246 [60.3%] younger than 50 years; 1051 men [50.9%]; and 1729 [86.0%] practicing in an urban area) who responded to the survey, 562 (27.2%) were very satisfied and 775 (37.5%) were somewhat satisfied, while 346 (16.7%) were somewhat dissatisfied and 198 (9.6%) were very dissatisfied with their EHR. Readability of information had the highest usability, with 543 physicians (26.3%) rating it as excellent, while usefulness of alerts had the lowest usability, with 262 physicians (12.7%) rating it as excellent. In multivariable models, good or excellent usability for entering data (β = 0.09 [95% CI, 0.05-0.14]; P < .001), alignment with workflow processes (β = 0.11 [95% CI, 0.06-0.16]; P < .001), ease of finding information (β = 0.14 [95% CI, 0.09-0.19]; P < .001), and usefulness of alerts (β = 0.11 [95% CI, 0.06-0.16]; P < .001) were associated with physicians being very satisfied with their EHR. In addition, being very satisfied with the EHR was associated with reduced frequency of burnout (β = -0.64 [95% CI, -1.06 to -0.22]; P < .001). In moderation analysis, only physicians with highly usable EHRs saw improvements in satisfaction from adopting efficiency strategies.

Conclusions and Relevance

In this survey study of physician EHR usability and satisfaction, approximately one-fourth of family physicians reported being very satisfied with their EHR, while another one-fourth reported being somewhat or very dissatisfied, a concerning finding amplified by the inverse association between EHR satisfaction and burnout. Electronic health record-based alerts had the lowest reported usability, suggesting EHR vendors should focus their efforts on improving alerts. Electronic health record efficiency strategies were broadly adopted, but only physicians with highly usable EHRs realized gains in EHR satisfaction from using these strategies, suggesting that EHR burden-reduction interventions are likely to have heterogenous associations across physicians with different EHRs.

The effect of electronic medical records on medication errors, workload, and medical information availability among qualified nurses in Israel- a cross sectional study

BACKGROUND

Errors in medication administration by qualified nursing staff in hospitals are a significant risk factor for patient safety. In recent decades, electronic medical records (EMR) systems have been implemented in hospitals, and it has been claimed that they contribute to reducing such errors. However, systematic research on the subject in Israel is scarce. This study examines the position of the qualified nursing staff regarding the impact of electronic medical records systems on factors related to patient safety, including errors in medication administration, workload, and availability of medical information.

METHODS

This cross-sectional study examines three main variables: Medication errors, workload, and medical information availability, comparing two periods- before and after EMR implementation based on self-reports. A final sample of 591 Israeli nurses was recruited using online private social media groups to complete an online structured questionnaire. The questionnaires included items assessing workload (using the Expanding Nursing Stress Scale), medical information availability (the Carrington-Gephart Unintended Consequences of Electronic Health Record Questionnaire), and medical errors (the Medical Error Checklists). Items were assessed twice, once for the period before the introduction of electronic records and once after. In addition, participants answered open-ended questions that were qualitatively analyzed.

RESULTS

Nurses perceive the EMR as reducing the extent of errors in drug administration (mean difference = -0.92 ± 0.90SD, p < 0.001), as well as the workload (mean difference = -0.83 ± 1.03SD, p < 0.001) by ∼ 30% on average, each. Concurrently, the systems are perceived to require a longer documentation time at the expense of patients' treatment time, and they may impair the availability of medical information by about 10% on average.

CONCLUSION

The results point to nurses' perceived importance of EMR systems in reducing medication errors and relieving the workload. Despite the overall positive attitudes toward EMR systems, nurses also report that they reduce information availability compared to the previous pen-and-paper approach. A need arises to improve the systems in terms of planning and adaptation to the field and provide appropriate technical and educational support to nurses using them.

Patient Safety and Artificial Intelligence in Clinical Care

This Viewpoint offers 3 recommendations for health care organizations and other stakeholders to consider as part of the Health and Human Services’ artificial intelligence safety program.

How Safe are Outpatient Electronic Health Records? An Evaluation of Medication-Related Decision Support using the Ambulatory Electronic Health Record Evaluation Tool

BACKGROUND

The purpose of the Ambulatory Electronic Health Record (EHR) Evaluation Tool is to provide outpatient clinics with an assessment that they can use to measure the ability of the EHR system to detect and prevent common prescriber errors. The tool consists of a medication safety test and a medication reconciliation module.

OBJECTIVES

The goal of this study was to perform a broad evaluation of outpatient medication-related decision support using the Ambulatory EHR Evaluation Tool.

METHODS

We performed a cross-sectional study with 10 outpatient clinics using the Ambulatory EHR Evaluation Tool. For the medication safety test, clinics were provided test patients and associated medication test orders to enter in their EHR, where they recorded any advice or information they received. Once finished, clinics received an overall percentage score of unsafe orders detected and individual order category scores. For the medication reconciliation module, clinics were asked to electronically reconcile two medication lists, where modifications were made by adding and removing medications and changing the dosage of select medications.

RESULTS

For the medication safety test, the mean overall score was 57%, with the highest score being 70%, and the lowest score being 40%. Clinics performed well in the drug allergy (100%), drug dose daily (85%), and inappropriate medication combinations (74%) order categories. Order categories with the lowest performance were drug laboratory (10%) and drug monitoring (3%). Most clinics (90%) scored a 0% in at least one order category. For the medication reconciliation module, only one clinic (10%) could reconcile medication lists electronically; however, there was no clinical decision support available that checked for drug interactions.

CONCLUSION

We evaluated a sample of ambulatory practices around their medication-related decision support and found that advanced capabilities within these systems have yet to be widely implemented. The tool was practical to use and identified substantial opportunities for improvement in outpatient medication safety.

Variation in Family Physicians' Experiences Across Different Electronic Health Record Platforms: a Descriptive Study

BACKGROUND

Electronic health records (EHRs) have been connected to excessive workload and physician burnout. Little is known about variation in physician experience with different EHRs, however.

OBJECTIVE

To analyze variation in reported usability and satisfaction across EHRs.

DESIGN

Internet-based survey available between December 2021 and October 2022 integrated into American Board of Family Medicine (ABFM) certification process.

PARTICIPANTS

ABFM-certified family physicians who use an EHR with at least 50 total responding physicians.

MEASUREMENTS

Self-reported experience of EHR usability and satisfaction.

KEY RESULTS

We analyzed the responses of 3358 physicians who used one of nine EHRs. Epic, athenahealth, and Practice Fusion were rated significantly higher across six measures of usability. Overall, between 10 and 30% reported being very satisfied with their EHR, and another 32 to 40% report being somewhat satisfied. Physicians who use athenahealth or Epic were most likely to be very satisfied, while physicians using Allscripts, Cerner, or Greenway were the least likely to be very satisfied. EHR-specific factors were the greatest overall influence on variation in satisfaction: they explained 48% of variation in the probability of being very satisfied with Epic, 46% with eClinical Works, 14% with athenahealth, and 49% with Cerner.

CONCLUSIONS

Meaningful differences exist in physician-reported usability and overall satisfaction with EHRs, largely explained by EHR-specific factors. User-centric design and implementation, and robust ongoing evaluation are needed to reduce physician burden and ensure excellent experience with EHRs.

Inpatient EHR User Experience and Hospital EHR Safety Performance

IMPORTANCE

Despite the broad adoption and optimization of electronic health record (EHR) systems across the continuum of care, serious usability and safety problems persist.

OBJECTIVE

To assess whether EHR safety performance is associated with EHR frontline user experience in a national sample of hospitals.

DESIGN, SETTING, AND PARTICIPANTS

This cross-sectional study included all US adult hospitals that used the National Quality Forum Leapfrog Health IT Safety Measure and also used the ARCH Collaborative EHR User experience survey from January 1, 2017, to January 1, 2019. Data analysis was performed from September 2020 to November 2022.

MAIN OUTCOMES AND MEASURES

The primary outcomes were hospital performance on the Leapfrog Health IT Safety measure (overall and 10 subcomponents) and the ARCH collaborative frontline user experience scores (overall and 8 subcomponents). Ordinary least squares models with survey responses clustered by hospital were used to assess associations between the overall measures and their subcomponents.

RESULTS

There were 112 hospitals and 5689 frontline user surveys included in the study. Hospitals scored a mean of 0.673 (range, 0.297-0.973) on the Leapfrog Health IT safety measure; the mean ARCH EHR user experience score was 3.377 (range, 1 [best] to 5 [worst]). The adjusted β coefficient between the overall safety score and overall user experience score was 0.011 (95% CI, 0.006-0.016). The ARCH overall score was also significantly associated with 10 subcategory scores of the Leapfrog Health IT safety score, and the overall Leapfrog score was associated with the 8 subcategory scores of the ARCH user experience score.

CONCLUSIONS AND RELEVANCE

This cross-sectional study found a positive association between frontline user-rated EHR usability and EHR safety performance. This finding suggests that improving EHR usability, which is a current well-known pain point for EHR users, could have direct benefits in terms of improved EHR safety.

Cell Therapy Informatics: Updates on the Integration of HCT/IEC Functionalities into an Electronic Medical Record System in the US to Promote Efficiency, Patient Safety, Research, and Data Interoperability

The use of electronic health/medical record (EMR) systems has streamlined medical practice and improved efficiency of clinical care in recent years. However, EMR systems are not generally well designed to support research and tracking of longitudinal outcomes across populations, which are particularly important in hematopoietic stem cell transplantation (HCT) and immune effector cell therapy (IEC), where data reporting to registries and regulatory agencies are often required. Since its formation in 2014, the HCT EMR user group has worked with a large EMR vendor (Epic) to develop many functionalities within the EMR to improve the care of HCT/IEC patients and facilitate the capture of HCT/IEC data in an easily interoperable format. Awareness and the widespread adoption of these new tools among transplant centers remains a challenge, however. In this report, we aim to increase awareness and adoption of these new features in the Epic EMR across the transplantation community, advocate for the use of data standards, and promote future collaboration with other commercial EMRs to develop standardized HCT/IEC content to improve patient care and facilitate interoperable data exchange.

Development and Usability Testing of a System to Detect Adverse Events and Medical Mistakes

Many inpatient hospital visits result in adverse events, and a disproportionate number of adverse events are thought to occur among vulnerable populations. The personal and financial costs of these events are significant at the individual, care team, and system levels. Existing methods for identifying adverse events, such as the Institute for Healthcare Improvement Global Trigger Tool, typically involve retroactive chart review to identify risks or triggers and then detailed review to determine whether and what type of harm occurred. These methods are limited in scalability and ability to prospectively identify triggers to enable intervention before an adverse event occurs. The purpose of this study was to gather usability feedback on a prototype of an informatics intervention based on the IHI method. The prototype electronic Global Trigger Tool collects and presents risk factors for adverse events. Six health professionals identified as potential users in clinical, quality improvement, and research roles were interviewed. Interviewees universally described insufficiencies of current methods for tracking adverse events and offered important information on desired future user interface features. A key next step will be to refine and integrate an electronic Global Trigger Tool system into standards-compliant electronic health record systems as a patient safety module.

Examining medication ordering errors using AHRQ network of patient safety databases

BACKGROUND

Studies examining the effects of computerized order entry (CPOE) on medication ordering errors demonstrate that CPOE does not consistently prevent these errors as intended. We used the Agency for Healthcare Research and Quality (AHRQ) Network of Patient Safety Databases (NPSD) to investigate the frequency and degree of harm of reported events that occurred at the ordering stage, characterized by error type.

MATERIALS AND METHODS

This was a retrospective observational study of safety events reported by healthcare systems in participating patient safety organizations from 6/2010 through 12/2020. All medication and other substance ordering errors reported to NPSD via common format v1.2 between 6/2010 through 12/2020 were analyzed. We aggregated and categorized the frequency of reported medication ordering errors by error type, degree of harm, and demographic characteristics.

RESULTS

A total of 12 830 errors were reported during the study period. Incorrect dose accounted for 3812 errors (29.7%), followed by incorrect medication 2086 (16.3%), and incorrect duration 765 (6.0%). Of 5282 events that reached the patient and had a known level of severity, 12 resulted in death, 4 resulted in severe harm, 45 resulted in moderate harm, 341 resulted in mild harm, and 4880 resulted in no harm.

CONCLUSION

Incorrect dose and incorrect drug orders were the most commonly reported and harmful types of medication ordering errors. Future studies should aim to develop and test interventions focused on CPOE to prevent medication ordering errors, prioritizing wrong-dose and wrong-drug errors.

Automated Detection of Patient Harm: Implementation and Prospective Evaluation of a Real-Time Broad-Spectrum Surveillance Application in a Hospital With Limited Resources

OBJECTIVES

This study aimed to prospectively validate an application that automates the detection of broad categories of hospital adverse events (AEs) extracted from a basic hospital information system, and to efficiently mobilize resources to reduce the level of acquired patient harm.

METHODS

Data were collected from an internally designed software, extracting results from 14 triggers indicative of patient harm, querying clinical and administrative databases including all inpatient admissions (n = 8760) from October 2019 to June 2020. Representative samples of the triggered cases were clinically validated using chart review by a consensus expert panel. The positive predictive value (PPV) of each trigger was evaluated, and the detection sensitivity of the surveillance system was estimated relative to incidence ranges in the literature.

RESULTS

The system identified 394 AEs among 946 triggered cases, associated with 291 patients, yielding an overall PPV of 42%. Variability was observed among the trigger PPVs and among the estimated detection sensitivities across the harm categories, the highest being for the healthcare-associated infections. The median length of stay of patients with an AE showed to be significantly higher than the median for the overall patient population.

CONCLUSIONS

This application was able to identify AEs across a broad spectrum of harm categories, in a real-time manner, while reducing the use of resources required by other harm detection methods. Such a system could serve as a promising patient safety tool for AE surveillance, allowing for timely, targeted, and resource-efficient interventions, even for hospitals with limited resources.

Failure in Medical Practice: Human Error, System Failure, or Case Severity?

The success rate in medical practice will probably never reach 100%. Success rates depend on many factors. Defining the success rate is both a technical and a philosophical issue. In opposition to the concept of success, medical failure should also be discussed. Its causality is multifactorial and extremely complex. Its actual rate and its real impact are unknown. In medical practice, failure depends not only on the human factor but also on the medical system and has at its center a very important variable-the patient. To combat errors, capturing, tracking, and analyzing them at an institutional level are important. Barriers such as the fear of consequences or a specific work climate or culture can affect this process. Although important data regarding medical errors and their consequences can be extracted by analyzing patient outcomes or using quality indicators, patient stories (clinical cases) seem to have the greatest impact on our subconscious as medical doctors and nurses and these may generate the corresponding and necessary reactions. Every clinical case has its own story. In this study, three different cases are presented to illustrate how human error, the limits of the system, and the particularities of the patient's condition (severity of the disease), alone or in combination, may lead to tragic outcomes There is a need to talk openly and in a balanced way about failure, regardless of its cause, to look at things as they are, without hiding the inconvenient truth. The common goal is not to find culprits but to find solutions and create a culture of safety.

Association Between Electronic Health Record Time and Quality of Care Metrics in Primary Care

IMPORTANCE

Physicians across the US spend substantial time working in the electronic health record (EHR), with primary care physicians (PCPs) spending the most time. The association between EHR time and ambulatory care quality outcomes is unclear.

OBJECTIVE

To characterize measures of EHR use and ambulatory care quality performance among PCPs.

DESIGN, SETTING, AND PARTICIPANTS

A cross-sectional study of PCPs with longitudinal patient panels using a single EHR vendor was conducted at Brigham and Women's Hospital and Massachusetts General Hospital during calendar year 2021.

EXPOSURES

Independent variables included PCPs demographic and practice characteristics and EHR time measures (PCP-level mean of daily total EHR time, after-hours time, time from 5:30 pm to 7:00 am and time on weekends, and daily EHR time on notes, sending and receiving patient, staff, results, prescription, or system messages [in-basket], and clinical review).

MAIN OUTCOMES AND MEASURES

Outcome variables were ambulatory quality measures (year-end, PCP panel-level achievement of targets for hemoglobin A1c level control, lipid management, hypertension control, diabetes screening, and breast cancer screening).

RESULTS

The sample included 291 physicians (174 [59.8%] women). Median panel size was 829 (IQR, 476-1157) patients and mean (SD) clinical full-time equivalent was 0.54 (0.27). The PCPs spent a mean (SD) of 145.9 (64.6) daily minutes on the EHR. There were significant associations between EHR time and panel-level achievement of hemoglobin A1c control, hypertension control, and breast cancer screening targets. In adjusted analyses, each additional 15 minutes of total daily EHR time was associated with 0.58 (95% CI, 0.32-0.84) percentage point greater panel-level hemoglobin A1c control, 0.52 (95% CI, 0.33-0.71) percentage point greater hypertension control, and 0.28 (95% CI, 0.05-0.52) higher breast cancer screening rates. Each daily additional 15 minutes of in-basket time was associated with 2.26 (95% CI, 1.05-3.48) greater panel-wide hemoglobin A1c control, 1.65 (95% CI, 0.83-2.47) percentage point greater hypertension control, and 1.26 (95% CI, 0.51-2.02) percentage point higher breast cancer screening rates. Associations were largely concentrated among PCPs with 0.5 clinical full-time equivalent or less. There were no associations between EHR use metrics and diabetes screening or lipid management in patients with cardiovascular disease.

CONCLUSIONS AND RELEVANCE

This cross-sectional study found an association between EHR time and some measures of ambulatory care quality. Although increased EHR time is associated with burnout, it may represent a level of thoroughness or communication that enhances certain outcomes. It may be useful for future studies to characterize payment models, workflows, and technologies that enable high-quality ambulatory care delivery while minimizing EHR burden.

Efficiency and Safety of Electronic Health Records in Switzerland-A Comparative Analysis of 2 Commercial Systems in Hospitals

OBJECTIVES

Differences in efficiency and safety between 2 electronic health record (systems A and B) in Swiss hospitals were investigated.

METHODS

In a scenario-based usability test under experimental conditions, a total of 100 physicians at 4 hospitals were asked to complete typical routine tasks, like medication or imaging orders. Differences in number of mouse clicks and time-on-task as indicators of efficiency and error type, error count, and rate as indicators of patient safety between hospital sites were analyzed. Time-on-task and clicks were correlated with error count.

RESULTS

There were differences in efficiency and safety between hospitals. Overall, physicians working with system B required less clicks (A: 511, B: 442, P = 0.001) and time (A: 2055 seconds, B: 1713 seconds, P = 0.055) and made fewer errors (A: 40%, B: 27%, P < 0.001). No participant completed all tasks correctly. The most frequent error in medication and radiology ordering was a wrong dose and a wrong level, respectively. Time errors were particularly prevalent in laboratory orders. Higher error counts coincided with longer time-on-task (r = 0.50, P < 0.001) and more clicks (r = 0.47, P < 0.001).

CONCLUSIONS

The variations in clicks, time, and errors are likely due to naive functionality and design of the systems and differences in their implementation. The high error rates coincide with inefficiency and jeopardize patient safety and produce economic costs and burden on physicians. The results raise usability concerns with potential for severe patient harm. A deeper understanding of differences as well as regulative guidelines and policy making are needed.

Mapping progress in intravascular catheter quality surveillance: An Australian case study of electronic medical record data linkage

Background and significance

Intravascular (IV) catheters are the most invasive medical device in healthcare. Localized priority-setting related to IV catheter quality surveillance is a key objective of recent healthcare reform in Australia. We sought to determine the plausibility of using electronic health record (EHR) data for catheter surveillance by mapping currently available data across state-wide platforms. This work has identified barriers and facilitators to a state-wide EHR surveillance initiative.

Materials and methods

Data variables were generated and mapped from routinely used EHR sources across Queensland, Australia through a systematic search of gray literature and expert consultation with clinical information specialists. EHR systems were eligible for inclusion if they collected data related to IV catheter insertion, care, or outcomes of hospitalized patients. Generated variables were mapped against international recommendations for IV catheter surveillance, with data linkage and data export capacity narratively summarized.

Results

We identified five EHR systems, namely, iEMR, MetaVision ICU®, Multiprac, RiskMan, and the Nephrology Registry. Systems were used across jurisdictions and hospital wards. Data linkage was not evident across systems. Extraction processes for catheter data were not standardized, lacking clear and reliable extraction techniques. In combination, EHR systems collected 43/50 international variables recommended for catheter surveillance, however, individual systems collected a median of 24/50 (IQR 22, 30) variables. We did not identify integrated clinical analytic systems (incorporating machine learning) to support clinical decision making or for risk stratification (e.g., catheter-related infection).

Conclusion

Current data linkage across EHR systems limits the development of an IV catheter quality surveillance system to provide timely data related to catheter complications and harm. To facilitate reliable and timely surveillance of catheter outcomes using clinical informatics, substantial work is needed to overcome existing barriers and transform health surveillance.

Development and pilot evaluation of an electronic health record usability and safety self-assessment tool

Objective

Poor electronic health record (EHR) usability contributes to clinician burnout and poses patent safety risks. Site-specific customization and configuration of EHRs require individual EHR system usability and safety testing which is resource intensive. We developed and pilot-tested a self-administered EHR usability and safety assessment tool, focused on computerized provider order entry (CPOE), which can be used by any facility to identify specific issues. In addition, the tool provides recommendations for improvement.

Materials and Methods

An assessment tool consisting of 104 questions was developed and pilot-tested at 2 hospitals, one using a Cerner EHR and the other using Epic. Five physicians at each site participated in and completed the assessment. Participant response accuracy compared to actual EHR interactions, consistency across participants, and usability issues identified through the tool were measured at each site.

Results

Across sites, participants answered an average of 46 questions in 23 min with 89.9% of responses either correct or partially correct. The tool identified 8 usability and safety issues at one site and 7 at the other site across medication, laboratory, and radiology CPOE functions.

Discussion

The tool shows promise as a method to rapidly evaluate EHR usability and safety and provide guidance on specific areas for improvement. Important improvements to the evaluation tool were identified including the need to clarify certain questions and provide definitions for usability terminology.

Conclusion

A self-administered usability and safety assessment tool can serve to identify specific usability and safety issues in the EHR and provide guidance for improvements.

Potential Drug Interactions Between Psychotropics and Intravenous Chemotherapeutics Used by Patients With Cancer

Introduction: Patients undergoing cancer treatment usually have comorbidities, and psychiatric disorders are commonly seen in these patients. For the treatment of these psychiatric disorders, the use of psychotropic drugs is common, turning these patients susceptible to untoward drug interactions. Therefore, the aim of this study was to estimate the prevalence of clinically relevant drug-drug interactions (DDI) between chemotherapeutic and psychotropic agents in patients with cancer treated at an oncology service in southern Brazil. Methods: An observational epidemiological study with a cross-sectional census-type design was carried out between October and December 2020. The drug-drug interactions were identified through consultation and analysis of the Medscape Drug Interaction Check and Micromedex databases. The interactions were classified as major, when the interaction can be fatal and/or require medical intervention to avoid or minimize serious adverse effects and moderate, when the interaction can exacerbate the patient's condition and/or requires changes in therapy. Results: A total of 74 patients was included in the study among the 194 patients seen in the oncology service during the period studied. A total of 24 (32.4%) DDIs were found, 21 (87.5%) of which were classified as being of major risk and 3 (12.5%) as moderate risk. According to the mechanism of action, 19 (79.1%) were classified as pharmacodynamic interactions and 5 (20.9%) as pharmacokinetic interactions. Conclusion: It was shown that a considerable percentage of patients undergoing intravenous chemotherapy are at risk of pharmacological interaction with psychotropic drugs. Thus, it is essential that the oncologist considers all psychotropic drugs and other drugs used by patients in order to avoid drug-drug interactions.

An e-Delphi study to obtain expert consensus on the level of risk associated with preventable e-prescribing events

Aims

We aim to seek expert opinion and gain consensus on the risks associated with a range of prescribing scenarios, preventable using e‐prescribing systems, to inform the development of a simulation tool to evaluate the risk and safety of e‐prescribing systems (ePRaSE).

Methods

We conducted a two‐round e‐Delphi survey where expert participants were asked to score pre‐designed prescribing scenarios using a five‐point Likert scale to ascertain the likelihood of occurrence of the prescribing event, likelihood of occurrence of harm and the severity of the harm.

Results

Twenty‐four experts consented to participate with 15 pand 13 participants completing rounds 1 and 2, respectively. Experts agreed on the level of risk associated with 136 out of 178 clinical scenarios with 131 scenarios categorised as high or extreme risk.

Conclusion

We identified 131 extreme or high‐risk prescribing scenarios that may be prevented using e‐prescribing clinical decision support. The prescribing scenarios represent a variety of categories, with drug–disease contraindications being the most frequent, representing 37 (27%) scenarios, and antimicrobial agents being the most common drug class, representing 28 (21%) of the scenarios. Our e‐Delphi study has achieved expert consensus on the risk associated with a range of clinical scenarios with most of the scenarios categorised as extreme or high risk. These prescribing scenarios represent the breadth of preventable prescribing error categories involving both basic and advanced clinical decision support. We will use the findings of this study to inform the development of the e‐prescribing risk and safety evaluation tool.

Patients’ willingness and ability to identify and respond to errors in their personal health records: a mixed methods analysis of cross-sectional survey data (Preprint)

Background

Errors in electronic health records are known to contribute to patient safety incidents; however, systems for checking the accuracy of patient records are almost nonexistent. Personal health records (PHRs) enabling patient access to and interaction with the clinical records offer a valuable opportunity for patients to actively participate in error surveillance.

Objective

This study aims to evaluate patients’ willingness and ability to identify and respond to errors in their PHRs.

Methods

A cross-sectional survey was conducted using a web-based questionnaire. Patient sociodemographic data were collected, including age, sex, ethnicity, educational level, health status, geographical location, motivation to self-manage, and digital health literacy (measured using the eHealth Literacy Scale tool). Patients with experience of using the Care Information Exchange (CIE) portal, who specified both age and sex, were included in these analyses. The patients’ responses to 4 relevant survey items (closed-ended questions, some with space for free-text comments) were examined to understand their willingness and ability to identify and respond to errors in their PHRs. Multinomial logistic regression was used to identify patients’ characteristics that predict the ability to understand information in the CIE and willingness to respond to errors in their records. The framework method was used to derive themes from patients’ free-text responses.

Results

Of 445 patients, 181 (40.7%) “definitely” understood the CIE information and approximately half (220/445, 49.4%) understood the CIE information “to some extent.” Patients with high digital health literacy (eHealth Literacy Scale score ≥26) were more confident in their ability to understand their records compared with patients with low digital health literacy (odds ratio [OR] 7.85, 95% CI 3.04-20.29; P<.001). Information-related barriers (medical terminology and lack of medical guidance or contextual information) and system-related barriers (functionality or usability and information communicated or displayed poorly) were described. Of 445 patients, 79 (17.8%) had noticed errors in their PHRs, which were related to patient demographic details, diagnoses, medical history, results, medications, letters or correspondence, and appointments. Most patients (272/445, 61.1%) wanted to be able to flag up errors to their health professionals for correction; 20.4% (91/445) of the patients were willing to correct errors themselves. Native English speakers were more likely to be willing to flag up errors to health professionals (OR 3.45, 95% CI 1.11-10.78; P=.03) or correct errors themselves (OR 5.65, 95% CI 1.33-24.03; P=.02).

Conclusions

A large proportion of patients were able and willing to identify and respond to errors in their PHRs. However, some barriers persist that disproportionately affect the underserved groups. Further development of PHR systems, including incorporating channels for patient feedback on the accuracy of their records, should address the needs of nonnative English speakers and patients with lower digital health literacy.

Characterization of Medication Errors in a Medical Intensive Care Unit of a University Teaching Hospital in South Korea

OBJECTIVES

The objective of this study was to characterize the current status of medication errors (MEs) throughout the medication therapy process from prescribing to use and monitoring in a medical intensive care unit (MICU) in Korea.

METHODS

Four trained research pharmacists collected data through retrospectively reviewing electronic medical records for adults hospitalized in the MICU in 2017. The occurrence of MEs was determined through interprofessional team discussion led by an academic faculty pharmacist and a medical intensivist based on the medication administration records (MARs). The type of MEs and the consequent ME-related outcome severity were categorized according to the Pharmaceutical Care Network Europe and the National Coordinating Council for Medication Error Reporting and Prevention, respectively.

RESULTS

Overall, electronic medical records for 293 patients with 78,761 MARs were reviewed in this study. At least one type of ME occurred in 271 patients (92.5%) in association with 16,203 MARs (21%), primarily caused by inappropriate dose (35.5%), drug (27.8%), and treatment duration (25.1%). Clinically significant harmful events occurred in 24 patients (8%), including life-threatening (n = 5) and death (n = 2) cases. The 2 patients died of enoxaparin-induced fatal hemorrhage and neutropenia associated with ganciclovir and cefepime. Antibiotics were the most common culprit medications leading to clinically significant harmful events.

CONCLUSIONS

In conclusion, MEs are prevalent in the MICU in Korea, most commonly prescribing errors. Although mostly benign, harmful events including deaths may occur due to MEs, mainly associated with antibiotics. Systematic strategies to minimize these potentially fatal MEs are urgently needed.

Electronic health records, mobile health, and the challenge of improving global health

Technology continues to impact healthcare around the world. This provides great opportunities, but also risks. These risks are compounded in low-resource settings where errors in planning and implementation may be more difficult to overcome. Global Health Informatics provides lessons in both opportunities and risks by building off of general Global Health. Global Health Informatics also requires a thorough understanding of the local environment and the needs of low-resource settings. Forming effective partnerships and following the lead of local experts are necessary for sustainability; it also ensures that the priorities of the local community come first. There is an opportunity for partnerships between low-resource settings and high income areas that can provide learning opportunities to avoid the pitfalls that plague many digital health systems and learn how to properly implement technology that truly improves healthcare.

Identifying Electronic Medication Administration Record (eMAR) Usability Issues from Patient Safety Event Reports

BACKGROUND

Improving our understanding of the association between medication errors and health information technology (health IT) usability has the potential to reduce errors and improve patient safety. This study used patient safety event reports (PSEs) to investigate the contribution of usability challenges associated with the electronic medication administration record (eMAR) to medication errors.

METHODS

Free-text descriptions of 849 medication-related PSEs selected from 2.3 million reports were analyzed. Coders identified the specific health IT components, usability challenge categories, and nuanced usability themes that contributed to each PSE. Thematic analysis was conducted to refine categorizations and identify emerging themes. Final analysis was limited to PSEs involving a contribution from eMAR, either as the point of origin or as a downstream contributor to error.

RESULTS

eMAR contributed to 473 PSEs. eMAR was the point of origin for 84 (17.8% of 473) PSEs. Usability challenge categories included Workflow support (n = 52, 11.0%) and Display/Visual clutter (n = 30, 6.3%). eMAR contributed downstream from the point of origin in 389 (82.2% of 473) PSEs, with errors stemming primarily from Pharmacy IT and computerized provider order entry (CPOE). Prominent secondary eMAR-associated usability challenges included Display/Visual clutter (n = 327, 69.1%) and Alerting (n = 32, 6.8%).

CONCLUSION

This study identified several eMAR usability challenges, through the analysis of PSEs, that contribute to medication errors. Findings highlight the critical need for improving the eMAR user interface. Improved interface design, better vendor usability testing, eMAR-focused certification testing, consideration of work system factors, and eMAR-focused usability and safety testing by health care facilities can improve eMAR technology and patient safety.

Association of Hospital Public Quality Reporting With Electronic Health Record Medication Safety Performance

IMPORTANCE

Despite billions spent in public investment, electronic health records (EHRs) have not delivered on the promise of large quality and safety improvement. Simultaneously, there is debate on whether public quality reporting is a useful tool to incentivize quality improvement.

OBJECTIVE

To evaluate whether publicly reported feedback was associated with hospital improvement in an evaluation of medication-related clinical decision support (CDS) safety performance.

DESIGN, SETTINGS, AND PARTICIPANTS

This nonrandomized controlled trial included US hospitals that participated in the Computerized Provider Order Entry (CPOE) Evaluation Tool in the Leapfrog Hospital Survey, a national quality reporting program that evaluates safety performance of hospital CDS using simulated orders and patients, in 2017 to 2018. A sharp regression discontinuity design was used to identify the association of receiving negative feedback with hospital performance improvement in the subsequent year. Data were analyzed from January through September 2020.

EXPOSURES

Publicly reported quality feedback.

MAIN OUTCOMES AND MEASURES

The main outcome was improvement from 2017 to 2018 on the Leapfrog CPOE Evaluation Tool, using regression discontinuity model estimates of the association of receiving negative publicly reported feedback with quality improvement.

RESULTS

A total of 1183 hospitals were included, with a mean (SD) CPOE score of 59.3% (16.3%) at baseline. Hospitals receiving negative feedback improved 8.44 (95% CI, 0.09 to 16.80) percentage points more in the subsequent year compared with hospitals that received positive feedback on the same evaluation. This change was driven by differences in improvement in basic CDS capabilities (β = 8.71 [95%CI, 1.67 to 18.73]) rather than advanced CDS (β = 6.15 [95% CI, -9.11 to 26.83]).

CONCLUSIONS AND RELEVANCE

In this nonrandomized controlled trial, publicly reported feedback was associated with quality improvement, suggesting targeted measurement and reporting of process quality may be an effective policy lever to encourage improvement in specific areas. Clinical decision support represents an important tool in ensuring patient safety and decreasing adverse drug events, especially for complex patients and those with multiple chronic conditions who often receive several different drugs during an episode of care.

Assessing hospital electronic health record vendor performance across publicly reported quality measures

OBJECTIVE

Little is known regarding variation among electronic health record (EHR) vendors in quality performance. This issue is compounded by selection effects in which high-quality hospitals coalesce to a subset of market leading vendors. We measured hospital performance, stratified by EHR vendor, across 4 quality metrics.

MATERIALS AND METHODS

We used data on 1272 hospitals in 2018 across 4 quality measures: Leapfrog Computerized Provider Order Entry/EHR Evaluation, Centers for Medicare and Medicaid Services Hospital Compare Star Ratings, Hospital-Acquired Condition (HAC) score, and Hospital Readmission Reduction Program (HRRP) ratio. We examined score distributions and used multivariable regression to evaluate the association between vendor and score, recovering partial R2 to assess the proportion of quality variation explained by vendor.

RESULTS

We found significant variation across and within EHR vendors. The largest vendor, vendor A, had the highest mean score on the Leapfrog Computerized Provider Order Entry/EHR Evaluation and HRRP ratio, vendor G had the highest Hospital Compare score, and vendor F had the highest HAC score. In adjusted models, no vendor was significantly associated with higher performance on more than 2 measures. EHR vendor explained between 1.2% (HAC) and 7.6 (HRRP) of the variation in quality performance.

DISCUSSION

No EHR vendor was associated with higher quality across all measures, and the 2 largest vendors were not associated with the highest scores. Only a small fraction of quality variation was explained by EHR vendor choice.

CONCLUSIONS

Top performance on quality measures can be achieved with any EHR vendor; much of quality performance is driven by the hospital and how it uses the EHR.

Associations of physicians' prescribing experience, work hours, and workload with prescription errors

OBJECTIVE

We aimed to assess associations of physician's work overload, successive work shifts, and work experience with physicians' risk to err.

MATERIALS AND METHODS

This large-scale study included physicians who prescribed at least 100 systemic medications at Sheba Medical Center during 2012-2017 in all acute care departments, excluding intensive care units. Presumed medication errors were flagged by a high-accuracy computerized decision support system that uses machine-learning algorithms to detect potential medication prescription errors. Physicians' successive work shifts (first or only shift, second, and third shifts), workload (assessed by the number of prescriptions during a shift) and work-experience, as well as a novel measurement of physicians' prescribing experience with a specific drug, were assessed per prescription. The risk to err was determined for various work conditions.

RESULTS

1 652 896 medical orders were prescribed by 1066 physicians; The system flagged 3738 (0.23%) prescriptions as erroneous. Physicians were 8.2 times more likely to err during high than normal-low workload shifts (5.19% vs 0.63%, P < .0001). Physicians on their third or second successive shift (compared to a first or single shift) were more likely to err (2.1%, 1.8%, and 0.88%, respectively, P < .001). Lack of experience in prescribing a specific medication was associated with higher error rate (0.37% for the first 5 prescriptions vs 0.13% after over 40, P < .001).

DISCUSSION

Longer hours and less experience in prescribing a specific medication increase risk of erroneous prescribing.

CONCLUSION

Restricting successive shifts, reducing workload, increasing training and supervision, and implementing smart clinical decision support systems may help reduce prescription errors.

Common Barriers to Reporting Medical Errors

BACKGROUND

Medical errors are the third leading cause of death in the United States. Reporting of all medical errors is important to better understand the problem and to implement solutions based on root causes. Underreporting of medical errors is a common and a challenging obstacle in the fight for patient safety. The goal of this study is to review common barriers to reporting medical errors.

METHODS

We systematically reviewed the literature by searching the MEDLINE and SCOPUS databases for studies on barriers to reporting medical errors. The preferred reporting items for systematic reviews and meta-analyses guideline was followed in selecting eligible studies.

RESULTS

Thirty studies were included in the final review, 8 of which were from the United States. The majority of the studies used self-administered questionnaires (75%) to collect data. Nurses were the most studied providers (87%), followed by physicians (27%). Fear of consequences is the most reported barrier (63%), followed by lack of feedback (27%) and work climate/culture (27%). Barriers to reporting were highly variable between different centers.

Overactive Bladder Prescribing Considerations: The Role of Polypharmacy, Anticholinergic Burden, and CYP2D6 Drug‒Drug Interactions

Overactive bladder (OAB) is a common disorder in the general population, and the prevalence increases with age. Adults with OAB typically have a greater number of comorbid conditions, such as hypertension, depression, and dementia, compared with adults without OAB. Subsequent to an increased number of comorbidities, adults with OAB take a greater number of concomitant medications, which may increase the risk of potentially harmful drug‒drug interactions. There are two important considerations for many of the medications approved for the treatment of OAB in the USA: anticholinergic burden and potential for drug‒drug interactions, notably related to cytochrome P450 (CYP) 2D6, which is responsible for the metabolism of approximately 25% of all drugs. A substantial number of drugs used for the treatment of OAB and comorbid conditions (e.g., cardiovascular and neurologic disorders) are CYP2D6 substrates or inhibitors. Furthermore, a substantial number of drugs with CYP2D6 properties also have strong anticholinergic properties. Here, we review polypharmacy associated with OAB and its common comorbidities, identify drugs with reported anticholinergic properties, and provide an overview of clinically relevant drug‒drug interactions in the treatment of OAB as they relate to CYP2D6 metabolism. This review aims to provide clinicians with essential information necessary for making treatment decisions when managing OAB.

The Development and Piloting of the Ambulatory Electronic Health Record Evaluation Tool: Lessons Learned

BACKGROUND

Substantial research has been performed about the impact of computerized physician order entry on medication safety in the inpatient setting; however, relatively little has been done in ambulatory care, where most medications are prescribed.

OBJECTIVE

To outline the development and piloting process of the Ambulatory Electronic Health Record (EHR) Evaluation Tool and to report the quantitative and qualitative results from the pilot.

METHODS

The Ambulatory EHR Evaluation Tool closely mirrors the inpatient version of the tool, which is administered by The Leapfrog Group. The tool was piloted with seven clinics in the United States, each using a different EHR. The tool consists of a medication safety test and a medication reconciliation module. For the medication test, clinics entered test patients and associated test orders into their EHR and recorded any decision support they received. An overall percentage score of unsafe orders detected, and order category scores were provided to clinics. For the medication reconciliation module, clinics demonstrated how their EHR electronically detected discrepancies between two medication lists.

RESULTS

For the medication safety test, the clinics correctly alerted on 54.6% of unsafe medication orders. Clinics scored highest in the drug allergy (100%) and drug-drug interaction (89.3%) categories. Lower scoring categories included drug age (39.3%) and therapeutic duplication (39.3%). None of the clinics alerted for the drug laboratory or drug monitoring orders. In the medication reconciliation module, three (42.8%) clinics had an EHR-based medication reconciliation function; however, only one of those clinics could demonstrate it during the pilot.

CONCLUSION

Clinics struggled in areas of advanced decision support such as drug age, drug laboratory, and drub monitoring. Most clinics did not have an EHR-based medication reconciliation function and this process was dependent on accessing patients' medication lists. Wider use of this tool could improve outpatient medication safety and can inform vendors about areas of improvement.

Evaluating the effects of electronic health records system adoption on the performance of Malaysian health care providers

BACKGROUND

The Ministry of Health of Malaysia has invested significant resources to implement an electronic health record (EHR) system to ensure the full automation of hospitals for coordinated care delivery. Thus, evaluating whether the system has been effectively utilized is necessary, particularly regarding how it predicts the post-implementation primary care providers' performance impact.

METHODS

Convenience sampling was employed for data collection in three government hospitals for 7 months. A standardized effectiveness survey for EHR systems was administered to primary health care providers (specialists, medical officers, and nurses) as they participated in medical education programs. Empirical data were assessed by employing partial least squares-structural equation modeling for hypothesis testing.

RESULTS

The results demonstrated that knowledge quality had the highest score for predicting performance and had a large effect size, whereas system compatibility was the most substantial system quality component. The findings indicated that EHR systems supported the clinical tasks and workflows of care providers, which increased system quality, whereas the increased quality of knowledge improved user performance.

CONCLUSION

Given these findings, knowledge quality and effective use should be incorporated into evaluating EHR system effectiveness in health institutions. Data mining features can be integrated into current systems for efficiently and systematically generating health populations and disease trend analysis, improving clinical knowledge of care providers, and increasing their productivity. The validated survey instrument can be further tested with empirical surveys in other public and private hospitals with different interoperable EHR systems.

Reducing Inappropriate Outpatient Medication Prescribing in Older Adults across Electronic Health Record Systems

BACKGROUND

The American Geriatrics Society recommends against the use of certain potentially inappropriate medications (PIMs) in older adults. Prescribing of these medications correlates with higher rates of hospital readmissions, morbidity, and mortality. Vanderbilt University Medical Center previously deployed clinical decision support (CDS) to decrease PIM prescribing rates, but recently transitioned to a new electronic health record (EHR).

OBJECTIVE

The goal of this study was to evaluate PIM prescribing rates for older adults before and after migration to the new EHR system.

METHODS

We reviewed prescribing rates of PIMs in adults 65 years and older, normalized per 100 total prescriptions from the legacy and new EHR systems between July 1, 2014 and December 31, 2019. The PIM prescribing rates before and after EHR migration during November 2017 were compared using a U-chart and Poisson regression model. Secondary analysis descriptively evaluated the frequency of prescriber acceptance rates in the new EHR.

RESULTS

Prescribing rates of PIMs decreased 5.2% (13.5 per 100 prescriptions to 12.8 per 100 prescriptions; p < 0.0001) corresponding to the implementation of alternatives CDS in the legacy EHR. After migration of the alternative CDS from the legacy to the new EHR system, PIM prescribing rates dropped an additional 18.8% (10.4 per 100 prescriptions; p < 0.0001). Acceptance rates of the alternative recommendations for PIMs was low overall at 11.1%.

CONCLUSION

The prescribing rate of PIMs in adults aged 65 years and older was successfully decreased with the implementation of prescribing CDS. This decrease was not only maintained but strengthened by the transition to a new EHR system.

Development of a Taxonomy for Medication-Related Patient Safety Events Related to Health Information Technology in Pediatrics

BACKGROUND

Although electronic health records (EHRs) are designed to improve patient safety, they have been associated with serious patient harm. An agreed-upon and standard taxonomy for classifying health information technology (HIT) related patient safety events does not exist.

OBJECTIVES

We aimed to develop and evaluate a taxonomy for medication-related patient safety events associated with HIT and validate it using a set of events involving pediatric patients.

METHODS

We performed a literature search to identify existing classifications for HIT-related safety events, which were assessed using real-world pediatric medication-related patient safety events extracted from two sources: patient safety event reporting system (ERS) reports and information technology help desk (HD) tickets. A team of clinical and patient safety experts used iterative tests of change and consensus building to converge on a single taxonomy. The final devised taxonomy was applied to pediatric medication-related events assess its characteristics, including interrater reliability and agreement.

RESULTS

Literature review identified four existing classifications for HIT-related patient safety events, and one was iteratively adapted to converge on a singular taxonomy. Safety events relating to usability accounted for a greater proportion of ERS reports, compared with HD tickets (37 vs. 20%, p = 0.022). Conversely, events pertaining to incorrect configuration accounted for a greater proportion of HD tickets, compared with ERS reports (63 vs. 8%, p < 0.01). Interrater agreement (%) and reliability (kappa) were 87.8% and 0.688 for ERS reports and 73.6% and 0.556 for HD tickets, respectively.

DISCUSSION

A standardized taxonomy for medication-related patient safety events related to HIT is presented. The taxonomy was validated using pediatric events. Further evaluation can assess whether the taxonomy is suitable for nonmedication-related events and those occurring in other patient populations.

CONCLUSION

Wider application of standardized taxonomies will allow for peer benchmarking and facilitate collaborative interinstitutional patient safety improvement efforts.

Unpacking the effects of adverse regulatory events: Evidence from pharmaceutical relabeling

•

Estimates a decline in demand and firm performance from negative regulatory shocks.

•

Quantifies the loss to the firm using an event study.

•

Estimates the losses attributable to declines in future innovation.

•

Supports the view that quicker drug access today may mean less innovation tomorrow.

We provide causal evidence that regulation induced product shocks significantly impact aggregate demand and firm performance in pharmaceutical markets. Event study results suggest an average loss between $569 million and $882 million. Affected products lose, on average, $186 million over their remaining effective patent life. This leaves a loss of between $383 million and $696 million attributable to declines in future innovation. Our findings complement research that shows drugs receiving expedited review are more likely to suffer from regulation induced product shocks. Thus, it appears we may be trading off quicker access to drugs today for less innovation tomorrow. Results remain robust to variation across types of relabeling, market sizes, and levels of competition.