Automated safety event monitoring using electronic medical records in a clinical trial setting: Validation study using the VA NEPHRON-D trial

Combination Therapy Use and Associated Events in Clinical Practice Following Dissemination of Trial Findings: A De-Implementation Study Using Interrupted Time Series Analysis

PURPOSE

It takes 17 years, on average, for trial results to be implemented into practice. Using data from the Department of Veterans Affairs (VA), this study assessed the potential impact on clinical practice of the dissemination of findings from a randomized, controlled trial reporting harm with the use of combination therapy. Communication between research and VA Pharmacy Benefits Management Services (PBM)  provided the impetus for communication from the PBM about the findings of the trial in accordance with policy.

METHODS

In this de-implementation study, interrupted time series analysis was used for assessing prescribing patterns and adverse clinical events before and after the dissemination of the trial findings. The de-implementation strategy was multicomponent and multilevel. Strategies were aligned with categories outlined in the Expert Recommendations for Implementing Change: train and educate stakeholders, use evaluative and iterative strategies, develop stakeholder inter-relationships, change infrastructure, provide interactive assistance, and engage consumers. VA patients with type 2 diabetes mellitus, chronic kidney disease stages 1 to 3, and a moderate or severe albuminuria who received care between July 2008 and November 2017 were included. Patients were subgrouped according to treatment with an angiotensin-converting enzyme inhibitor + angiotensin receptor blocker. The primary end point was the prevalence of combination therapy use. Secondary end points were the incidences of acute kidney injury and hyperkalemia.

FINDINGS

This study followed 712,245 patients, 9297 of whom used combination therapy. Data were available from 428,535 and 283,710 patients pre- and post-intervention, respectively; among these, 8324 and 973 patients used combination therapy, the median ages were 66 and 68 years, and 96.92% and 98.82% were men. One month following communication from the PBM, the reductions in combination therapy users, acute kidney injury events, and hyperkalemia were 331.94 (95% CI, 500.27-163.32), 36.58% (95% CI, 31.90%-41.95%), and 25.49% (95% CI, 14.17%-36.07%) per 100,000 patients per month, respectively (all, P < 0.001), whereas before the communication, these changes were +14.84 (95% CI, 10.27-19.42), -3.46% (95% CI, 3.18-3.74), and -3.27% (95% CI, 2.66%-3.87%) (all, P < 0.001).

IMPLICATIONS

The apparent speed and impact of the implementation of changes resulting from the dissemination of trial findings into VA clinical practice are encouraging. The speed of implementation was much faster than average for health care providers in the United States. Established communications between research and clinical practice, as well as established policy and communications between PBM and clinical practice, may be a model for other health care organizations.

Automated Detection of Patient Harm: Implementation and Prospective Evaluation of a Real-Time Broad-Spectrum Surveillance Application in a Hospital With Limited Resources

OBJECTIVES

This study aimed to prospectively validate an application that automates the detection of broad categories of hospital adverse events (AEs) extracted from a basic hospital information system, and to efficiently mobilize resources to reduce the level of acquired patient harm.

METHODS

Data were collected from an internally designed software, extracting results from 14 triggers indicative of patient harm, querying clinical and administrative databases including all inpatient admissions (n = 8760) from October 2019 to June 2020. Representative samples of the triggered cases were clinically validated using chart review by a consensus expert panel. The positive predictive value (PPV) of each trigger was evaluated, and the detection sensitivity of the surveillance system was estimated relative to incidence ranges in the literature.

RESULTS

The system identified 394 AEs among 946 triggered cases, associated with 291 patients, yielding an overall PPV of 42%. Variability was observed among the trigger PPVs and among the estimated detection sensitivities across the harm categories, the highest being for the healthcare-associated infections. The median length of stay of patients with an AE showed to be significantly higher than the median for the overall patient population.

CONCLUSIONS

This application was able to identify AEs across a broad spectrum of harm categories, in a real-time manner, while reducing the use of resources required by other harm detection methods. Such a system could serve as a promising patient safety tool for AE surveillance, allowing for timely, targeted, and resource-efficient interventions, even for hospitals with limited resources.

Leveraging electronic health record query to streamline adverse event reporting and protocol compliance

Electronic medical records are increasingly being leveraged to improve the efficiency and effectiveness of clinical trials. Reporting safety data and adhering to follow-up schedules are two challenges faced by study centers conducting a large number of clinical trials led by a single principal investigator. The Lenox Hill Electrophysiology Research Department collaborated with Northwell Health's informatics department to develop a live query accessing both inpatient and outpatient data. To demonstrate the efficacy of this approach we compared the compliance rate of adverse event reporting and patient follow-up visits between a clinical trial run using this approach and a clinical trial conducted prior to use. We compared the number of out of window visits, missed visits, missed assessments, subject drop out and number of late reported adverse events between both studies. The trial run using the described query method had a marked reduction in these categories. Leveraging available informatics resources have allowed for improved efficiency, accurate adverse even reporting and improved follow-up scheduling.

Patient Safety/Quality Improvement Primer, Part II: Prevention of Harm Through Root Cause Analysis and Action (RCA2)

With increasing emphasis on patient safety/quality improvement, health care systems are mirroring industry in the implementation of root cause analysis (RCA) for the identification and mitigation of errors. RCA uses a team approach with emphasis on the system, as opposed to the individual, to accrue empirical data on what happened and why. While many otolaryngologists have a broad understanding of RCA, practical experience is often lacking. Part II of this patient safety/quality improvement primer investigates the manner in which RCA is utilized in the prevention of medical errors. Attention is given to identifying system errors, recording adverse events, and determining which events warrant RCA. The primer outlines steps necessary to conduct an effective RCA, with emphasis placed on actions that arise from the RCA process through the root cause analysis and action (or RCA²) rubric. In addition, the article provides strategies for the implementation of RCA into clinical practice and medical education.