Electronic alerts, comparative practitioner metrics, and education improve thromboprophylaxis and reduce venous thrombosis in community hospitals

Performance of Risk Assessment Models for VTE in Patients Who Are Critically Ill Receiving Pharmacologic Thromboprophylaxis: A Post Hoc Analysis of the Pneumatic Compression for Preventing VTE Trial

BACKGROUND

The diagnostic performance of the available risk assessment models for VTE in patients who are critically ill receiving pharmacologic thromboprophylaxis is unclear.

RESEARCH QUESTION

For patients who are critically ill receiving pharmacologic thromboprophylaxis, do risk assessment models predict who would develop VTE or who could benefit from adjunctive pneumatic compression for thromboprophylaxis?

STUDY DESIGN AND METHODS

In this post hoc analysis of the Pneumatic Compression for Preventing VTE (PREVENT) trial, different risk assessment models for VTE (ICU-VTE, Kucher, Intermountain, Caprini, Padua, and International Medical Prevention Registry on VTE [IMPROVE] models) were evaluated. Receiver-operating characteristic curves were constructed, and the sensitivity, specificity, positive and negative predictive values, and positive and negative likelihood ratios were calculated. In addition, subgroup analyses were performed evaluating the effect of adjunctive pneumatic compression vs none on the study primary outcome.

RESULTS

Among 2,003 patients receiving pharmacologic thromboprophylaxis, 198 (9.9%) developed VTE. With multivariable logistic regression analysis, the independent predictors of VTE were Acute Physiology and Chronic Health Evaluation II score, prior immobilization, femoral central venous catheter, and invasive mechanical ventilation. All risk assessment models had areas under the curve < 0.60 except for the Caprini model (0.64; 95% CI, 0.60-0.68). The Caprini, Padua, and Intermountain models had high sensitivity (> 85%) but low specificity (< 20%) for predicting VTE, whereas the ICU-VTE, Kucher, and IMPROVE models had low sensitivities (< 15%) but high specificities (> 85%). The positive predictive value was low (< 20%) for all studied cutoff scores, whereas the negative predictive value was mostly > 90%. Using the risk assessment models to stratify patients into high- vs low-risk subgroups, the effect of adjunctive pneumatic compression vs pharmacologic prophylaxis alone did not differ across the subgroups (Pinteraction > .05).

INTERPRETATION

The risk assessment models for VTE performed poorly in patients who are critically ill receiving pharmacologic thromboprophylaxis. None of the models identified a subgroup of patients who might benefit from adjunctive pneumatic compression.

CLINICAL TRIAL REGISTRATION

ClinicalTrials.gov; No.: NCT02040103; URL: www.

CLINICALTRIALS

gov. ISRCTN44653506.

Meaningful time-related aspects of alerts in Clinical Decision Support Systems. A unified framework

Alerts are a common functionality of clinical decision support systems (CDSSs). Although they have proven to be useful in clinical practice, the alert burden can lead to alert fatigue and significantly reduce their usability and acceptance. Based on a literature review, we propose a unified framework consisting of a set of meaningful timestamps that allows the use of state-of-the-art measures for alert burden, such as alert dwell time, alert think time, and response time. In addition, it can be used to investigate other measures that could be relevant as regards dealing with this problem. Furthermore, we provide a case study concerning three different types of alerts to which the framework was successfully applied. We consider that our framework can easily be adapted to other CDSSs and that it could be useful for dealing with alert burden measurement thus contributing to its appropriate management.

Improving thromboprophylaxis in the medical inpatients: The role of the resident in an academic hospital

INTRODUCTION

Venous thromboembolism (VTE) is one of the main causes of preventable in-hospital death. It is recommended for hospitals to have an appropriate thromboprophylaxis (TP) protocol to avoid VTE complications.

OBJECTIVE

To determine the effect of the resident physician feedback to the staff physician in TP appropriateness after the Caprini RAM score implementation.

METHODS

Caprini RAM was implemented by the residents in medical patients. Patients were divided in low, moderate, high, and highest-risk groups, with TP recommendation accordingly. In cases with inadequate TP, the resident provided feedback to the staff physician for adjustment. Change to appropriate TP was assessed retrospectively.

RESULTS

A total of 265 records were included. Before intervention, 193 (72.8%) patients had appropriate TP and post-intervention, 207 (78.1%) patients received adequate TP (p < .001).

CONCLUSIONS

Feedback from the internal medicine resident to staff physician improves appropriate TP in medical inpatients as a quality of care strategy.

Biomarker derived risk scores predict venous thromboembolism and major bleeding among patients with COVID-19

Background

Venous thromboembolism (VTE) risk is increased in patients with COVID-19 infection. Understanding which patients are likely to develop VTE may inform pharmacologic VTE prophylaxis decision making. The hospital-associated venous thromboembolism-Intermountain Risk Score (HA-VTE IMRS) and the hospital-associated major bleeding-Intermountain Risk Score (HA-MB IMRS) are risk scores predictive of VTE and bleeding that were derived from only patient age and data found in the complete blood count (CBC) and basic metabolic panel (BMP).

Objectives

We assessed the HA-VTE IMRS and HA-MB IMRS for predictiveness of 90-day VTE and major bleeding, respectively, among patients diagnosed with COVID-19, and further investigated if adding D-dimer improved these predictions. We also reported 30-day outcomes.

Patients/Methods

We identified 5047 sequential patients with a laboratory confirmed diagnosis of COVID-19 and a CBC and BMP between 2 days before and 7 days following the diagnosis of COVID-19 from March 12, 2020, to February 28, 2021. We calculated the HA-VTE IMRS and the HA-MB IMRS for all patients. We assessed the added predictiveness of D-dimer obtained within 48 hours of the COVID test.

Results

The HA-VTE IMRS yielded a c-statistic of 0.70 for predicting 90-day VTE and adding D-dimer improved the c-statistic to 0.764 with the corollary sensitivity/specificity/positive/negative predictive values of 49.4%/75.7%/6.7%/97.7% and 58.8%/76.2%/10.9%/97.4%, respectively. Among hospitalized and ambulatory patients separately, the HA-VTE IMRS performed similarly. The HA-MB IMRS predictiveness for 90-day major bleeding yielded a c-statistic of 0.64.

Conclusion

The HA-VTE IMRS and HA-MB IMRS predict 90- and 30-day VTE and major bleeding among COVID-19 patients. Adding D-dimer improved the predictiveness of the HA-VTE IMRS for VTE.

Del papel a la práctica: adherencia a las guías de práctica clínica de tromboprofilaxis en pacientes quirúrgicos en Colombia

El desarrollo del tromboembolismo venoso (TEV) en pacientes quirúrgicos representa un serio problema de salud pública, pues aumenta las tasas de morbimortalidad y los costos asociados con la atención intrahospitalaria de esta población. No obstante lo anterior, y a pesar de que su efectividad ha sido demostrada, en Colombia las medidas profilácticas no son utilizadas de forma adecuada en estos pacientes. Una posible causa de esta situación es la pobre adherencia de los profesionales de la salud a las guías de práctica clínica (GPC) para la prevención del TEV. En este sentido, se han descrito varias aproximaciones metodológicas para lograr una adecuada implementación de la tromboprofilaxis al transformar los comportamientos de los médicos. Sin embargo, para lograr este propósito es necesario considerar de forma integral las barreras multifactoriales y las condiciones sociológicas que subyacen a este problema. Se sabe que una mejor adherencia a las GPC de profilaxis de TEV conduce a una mejor práctica clínica. Por lo tanto, el objetivo de este artículo es realizar un análisis reflexivo de las causas y posibles soluciones de la baja adherencia de los profesionales de la salud en Colombia a dichas guías.

Post-discharge thrombosis and bleeding in medical patients: A novel risk score derived from ubiquitous biomarkers

BACKGROUND

Some hospitalized medical patients experience venous thromboembolism (VTE) following discharge. Prophylaxis extended beyond hospital discharge (extended duration thromboprophylaxis [EDT]) may reduce this risk. However, EDT is costly and can cause bleeding, so selecting appropriate patients is essential. We formerly reported the performance of a mortality risk prediction score (Intermountain Risk Score [IMRS]) that was minimally predictive of 90-day hospital-associated venous thromboembolism (HA-VTE) and major bleeding (HA-MB). We used the components of the IMRS to calculate de novo risk scores to predict 90-day HA-VTE (HA-VTE IMRS) and major bleeding (HA-MB IMRS).

METHODS

From 45 669 medical patients we randomly assigned 30 445 to derive the HA-VTE IMRS and the HA-MB IMRS. Backward stepwise regression and bootstrapping identified predictor covariates from the blood count and basic chemistry. These candidate variables were split into quintiles, and the referent quintile was that with the lowest event rate for HA-VTE and HA-MB; respectively. A clinically relevant rate of HA-VTE and HA-MB was used to inform outcome rates. Performance was assessed in the derivation set of 15 224 patients.

RESULTS

The HA-VTE IMRS and HA-MB IMRS area under the receiver operating curve (AUC) in the derivation set were 0.646, and 0.691, respectively. In the validation set, the HA-VTE IMRS and HA-MB IMRS AUCs were 0.60 and 0.643.

CONCLUSIONS

Risk scores derived from components of routine labs ubiquitous in clinical care identify patients that are at risk for 90-day postdischarge HA-VTE and major bleeding. This may identify a subset of patients with high HA-VTE risk and low HA-MB risk who may benefit from EDT.

Risk-assessment models for VTE and bleeding in hospitalized medical patients: an overview of systematic reviews

Multiple risk-assessment models (RAMs) for venous thromboembolism (VTE) in hospitalized medical patients have been developed. To inform the 2018 American Society of Hematology (ASH) guidelines on VTE, we conducted an overview of systematic reviews to identify and summarize evidence related to RAMs for VTE and bleeding in medical inpatients. We searched Epistemonikos, the Cochrane Database, Medline, and Embase from 2005 through June 2017 and then updated the search in January 2020 to identify systematic reviews that included RAMs for VTE and bleeding in medical inpatients. We conducted study selection, data abstraction and quality assessment (using the Risk of Bias in Systematic Reviews [ROBIS] tool) independently and in duplicate. We described the characteristics of the reviews and their included studies, and compared the identified RAMs using narrative synthesis. Of 15 348 citations, we included 2 systematic reviews, of which 1 had low risk of bias. The reviews included 19 unique studies reporting on 15 RAMs. Seven of the RAMs were derived using individual patient data in which risk factors were included based on their predictive ability in a regression analysis. The other 8 RAMs were empirically developed using consensus approaches, risk factors identified from a literature review, and clinical expertise. The RAMs that have been externally validated include the Caprini, Geneva, IMPROVE, Kucher, and Padua RAMs. The Padua, Geneva, and Kucher RAMs have been evaluated in impact studies that reported an increase in appropriate VTE prophylaxis rates. Our findings informed the ASH guidelines. They also aim to guide health care practitioners in their decision-making processes regarding appropriate individual prophylactic management.

Natural Language Processing Performance for the Identification of Venous Thromboembolism in an Integrated Healthcare System

Real-time identification of venous thromboembolism (VTE), defined as deep vein thrombosis (DVT) and pulmonary embolism (PE), can inform a healthcare organization's understanding of these events and be used to improve care. In a former publication, we reported the performance of an electronic medical record (EMR) interrogation tool that employs natural language processing (NLP) of imaging studies for the diagnosis of venous thromboembolism. Because we transitioned from the legacy electronic medical record to the Cerner product, iCentra, we now report the operating characteristics of the NLP EMR interrogation tool in the new EMR environment. Two hundred randomly selected patient encounters for which the imaging report assessed by NLP that revealed VTE was present were reviewed. These included one hundred imaging studies for which PE was identified. These included computed tomography pulmonary angiography-CTPA, ventilation perfusion-V/Q scan, and CT angiography of the chest/ abdomen/pelvis. One hundred randomly selected comprehensive ultrasound (CUS) that identified DVT were also obtained. For comparison, one hundred patient encounters in which PE was suspected and imaging was negative for PE (CTPA or V/Q) and 100 cases of suspected DVT with negative CUS as reported by NLP were also selected. Manual chart review of the 400 charts was performed and we report the sensitivity, specificity, positive and negative predictive values of NLP compared with manual chart review. NLP and manual review agreed on the presence of PE in 99 of 100 cases, the presence of DVT in 96 of 100 cases, the absence of PE in 99 of 100 cases and the absence of DVT in all 100 cases. When compared with manual chart review, NLP interrogation of CUS, CTPA, CT angiography of the chest, and V/Q scan yielded a sensitivity = 93.3%, specificity = 99.6%, positive predictive value = 97.1%, and negative predictive value = 99%.

Predicting postdischarge hospital-associated venous thromboembolism among medical patients using a validated mortality risk score derived from common biomarkers

BACKGROUND

Discharged medical patients are at risk for venous thromboembolism (VTE). It is difficult to identify which discharged patients would benefit from extended duration thromboprophylaxis. The Intermountain Risk Score is a prediction score derived from discrete components of the complete blood cell count and basic metabolic panel and is highly predictive of 1-year mortality. We sought to ascertain if the Intermountain Risk Score might also be predictive of 90-day postdischarge hospital-associated VTE (HA-VTE).

METHODS

We applied the Intermountain Risk Score to 60 064 medical patients who survived 90 days after discharge and report predictiveness for HA-VTE. Area under the receiver operating curve analyses were performed. We then assessed whether the Intermountain Risk Score improved prediction of 2 existing VTE risk assessment models.

RESULTS

The Intermountain Risk Score poorly predicted HA-VTE (area under the curve = 0.58; 95% confidence interval [CI], 0.56-0.60). Each clinical risk assessment model was superior to the Intermountain Risk Score (UTAH area under the curve, 0.63; Kucher area under the curve, 0.62; Intermountain Risk Score area under the curve, 0.58; P < .001 for each comparison). Adding the Intermountain Risk Score to these scores did not substantially improve the performance of either risk assessment model (UTAH + Intermountain Risk Score, 0.65; Kucher + Intermountain Risk Score, 0.64).

CONCLUSION

The Intermountain Risk Score demonstrated poor predictiveness for HA-VTE when compared to existing risk assessment models. Adding the Intermountain Risk Score to existing risk assessment models did not improve upon either risk assessment model alone to justify the added complexity.

External validation of the simplified Geneva risk assessment model for hospital-associated venous thromboembolism in the Padua cohort

BACKGROUND

The simplified Geneva risk assessment model (RAM) predicts the risk of hospitalization-related venous thromboembolism (VTE) in medical inpatients in its developmental cohort but has not been validated.

OBJECTIVES

To externally validate the simplified Geneva RAM.

PATIENTS/METHODS

For this secondary analysis of a prospective cohort set in Padua, we calculated the simplified Geneva RAM for all participants. They were followed up for 90 days for the occurrence of adjudicated VTE. Thirty- and 90-day risks of VTE were estimated by the Kaplan-Meier method, and categories of risks compared with a Cox regression model adjusted for the use of thromboprophylaxis.

RESULTS

Among 1180 medical inpatients, the 90-day risk of symptomatic VTE was 3.1%. The simplified Geneva RAM classified 56.9% as high risk (≥3 points; 90-day risk of VTE of 5.2%) and 43.1% as low risk (<3 points; 90-day risk of VTE of 0.4%). Compared with low-risk participants, high-risk participants had an 18-fold greater risk of VTE than low-risk participants (hazard ratio [HR] 17.9, 95% confidence interval [CI] 4.3-74.7). A very high-risk category (≥7 points) identified 5.3% of participants with a 9.5% probability of VTE at 90 days.

CONCLUSIONS

In this external validation study, we confirm the excellent discrimination and clinically adequate calibration of the simplified Geneva RAM as a stratification tool to guide the use of thromboprophylaxis.

The effects of on-screen, point of care computer reminders on processes and outcomes of care

BACKGROUND

The opportunity to improve care by delivering decision support to clinicians at the point of care represents one of the main incentives for implementing sophisticated clinical information systems. Previous reviews of computer reminder and decision support systems have reported mixed effects, possibly because they did not distinguish point of care computer reminders from e-mail alerts, computer-generated paper reminders, and other modes of delivering 'computer reminders'.

OBJECTIVES

To evaluate the effects on processes and outcomes of care attributable to on-screen computer reminders delivered to clinicians at the point of care.

SEARCH STRATEGY

We searched the Cochrane EPOC Group Trials register, MEDLINE, EMBASE and CINAHL and CENTRAL to July 2008, and scanned bibliographies from key articles.

SELECTION CRITERIA

Studies of a reminder delivered via a computer system routinely used by clinicians, with a randomised or quasi-randomised design and reporting at least one outcome involving a clinical endpoint or adherence to a recommended process of care.

DATA COLLECTION AND ANALYSIS

Two authors independently screened studies for eligibility and abstracted data. For each study, we calculated the median improvement in adherence to target processes of care and also identified the outcome with the largest such improvement. We then calculated the median absolute improvement in process adherence across all studies using both the median outcome from each study and the best outcome.

MAIN RESULTS

Twenty-eight studies (reporting a total of thirty-two comparisons) were included. Computer reminders achieved a median improvement in process adherence of 4.2% (interquartile range (IQR): 0.8% to 18.8%) across all reported process outcomes, 3.3% (IQR: 0.5% to 10.6%) for medication ordering, 3.8% (IQR: 0.5% to 6.6%) for vaccinations, and 3.8% (IQR: 0.4% to 16.3%) for test ordering. In a sensitivity analysis using the best outcome from each study, the median improvement was 5.6% (IQR: 2.0% to 19.2%) across all process measures and 6.2% (IQR: 3.0% to 28.0%) across measures of medication ordering. In the eight comparisons that reported dichotomous clinical endpoints, intervention patients experienced a median absolute improvement of 2.5% (IQR: 1.3% to 4.2%). Blood pressure was the most commonly reported clinical endpoint, with intervention patients experiencing a median reduction in their systolic blood pressure of 1.0 mmHg (IQR: 2.3 mmHg reduction to 2.0 mmHg increase).

AUTHORS' CONCLUSIONS

Point of care computer reminders generally achieve small to modest improvements in provider behaviour. A minority of interventions showed larger effects, but no specific reminder or contextual features were significantly associated with effect magnitude. Further research must identify design features and contextual factors consistently associated with larger improvements in provider behaviour if computer reminders are to succeed on more than a trial and error basis.