Evaluation of the pulmonary embolism rule-out criteria in a retrospective cohort at an urban academic hospital

Safety of the pulmonary embolism rule-out criteria rule: Findings from the Registro Informatizado de la Enfermedad TromboEmbolica venosa (RIETE) registry

BACKGROUND

The diagnostic strategy for pulmonary embolism (PE) includes a D-dimer test when PE probability is low or intermediate, but false-positive D-dimer results are frequent and can result in an unnecessary computed tomography pulmonary angiogram. The PE rule-out criteria (PERC) rule excludes PE without D-dimer testing when pretest probability is <15%. The aim of this study was to assess the safety of the PERC rule strategy in patients included in the Registro Informatizado de la Enfermedad TromboEmbolica venosa (RIETE) registry.

METHODS

This retrospective cohort study used data from the RIETE registry, an ongoing, international prospective registry of patients with objectively confirmed venous thromboembolism. The primary outcome was the failure rate of the PERC strategy, represented by the proportion of PERC-negative (PERC-N) patients with a PE included in the registry. Secondary outcomes were a comparison of the clinical characteristics, treatment strategy, and outcome of PERC-N versus PERC-positive (PERC-P) patients at 3 months.

RESULTS

From 2001 to 2021, a total of 49,793 patients with acute PE were enrolled in the RIETE registry. We included 48,903 in the final analysis after exclusion of 890 patients with an undetermined PERC status. Only 346 patients were PERC-N with a failure rate of 0.7% (95% confidence interval 0.6%-0.8%). PERC-N patients presented more frequently with chest pain but less often with dyspnea, syncope, or hypotension. They also had subsegmental or segmental PE more frequently, were more often treated with direct oral anticoagulants, and received mechanical or pharmacological thrombolysis less often. In addition, PERC-N patients had a lower incidence of recurrent deep vein thrombosis, major bleeding, and death attributed to PE during the 3-month follow-up.

CONCLUSIONS

A low failure rate of the PERC rule was observed in the RIETE registry, thus supporting its use to safely identify patients with an unlikely probability of PE.

Application of the pulmonary embolism rule-out criteria (PERC rule) and age-adjusted D-Dimer in patients undergoing computed tomography pulmonary angiography for diagnosis of pulmonary embolism

Background

Diagnosis of pulmonary embolism (PE) constitutes a challenge for practitioners. Current practice involves use of pre-test probability prediction rules. Several strategies to optimize this process have been explored.

Objectives

To explore whether application of the pulmonary embolism rule-out criteria (PERC rule) and age-adjusted D-dimer (DD) would have reduced the number of computed tomography pulmonary angiography (CTPA) examinations performed in patients with suspected PE.

Methods

A retrospective cross-sectional study of adult patients taken for CTPA under suspicion of PE in 2018 and 2020. The PERC rule and age-adjusted DD were applied. The number of cases without indications for imaging studies was estimated and the operational characteristics for diagnosis of PE were calculated.

Results

302 patients were included. PE was diagnosed in 29.8%. Only 27.2% of 'not probable' cases according to the Wells criteria had D-dimer assays. Age adjustment would have reduced tomography use by 11.1%, with an AUC of 0.5. The PERC rule would have reduced use by 7%, with an AUC of 0.72.

Conclusions

Application of age-adjusted D-dimer and the PERC rule to patients taken for CTPA because of suspected PE seems to reduce the number of indications for the procedure.

Vascular imaging of the lung: perspectives on current imaging methods

This commentary will discuss the use of advanced non-invasive imaging methodology for the pulmonary vascular system with special attention to a rubric for the imaging and clinical team to use for any particular clinical situation.

A retrospective application of the pulmonary embolism rule out criteria (PERC) of the American College of Physicians would reduce the number of CTPAS by 6% without a false negative in an Irish hospital

BACKGROUND

Internationally, the number of computerised tomographic pulmonary angiographies (CTPAs) being performed to rule out pulmonary embolism (PE) has caused some concern.

AIM

This study was performed to assess if the application of Pulmonary Embolism Rule-out Criteria (PERC) in an Irish Emergency Department (ED) would have helped to safely reduce the number of D-dimer assays and computed tomographic pulmonary angiographies (CTPAs) ordered.

METHODS

The PERC was retrospectively calculated in all patients who underwent CTPA for possible PE. It was then established if the application of the PERC as per the American College of Physicians' (ACP) guidelines would have safely ruled out the need for further imaging.

RESULTS

Of the 529 patients who underwent CTPA in the study, 63 patients (12%) had PE on CTPA. Had the PERC criteria been applied, no patient who had a PE would have been missed. In this study, PERC had 100% sensitivity and 14% specificity.

DISCUSSION/CONCLUSION

Application of the PERC rule, as per the ACP guidelines, would have reduced the number of CTPAs performed by 32 (6%) without missing any patient with a proven pulmonary embolus.

The DAGMAR Score: D-dimer assay-guided moderation of adjusted risk. Improving specificity of the D-dimer for pulmonary embolism

We generated a novel scoring system to improve the test characteristics of D-dimer in patients with suspected PE (pulmonary emboli). Electronic Medical Record data were retrospectively reviewed on Emergency Department (ED) patients 18 years or older for whom a D-dimer and imaging were ordered between June 4, 2012 and March 30, 2016. Symptoms (dyspnea, unilateral leg swelling, hemoptysis), age, vital signs, medical history (cancer, recent surgery, medications, history of deep vein thrombosis or PE, COPD, smoking), laboratory values (quantitative D-dimer, platelets, and mean platelet volume (MPV)), and imaging results (CT, VQ) were collected. Points were designated to factors that were significant in two multiple regression analyses, for PE or positive D-dimer. Points predictive of PE were designated positive values and points predictive of positive D-dimer, irrespective of presence of PE, were designated negative values. The DAGMAR (D-dimer Assay-Guided Moderation of Adjusted Risk) score was developed using age and platelet adjustment and points for factors associated with PE and elevated D-dimer. Of 8486 visits reviewed, 3523 were unique visits with imaging, yielding 2253 (26.5%) positive D-dimers. 3501 CT scans and 156 VQ scans were completed, detecting 198 PE. In our cohort, a DAGMAR Score < 2 equated to overall PE risk < 1.2%. Specificity improved (38% to 59%) without compromising sensitivity (94% to 96%). Use of the DAGMAR Score would have reduced CT scans from 2253 to 1556 and lead to fewer false negative results. By considering factors that affect D-dimer and also PE, we improved specificity without compromising sensitivity.

Use of the d-dimer for Detecting Pulmonary Embolism in the Emergency Department

BACKGROUND

Assessment for pulmonary embolism (PE) in the emergency department (ED) remains complex, involving clinical decision tools, blood tests, and imaging.

OBJECTIVE

Our objective was to examine the test characteristics of the high-sensitivity d-dimer for the diagnosis of PE at our institution and evaluate use of the d-dimer and factors associated with a falsely elevated d-dimer.

METHODS

We retrospectively collected data on adult patients evaluated with a d-dimer and computed tomography (CT) pulmonary angiogram or ventilation perfusion scan at two EDs between June 4, 2012 and March 30, 2016. We collected symptoms (dyspnea, unilateral leg swelling, hemoptysis), vital signs, and medical and social history (cancer, recent surgery, medications, history of deep vein thrombosis or PE, chronic obstructive pulmonary disease, smoking). We calculated test characteristics, including sensitivity, specificity, and likelihood ratios for the assay using conventional threshold and with age adjustment, and performed a univariate analysis.

RESULTS

We found 3523 unique visits with d-dimer and imaging, detecting 198 PE. Imaging was pursued on 1270 patients with negative d-dimers, revealing 9 false negatives, and d-dimer was sent on 596 patients for whom negative Pulmonary Embolism Rule-Out Criteria (PERC) were documented with 2% subsequent radiographic detection of PE. The d-dimer showed a sensitivity of 95.7% (95% confidence interval [CI] 91-98%), specificity of 40.0% (95% CI 38-42%), negative likelihood ratio of 0.11 (95% CI 0.06-0.21), and positive likelihood ratio of 1.59 (95% CI 1.53-1.66) for the radiographic detection of PE. With age adjustment, 347 of the 2253 CT scans that were pursued in patients older than 50 years with an elevated d-dimer could have been avoided without missing any additional PE. Many risk factors, such as age, history of PE, recent surgery, shortness of breath, tachycardia and hypoxia, elevated the d-dimer, regardless of the presence of PE.

CONCLUSIONS

Many patients with negative d-dimer and PERC still received imaging. Our data support the use of age adjustment, and perhaps adjustment for other factors seen in patients evaluated for PE.

Creation of a simple natural language processing tool to support an imaging utilization quality dashboard

BACKGROUND

Testing for venous thromboembolism (VTE) is associated with cost and risk to patients (e.g. radiation). To assess the appropriateness of imaging utilization at the provider level, it is important to know that provider's diagnostic yield (percentage of tests positive for the diagnostic entity of interest). However, determining diagnostic yield typically requires either time-consuming, manual review of radiology reports or the use of complex and/or proprietary natural language processing software.

OBJECTIVES

The objectives of this study were twofold: 1) to develop and implement a simple, user-configurable, and open-source natural language processing tool to classify radiology reports with high accuracy and 2) to use the results of the tool to design a provider-specific VTE imaging dashboard, consisting of both utilization rate and diagnostic yield.

METHODS

Two physicians reviewed a training set of 400 lower extremity ultrasound (UTZ) and computed tomography pulmonary angiogram (CTPA) reports to understand the language used in VTE-positive and VTE-negative reports. The insights from this review informed the arguments to the five modifiable parameters of the NLP tool. A validation set of 2,000 studies was then independently classified by the reviewers and by the tool; the classifications were compared and the performance of the tool was calculated.

RESULTS

The tool was highly accurate in classifying the presence and absence of VTE for both the UTZ (sensitivity 95.7%; 95% CI 91.5-99.8, specificity 100%; 95% CI 100-100) and CTPA reports (sensitivity 97.1%; 95% CI 94.3-99.9, specificity 98.6%; 95% CI 97.8-99.4). The diagnostic yield was then calculated at the individual provider level and the imaging dashboard was created.

CONCLUSIONS

We have created a novel NLP tool designed for users without a background in computer programming, which has been used to classify venous thromboembolism reports with a high degree of accuracy. The tool is open-source and available for download at http://iturrate.com/simpleNLP. Results obtained using this tool can be applied to enhance quality by presenting information about utilization and yield to providers via an imaging dashboard.

RESPECT-ED: Rates of Pulmonary Emboli (PE) and Sub-Segmental PE with Modern Computed Tomographic Pulmonary Angiograms in Emergency Departments: A Multi-Center Observational Study Finds Significant Yield Variation, Uncorrelated with Use or Small PE Rates

INTRODUCTION

Overuse of CT Pulmonary Angiograms (CTPA) for diagnosing pulmonary embolism (PE), particularly in Emergency Departments (ED), is considered problematic. Marked variations in positive CTPA rates are reported, with American 4-10% yields driving most concerns. Higher resolution CTPA may increase sub-segmental PE (SSPE) diagnoses, which may be up to 40% false positive. Excessive use and false positives could increase harm vs. benefit. These issues have not been systematically examined outside America.

AIMS

To describe current yield variation and CTPA utilisation in Australasian ED, exploring potential factors correlated with variation.

METHODS

A retrospective multi-centre review of consecutive ED-ordered CTPA using standard radiology reports. ED CTPA report data were inputted onto preformatted data-sheets. The primary outcome was site level yield, analysed both intra-site and against a nominated 15.3% yield. Factors potentially associated with yield were assessed for correlation.

RESULTS

Fourteen radiology departments (15 ED) provided 7077 CTPA data (94% ≥64-slice CT); PE were reported in 1028 (yield 14.6% (95%CI 13.8-15.4%; range 9.3-25.3%; site variation p <0.0001) with four sites significantly below and one above the 15.3% target. Admissions, CTPA usage, PE diagnosis rates and size of PE were uncorrelated with yield. Large PE (≥lobar) were 55% (CI: 52.1-58.2%) and SSPE 8.8% (CI: 7.1-10.5%) of positive scans. CTPA usage (0.2-1.5% adult attendances) was correlated (p<0.006) with PE diagnosis but not SSPE: large PE proportions.

DISCUSSION/ CONCLUSIONS

We found significant intra-site CTPA yield variation within Australasia. Yield was not clearly correlated with CTPA usage or increased small PE rates. Both SSPE and large PE rates were similar to higher yield historical cohorts. CTPA use was considerably below USA 2.5-3% rates. Higher CTPA utilisation was positively correlated with PE diagnoses, but without evidence of increased proportions of small PE. This suggests that increased diagnoses seem to be of clinically relevant sized PE.