1
|
Lian Z, Wei XN, Chai D. Machine Learning-Based Prediction of Pulmonary Embolism Prognosis Using Nutritional and Inflammatory Indices. Clin Appl Thromb Hemost 2024; 30:10760296241300484. [PMID: 39552298 PMCID: PMC11571247 DOI: 10.1177/10760296241300484] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/17/2024] [Revised: 10/24/2024] [Accepted: 11/01/2024] [Indexed: 11/19/2024] Open
Abstract
PURPOSE This study aimed to create and assess machine learning (ML) models that utilize nutritional and inflammatory indices, focusing on the advanced lung cancer inflammation index (ALI) and neutrophil-to-albumin ratio (NAR), to improve the prediction accuracy of PE prognosis. PATIENTS AND METHODS We conducted a retrospective analysis of 312 patients, comprising 254 survivors and 58 non-survivors. The Boruta algorithm was used to identify significant variables, and four ML models (XGBoost, Random Forest, Logistic Regression, and SVM) were employed to analyze the clinical data and assess the performance of the models. RESULTS The XGBoost model, with optimal hyperparameters, achieved the best performance, with an accuracy of 0.882, an F1-score of 0.889, a precision of 0.917, a sensitivity of 0.863, a specificity of 0.905, and an AUC of 0.873. Analysis of feature importance indicated that the most critical predictors across models were respiratory failure, log-transformed ALI, albumin level, age, diastolic blood pressure, and NAR. CONCLUSION The ML-based prediction models effectively predicted the prognosis of PE, with the XGBoost model exhibiting good performance. Respiratory failure, ALI, albumin level, age, diastolic blood pressure, and NAR were correlated with PE prognosis.
Collapse
Affiliation(s)
- Zengzhi Lian
- Department of Pulmonary and Critical Care Medicine, Taicang Affiliated Hospital of Soochow University, Suzhou, Jiangsu Province, China
| | - Xue-ni Wei
- Department of Pharmacy, Taicang Affiliated Hospital of Soochow University, Suzhou, Jiangsu Province, China
| | - Dayang Chai
- Department of Cardiovascular Medicine, Taicang Affiliated Hospital of Soochow University, Suzhou, Jiangsu Province, China
| |
Collapse
|
2
|
Rouleau SG, Campbell AR, Huang J, Reed ME, Vinson DR. Disposition of emergency department patients with acute pulmonary embolism after ambulance arrival. J Am Coll Emerg Physicians Open 2023; 4:e13068. [PMID: 38029020 PMCID: PMC10667606 DOI: 10.1002/emp2.13068] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/08/2023] [Revised: 10/12/2023] [Accepted: 10/20/2023] [Indexed: 12/01/2023] Open
Abstract
Objective Most outpatients with pulmonary embolism (PE) are diagnosed in the emergency department (ED). The relationship between means of arrival, site of diagnosis, and disposition in ED patients with PE is unknown. We compared discharge home between patients arriving by emergency medical services (EMS) and those arriving by other means. Within the EMS cohort, we compared those with a recent PE diagnosis in the outpatient clinic setting to those who were diagnosed with PE in the ED. Methods This study was a secondary analysis of a retrospective cohort that included all adult, non-pregnant ED patients treated for acute PE across 21 community EDs from January 2013 to April 2015. The primary outcome was discharge home within 24 h of ED registration; we also examined mortality. We described associations with patient arrival method and other patient characteristics. Results Among 2996 ED patient encounters with acute PE, 644 (21.5%) arrived by EMS. This group had a lower frequency of discharge (9.2% vs 26.4%) and higher 30-day all-cause mortality (8.7% vs 3.1%) than their counterparts (p < 0.001 for both). These associations remained after adjusting for confounding variables. Among the EMS cohort, 14 patients (2.2%) arrived with a PE diagnosis recently made in the outpatient setting. Conclusion Patients with PE who arrived at the ED by EMS were less likely to be discharged home within 24 h and more likely to die within 30 days than those who arrived by other means. Less than 3% of the EMS group had been diagnosed with PE before ED arrival.
Collapse
Affiliation(s)
- Samuel G. Rouleau
- Department of Emergency MedicineUC Davis HealthSacramentoCaliforniaUSA
| | | | - Jie Huang
- Kaiser Permanente Division of ResearchOaklandCaliforniaUSA
| | - Mary E. Reed
- Kaiser Permanente Division of ResearchOaklandCaliforniaUSA
| | - David R. Vinson
- Kaiser Permanente Division of ResearchOaklandCaliforniaUSA
- The Permanente Medical GroupOaklandCaliforniaUSA
- Department of Emergency MedicineKaiser Permanente Roseville Medical CenterRosevilleCaliforniaUSA
| | | |
Collapse
|
3
|
Weekes AJ, Davison J, Lupez K, Raper JD, Thomas AM, Cox CA, Esener D, Boyd JS, Nomura JT, Murphy K, Ockerse PM, Leech S, Johnson J, Abrams E, Kelly C, O'Connell NS. Quality of life 1 month after acute pulmonary embolism in emergency department patients. Acad Emerg Med 2023; 30:819-831. [PMID: 36786661 DOI: 10.1111/acem.14692] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/28/2022] [Revised: 01/30/2023] [Accepted: 02/07/2023] [Indexed: 02/15/2023]
Abstract
OBJECTIVE The Pulmonary Embolism Quality-of-Life (PEmb-QoL) questionnaire assesses quality of life (QoL) after pulmonary embolism (PE). We aimed to determine whether any clinical or pathophysiologic features of PE were associated with worse PEmb-QoL scores 1 month after PE. METHODS In this prospective multicenter registry, we conducted PEmb-QoL questionnaires. We determined differences in QoL domain scores for four primary variables: clinical deterioration (death, cardiac arrest, respiratory failure, hypotension requiring fluid bolus, catecholamine support, or new dysrhythmia), right ventricular dysfunction (RVD), PE risk stratification, and subsequent rehospitalization. For overall QoL score, we fit a multivariable regression model that included these four primary variables as independent variables. RESULTS Of 788 PE patients participating in QoL assessments, 156 (19.8%) had a clinical deterioration event, 236 (30.7%) had RVD of which 38 (16.1%) had escalated interventions. For those without and with clinical deterioration, social limitations had mean (±SD) scores of 2.07 (±1.27) and 2.36 (±1.47), respectively (p = 0.027). For intensity of complaints, mean (±SD) scores for patients without RVD (4.32 ± 2.69) were significantly higher than for those with RVD with or without reperfusion interventions (3.82 ± 1.81 and 3.83 ± 2.11, respectively; p = 0.043). There were no domain score differences between PE risk stratification groups. All domain scores were worse for patients with rehospitalization versus without. By multivariable analysis, worse total PEmb-QoL scores with effect sizes were subsequent rehospitalization 11.29 (6.68-15.89), chronic obstructive pulmonary disease (COPD) 8.17 (3.91-12.43), and longer index hospital length of stay 0.06 (0.03-0.08). CONCLUSIONS Acute clinical deterioration, RVD, and PE severity were not predictors of QoL at 1 month post-PE. Independent predictors of worsened QoL were rehospitalization, COPD, and index hospital length of stay.
Collapse
Affiliation(s)
- Anthony J Weekes
- Department of Emergency Medicine, Atrium Health's Carolinas Medical Center, Charlotte, North Carolina, USA
| | - Jillian Davison
- Department of Emergency Medicine, Orlando Health, Orlando, Florida, USA
| | - Kathryn Lupez
- Department of Emergency Medicine, Atrium Health's Carolinas Medical Center, Charlotte, North Carolina, USA
- Department of Emergency Medicine, Tufts Medical Center, Boston, Massachusetts, USA
| | - Jaron D Raper
- Department of Emergency Medicine, Atrium Health's Carolinas Medical Center, Charlotte, North Carolina, USA
- Department of Emergency Medicine, University of Alabama at Birmingham, Birmingham, Alabama, USA
| | - Alyssa M Thomas
- Department of Emergency Medicine, Atrium Health's Carolinas Medical Center, Charlotte, North Carolina, USA
- Emergency Department, Houston Methodist Baytown Hospital, Houston, Texas, USA
| | - Carly A Cox
- Department of Emergency Medicine, Atrium Health's Carolinas Medical Center, Charlotte, North Carolina, USA
- Emergency Medicine of Idaho, Meridian, Idaho, USA
| | - Dasia Esener
- Department of Emergency Medicine, Kaiser Permanente, San Diego, California, USA
| | - Jeremy S Boyd
- Department of Emergency Medicine, Vanderbilt University Medical Center, Nashville, Tennessee, USA
| | - Jason T Nomura
- Department of Emergency Medicine, Christiana Care, Newark, Delaware, USA
| | - Kathleen Murphy
- Department of Emergency Medicine, Christiana Care, Newark, Delaware, USA
| | - Patrick M Ockerse
- Department of Emergency Medicine, University of Utah Health, Salt Lake City, Utah, USA
| | - Stephen Leech
- Department of Emergency Medicine, Orlando Health, Orlando, Florida, USA
| | - Jakea Johnson
- Department of Emergency Medicine, Vanderbilt University Medical Center, Nashville, Tennessee, USA
| | - Eric Abrams
- Department of Emergency Medicine, Kaiser Permanente, San Diego, California, USA
| | - Christopher Kelly
- Department of Emergency Medicine, University of Utah Health, Salt Lake City, Utah, USA
| | - Nathaniel S O'Connell
- Department of Biostatistics and Data Science, Wake Forest University School of Medicine, Winston-Salem, North Carolina, USA
| |
Collapse
|
4
|
Weekes AJ, Raper JD, Esener D, Davison J, Boyd JS, Kelly C, Nomura JT, Thomas AM, Lupez K, Cox CA, Ockerse PM, Leech S, Johnson J, Abrams E, Murphy K, O'Connell NS. Comparing predictive performance of pulmonary embolism risk stratification tools for acute clinical deterioration. J Am Coll Emerg Physicians Open 2023; 4:e12983. [PMID: 37251351 PMCID: PMC10214857 DOI: 10.1002/emp2.12983] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/06/2023] [Revised: 05/04/2023] [Accepted: 05/11/2023] [Indexed: 05/31/2023] Open
Abstract
Objectives Existing pulmonary embolism (PE) risk scores were developed to predict death within weeks, but not more proximate adverse events. We determined the ability of 3 PE risk stratification tools (simplified pulmonary embolism severity index [sPESI], 2019 European Society of Cardiology guidelines [ESC], and PE short-term clinical outcomes risk estimation [PE-SCORE]) to predict 5-day clinical deterioration after emergency department (ED) diagnosis of PE. Methods We analyzed data from six EDs on ED patients with confirmed PE. Clinical deterioration was defined as death, respiratory failure, cardiac arrest, new dysrhythmia, sustained hypotension requiring vasopressors or volume resuscitation, or escalated intervention within 5 days of PE diagnosis. We determined sensitivity and specificity of sPESI, ESC, and PE-SCORE for predicting clinical deterioration. Results Of 1569 patients, 24.5% had clinical deterioration within 5 days. sPESI, ESC, and PE-SCORE classifications were low-risk in 558 (35.6%), 167 (10.6%), and 309 (19.6%), respectively. Sensitivities of sPESI, ESC, and PE-SCORE for clinical deterioration were 81.8 (78, 85.7), 98.7 (97.6, 99.8), and 96.1 (94.2, 98), respectively. Specificities of sPESI, ESC, and PE-SCORE for clinical deterioration were 41.2 (38.4, 44), 13.7 (11.7, 15.6), and 24.8 (22.4, 27.3). Areas under the curve were 61.5 (59.1, 63.9), 56.2 (55.1, 57.3), and 60.5 (58.9, 62.0). Negative predictive values were 87.5 (84.7, 90.2), 97 (94.4, 99.6), and 95.1 (92.7, 97.5). Conclusions ESC and PE-SCORE were better than sPESI for detecting clinical deterioration within 5 days after PE diagnosis.
Collapse
Affiliation(s)
- Anthony J. Weekes
- Department of Emergency MedicineAtrium Health's Carolinas Medical CenterCharlotteNorth CarolinaUSA
| | - Jaron D. Raper
- Department of Emergency MedicineAtrium Health's Carolinas Medical CenterCharlotteNorth CarolinaUSA
- Present address:
Department of Emergency MedicineUniversity of Alabama at BirminghamBirminghamAlabama
| | - Dasia Esener
- Department of Emergency MedicineKaiser PermanenteSan DiegoCaliforniaUSA
| | - Jillian Davison
- Department of Emergency MedicineOrlando HealthOrlandoFloridaUSA
| | - Jeremy S. Boyd
- Department of Emergency MedicineVanderbilt University Medical CenterNashvilleTennesseeUSA
| | - Christopher Kelly
- Department of Emergency MedicineUniversity of Utah HealthSalt Lake CityUtahUSA
| | - Jason T. Nomura
- Department of Emergency MedicineChristiana CareNewarkDelawareUSA
| | - Alyssa M. Thomas
- Department of Emergency MedicineAtrium Health's Carolinas Medical CenterCharlotteNorth CarolinaUSA
- Present address:
Emergency DepartmentHouston Methodist Baytown HospitalHoustonTexas
| | - Kathryn Lupez
- Department of Emergency MedicineAtrium Health's Carolinas Medical CenterCharlotteNorth CarolinaUSA
- Present address:
Department of Emergency MedicineTufts Medical CenterBostonMassachusetts
| | - Carly A. Cox
- Department of Emergency MedicineAtrium Health's Carolinas Medical CenterCharlotteNorth CarolinaUSA
- Present address:
Emergency Medicine of IdahoMeridianIdaho
| | - Patrick M. Ockerse
- Department of Emergency MedicineUniversity of Utah HealthSalt Lake CityUtahUSA
| | - Stephen Leech
- Department of Emergency MedicineOrlando HealthOrlandoFloridaUSA
| | - Jakea Johnson
- Department of Emergency MedicineVanderbilt University Medical CenterNashvilleTennesseeUSA
| | - Eric Abrams
- Department of Emergency MedicineKaiser PermanenteSan DiegoCaliforniaUSA
| | - Kathleen Murphy
- Department of Emergency MedicineChristiana CareNewarkDelawareUSA
| | - Nathaniel S. O'Connell
- Department of Biostatistics and Data ScienceWake Forest University School of MedicineWinston‐SalemNorth CarolinaUSA
| |
Collapse
|
5
|
Vinson DR, Casey SD, Vuong PL, Huang J, Ballard DW, Reed ME. Sustainability of a Clinical Decision Support Intervention for Outpatient Care for Emergency Department Patients With Acute Pulmonary Embolism. JAMA Netw Open 2022; 5:e2212340. [PMID: 35576004 PMCID: PMC9112064 DOI: 10.1001/jamanetworkopen.2022.12340] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/11/2022] Open
Abstract
IMPORTANCE Physicians commonly hospitalize patients presenting to the emergency department (ED) with acute pulmonary embolism (PE), despite eligibility for safe outpatient management. Risk stratification using electronic health record-embedded clinical decision support systems can aid physician site-of-care decision-making and increase safe outpatient management. The long-term sustainability of early improvements after the cessation of trial-based, champion-led promotion is uncertain. OBJECTIVE To evaluate the sustainability of recommended site-of-care decision-making support 4 years after initial physician champion-led interventions to increase outpatient management for patients with acute PE. DESIGN, SETTING, AND PARTICIPANTS This retrospective cohort study was conducted in 21 US community hospitals in an integrated health system. Participants included adult patients presenting to the ED with acute PE. Study sites had participated in an original decision-support intervention trial 4 years prior to the current study period: 10 sites were intervention sites, 11 sites were controls. In that trial, decision support with champion promotion resulted in significantly higher outpatient management at intervention sites compared with controls. After trial completion, all study sites were given continued access to a modified decision-support tool without further champion-led outreach. Data were analyzed from January 2019 to February 2020. EXPOSURES ED treatment with a modified clinical decision support tool. MAIN OUTCOMES AND MEASURES The main outcome was frequency of outpatient management, defined as discharge home directly from the ED, stratified by the PE Severity Index. The safety measure of outpatient care was 7-day PE-related hospitalization. RESULTS This study included 1039 patients, including 533 (51.3%) women, with a median (IQR) age of 65 (52-74) years. Nearly half (474 patients [45.6%]) were rated lower risk on the PE Severity Index. Overall, 278 patients (26.8%) were treated as outpatients, with only four 7-day PE-related hospitalizations (1.4%; 95% CI, 0.4%-3.6%). The practice gap in outpatient management created by the earlier trial persisted in the outpatient management for patients with lower risk: 109 of 236 patients (46.2%) at former intervention sites vs 81 of 238 patients (34.0%) at former control sites (difference, 12.2; [95% CI, 3.4-20.9] percentage points; P = .007), with wide interfacility variation (range, 7.1%-47.1%). CONCLUSIONS AND RELEVANCE In this cohort study, a champion-led, decision-support intervention to increase outpatient management for patients presenting to the ED with acute pulmonary embolism was associated with sustained higher rates of outpatient management 4 years later. The application of our findings to improving sustainability of practice change for other clinical conditions warrants further study.
Collapse
Affiliation(s)
- David R. Vinson
- The Permanente Medical Group, Oakland, California
- Kaiser Permanente Division of Research, Oakland, California
- The Kaiser Permanente CREST Network
- Department of Emergency Medicine, Kaiser Permanente Roseville Medical Center, Roseville, California
| | - Scott D. Casey
- The Kaiser Permanente CREST Network
- Department of Emergency Medicine, UC Davis Health, University of California, Davis, Sacramento
| | - Peter L. Vuong
- Department of Emergency Medicine, Kaiser Permanente Modesto Medical Center, Modesto, California
| | - Jie Huang
- Kaiser Permanente Division of Research, Oakland, California
- The Kaiser Permanente CREST Network
| | - Dustin W. Ballard
- The Permanente Medical Group, Oakland, California
- Kaiser Permanente Division of Research, Oakland, California
- The Kaiser Permanente CREST Network
- Department of Emergency Medicine, Kaiser Permanente San Rafael Medical Center, San Rafael, California
| | - Mary E. Reed
- Kaiser Permanente Division of Research, Oakland, California
- The Kaiser Permanente CREST Network
| |
Collapse
|
6
|
Ehrman RR. Right ventricular dysfunction as a triage tool in low-risk pulmonary embolism: Not yet ready for routine clinical use. Acad Emerg Med 2022; 29:908-910. [PMID: 35304929 DOI: 10.1111/acem.14488] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/17/2022] [Accepted: 03/18/2022] [Indexed: 11/30/2022]
Affiliation(s)
- Robert R. Ehrman
- Department of Emergency Medicine Wayne State University School of Medicine Detroit Michigan USA
| |
Collapse
|