1
|
Liu L, Li Y, Liu N, Luo J, Deng J, Peng W, Bai Y, Zhang G, Zhao G, Yang N, Li C, Long X. Establishment of machine learning-based tool for early detection of pulmonary embolism. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2024; 244:107977. [PMID: 38113803 DOI: 10.1016/j.cmpb.2023.107977] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/07/2023] [Revised: 09/11/2023] [Accepted: 12/11/2023] [Indexed: 12/21/2023]
Abstract
BACKGROUND AND OBJECTIVES Pulmonary embolism (PE) is a complex disease with high mortality and morbidity rate, leading to increasing society burden. However, current diagnosis is solely based on symptoms and laboratory data despite its complex pathology, which easily leads to misdiagnosis and missed diagnosis by inexperienced doctors. Especially, CT pulmonary angiography, the gold standard method, is not widely available. In this study, we aim to establish a rapid and accurate screening model for pulmonary embolism using machine learning technology. Importantly, data required for disease prediction are easily accessed, including routine laboratory data and medical record information of patients. METHODS We extracted features from patients' routine laboratory results and medical records, including blood routine, biochemical group, blood coagulation routine and other test results, as well as symptoms and medical history information. Samples with a feature loss rate greater than 0.8 were deleted from the original database. Data from 4723 cases were retained, 231 of which were positive for pulmonary embolism. 50 features were retained through the positive and negative statistical hypothesis testing which was used to build the predictive model. In order to avoid identification as majority-class samples caused by the imbalance of sample proportion, we used the method of Synthetic Minority Oversampling Technique (SMOTE) to increase the amount of information on minority samples. Five typical machine learning algorithms were used to model the screening of pulmonary embolism, including Support Vector Machines, Logistic Regression, Random Forest, XGBoost, and Back Propagation Neural Networks. To evaluate model performance, sensitivity, specificity and AUC curve were analyzed as the main evaluation indicators. Furthermore, a baseline model was established using the characteristics of the pulmonary embolism guidelines as a comparison model. RESULTS We found that XGBoost showed better performance compared to other models, with the highest sensitivity and specificity (0.99 and 0.99, respectively). Moreover, it showed significant improvement in performance compared to the baseline model (sensitivity and specificity were 0.76 and 0.76 respectively). More important, our model showed low missed diagnosis rate (0.46) and high AUC value (0.992). Finally, the calculation time of our model is only about 0.05 s to obtain the possibility of pulmonary embolism. CONCLUSIONS In this study, five machine learning classification models were established to assess the likelihood of patients suffering from pulmonary embolism, and the XGBoost model most significantly improved the precision, sensitivity, and AUC for pulmonary embolism screening. Collectively, we have established an AI-based model to accurately predict pulmonary embolism at early stage.
Collapse
Affiliation(s)
- Lijue Liu
- School of Automation, Central South University, Changsha, Hunan 410083, China; Xiangjiang Laboratory, Changsha 410205, China; Hunan Zixing Intelligent Medical Technology Co., Ltd, Changsha, Hunan 410000, China
| | - Yaming Li
- School of Automation, Central South University, Changsha, Hunan 410083, China
| | - Na Liu
- Xiangya Hospital, Central South University, Xiangya Road 87#, Changsha 410008, China
| | - Jingmin Luo
- Xiangya Hospital, Central South University, Xiangya Road 87#, Changsha 410008, China
| | - Jinhai Deng
- Hunan Zixing Intelligent Medical Technology Co., Ltd, Changsha, Hunan 410000, China; Richard Dimbleby Laboratory of Cancer Research, School of Cancer & Pharmaceutical Sciences, King's College London, London SE1 1UL, UK
| | - Weixiong Peng
- Hunan Zixing Intelligent Medical Technology Co., Ltd, Changsha, Hunan 410000, China; Department of Electrical and Electronic Engineering, College of Engineering, Southern University of Science and Technology (SUSTech), Shenzhen, Guangdong 518055, China
| | - Yongping Bai
- Xiangya Hospital, Central South University, Xiangya Road 87#, Changsha 410008, China
| | - Guogang Zhang
- Department of Cardiovascular Medicine, The Third Xiangya Hospital, Central South University, Tongzipo Road 138#, Changsha 410008,China.
| | - Guihu Zhao
- Xiangya Hospital, Central South University, Xiangya Road 87#, Changsha 410008, China
| | - Ning Yang
- Xiangya Hospital, Central South University, Xiangya Road 87#, Changsha 410008, China
| | - Chuanchang Li
- Xiangya Hospital, Central South University, Xiangya Road 87#, Changsha 410008, China
| | - Xueying Long
- Xiangya Hospital, Central South University, Xiangya Road 87#, Changsha 410008, China
| |
Collapse
|
3
|
Yaghi S, Shu L, Bakradze E, Salehi Omran S, Giles JA, Amar JY, Henninger N, Elnazeir M, Liberman AL, Moncrieffe K, Lu J, Sharma R, Cheng Y, Zubair AS, Simpkins AN, Li GT, Kung JC, Perez D, Heldner M, Scutelnic A, Seiffge D, Siepen B, Rothstein A, Khazaal O, Do D, Kasab SA, Rahman LA, Mistry EA, Kerrigan D, Lafever H, Nguyen TN, Klein P, Aparicio H, Frontera J, Kuohn L, Agarwal S, Stretz C, Kala N, El Jamal S, Chang A, Cutting S, Xiao H, de Havenon A, Muddasani V, Wu T, Wilson D, Nouh A, Asad SD, Qureshi A, Moore J, Khatri P, Aziz Y, Casteigne B, Khan M, Cheng Y, Mac Grory B, Weiss M, Ryan D, Vedovati MC, Paciaroni M, Siegler JE, Kamen S, Yu S, Leon Guerrero CR, Atallah E, De Marchis GM, Brehm A, Dittrich T, Psychogios M, Alvarado-Dyer R, Kass-Hout T, Prabhakaran S, Honda T, Liebeskind DS, Furie K. Direct Oral Anticoagulants Versus Warfarin in the Treatment of Cerebral Venous Thrombosis (ACTION-CVT): A Multicenter International Study. Stroke 2022; 53:728-738. [PMID: 35143325 DOI: 10.1161/strokeaha.121.037541] [Citation(s) in RCA: 57] [Impact Index Per Article: 28.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
BACKGROUND A small randomized controlled trial suggested that dabigatran may be as effective as warfarin in the treatment of cerebral venous thrombosis (CVT). We aimed to compare direct oral anticoagulants (DOACs) to warfarin in a real-world CVT cohort. METHODS This multicenter international retrospective study (United States, Europe, New Zealand) included consecutive patients with CVT treated with oral anticoagulation from January 2015 to December 2020. We abstracted demographics and CVT risk factors, hypercoagulable labs, baseline imaging data, and clinical and radiological outcomes from medical records. We used adjusted inverse probability of treatment weighted Cox-regression models to compare recurrent cerebral or systemic venous thrombosis, death, and major hemorrhage in patients treated with warfarin versus DOACs. We performed adjusted inverse probability of treatment weighted logistic regression to compare recanalization rates on follow-up imaging across the 2 treatments groups. RESULTS Among 1025 CVT patients across 27 centers, 845 patients met our inclusion criteria. Mean age was 44.8 years, 64.7% were women; 33.0% received DOAC only, 51.8% received warfarin only, and 15.1% received both treatments at different times. During a median follow-up of 345 (interquartile range, 140-720) days, there were 5.68 recurrent venous thrombosis, 3.77 major hemorrhages, and 1.84 deaths per 100 patient-years. Among 525 patients who met recanalization analysis inclusion criteria, 36.6% had complete, 48.2% had partial, and 15.2% had no recanalization. When compared with warfarin, DOAC treatment was associated with similar risk of recurrent venous thrombosis (aHR, 0.94 [95% CI, 0.51-1.73]; P=0.84), death (aHR, 0.78 [95% CI, 0.22-2.76]; P=0.70), and rate of partial/complete recanalization (aOR, 0.92 [95% CI, 0.48-1.73]; P=0.79), but a lower risk of major hemorrhage (aHR, 0.35 [95% CI, 0.15-0.82]; P=0.02). CONCLUSIONS In patients with CVT, treatment with DOACs was associated with similar clinical and radiographic outcomes and favorable safety profile when compared with warfarin treatment. Our findings need confirmation by large prospective or randomized studies.
Collapse
Affiliation(s)
- Shadi Yaghi
- Department of Neurology, Brown University, Providence, RI (S.Y., L.S., C.S., N.K., S.E.J., A.C., S.C., K.F.)
| | - Liqi Shu
- Department of Neurology, Brown University, Providence, RI (S.Y., L.S., C.S., N.K., S.E.J., A.C., S.C., K.F.)
| | | | - Setareh Salehi Omran
- Department of Neurology, University of Colorado School of Medicine, Aurora (S.S.O.)
| | - James A Giles
- Department of Neurology, Washington University, Saint Louis, MO (J.A.G., J.Y.A.)
| | - Jordan Y Amar
- Department of Neurology, Washington University, Saint Louis, MO (J.A.G., J.Y.A.)
| | - Nils Henninger
- Department of Neurology, University of Massachusetts, Worcester. (N.H., M.E.).,Department of Psychiatry, University of Massachusetts, Worcester. (N.H.)
| | - Marwa Elnazeir
- Department of Neurology, University of Massachusetts, Worcester. (N.H., M.E.)
| | - Ava L Liberman
- Department of Neurology, Weill Cornell Medical Center, NY (A.L.L.)
| | | | - Jenny Lu
- Department of Neurology, Montefiore Medical Center, NY (K.M., J.L.)
| | - Richa Sharma
- Department of Neurology, Yale University, New Haven, CT (R.S., Y.C., A.S.Z., A.d.H.)
| | - Yee Cheng
- Department of Neurology, Yale University, New Haven, CT (R.S., Y.C., A.S.Z., A.d.H.)
| | - Adeel S Zubair
- Department of Neurology, Yale University, New Haven, CT (R.S., Y.C., A.S.Z., A.d.H.)
| | - Alexis N Simpkins
- Department of Neurology, University of Florida, Gainesville (A.N.S., G.T.L., J.C.K., D.P.)
| | - Grace T Li
- Department of Neurology, University of Florida, Gainesville (A.N.S., G.T.L., J.C.K., D.P.)
| | - Justin Chi Kung
- Department of Neurology, University of Florida, Gainesville (A.N.S., G.T.L., J.C.K., D.P.)
| | - Dezaray Perez
- Department of Neurology, University of Florida, Gainesville (A.N.S., G.T.L., J.C.K., D.P.)
| | - Mirjam Heldner
- Department of Neurology, Inselspital Universitätsspital, Bern, Switzerland (M.H., A.S., D.S., B.S.)
| | - Adrian Scutelnic
- Department of Neurology, Inselspital Universitätsspital, Bern, Switzerland (M.H., A.S., D.S., B.S.)
| | - David Seiffge
- Department of Neurology, Inselspital Universitätsspital, Bern, Switzerland (M.H., A.S., D.S., B.S.)
| | - Bernhard Siepen
- Department of Neurology, Inselspital Universitätsspital, Bern, Switzerland (M.H., A.S., D.S., B.S.)
| | - Aaron Rothstein
- Department of Neurology, University of Pennsylvania, Philadelphia, PA (A.R., O.K., D.D.)
| | - Ossama Khazaal
- Department of Neurology, University of Pennsylvania, Philadelphia, PA (A.R., O.K., D.D.)
| | - David Do
- Department of Neurology, University of Pennsylvania, Philadelphia, PA (A.R., O.K., D.D.)
| | - Sami Al Kasab
- Department of Neurology, Medical University of South Carolina, Charleston (S.A.K., L.A.R.).,Department of Neurosurgery, Medical University of South Carolina, Charleston (S.A.K.)
| | - Line Abdul Rahman
- Department of Neurology, Medical University of South Carolina, Charleston (S.A.K., L.A.R.)
| | - Eva A Mistry
- Department of Neurology and Rehabilitation Medicine, University of Cincinnati (E.A.M., P.K., Y.A., B.C.)
| | - Deborah Kerrigan
- Department of Neurology, Vanderbilt University, Nashville, TN (D.K., H.L.)
| | - Hayden Lafever
- Department of Neurology, Vanderbilt University, Nashville, TN (D.K., H.L.)
| | - Thanh N Nguyen
- Department of Neurology, Boston University School of Medicine, MA (T.N.N., P.K., H.A.)
| | - Piers Klein
- Department of Neurology and Rehabilitation Medicine, University of Cincinnati (E.A.M., P.K., Y.A., B.C.).,Department of Neurology, Boston University School of Medicine, MA (T.N.N., P.K., H.A.)
| | - Hugo Aparicio
- Department of Neurology, Boston University School of Medicine, MA (T.N.N., P.K., H.A.)
| | | | - Lindsey Kuohn
- Department of Neurology, New York University, NY (J.F., L.K., S.A.)
| | - Shashank Agarwal
- Department of Neurology, New York University, NY (J.F., L.K., S.A.)
| | - Christoph Stretz
- Department of Neurology, Brown University, Providence, RI (S.Y., L.S., C.S., N.K., S.E.J., A.C., S.C., K.F.)
| | - Narendra Kala
- Department of Neurology, Brown University, Providence, RI (S.Y., L.S., C.S., N.K., S.E.J., A.C., S.C., K.F.)
| | - Sleiman El Jamal
- Department of Neurology, Brown University, Providence, RI (S.Y., L.S., C.S., N.K., S.E.J., A.C., S.C., K.F.)
| | - Alison Chang
- Department of Neurology, Brown University, Providence, RI (S.Y., L.S., C.S., N.K., S.E.J., A.C., S.C., K.F.)
| | - Shawna Cutting
- Department of Neurology, Brown University, Providence, RI (S.Y., L.S., C.S., N.K., S.E.J., A.C., S.C., K.F.)
| | - Han Xiao
- Department of Biostatistics, University of California Santa Barbara (H.X.)
| | - Adam de Havenon
- Department of Neurology, Yale University, New Haven, CT (R.S., Y.C., A.S.Z., A.d.H.)
| | - Varsha Muddasani
- Department of Neurology, University of Utah, Salt Lake City (V.M.)
| | - Teddy Wu
- Department of Neurology, Christchurch hospital, New Zealand (T.W., D.W.)
| | - Duncan Wilson
- Department of Neurology, Christchurch hospital, New Zealand (T.W., D.W.)
| | - Amre Nouh
- Department of Neurology, Hartford Hospital, CT (A.N., S.D.A.)
| | | | - Abid Qureshi
- Department of Neurology, University of Kansas, Kansas City (A.Q., J.M.)
| | - Justin Moore
- Department of Neurology, University of Kansas, Kansas City (A.Q., J.M.)
| | | | - Yasmin Aziz
- Department of Neurology and Rehabilitation Medicine, University of Cincinnati (E.A.M., P.K., Y.A., B.C.)
| | - Bryce Casteigne
- Department of Neurology and Rehabilitation Medicine, University of Cincinnati (E.A.M., P.K., Y.A., B.C.)
| | - Muhib Khan
- Department of Neurology, Spectrum Health, Michigan State University, Grand Rapids (M.K., Y.C.)
| | - Yao Cheng
- Department of Neurology, Spectrum Health, Michigan State University, Grand Rapids (M.K., Y.C.)
| | - Brian Mac Grory
- Department of Neurology, Duke University, Durham, NC (B.M.G., M.W., D.R.)
| | - Martin Weiss
- Department of Neurology, Duke University, Durham, NC (B.M.G., M.W., D.R.)
| | - Dylan Ryan
- Department of Neurology, Duke University, Durham, NC (B.M.G., M.W., D.R.)
| | | | | | - James E Siegler
- Department of Neurology, Cooper University, Camden, NJ (J.E.S., S.K., S.Y.)
| | - Scott Kamen
- Department of Neurology, Cooper University, Camden, NJ (J.E.S., S.K., S.Y.)
| | - Siyuan Yu
- Department of Neurology, Cooper University, Camden, NJ (J.E.S., S.K., S.Y.)
| | | | - Eugenie Atallah
- Department of Neurology, George Washington University, District of Columbia (C.R.L.G., E.A.)
| | - Gian Marco De Marchis
- Department of Neurology, University Hospital Basel and University of Basel, Switzerland (G.M.D.M., T.D.)
| | - Alex Brehm
- Department of interventional and diagnostic Neuroradiology, Clinic of Radiology and Nuclear Medicine, University Hospital Basel and University of Basel, Switzerland (A.B., M.P.)
| | - Tolga Dittrich
- Department of Neurology, University Hospital Basel and University of Basel, Switzerland (G.M.D.M., T.D.)
| | - Marios Psychogios
- Department of interventional and diagnostic Neuroradiology, Clinic of Radiology and Nuclear Medicine, University Hospital Basel and University of Basel, Switzerland (A.B., M.P.)
| | | | - Tareq Kass-Hout
- Department of Neurology, University of Chicago, IL (R.A.-D., T.K.-H., S.P.)
| | - Shyam Prabhakaran
- Department of Neurology, University of Chicago, IL (R.A.-D., T.K.-H., S.P.)
| | - Tristan Honda
- Department of Neurology, University of California at Los Angeles (T.H., D.S.L.)
| | - David S Liebeskind
- Department of Neurology, University of California at Los Angeles (T.H., D.S.L.)
| | - Karen Furie
- Department of Neurology, Brown University, Providence, RI (S.Y., L.S., C.S., N.K., S.E.J., A.C., S.C., K.F.)
| |
Collapse
|