1
|
Mao B, Ling L, Pan Y, Zhang R, Zheng W, Shen Y, Lu W, Lu Y, Xu S, Wu J, Wang M, Wan S. Machine learning for the prediction of in-hospital mortality in patients with spontaneous intracerebral hemorrhage in intensive care unit. Sci Rep 2024; 14:14195. [PMID: 38902304 PMCID: PMC11190185 DOI: 10.1038/s41598-024-65128-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/26/2023] [Accepted: 06/17/2024] [Indexed: 06/22/2024] Open
Abstract
This study aimed to develop a machine learning (ML)-based tool for early and accurate prediction of in-hospital mortality risk in patients with spontaneous intracerebral hemorrhage (sICH) in the intensive care unit (ICU). We did a retrospective study in our study and identified cases of sICH from the MIMIC IV (n = 1486) and Zhejiang Hospital databases (n = 110). The model was constructed using features selected through LASSO regression. Among five well-known models, the selection of the best model was based on the area under the curve (AUC) in the validation cohort. We further analyzed calibration and decision curves to assess prediction results and visualized the impact of each variable on the model through SHapley Additive exPlanations. To facilitate accessibility, we also created a visual online calculation page for the model. The XGBoost exhibited high accuracy in both internal validation (AUC = 0.907) and external validation (AUC = 0.787) sets. Calibration curve and decision curve analyses showed that the model had no significant bias as well as being useful for supporting clinical decisions. XGBoost is an effective algorithm for predicting in-hospital mortality in patients with sICH, indicating its potential significance in the development of early warning systems.
Collapse
Affiliation(s)
- Baojie Mao
- Brain center, Affiliated Zhejiang Hospital, Zhejiang University School of Medicine, 1229 Gudun Road, Hangzhou, 310030, China
| | - Lichao Ling
- Brain center, Affiliated Zhejiang Hospital, Zhejiang University School of Medicine, 1229 Gudun Road, Hangzhou, 310030, China
| | - Yuhang Pan
- Urology Department, Lin'an Hospital of Traditional Chinese Medicine, Hangzhou, 311321, China
| | - Rui Zhang
- Brain center, Affiliated Zhejiang Hospital, Zhejiang University School of Medicine, 1229 Gudun Road, Hangzhou, 310030, China
- The Second School of Clinical Medicine, Zhejiang Chinese Medical University, Hangzhou, 310053, China
| | - Wanning Zheng
- Brain center, Affiliated Zhejiang Hospital, Zhejiang University School of Medicine, 1229 Gudun Road, Hangzhou, 310030, China
- The Second School of Clinical Medicine, Zhejiang Chinese Medical University, Hangzhou, 310053, China
| | - Yanfei Shen
- Department of Intensive Care, Affiliated Zhejiang Hospital, Zhejiang University School of Medicine, Hangzhou, 310030, China
| | - Wei Lu
- ArteryFlow Technology Co., Ltd., Hangzhou, 310051, China
| | - Yuning Lu
- Brain center, Affiliated Zhejiang Hospital, Zhejiang University School of Medicine, 1229 Gudun Road, Hangzhou, 310030, China
- The Second School of Clinical Medicine, Zhejiang Chinese Medical University, Hangzhou, 310053, China
| | - Shanhu Xu
- Brain center, Affiliated Zhejiang Hospital, Zhejiang University School of Medicine, 1229 Gudun Road, Hangzhou, 310030, China
| | - Jiong Wu
- Brain center, Affiliated Zhejiang Hospital, Zhejiang University School of Medicine, 1229 Gudun Road, Hangzhou, 310030, China
| | - Ming Wang
- Brain center, Affiliated Zhejiang Hospital, Zhejiang University School of Medicine, 1229 Gudun Road, Hangzhou, 310030, China.
| | - Shu Wan
- Brain center, Affiliated Zhejiang Hospital, Zhejiang University School of Medicine, 1229 Gudun Road, Hangzhou, 310030, China.
| |
Collapse
|
2
|
Liu L, Jiang J, Wu L, Zeng DM, Yan C, Liang L, Shi J, Xie Q. Assessing the risk of concurrent mycoplasma pneumoniae pneumonia in children with tracheobronchial tuberculosis: retrospective study. PeerJ 2024; 12:e17164. [PMID: 38560467 PMCID: PMC10979740 DOI: 10.7717/peerj.17164] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/29/2023] [Accepted: 03/06/2024] [Indexed: 04/04/2024] Open
Abstract
Objective This study aimed to create a predictive model based on machine learning to identify the risk for tracheobronchial tuberculosis (TBTB) occurring alongside Mycoplasma pneumoniae pneumonia in pediatric patients. Methods Clinical data from 212 pediatric patients were examined in this retrospective analysis. This cohort included 42 individuals diagnosed with TBTB and Mycoplasma pneumoniae pneumonia (combined group) and 170 patients diagnosed with lobar pneumonia alone (pneumonia group). Three predictive models, namely XGBoost, decision tree, and logistic regression, were constructed, and their performances were assessed using the receiver's operating characteristic (ROC) curve, precision-recall curve (PR), and decision curve analysis (DCA). The dataset was divided into a 7:3 ratio to test the first and second groups, utilizing them to validate the XGBoost model and to construct the nomogram model. Results The XGBoost highlighted eight significant signatures, while the decision tree and logistic regression models identified six and five signatures, respectively. The ROC analysis revealed an area under the curve (AUC) of 0.996 for XGBoost, significantly outperforming the other models (p < 0.05). Similarly, the PR curve demonstrated the superior predictive capability of XGBoost. DCA further confirmed that XGBoost offered the highest AIC (43.226), the highest average net benefit (0.764), and the best model fit. Validation efforts confirmed the robustness of the findings, with the validation groups 1 and 2 showing ROC and PR curves with AUC of 0.997, indicating a high net benefit. The nomogram model was shown to possess significant clinical value. Conclusion Compared to machine learning approaches, the XGBoost model demonstrated superior predictive efficacy in identifying pediatric patients at risk of concurrent TBTB and Mycoplasma pneumoniae pneumonia. The model's identification of critical signatures provides valuable insights into the pathogenesis of these conditions.
Collapse
Affiliation(s)
- Lin Liu
- Department of Pediatrics, the Affiliated Changsha Central Hospital, Hengyang Medical School, University of South China, Changsha, Hunan, China
| | - Jie Jiang
- Department of Pediatrics, the Affiliated Changsha Central Hospital, Hengyang Medical School, University of South China, Changsha, Hunan, China
| | - Lei Wu
- Department of Pediatrics, the Affiliated Changsha Central Hospital, Hengyang Medical School, University of South China, Changsha, Hunan, China
| | - De miao Zeng
- Department of Joint Surgery, he Hong-he Affiliated Hospital of Kunming Medical University/The Southern Central Hospital of Yun-nan Province (The First People’s Hospital of Honghe State), Changsha, Hunan, China
| | - Can Yan
- Department of Pediatrics, the Affiliated Changsha Central Hospital, Hengyang Medical School, University of South China, Changsha, Hunan, China
| | - Linlong Liang
- Department of Pediatrics, the Affiliated Changsha Central Hospital, Hengyang Medical School, University of South China, Changsha, Hunan, China
| | - Jiayun Shi
- Department of Pediatrics, the Affiliated Changsha Central Hospital, Hengyang Medical School, University of South China, Changsha, Hunan, China
| | - Qifang Xie
- Department of Pediatrics, the Affiliated Changsha Central Hospital, Hengyang Medical School, University of South China, Changsha, Hunan, China
| |
Collapse
|
3
|
Yang S, Cao L, Zhou Y, Hu C. A Retrospective Cohort Study: Predicting 90-Day Mortality for ICU Trauma Patients with a Machine Learning Algorithm Using XGBoost Using MIMIC-III Database. J Multidiscip Healthc 2023; 16:2625-2640. [PMID: 37701177 PMCID: PMC10493110 DOI: 10.2147/jmdh.s416943] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/08/2023] [Accepted: 08/29/2023] [Indexed: 09/14/2023] Open
Abstract
Objective The aim of this study was to develop and validate a machine learning-based predictive model that predicts 90-day mortality in ICU trauma patients. Methods Data of patients with severe trauma were extracted from the Medical Information Mart for Intensive Care III (MIMIC-III) database. The performances of mortality prediction models generated using nine machine learning extreme gradient boosting (XGBoost), logistic regression, random forest, AdaBoost, multilayer perceptron (MLP) neural networks, support vector machine (SVM), light gradient boosting machine (GBM), k nearest neighbors (KNN) and gaussian naive bayes (GNB). The performance of the model was evaluated in terms of discrimination, calibration and clinical application. Results We found that the accuracy, sensitivity, specificity, PPV, NPV and F1 score of our proposed XGBoost model were 82.8%, 79.7%, 77.6%, 51.2%, 91.5% and 0.624, respectively. Among the nine models, the XGBoost model performed best. Compared with traditional logistic regression, the calibration curves of the XGBoost model and decision curve analysis (DCA) performed well. Conclusion Our study shows that the XGBoost model outperforms other machine learning models in predicting 90-day mortality in trauma patients. It can be used to assist clinicians in the early identification of mortality risk factors and early intervention to reduce mortality.
Collapse
Affiliation(s)
- Shan Yang
- Department of Critical Care Medicine, West China Hospital of Sichuan University, Chengdu, Sichuan, 610041, People’s Republic of China
| | - Lirui Cao
- West China Hospital of Sichuan University, Chengdu, Sichuan, 610041, People’s Republic of China
| | - Yongfang Zhou
- Department of Respiratory Care, West China Hospital of Sichuan University, Chengdu, Sichuan, 610041, People’s Republic of China
| | - Chenggong Hu
- Department of Critical Care Medicine, West China Hospital of Sichuan University, Chengdu, Sichuan, 610041, People’s Republic of China
| |
Collapse
|
4
|
Li D, Zhao J, Xu B, Zheng Y, Liu M, Huang H, Han S, Wu X. Predicting busulfan exposure in patients undergoing hematopoietic stem cell transplantation using machine learning techniques. Expert Rev Clin Pharmacol 2023; 16:751-761. [PMID: 37326641 DOI: 10.1080/17512433.2023.2226866] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/29/2023] [Accepted: 06/13/2023] [Indexed: 06/17/2023]
Abstract
PURPOSE This study aimed to establish an optimal model to predict the busulfan (BU) area under the curve at steady state (AUCss) by using machine learning (ML). PATIENTS AND METHODS Seventy-nine adult patients (age ≥18 years) who received BU intravenously and underwent therapeutic drug monitoring from 2013 to 2021 at Fujian Medical University Union Hospital were enrolled in this retrospective study. The whole dataset was divided into a training group and test group at the ratio of 8:2. BU AUCss were considered as the target variable. Nine different ML algorithms and one population pharmacokinetic (pop PK) model were developed and validated, and their predictive performance was compared. RESULTS All ML models were superior to the pop PK model (R2 = 0.751, MSE = 0.722, 14 and RMSE = 0.830) in model fitting and had better predictive accuracy. The ML model of BU AUCss established through support vector regression (SVR) and gradient boosted regression trees (GBRT) had the best predictive ability (R2 = 0.953 and 0.953, MSE = 0.323 and 0.326, and RMSE = 0.423 and 0.425). CONCLUSION All the ML models can potentially be used to estimate BU AUCss with the aim of facilitating rational use of BU on the individualized level, especially models built by SVR and GBRT algorithms.
Collapse
Affiliation(s)
- Dandan Li
- Department of Pharmacy, Fujian Medical University Union Hospital, Fuzhou, China
- School of Pharmacy, Fujian Medical University, Fuzhou, China
| | - Jingtong Zhao
- School of Economics, Renmin University of China, Beijing, China
| | - Baohua Xu
- Department of Pharmacy, Fujian Medical University Union Hospital, Fuzhou, China
- School of Pharmacy, Fujian Medical University, Fuzhou, China
| | - You Zheng
- Department of Pharmacy, Fujian Medical University Union Hospital, Fuzhou, China
- School of Pharmacy, Fujian Medical University, Fuzhou, China
| | - Maobai Liu
- Department of Pharmacy, Fujian Medical University Union Hospital, Fuzhou, China
| | - Huiping Huang
- Department of Pharmacy, Fujian Medical University Union Hospital, Fuzhou, China
- School of Pharmacy, Fujian Medical University, Fuzhou, China
| | - Song Han
- School of Economics, Renmin University of China, Beijing, China
| | - Xuemei Wu
- Department of Pharmacy, Fujian Medical University Union Hospital, Fuzhou, China
| |
Collapse
|
5
|
Chen Z, Li T, Guo S, Zeng D, Wang K. Machine learning-based in-hospital mortality risk prediction tool for intensive care unit patients with heart failure. Front Cardiovasc Med 2023; 10:1119699. [PMID: 37077747 PMCID: PMC10106627 DOI: 10.3389/fcvm.2023.1119699] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/09/2022] [Accepted: 03/21/2023] [Indexed: 04/05/2023] Open
Abstract
ObjectiveRisk stratification of patients with congestive heart failure (HF) is vital in clinical practice. The aim of this study was to construct a machine learning model to predict the in-hospital all-cause mortality for intensive care unit (ICU) patients with HF.MethodseXtreme Gradient Boosting algorithm (XGBoost) was used to construct a new prediction model (XGBoost model) from the Medical Information Mart for Intensive Care IV database (MIMIC-IV) (training set). The eICU Collaborative Research Database dataset (eICU-CRD) was used for the external validation (test set). The XGBoost model performance was compared with a logistic regression model and an existing model (Get with the guideline-Heart Failure model) for mortality in the test set. Area under the receiver operating characteristic cure and Brier score were employed to evaluate the discrimination and the calibration of the three models. The SHapley Additive exPlanations (SHAP) value was applied to explain XGBoost model and calculate the importance of its features.ResultsThe total of 11,156 and 9,837 patients with congestive HF from the training set and test set, respectively, were included in the study. In-hospital all-cause mortality occurred in 13.3% (1,484/11,156) and 13.4% (1,319/9,837) of patients, respectively. In the training set, of 17 features with the highest predictive value were selected into the models with LASSO regression. Acute Physiology Score III (APS III), age and Sequential Organ Failure Assessment (SOFA) were strongest predictors in SHAP. In the external validation, the XGBoost model performance was superior to that of conventional risk predictive methods, with an area under the curve of 0.771 (95% confidence interval, 0.757–0.784) and a Brier score of 0.100. In the evaluation of clinical effectiveness, the machine learning model brought a positive net benefit in the threshold probability of 0%–90%, prompting evident competitiveness compare to the other two models. This model has been translated into an online calculator which is accessible freely to the public (https://nkuwangkai-app-for-mortality-prediction-app-a8mhkf.streamlit.app).ConclusionThis study developed a valuable machine learning risk stratification tool to accurately assess and stratify the risk of in-hospital all-cause mortality in ICU patients with congestive HF. This model was translated into a web-based calculator which access freely.
Collapse
Affiliation(s)
- Zijun Chen
- Department of Cardiology, The Yongchuan Hospital of Chongqing Medical University, Chongqing, China
- Department of Cardiology, The Second Affiliated Hospital of Chongqing Medical University, Chongqing, China
| | - Tingming Li
- Department of Cardiology, The Yongchuan Hospital of Chongqing Medical University, Chongqing, China
| | - Sheng Guo
- Department of Cardiology, The People’s Hospital of Rongchang District, Chongqing, China
| | - Deli Zeng
- Department of Cardiology, The Yongchuan Hospital of Chongqing Medical University, Chongqing, China
| | - Kai Wang
- Department of Cardiology, The Yongchuan Hospital of Chongqing Medical University, Chongqing, China
- Correspondence: Kai Wang
| |
Collapse
|
6
|
Zhao X, Nie X. Status Forecasting Based on the Baseline Information Using Logistic Regression. ENTROPY (BASEL, SWITZERLAND) 2022; 24:1481. [PMID: 37420501 DOI: 10.3390/e24101481] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/29/2022] [Revised: 09/30/2022] [Accepted: 10/10/2022] [Indexed: 07/09/2023]
Abstract
In the status forecasting problem, classification models such as logistic regression with input variables such as physiological, diagnostic, and treatment variables are typical ways of modeling. However, the parameter value and model performance differ among individuals with different baseline information. To cope with these difficulties, a subgroup analysis is conducted, in which models' ANOVA and rpart are proposed to explore the influence of baseline information on the parameters and model performance. The results show that the logistic regression model achieves satisfactory performance, which is generally higher than 0.95 in AUC and around 0.9 in F1 and balanced accuracy. The subgroup analysis presents the prior parameter values for monitoring variables including SpO2, milrinone, non-opioid analgesics and dobutamine. The proposed method can be used to explore variables that are and are not medically related to the baseline variables.
Collapse
Affiliation(s)
- Xin Zhao
- School of Mathematics, Southeast University, Nanjing 210096, China
| | - Xiaokai Nie
- School of Automation, Southeast University, Nanjing 210096, China
- Key Laboratory of Measurement and Control of Complex Systems of Engineering, Ministry of Education, Southeast University, Nanjing 210096, China
- Shenzhen Research Institute, Southeast University, Shenzhen 518057, China
| |
Collapse
|
7
|
Dynamic Prediction of Mechanical Thrombectomy Outcome for Acute Ischemic Stroke Patients Using Machine Learning. Brain Sci 2022; 12:brainsci12070938. [PMID: 35884744 PMCID: PMC9313360 DOI: 10.3390/brainsci12070938] [Citation(s) in RCA: 8] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/16/2022] [Revised: 07/13/2022] [Accepted: 07/15/2022] [Indexed: 02/06/2023] Open
Abstract
The unfavorable outcome of acute ischemic stroke (AIS) with large vessel occlusion (LVO) is related to clinical factors at multiple time points. However, predictive models used for dynamically predicting unfavorable outcomes using clinically relevant preoperative and postoperative time point variables have not been developed. Our goal was to develop a machine learning (ML) model for the dynamic prediction of unfavorable outcomes. We retrospectively reviewed patients with AIS who underwent a consecutive mechanical thrombectomy (MT) from three centers in China between January 2014 and December 2018. Based on the eXtreme gradient boosting (XGBoost) algorithm, we used clinical characteristics on admission (“Admission” Model) and additional variables regarding intraoperative management and the postoperative National Institute of Health stroke scale (NIHSS) score (“24-Hour” Model, “3-Day” Model and “Discharge” Model). The outcome was an unfavorable outcome at the three-month mark (modified Rankin scale, mRS 3–6: unfavorable). The area under the receiver operating characteristic curve and Brier scores were the main evaluating indexes. The unfavorable outcome at the three-month mark was observed in 156 (62.0%) of 238 patients. These four models had a high accuracy in the range of 75.0% to 87.5% and had a good discrimination with AUC in the range of 0.824 to 0.945 on the testing set. The Brier scores of the four models ranged from 0.122 to 0.083 and showed a good predictive ability on the testing set. This is the first dynamic, preoperative and postoperative predictive model constructed for AIS patients who underwent MT, which is more accurate than the previous prediction model. The preoperative model could be used to predict the clinical outcome before MT and support the decision to perform MT, and the postoperative models would further improve the predictive accuracy of the clinical outcome after MT and timely adjust therapeutic strategies.
Collapse
|
8
|
Applying logistic LASSO regression for the diagnosis of atypical Crohn's disease. Sci Rep 2022; 12:11340. [PMID: 35790774 PMCID: PMC9256608 DOI: 10.1038/s41598-022-15609-5] [Citation(s) in RCA: 8] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/17/2022] [Accepted: 06/27/2022] [Indexed: 11/20/2022] Open
Abstract
In countries with a high incidence of tuberculosis, the typical clinical features of Crohn's disease (CD) may be covered up after tuberculosis infection, and the identification of atypical Crohn's disease and intestinal tuberculosis (ITB) is still a dilemma for clinicians. Least absolute shrinkage and selection operator (LASSO) regression has been applied to select variables in disease diagnosis. However, its value in discriminating ITB and atypical Crohn's disease remains unknown. A total of 400 patients were enrolled from January 2014 to January 2019 in second Xiangya hospital Central South University.Among them, 57 indicators including clinical manifestations, laboratory results, endoscopic findings, computed tomography enterography features were collected for further analysis. R software version 3.6.1 (glmnet package) was used to perform the LASSO logistic regression analysis. SPSS 20.0 was used to perform Pearson chi-square test and binary logistic regression analysis. In the variable selection step, LASSO regression and Pearson chi-square test were applied to select the most valuable variables as candidates for further logistic regression analysis. Secondly, variables identified from step 1 were applied to construct binary logistic regression analysis. Receiver operating characteristic (ROC) curve analysis was performed on these models to assess the ability and the optimal cutoff value for diagnosis. The area under the ROC curve (AUC), sensitivity, specificity, positive predictive value (PPV), negative predictive value (NPV), accuracy rate, together with their 95% confidence and intervals (CIs) were calculated. MedCalc software (Version 16.8) was applied to analyze the ROC curves of models. 332 patients were eventually enrolled to build a binary logistic regression model to discriminate CD (including comprehensive CD and tuberculosis infected CD) and ITB. However, we did not get a satisfactory diagnostic value via applying the binary logistic regression model of comprehensive CD and ITB to predict tuberculosis infected CD and ITB (accuracy rate:79.2%VS 65.1%). Therefore, we further established a binary logistic regression model to discriminate atypical CD from ITB, based on Pearsonchi-square test (model1) and LASSO regression (model 2). Model 1 showed 89.9% specificity, 65.9% sensitivity, 88.5% PPV, 68.9% NPV, 76.9% diagnostic accuracy, and an AUC value of 0.811, and model 2 showed 80.6% specificity, 84.4% sensitivity, 82.3% PPV, 82.9% NPV, 82.6% diagnostic accuracy, and an AUC value of 0.887. The comparison of AUCs between model1 and model2 was statistically different (P < 0.05). Tuberculosis infection increases the difficulty of discriminating CD from ITB. LASSO regression showed a more efficient ability than Pearson chi-square test based logistic regression on differential diagnosing atypical CD and ITB.
Collapse
|