1
|
Yin AA, Zhang X, He YL, Zhao JJ, Zhang X, Fei Z, Lin W, Song BQ. Machine learning prediction models for in-hospital postoperative functional outcome after moderate-to-severe traumatic brain injury. Eur J Trauma Emerg Surg 2024:10.1007/s00068-023-02434-2. [PMID: 38355915 DOI: 10.1007/s00068-023-02434-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/19/2023] [Accepted: 12/28/2023] [Indexed: 02/16/2024]
Abstract
AIM This study aims to utilize machine learning (ML) and logistic regression (LR) models to predict surgical outcomes among patients with traumatic brain injury (TBI) based on admission examination, assisting in making optimal surgical treatment decision for these patients. METHOD We conducted a retrospective review of patients hospitalized in our department for moderate-to-severe TBI. Patients admitted between October 2011 and October 2022 were assigned to the training set, while patients admitted between November 2022 and May 2023 were designated as the external validation set. Five ML algorithms and LR model were employed to predict the postoperative Glasgow Outcome Scale (GOS) status at discharge using clinical and routine blood data collected upon admission. The Shapley (SHAP) plot was utilized for interpreting the models. RESULTS A total of 416 patients were included in this study, and they were divided into the training set (n = 396) and the external validation set (n = 47). The ML models, using both clinical and routine blood data, were able to predict postoperative GOS outcomes with area under the curve (AUC) values ranging from 0.860 to 0.900 during the internal cross-validation and from 0.801 to 0.890 during the external validation. In contrast, the LR model had the lowest AUC values during the internal and external validation (0.844 and 0.567, respectively). When blood data was not available, the ML models achieved AUCs of 0.849 to 0.870 during the internal cross-validation and 0.714 to 0.861 during the external validation. Similarly, the LR model had the lowest AUC values (0.821 and 0.638, respectively). Through repeated cross-validation analysis, we found that routine blood data had a significant association with higher mean AUC values in all ML and LR models. The SHAP plot was used to visualize the contributions of all predictors and highlighted the significance of blood data in the lightGBM model. CONCLUSION The study concluded that ML models could provide rapid and accurate predictions for postoperative GOS outcomes at discharge following moderate-to-severe TBI. The study also highlighted the crucial role of routine blood tests in improving such predictions, and may contribute to the optimization of surgical treatment decision-making for patients with TBI.
Collapse
Affiliation(s)
- An-An Yin
- Department of Plastic and Reconstructive Surgery, Craniomaxillofacial Surgery Group, Xijing Hospital, Fourth Military Medical University, Changle West Road, No. 169, Xi'an, 710032, China
| | - Xi Zhang
- Department of Plastic and Reconstructive Surgery, Craniomaxillofacial Surgery Group, Xijing Hospital, Fourth Military Medical University, Changle West Road, No. 169, Xi'an, 710032, China
| | - Ya-Long He
- Department of Neurosurgery, Xijing Institute of Clinical Neuroscience, Xijing Hospital, Fourth Military Medical University, Changle West Road, No. 169, Xi'an, 710032, China
| | - Jun-Jie Zhao
- Department of Neurosurgery, Xijing Institute of Clinical Neuroscience, Xijing Hospital, Fourth Military Medical University, Changle West Road, No. 169, Xi'an, 710032, China
| | - Xiang Zhang
- Department of Neurosurgery, Xijing Institute of Clinical Neuroscience, Xijing Hospital, Fourth Military Medical University, Changle West Road, No. 169, Xi'an, 710032, China
| | - Zhou Fei
- Department of Neurosurgery, Xijing Institute of Clinical Neuroscience, Xijing Hospital, Fourth Military Medical University, Changle West Road, No. 169, Xi'an, 710032, China.
| | - Wei Lin
- Department of Neurosurgery, Xijing Institute of Clinical Neuroscience, Xijing Hospital, Fourth Military Medical University, Changle West Road, No. 169, Xi'an, 710032, China.
| | - Bao-Qiang Song
- Department of Plastic and Reconstructive Surgery, Craniomaxillofacial Surgery Group, Xijing Hospital, Fourth Military Medical University, Changle West Road, No. 169, Xi'an, 710032, China.
| |
Collapse
|
2
|
Yin AA, He YL, Zhang X, Fei Z, Lin W, Song BQ. Machine learning models for predicting in-hospital outcomes after non-surgical treatment among patients with moderate-to-severe traumatic brain injury. J Clin Neurosci 2024; 120:36-41. [PMID: 38181552 DOI: 10.1016/j.jocn.2023.11.015] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/17/2023] [Accepted: 11/07/2023] [Indexed: 01/07/2024]
Abstract
AIM This study aims to develop prediction models for in-hospital outcomes after non-surgical treatment among patients with moderate-to-severe traumatic brain injury (TBI). METHOD We conducted a retrospective review of patients hospitalized for moderate-to-severe TBI in our department from 2011 to 2020. Five machine learning (ML) algorithms and the conventional logistic regression (LR) model were employed to predict in-hospital mortality and the Glasgow Outcome Scale (GOS) functional outcomes. These models utilized clinical and routine blood data collected upon admission. RESULTS This study included a total of 196 patients who received only non-surgical treatment after moderate-to-severe TBI. When predicting mortality, ML models achieved area under the curve (AUC) values of 0.921 to 0.994 using clinical and routine blood data, and 0.877 to 0.982 using only clinical data. In comparison, LR models yielded AUCs of 0.762 and 0.730 respectively. When predicting the GOS outcome, ML models achieved AUCs of 0.870 to 0.915 using clinical and routine blood data, and 0.858 to 0.927 using only clinical data. In comparison, the LR model yielded AUCs of 0.798 and 0.787 respectively. Repeated internal validation showed that the contributions of routine blood data for prediction models may depend on different prediction algorithms and different outcome measurements. CONCLUSION The study reported ML-based prediction models that provided rapid and accurate predictions on short-term outcomes after non-surgical treatment among patients with moderate-to-severe TBI. The study also highlighted the superiority of ML models over conventional LR models and proposed the complex contributions of routine blood data in such predictions.
Collapse
Affiliation(s)
- An-An Yin
- Department of Plastic and Reconstructive Surgery, Craniomaxillofacial Surgery Group, Xijing Hospital, Fourth Military Medical University, Xi'an, China; Shaanxi Provincial Key Laboratory of Clinic Genetics, Fourth Military Medical University, Xi'an, Shaanxi, China
| | - Ya-Long He
- Department of Neurosurgery, Xijing Institute of Clinical Neuroscience, Xijing Hospital, Fourth Military Medical University, Xi'an, China
| | - Xi Zhang
- Department of Plastic and Reconstructive Surgery, Craniomaxillofacial Surgery Group, Xijing Hospital, Fourth Military Medical University, Xi'an, China
| | - Zhou Fei
- Department of Neurosurgery, Xijing Institute of Clinical Neuroscience, Xijing Hospital, Fourth Military Medical University, Xi'an, China
| | - Wei Lin
- Department of Neurosurgery, Xijing Institute of Clinical Neuroscience, Xijing Hospital, Fourth Military Medical University, Xi'an, China
| | - Bao-Qiang Song
- Department of Plastic and Reconstructive Surgery, Craniomaxillofacial Surgery Group, Xijing Hospital, Fourth Military Medical University, Xi'an, China.
| |
Collapse
|