1
|
Zhao X, Li J, Xie X, Fang Z, Feng Y, Zhong Y, Chen C, Huang K, Ge C, Shi H, Si Y, Zou J. Online interpretable dynamic prediction models for postoperative delirium after cardiac surgery under cardiopulmonary bypass developed based on machine learning algorithms: A retrospective cohort study. J Psychosom Res 2024; 176:111553. [PMID: 37995429 DOI: 10.1016/j.jpsychores.2023.111553] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/09/2023] [Revised: 11/12/2023] [Accepted: 11/12/2023] [Indexed: 11/25/2023]
Abstract
OBJECTIVE Postoperative delirium (POD) is strongly associated with poor early and long-term prognosis in cardiac surgery patients with cardiopulmonary bypass (CPB). This study aimed to develop dynamic prediction models for POD after cardiac surgery under CPB using machine learning (ML) algorithms. METHODS From July 2021 to June 2022, clinical data were collected from patients undergoing cardiac surgery under CPB at Nanjing First Hospital. A dataset from the same center (October 2022 to November 2022) was also used for temporal external validation. We used ML and deep learning to build models in the training set, optimized parameters in the test set, and finally validated the best model in the validation set. The SHapley Additive exPlanations (SHAP) method was introduced to explain the best models. RESULTS Of the 885 patients enrolled, 221 (25.0%) developed POD. 22 (22.0%) of 100 validation cohort patients developed POD. The preoperative and postoperative artificial neural network (ANN) models exhibited optimal performance. The validation results demonstrated satisfactory predictive performance of the ANN model, with area under the receiver operator characteristic curve (AUROC) values of 0.776 and 0.684 for the preoperative and postoperative models, respectively. Based on the ANN algorithm, we constructed dynamic, highly accurate, and interpretable web risk calculators for POD. CONCLUSIONS We successfully developed online interpretable dynamic ANN models as clinical decision aids to identify patients at high risk of POD before and after cardiac surgery to facilitate early intervention or care.
Collapse
Affiliation(s)
- Xiuxiu Zhao
- Department of Anesthesiology, Perioperative and Pain Medicine, Nanjing First Hospital, Nanjing Medical University, Nanjing, China
| | - Junlin Li
- School of Basic Medicine and Clinical Pharmacy, China Pharmaceutical University, Nanjing, China; Department of Clinical Pharmacology, Nanjing First Hospital, Nanjing Medical University, Nanjing, China
| | - Xianhai Xie
- School of Basic Medicine and Clinical Pharmacy, China Pharmaceutical University, Nanjing, China; Department of Clinical Pharmacology, Nanjing First Hospital, Nanjing Medical University, Nanjing, China
| | - Zhaojing Fang
- Department of Anesthesiology, Perioperative and Pain Medicine, Nanjing First Hospital, Nanjing Medical University, Nanjing, China
| | - Yue Feng
- Department of Anesthesiology, Perioperative and Pain Medicine, Nanjing First Hospital, Nanjing Medical University, Nanjing, China
| | - Yi Zhong
- Department of Anesthesiology, Perioperative and Pain Medicine, Nanjing First Hospital, Nanjing Medical University, Nanjing, China
| | - Chen Chen
- Department of Clinical Pharmacology, Nanjing First Hospital, Nanjing Medical University, Nanjing, China; Department of Pharmacy, Nanjing First Hospital, China Pharmaceutical University, Nanjing, China
| | - Kaizong Huang
- Department of Clinical Pharmacology, Nanjing First Hospital, Nanjing Medical University, Nanjing, China; Department of Pharmacy, Nanjing First Hospital, China Pharmaceutical University, Nanjing, China
| | - Chun Ge
- Department of Clinical Pharmacology, Nanjing First Hospital, Nanjing Medical University, Nanjing, China; Department of Pharmacy, Nanjing First Hospital, China Pharmaceutical University, Nanjing, China
| | - Hongwei Shi
- Department of Anesthesiology, Perioperative and Pain Medicine, Nanjing First Hospital, Nanjing Medical University, Nanjing, China
| | - Yanna Si
- Department of Anesthesiology, Perioperative and Pain Medicine, Nanjing First Hospital, Nanjing Medical University, Nanjing, China.
| | - Jianjun Zou
- Department of Clinical Pharmacology, Nanjing First Hospital, Nanjing Medical University, Nanjing, China; Department of Pharmacy, Nanjing First Hospital, China Pharmaceutical University, Nanjing, China.
| |
Collapse
|
2
|
Dang H, Su W, Tang Z, Yue S, Zhang H. Prediction of motor function in patients with traumatic brain injury using genetic algorithms modified back propagation neural network: A data-based study. Front Neurosci 2023; 16:1031712. [PMID: 36741050 PMCID: PMC9892718 DOI: 10.3389/fnins.2022.1031712] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/30/2022] [Accepted: 12/30/2022] [Indexed: 01/20/2023] Open
Abstract
Objective Traumatic brain injury (TBI) is one of the leading causes of death and disability worldwide. In this study, the characteristics of the patients, who were admitted to the China Rehabilitation Research Center, were elucidated in the TBI database, and a prediction model based on the Fugl-Meyer assessment scale (FMA) was established using this database. Methods A retrospective analysis of 463 TBI patients, who were hospitalized from June 2016 to June 2020, was performed. The data of the patients used for this study included the age and gender of the patients, course of TBI, complications, and concurrent dysfunctions, which were assessed using FMA and other measures. The information was collected at the time of admission to the hospital and 1 month after hospitalization. After 1 month, a prediction model, based on the correlation analyses and a 1-layer genetic algorithms modified back propagation (GA-BP) neural network with 175 patients, was established to predict the FMA. The correlations between the predicted and actual values of 58 patients (prediction set) were described. Results Most of the TBI patients, included in this study, had severe conditions (70%). The main causes of the TBI were car accidents (56.59%), while the most common complication and dysfunctions were hydrocephalus (46.44%) and cognitive and motor dysfunction (65.23 and 63.50%), respectively. A total of 233 patients were used in the prediction model, studying the 11 prognostic factors, such as gender, course of the disease, epilepsy, and hydrocephalus. The correlation between the predicted and the actual value of 58 patients was R 2 = 0.95. Conclusion The genetic algorithms modified back propagation neural network can predict motor function in patients with traumatic brain injury, which can be used as a reference for risk and prognosis assessment and guide clinical decision-making.
Collapse
Affiliation(s)
- Hui Dang
- Qilu Hospital, Cheeloo College of Medicine, Shandong University, Jinan, Shandong, China,China Rehabilitation Research Center, Beijing, China,School of Health and Life Sciences, University of Health and Rehabilitation Sciences, Qingdao, Shandong, China
| | - Wenlong Su
- School of Health and Life Sciences, University of Health and Rehabilitation Sciences, Qingdao, Shandong, China,China Rehabilitation Research Center, School of Rehabilitation, Capital Medical University, Beijing, China
| | - Zhiqing Tang
- China Rehabilitation Research Center, School of Rehabilitation, Capital Medical University, Beijing, China
| | - Shouwei Yue
- Qilu Hospital, Cheeloo College of Medicine, Shandong University, Jinan, Shandong, China,*Correspondence: Shouwei Yue,
| | - Hao Zhang
- Qilu Hospital, Cheeloo College of Medicine, Shandong University, Jinan, Shandong, China,School of Health and Life Sciences, University of Health and Rehabilitation Sciences, Qingdao, Shandong, China,China Rehabilitation Research Center, School of Rehabilitation, Capital Medical University, Beijing, China,Hao Zhang,
| |
Collapse
|
3
|
Pan Y, Fang C, Zhu X, Wan J. Construction of a predictive model based on MIV-SVR for prognosis and length of stay in patients with traumatic brain injury: Retrospective cohort study. Digit Health 2023; 9:20552076231217814. [PMID: 38053736 PMCID: PMC10695088 DOI: 10.1177/20552076231217814] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/23/2023] [Accepted: 11/10/2023] [Indexed: 12/07/2023] Open
Abstract
Objective To investigate the mean impact value (MIV) method for discerning the most efficacious input variables for the machine learning (ML) model. Subsequently, various ML algorithms are harnessed to formulate a more accurate predictive model that can forecast both the prognosis and the length of hospital stay for patients suffering from traumatic brain injury (TBI). Design Retrospective cohort study. Participants The study retrospectively accrued data from 1128 cases of patients who sought medical intervention at the Neurosurgery Center of the Second Affiliated Hospital of Anhui Medical University, within the timeframe spanning from May 2017 to May 2022. Methods We performed a retrospective analysis of patient data obtained from the Neurosurgery Center of the Second Hospital of Anhui Medical University, covering the period from May 2017 to May 2022. Following meticulous data filtration and partitioning, 70% of the data were allocated for model training, while the remaining 30% served for model evaluation. During the construction phase of the ML models, a gamut of 11 independent variables-including, but not limited to, in-hospital complications and patient age-were utilized as input variables. Conversely, the length of stay (LOS) and the Glasgow Outcome Scale (GOS) scores were designated as output variables. The model architecture was initially refined through the MIV methodology to identify optimal input variables, whereupon five distinct predictive models were constructed, encompassing support vector regression (SVR), convolutional neural networks (CNN), backpropagation (BP) neural networks, artificial neural networks (ANN) and logistic regression (LR). Ultimately, SVR emerged as the most proficient predictive model and was further authenticated through an external dataset obtained from the First Hospital of Anhui Medical University. Results Upon incorporating the optimal input variables as ascertained through MIV, it was observed that the SVR model exhibited remarkable predictive prowess. Specifically, the Mean Absolute Percentage Error (MAPE) of the SVR model in predicting the GOS score in the test dataset is only 6.30%, and the MAPE in the external validation set is only 7.61%. In terms of predicting hospitalization time, the accuracy of the test and external validation sets were 9.28% and 7.91%, respectively. This error indicator is significantly lower than the error of other prediction models, thus proving the excellent efficacy and clinical reliability of the MIV-optimized SVR model. Conclusion This study unequivocally substantiates that the incorporation of MIV for selecting optimal input variables can substantially augment the predictive accuracy of machine learning models. Among the models examined, the MIV-SVR model emerged as the most accurate and clinically applicable, thereby rendering it highly conducive for future clinical decision-making processes.
Collapse
Affiliation(s)
- Yifeng Pan
- The School of Big Data and Artificial Intelligence, Anhui Xinhua University, Hefei, China
| | - Cheng Fang
- Department of Neurosurgery, National Cancer Center/National Clinical Research Center for Cancer/Cancer Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China
| | - Xueling Zhu
- The School of Big Data and Artificial Intelligence, Anhui Xinhua University, Hefei, China
| | - Jinghai Wan
- Department of Neurosurgery, National Cancer Center/National Clinical Research Center for Cancer/Cancer Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China
| |
Collapse
|
4
|
Eysenbach G, Pan Y, Zhao L, Niu Z, Guo Q, Zhao B. A Machine Learning-Based Approach to Predict Prognosis and Length of Hospital Stay in Adults and Children With Traumatic Brain Injury: Retrospective Cohort Study. J Med Internet Res 2022; 24:e41819. [PMID: 36485032 PMCID: PMC9789495 DOI: 10.2196/41819] [Citation(s) in RCA: 8] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/09/2022] [Revised: 11/04/2022] [Accepted: 11/15/2022] [Indexed: 11/16/2022] Open
Abstract
BACKGROUND The treatment and care of adults and children with traumatic brain injury (TBI) constitute an intractable global health problem. Predicting the prognosis and length of hospital stay of patients with TBI may improve therapeutic effects and significantly reduce societal health care burden. Applying novel machine learning methods to the field of TBI may be valuable for determining the prognosis and cost-effectiveness of clinical treatment. OBJECTIVE We aimed to combine multiple machine learning approaches to build hybrid models for predicting the prognosis and length of hospital stay for adults and children with TBI. METHODS We collected relevant clinical information from patients treated at the Neurosurgery Center of the Second Affiliated Hospital of Anhui Medical University between May 2017 and May 2022, of which 80% was used for training the model and 20% for testing via screening and data splitting. We trained and tested the machine learning models using 5 cross-validations to avoid overfitting. In the machine learning models, 11 types of independent variables were used as input variables and Glasgow Outcome Scale score, used to evaluate patients' prognosis, and patient length of stay were used as output variables. Once the models were trained, we obtained and compared the errors of each machine learning model from 5 rounds of cross-validation to select the best predictive model. The model was then externally tested using clinical data of patients treated at the First Affiliated Hospital of Anhui Medical University from June 2021 to February 2022. RESULTS The final convolutional neural network-support vector machine (CNN-SVM) model predicted Glasgow Outcome Scale score with an accuracy of 93% and 93.69% in the test and external validation sets, respectively, and an area under the curve of 94.68% and 94.32% in the test and external validation sets, respectively. The mean absolute percentage error of the final built convolutional neural network-support vector regression (CNN-SVR) model predicting inpatient time in the test set and external validation set was 10.72% and 10.44%, respectively. The coefficient of determination (R2) was 0.93 and 0.92 in the test set and external validation set, respectively. Compared with back-propagation neural network, CNN, and SVM models built separately, our hybrid model was identified to be optimal and had high confidence. CONCLUSIONS This study demonstrates the clinical utility of 2 hybrid models built by combining multiple machine learning approaches to accurately predict the prognosis and length of stay in hospital for adults and children with TBI. Application of these models may reduce the burden on physicians when assessing TBI and assist clinicians in the medical decision-making process.
Collapse
Affiliation(s)
| | - Yifeng Pan
- The School of Big Data and Artificial Intelligence, Anhui Xinhua University, Hefei, China
| | - Luotong Zhao
- Department of Neurosurgery, The Second Affiliated Hospital of Anhui Medical University, Anhui Medical University, Hefei, China
| | - Zhaoyi Niu
- Department of Neurosurgery, The Second Affiliated Hospital of Anhui Medical University, Anhui Medical University, Hefei, China
| | - Qingguo Guo
- Department of Neurosurgery, The Second Affiliated Hospital of Anhui Medical University, Anhui Medical University, Hefei, China
| | - Bing Zhao
- Department of Neurosurgery, The Second Affiliated Hospital of Anhui Medical University, Anhui Medical University, Hefei, China
| |
Collapse
|