1
|
Tao Y, Ding X, Guo WL. Using machine-learning models to predict extubation failure in neonates with bronchopulmonary dysplasia. BMC Pulm Med 2024; 24:308. [PMID: 38956528 PMCID: PMC11218173 DOI: 10.1186/s12890-024-03133-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/12/2023] [Accepted: 06/26/2024] [Indexed: 07/04/2024] Open
Abstract
AIM To develop a decision-support tool for predicting extubation failure (EF) in neonates with bronchopulmonary dysplasia (BPD) using a set of machine-learning algorithms. METHODS A dataset of 284 BPD neonates on mechanical ventilation was used to develop predictive models via machine-learning algorithms, including extreme gradient boosting (XGBoost), random forest, support vector machine, naïve Bayes, logistic regression, and k-nearest neighbor. The top three models were assessed by the area under the receiver operating characteristic curve (AUC), and their performance was tested by decision curve analysis (DCA). Confusion matrix was used to show the high performance of the best model. The importance matrix plot and SHapley Additive exPlanations values were calculated to evaluate the feature importance and visualize the results. The nomogram and clinical impact curves were used to validate the final model. RESULTS According to the AUC values and DCA results, the XGboost model performed best (AUC = 0.873, sensitivity = 0.896, specificity = 0.838). The nomogram and clinical impact curve verified that the XGBoost model possessed a significant predictive value. The following were predictive factors for EF: pO2, hemoglobin, mechanical ventilation (MV) rate, pH, Apgar score at 5 min, FiO2, C-reactive protein, Apgar score at 1 min, red blood cell count, PIP, gestational age, highest FiO2 at the first 24 h, heart rate, birth weight, pCO2. Further, pO2, hemoglobin, and MV rate were the three most important factors for predicting EF. CONCLUSIONS The present study indicated that the XGBoost model was significant in predicting EF in BPD neonates with mechanical ventilation, which is helpful in determining the right extubation time among neonates with BPD to reduce the occurrence of complications.
Collapse
Affiliation(s)
- Yue Tao
- Department of radiology, Children's Hospital of Soochow University, 92 Zhongnan District, Suzhou, Jiangsu, 215025, China
| | - Xin Ding
- Department of neonatology, Children's Hospital of Soochow University, 92 Zhongnan District, Suzhou, Jiangsu, 215025, China
| | - Wan-Liang Guo
- Department of radiology, Children's Hospital of Soochow University, 92 Zhongnan District, Suzhou, Jiangsu, 215025, China.
| |
Collapse
|
2
|
Al-Ali AH, Alraeyes KA, Julkarnain PR, Lakshmanan AP, Alobaid A, Aljoni AY, Saleem NH, Al Odat MA, Aletreby WT. Independent Risk Factors of Failed Extubation among Adult Critically Ill Patients: A Prospective Observational Study from Saudi Arabia. SAUDI JOURNAL OF MEDICINE & MEDICAL SCIENCES 2024; 12:216-222. [PMID: 39055080 PMCID: PMC11268545 DOI: 10.4103/sjmms.sjmms_19_24] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 01/08/2024] [Revised: 03/12/2024] [Accepted: 03/28/2024] [Indexed: 07/27/2024]
Abstract
Background Mechanical ventilation provides essential support for critically ill patients in several diagnoses; however, extubation failure can affect patient outcomes. From Saudi Arabia, no study has assessed the factors associated with extubation failure in adults. Methods This prospective observational study was conducted in the intensive care unit of a tertiary care hospital in Riyadh, Saudi Arabia. Adult patients who had been mechanically ventilated via the endotracheal tube for a minimum of 24 hours and then extubated according to the weaning protocol were included. Failed extubation was defined as reintubation within 48 hours of extubation. Results A total of 505 patients were included, of which 72 patients had failed extubation (14.3%, 95% CI: 11.4%-17.7%). Compared with the failed extubation group, the successfully extubated group had significantly shorter duration of mechanical ventilation (mean difference: -2.6 days, 95% CI: -4.3 to -1; P = 0.001), a slower respiratory rate at the time of extubation (mean difference: -2.3 breath/min, 95% CI: -3.8 to -1; P = 0.0005), higher pH (mean difference: 0.02, 95% CI: 0.001-0.04; P = 0.03), and more patients with strong cough (percent difference: 17.7%, 95% CI: 4.8%-30.5%; P = 0.02). Independent risk factors of failed extubation were age (aOR = 1.02; 95% CI: 1.002-1.03; P = 0.03), respiratory rate (aOR = 1.06, 95% CI: 1.01-1.1; P = 0.008), duration of mechanical ventilation (aOR = 1.08, 95% CI: 1.03 - 1.1; P < 0.001), and pH (aOR = 0.02, 95% CI: 0.0006-0.5; P = 0.02). Conclusion Older age, longer duration of mechanical ventilation, faster respiratory rate, and lower pH were found to be independent risk factors that significantly increased the odds of extubation failure among adults.
Collapse
Affiliation(s)
- Aqeel Hamad Al-Ali
- Respiratory Care Administration, King Saud Medical City, Riyadh, Saudi Arabia
| | | | | | | | - Alzahra Alobaid
- Respiratory Care Administration, King Saud Medical City, Riyadh, Saudi Arabia
| | - Ahmed Yahya Aljoni
- Respiratory Care Administration, King Saud Medical City, Riyadh, Saudi Arabia
| | - Nada Hadi Saleem
- Respiratory Care Administration, King Saud Medical City, Riyadh, Saudi Arabia
| | | | | |
Collapse
|
3
|
Huang KY, Hsu YL, Chen HC, Horng MH, Chung CL, Lin CH, Xu JL, Hou MH. Developing a machine-learning model for real-time prediction of successful extubation in mechanically ventilated patients using time-series ventilator-derived parameters. Front Med (Lausanne) 2023; 10:1167445. [PMID: 37228399 PMCID: PMC10203709 DOI: 10.3389/fmed.2023.1167445] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/16/2023] [Accepted: 04/17/2023] [Indexed: 05/27/2023] Open
Abstract
Background Successful weaning from mechanical ventilation is important for patients admitted to intensive care units. However, models for predicting real-time weaning outcomes remain inadequate. Therefore, this study aimed to develop a machine-learning model for predicting successful extubation only using time-series ventilator-derived parameters with good accuracy. Methods Patients with mechanical ventilation admitted to the Yuanlin Christian Hospital in Taiwan between August 2015 and November 2020 were retrospectively included. A dataset with ventilator-derived parameters was obtained before extubation. Recursive feature elimination was applied to select the most important features. Machine-learning models of logistic regression, random forest (RF), and support vector machine were adopted to predict extubation outcomes. In addition, the synthetic minority oversampling technique (SMOTE) was employed to address the data imbalance problem. The area under the receiver operating characteristic (AUC), F1 score, and accuracy, along with the 10-fold cross-validation, were used to evaluate prediction performance. Results In this study, 233 patients were included, of whom 28 (12.0%) failed extubation. The six ventilatory variables per 180 s dataset had optimal feature importance. RF exhibited better performance than the others, with an AUC value of 0.976 (95% confidence interval [CI], 0.975-0.976), accuracy of 94.0% (95% CI, 93.8-94.3%), and an F1 score of 95.8% (95% CI, 95.7-96.0%). The difference in performance between the RF and the original and SMOTE datasets was small. Conclusion The RF model demonstrated a good performance in predicting successful extubation in mechanically ventilated patients. This algorithm made a precise real-time extubation outcome prediction for patients at different time points.
Collapse
Affiliation(s)
- Kuo-Yang Huang
- Division of Chest Medicine, Department of Internal Medicine, Changhua Christian Hospital, Changhua, Taiwan
- Artificial Intelligence Development Center, Changhua Christian Hospital, Changhua, Taiwan
- Institute of Genomics and Bioinformatics, National Chung Hsing University, Taichung, Taiwan
- Ph.D. Program in Medical Biotechnology, National Chung Hsing University, Taichung, Taiwan
| | - Ying-Lin Hsu
- Department of Applied Mathematics, Institute of Statistics, National Chung Hsing University, Taichung, Taiwan
| | - Huang-Chi Chen
- Division of Chest Medicine, Department of Internal Medicine, Yuanlin Christian Hospital, Changhua, Taiwan
| | - Ming-Hwarng Horng
- Division of Chest Medicine, Department of Internal Medicine, Yuanlin Christian Hospital, Changhua, Taiwan
| | - Che-Liang Chung
- Division of Chest Medicine, Department of Internal Medicine, Yuanlin Christian Hospital, Changhua, Taiwan
| | - Ching-Hsiung Lin
- Division of Chest Medicine, Department of Internal Medicine, Changhua Christian Hospital, Changhua, Taiwan
- Institute of Genomics and Bioinformatics, National Chung Hsing University, Taichung, Taiwan
- Department of Recreation and Holistic Wellness, MingDao University, Changhua, Taiwan
| | - Jia-Lang Xu
- Artificial Intelligence Development Center, Changhua Christian Hospital, Changhua, Taiwan
| | - Ming-Hon Hou
- Division of Chest Medicine, Department of Internal Medicine, Changhua Christian Hospital, Changhua, Taiwan
- Institute of Genomics and Bioinformatics, National Chung Hsing University, Taichung, Taiwan
- Ph.D. Program in Medical Biotechnology, National Chung Hsing University, Taichung, Taiwan
- Graduate Institute of Biotechnology, National Chung Hsing University, Taichung, Taiwan
- Department of Life Sciences, National Chung Hsing University, Taichung, Taiwan
| |
Collapse
|
4
|
Yan Y, Luo J, Wang Y, Chen X, Du Z, Xie Y, Li X. Development and validation of a mechanical power-oriented prediction model of weaning failure in mechanically ventilated patients: a retrospective cohort study. BMJ Open 2022; 12:e066894. [PMID: 36521885 PMCID: PMC9756150 DOI: 10.1136/bmjopen-2022-066894] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/23/2022] Open
Abstract
OBJECTIVE To develop and validate a mechanical power (MP)-oriented prediction model of weaning failure in mechanically ventilated patients. DESIGN A retrospective cohort study. SETTING Data were collected from the large US Medical Information Mart for Intensive Care-IV (MIMIC-IV) V.1.0, which integrates comprehensive clinical data from 76 540 intensive care unit (ICU) admissions from 2008 to 2019. PARTICIPANTS A total of 3695 patients with invasive mechanical ventilation for more than 24 hours and weaned with T-tube ventilation strategies were enrolled from the MIMIC-IV database. PRIMARY AND SECONDARY OUTCOME Weaning failure. RESULTS All eligible patients were randomised into development cohorts (n=2586, 70%) and validation cohorts (n=1109, 30%). Multivariate logistic regression analysis of the development cohort showed that positive end-expiratory pressure, dynamic lung compliance, MP, inspired oxygen concentration, length of ICU stay and invasive mechanical ventilation duration were independent predictors of weaning failure. Calibration curves showed good correlation between predicted and observed outcomes. The prediction model showed accurate discrimination in the development and validation cohorts, with area under the receiver operating characteristic curve values of 0.828 (95% CI: 0.812 to 0.844) and 0.833 (95% CI: 0.809 to 0.857), respectively. Decision curve analysis indicated that the predictive model was clinically beneficial. CONCLUSION The MP-oriented model of weaning failure accurately predicts the risk of weaning failure in mechanical ventilation patients and provides valuable information for clinicians making decisions on weaning.
Collapse
Affiliation(s)
- Yao Yan
- Department of Emergency Medicine, Lianyungang Clinical College of Nanjing Medical University, Lianyungang, Jiangsu, China
- Department of Critical Care Medicine, The Second People's Hospital of Lianyungang, Lianyungang, Jiangsu, China
| | - Jiye Luo
- Department of Emergency Medicine, The First People's Hospital of Lianyungang, Lianyungang, Jiangsu, China
| | - Yanli Wang
- Department of Emergency Medicine, The First People's Hospital of Lianyungang, Lianyungang, Jiangsu, China
| | - Xiaobing Chen
- Department of Emergency Medicine, The First People's Hospital of Lianyungang, Lianyungang, Jiangsu, China
| | - Zhiqiang Du
- Department of Critical Care Medicine, The Second People's Hospital of Lianyungang, Lianyungang, Jiangsu, China
| | - Yongpeng Xie
- Department of Emergency Medicine, The First People's Hospital of Lianyungang, Lianyungang, Jiangsu, China
| | - Xiaomin Li
- Department of Emergency Medicine, Lianyungang Clinical College of Nanjing Medical University, Lianyungang, Jiangsu, China
- Department of Emergency Medicine, The First People's Hospital of Lianyungang, Lianyungang, Jiangsu, China
| |
Collapse
|
5
|
Impairment in Preextubation Alveolar Gas Exchange Is Associated With Postextubation Respiratory Support Needs in Infants After Cardiac Surgery. Crit Care Explor 2022; 4:e0681. [PMID: 35510153 PMCID: PMC9061152 DOI: 10.1097/cce.0000000000000681] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/25/2022] Open
Abstract
OBJECTIVES: DESIGN: SETTING: PATIENTS: INTERVENTIONS: MEASUREMENTS AND MAIN RESULTS: CONCLUSIONS:
Collapse
|
6
|
Theologou S, Ischaki E, Zakynthinos SG, Charitos C, Michopanou N, Patsatzis S, Mentzelopoulos SD. High Flow Oxygen Therapy at Two Initial Flow Settings versus Conventional Oxygen Therapy in Cardiac Surgery Patients with Postextubation Hypoxemia: A Single-Center, Unblinded, Randomized, Controlled Trial. J Clin Med 2021; 10:jcm10102079. [PMID: 34066244 PMCID: PMC8151420 DOI: 10.3390/jcm10102079] [Citation(s) in RCA: 14] [Impact Index Per Article: 4.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/15/2021] [Revised: 05/09/2021] [Accepted: 05/10/2021] [Indexed: 01/10/2023] Open
Abstract
In cardiac surgery patients with pre-extubation PaO2/inspired oxygen fraction (FiO2) < 200 mmHg, the possible benefits and optimal level of high-flow nasal cannula (HFNC) support are still unclear; therefore, we compared HFNC support with an initial gas flow of 60 or 40 L/min and conventional oxygen therapy. Ninety nine patients were randomly allocated (respective ratio: 1:1:1) to I = intervention group 1 (HFNC initial flow = 60 L/min, FiO2 = 0.6), intervention group 2 (HFNC initial flow = 40 L/min, FiO2 = 0.6), or control group (Venturi mask, FiO2 = 0.6). The primary outcome was occurrence of treatment failure. The baseline characteristics were similar. The hazard for treatment failure was lower in intervention group 1 vs. control (hazard ratio (HR): 0.11, 95% CI: 0.03–0.34) and intervention group 2 vs. control (HR: 0.30, 95% CI: 0.12–0.77). During follow-up, the probability of peripheral oxygen saturation (SpO2) > 92% and respiratory rate within 12–20 breaths/min was 2.4–3.9 times higher in intervention group 1 vs. the other 2 groups. There was no difference in PaO2/FiO2, patient comfort, intensive care unit or hospital stay, or clinical course complications or adverse events. In hypoxemic cardiac surgery patients, postextubation HFNC with an initial gas flow of 60 or 40 L/min resulted in less frequent treatment failure vs. conventional therapy. The results in terms of SpO2/respiratory rate targets favored an initial HFNC flow of 60 L/min.
Collapse
Affiliation(s)
- Stavros Theologou
- Department of Cardiac Surgery, Evaggelismos General Hospital, 10675 Athens, Greece; (S.T.); (C.C.); (N.M.); (S.P.)
| | - Eleni Ischaki
- First Department of Intensive Care Medicine, National and Kapodistrian University of Athens Medical School, Evaggelismos General Hospital, 10675 Athens, Greece; (E.I.); (S.G.Z.)
| | - Spyros G. Zakynthinos
- First Department of Intensive Care Medicine, National and Kapodistrian University of Athens Medical School, Evaggelismos General Hospital, 10675 Athens, Greece; (E.I.); (S.G.Z.)
| | - Christos Charitos
- Department of Cardiac Surgery, Evaggelismos General Hospital, 10675 Athens, Greece; (S.T.); (C.C.); (N.M.); (S.P.)
| | - Nektaria Michopanou
- Department of Cardiac Surgery, Evaggelismos General Hospital, 10675 Athens, Greece; (S.T.); (C.C.); (N.M.); (S.P.)
| | - Stratos Patsatzis
- Department of Cardiac Surgery, Evaggelismos General Hospital, 10675 Athens, Greece; (S.T.); (C.C.); (N.M.); (S.P.)
| | - Spyros D. Mentzelopoulos
- First Department of Intensive Care Medicine, National and Kapodistrian University of Athens Medical School, Evaggelismos General Hospital, 10675 Athens, Greece; (E.I.); (S.G.Z.)
- Correspondence: or ; Tel.: +30-697-530-4909
| |
Collapse
|
7
|
Zhao QY, Wang H, Luo JC, Luo MH, Liu LP, Yu SJ, Liu K, Zhang YJ, Sun P, Tu GW, Luo Z. Development and Validation of a Machine-Learning Model for Prediction of Extubation Failure in Intensive Care Units. Front Med (Lausanne) 2021; 8:676343. [PMID: 34079812 PMCID: PMC8165178 DOI: 10.3389/fmed.2021.676343] [Citation(s) in RCA: 34] [Impact Index Per Article: 11.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/05/2021] [Accepted: 04/19/2021] [Indexed: 02/05/2023] Open
Abstract
Background: Extubation failure (EF) can lead to an increased chance of ventilator-associated pneumonia, longer hospital stays, and a higher mortality rate. This study aimed to develop and validate an accurate machine-learning model to predict EF in intensive care units (ICUs). Methods: Patients who underwent extubation in the Medical Information Mart for Intensive Care (MIMIC)-IV database were included. EF was defined as the need for ventilatory support (non-invasive ventilation or reintubation) or death within 48 h following extubation. A machine-learning model called Categorical Boosting (CatBoost) was developed based on 89 clinical and laboratory variables. SHapley Additive exPlanations (SHAP) values were calculated to evaluate feature importance and the recursive feature elimination (RFE) algorithm was used to select key features. Hyperparameter optimization was conducted using an automated machine-learning toolkit (Neural Network Intelligence). The final model was trained based on key features and compared with 10 other models. The model was then prospectively validated in patients enrolled in the Cardiac Surgical ICU of Zhongshan Hospital, Fudan University. In addition, a web-based tool was developed to help clinicians use our model. Results: Of 16,189 patients included in the MIMIC-IV cohort, 2,756 (17.0%) had EF. Nineteen key features were selected using the RFE algorithm, including age, body mass index, stroke, heart rate, respiratory rate, mean arterial pressure, peripheral oxygen saturation, temperature, pH, central venous pressure, tidal volume, positive end-expiratory pressure, mean airway pressure, pressure support ventilation (PSV) level, mechanical ventilation (MV) durations, spontaneous breathing trial success times, urine output, crystalloid amount, and antibiotic types. After hyperparameter optimization, our model had the greatest area under the receiver operating characteristic (AUROC: 0.835) in internal validation. Significant differences in mortality, reintubation rates, and NIV rates were shown between patients with a high predicted risk and those with a low predicted risk. In the prospective validation, the superiority of our model was also observed (AUROC: 0.803). According to the SHAP values, MV duration and PSV level were the most important features for prediction. Conclusions: In conclusion, this study developed and prospectively validated a CatBoost model, which better predicted EF in ICUs than other models.
Collapse
Affiliation(s)
- Qin-Yu Zhao
- College of Engineering and Computer Science, Australian National University, Canberra, ACT, Australia
| | - Huan Wang
- Department of Critical Care Medicine, Zhongshan Hospital, Fudan University, Shanghai, China
| | - Jing-Chao Luo
- Department of Critical Care Medicine, Zhongshan Hospital, Fudan University, Shanghai, China
| | - Ming-Hao Luo
- Shanghai Medical College, Fudan University, Shanghai, China
| | - Le-Ping Liu
- Department of Blood Transfusion, The Third Xiangya Hospital of Central South University, Changsha, China
| | - Shen-Ji Yu
- Department of Critical Care Medicine, Zhongshan Hospital, Fudan University, Shanghai, China
| | - Kai Liu
- Department of Critical Care Medicine, Zhongshan Hospital, Fudan University, Shanghai, China
| | - Yi-Jie Zhang
- Department of Critical Care Medicine, Zhongshan Hospital, Fudan University, Shanghai, China
| | - Peng Sun
- Artificial Intelligence Institute, Shanghai Jiao Tong University, Shanghai, China
| | - Guo-Wei Tu
- Department of Critical Care Medicine, Zhongshan Hospital, Fudan University, Shanghai, China
- *Correspondence: Guo-Wei Tu
| | - Zhe Luo
- Department of Critical Care Medicine, Zhongshan Hospital, Fudan University, Shanghai, China
- Department of Critical Care Medicine, Xiamen Branch, Zhongshan Hospital, Fudan University, Xiamen, China
- Zhe Luo
| |
Collapse
|