1
|
Casas-Rojo JM, Ventura PS, Antón Santos JM, de Latierro AO, Arévalo-Lorido JC, Mauri M, Rubio-Rivas M, González-Vega R, Giner-Galvañ V, Otero Perpiñá B, Fonseca-Aizpuru E, Muiño A, Del Corral-Beamonte E, Gómez-Huelgas R, Arnalich-Fernández F, Llorente Barrio M, Sancha-Lloret A, Rábago Lorite I, Loureiro-Amigo J, Pintos-Martínez S, García-Sardón E, Montaño-Martínez A, Rojano-Rivero MG, Ramos-Rincón JM, López-Escobar A. Improving prediction of COVID-19 mortality using machine learning in the Spanish SEMI-COVID-19 registry. Intern Emerg Med 2023; 18:1711-1722. [PMID: 37349618 DOI: 10.1007/s11739-023-03338-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/16/2023] [Accepted: 06/01/2023] [Indexed: 06/24/2023]
Abstract
COVID-19 is responsible for high mortality, but robust machine learning-based predictors of mortality are lacking. To generate a model for predicting mortality in patients hospitalized with COVID-19 using Gradient Boosting Decision Trees (GBDT). The Spanish SEMI-COVID-19 registry includes 24,514 pseudo-anonymized cases of patients hospitalized with COVID-19 from 1 February 2020 to 5 December 2021. This registry was used as a GBDT machine learning model, employing the CatBoost and BorutaShap classifier to select the most relevant indicators and generate a mortality prediction model by risk level, ranging from 0 to 1. The model was validated by separating patients according to admission date, using the period 1 February to 31 December 2020 (first and second waves, pre-vaccination period) for training, and 1 January to 30 November 2021 (vaccination period) for the test group. An ensemble of ten models with different random seeds was constructed, separating 80% of the patients for training and 20% from the end of the training period for cross-validation. The area under the receiver operating characteristics curve (AUC) was used as a performance metric. Clinical and laboratory data from 23,983 patients were analyzed. CatBoost mortality prediction models achieved an AUC performance of 84.76 (standard deviation 0.45) for patients in the test group (potentially vaccinated patients not included in model training) using 16 features. The performance of the 16-parameter GBDT model for predicting COVID-19 hospital mortality, although requiring a relatively large number of predictors, shows a high predictive capacity.
Collapse
Affiliation(s)
- José-Manuel Casas-Rojo
- Internal Medicine Department, Infanta Cristina University Hospital, Parla, 28981, Madrid, Spain
| | - Paula Sol Ventura
- Department of Pediatric Endocrinology, Hospital HM Nens, HM Hospitales, 08009, Barcelona, Spain
| | | | | | | | - Marc Mauri
- Data Scientist, Kaizen AI, Barcelona, Spain
| | - Manuel Rubio-Rivas
- Internal Medicine Department, Bellvitge University Hospital, Hospitalet de Llobregat, Barcelona, Spain
| | - Rocío González-Vega
- Internal Medicine Department, Hospital Costa del Sol, Marbella, Málaga, Spain
| | - Vicente Giner-Galvañ
- Internal Medicine Department, Hospital Universitario San Juan. San Juan de Alicante, Alicante, Spain
| | | | - Eva Fonseca-Aizpuru
- Internal Medicine Department, Hospital Universitario de Cabueñes, Gijón, Asturias, Spain
| | - Antonio Muiño
- Internal Medicine Department, Hospital Universitario Gregorio Marañón, Madrid, Spain
| | | | - Ricardo Gómez-Huelgas
- Internal Medicine Department, Regional University Hospital of Málaga, Biomedical Research Institute of Málaga (IBIMA), University of Málaga (UMA), Málaga, Spain
| | | | | | | | - Isabel Rábago Lorite
- Internal Medicine Department, Hospital Universitario Infanta Sofía. San Sebastián de los Reyes, Madrid, Spain
| | - José Loureiro-Amigo
- Internal Medicine Department, Hospital Moisès Broggi, Sant Joan Despí, Barcelona, Spain
| | - Santiago Pintos-Martínez
- Internal Medicine Department, Hospital Universitario de Sagunto, Puerto de Sagunto, Valencia, Spain
| | - Eva García-Sardón
- Internal Medicine Department, Hospital Universitario de Cáceres, Cáceres, Spain
| | | | | | | | - Alejandro López-Escobar
- Pediatrics Department, Clinical Research Unit, Hospital Universitario Vithas Madrid La Milagrosa, Fundación Vithas, Madrid, Spain.
| |
Collapse
|
2
|
Chiu CC, Wu CM, Chien TN, Kao LJ, Li C, Jiang HL. Applying an Improved Stacking Ensemble Model to Predict the Mortality of ICU Patients with Heart Failure. J Clin Med 2022; 11:6460. [PMID: 36362686 PMCID: PMC9659015 DOI: 10.3390/jcm11216460] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/17/2022] [Revised: 10/21/2022] [Accepted: 10/26/2022] [Indexed: 08/31/2023] Open
Abstract
Cardiovascular diseases have been identified as one of the top three causes of death worldwide, with onset and deaths mostly due to heart failure (HF). In ICU, where patients with HF are at increased risk of death and consume significant medical resources, early and accurate prediction of the time of death for patients at high risk of death would enable them to receive appropriate and timely medical care. The data for this study were obtained from the MIMIC-III database, where we collected vital signs and tests for 6699 HF patient during the first 24 h of their first ICU admission. In order to predict the mortality of HF patients in ICUs more precisely, an integrated stacking model is proposed and applied in this paper. In the first stage of dataset classification, the datasets were subjected to first-level classifiers using RF, SVC, KNN, LGBM, Bagging, and Adaboost. Then, the fusion of these six classifier decisions was used to construct and optimize the stacked set of second-level classifiers. The results indicate that our model obtained an accuracy of 95.25% and AUROC of 82.55% in predicting the mortality rate of HF patients, which demonstrates the outstanding capability and efficiency of our method. In addition, the results of this study also revealed that platelets, glucose, and blood urea nitrogen were the clinical features that had the greatest impact on model prediction. The results of this analysis not only improve the understanding of patients' conditions by healthcare professionals but allow for a more optimal use of healthcare resources.
Collapse
Affiliation(s)
- Chih-Chou Chiu
- Department of Business Management, National Taipei University of Technology, Taipei 106, Taiwan
| | - Chung-Min Wu
- Department of Business Management, National Taipei University of Technology, Taipei 106, Taiwan
| | - Te-Nien Chien
- College of Management, National Taipei University of Technology, Taipei 106, Taiwan
| | - Ling-Jing Kao
- Department of Business Management, National Taipei University of Technology, Taipei 106, Taiwan
| | - Chengcheng Li
- College of Management, National Taipei University of Technology, Taipei 106, Taiwan
| | - Han-Ling Jiang
- Alliance Manchester Business School, University of Manchester, Manchester M15 6PB, UK
| |
Collapse
|
3
|
Ferrara P, Battiato S, Polosa R. Progress and prospects for artificial intelligence in clinical practice: learning from COVID-19. Intern Emerg Med 2022; 17:1855-1857. [PMID: 36063262 PMCID: PMC9442555 DOI: 10.1007/s11739-022-03080-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/05/2022] [Accepted: 08/11/2022] [Indexed: 12/05/2022]
Affiliation(s)
- Pietro Ferrara
- Center for Public Health Research, University of Milan Bicocca, Monza, Italy
- IRCCS Istituto Auxologico Italiano, Milan, Italy
| | - Sebastiano Battiato
- Department of Mathematics and Computer Science, University of Catania, Catania, Italy
| | - Riccardo Polosa
- Center of Excellence for the Acceleration of Harm Reduction (CoEHAR), University of Catania, Catania, Italy.
- Department of Clinical and Experimental Medicine, University of Catania, Catania, Italy.
- Institute of Internal Medicine, AOU "Policlinico-V. Emanuele", Via S. Sofia, 78, Catania, Italy.
| |
Collapse
|