Individual outcome prediction models for patients with COVID-19 based on their first day of admission to the intensive care unit

Machine learning-based clinical decision support using laboratory data

Artificial intelligence (AI) and machine learning (ML) are becoming vital in laboratory medicine and the broader context of healthcare. In this review article, we summarized the development of ML models and how they contribute to clinical laboratory workflow and improve patient outcomes. The process of ML model development involves data collection, data cleansing, feature engineering, model development, and optimization. These models, once finalized, are subjected to thorough performance assessments and validations. Recently, due to the complexity inherent in model development, automated ML tools were also introduced to streamline the process, enabling non-experts to create models. Clinical Decision Support Systems (CDSS) use ML techniques on large datasets to aid healthcare professionals in test result interpretation. They are revolutionizing laboratory medicine, enabling labs to work more efficiently with less human supervision across pre-analytical, analytical, and post-analytical phases. Despite contributions of the ML tools at all analytical phases, their integration presents challenges like potential model uncertainties, black-box algorithms, and deskilling of professionals. Additionally, acquiring diverse datasets is hard, and models' complexity can limit clinical use. In conclusion, ML-based CDSS in healthcare can greatly enhance clinical decision-making. However, successful adoption demands collaboration among professionals and stakeholders, utilizing hybrid intelligence, external validation, and performance assessments.

Machine and deep learning methods for clinical outcome prediction based on physiological data of COVID-19 patients: a scoping review

INTRODUCTION

Since the beginning of the COVID-19 pandemic, numerous machine and deep learning (MDL) methods have been proposed in the literature to analyze patient physiological data. The objective of this review is to summarize various aspects of these methods and assess their practical utility for predicting various clinical outcomes.

METHODS

We searched PubMed, Scopus, and Cochrane Library, screened and selected the studies matching the inclusion criteria. The clinical analysis focused on the characteristics of the patient cohorts in the studies included in this review, the specific tasks in the context of the COVID-19 pandemic that machine and deep learning methods were used for, and their practical limitations. The technical analysis focused on the details of specific MDL methods and their performance.

RESULTS

Analysis of the 48 selected studies revealed that the majority (∼54 %) of them examined the application of MDL methods for the prediction of survival/mortality-related patient outcomes, while a smaller fraction (∼13 %) of studies also examined applications to the prediction of patients' physiological outcomes and hospital resource utilization. 21 % of the studies examined the application of MDL methods to multiple clinical tasks. Machine and deep learning methods have been shown to be effective at predicting several outcomes of COVID-19 patients, such as disease severity, complications, intensive care unit (ICU) transfer, and mortality. MDL methods also achieved high accuracy in predicting the required number of ICU beds and ventilators.

CONCLUSION

Machine and deep learning methods have been shown to be valuable tools for predicting disease severity, organ dysfunction and failure, patient outcomes, and hospital resource utilization during the COVID-19 pandemic. The discovered knowledge and our conclusions and recommendations can also be useful to healthcare professionals and artificial intelligence researchers in managing future pandemics.

Prediction of prognosis in COVID-19 patients using machine learning: A systematic review and meta-analysis

BACKGROUND

Accurate prediction of prognostic outcomes in patients with COVID-19 could facilitate clinical decision-making and medical resource allocation. However, little is known about the ability of machine learning (ML) to predict prognosis in COVID-19 patients.

OBJECTIVE

This study aimed to systematically examine the prognostic value of ML in patients with COVID-19.

METHODS

A systematic search was conducted in PubMed, Web of Science, Embase, Cochrane Library, and IEEE Xplore up to December 15, 2021. Studies predicting the prognostic outcomes of COVID-19 patients using ML were eligible for inclusion. Risk of bias was evaluated by a tailored checklist based on Quality Assessment of Diagnostic Accuracy Studies 2 (QUADAS-2). Pooled sensitivity, specificity, and area under the receiver operating curve (AUC) were calculated to evaluate model performance.

RESULTS

A total of 33 studies that described 35 models were eligible for inclusion, with 27 models presenting mortality, four intensive care unit (ICU) admission, and four use of ventilation. For predicting mortality, ML gave a pooled sensitivity of 0.86 (95% CI, 0.79-0.90), a specificity of 0.87 (95% CI, 0.80-0.92), and an AUC of 0.93 (95% CI, 0.90-0.95). For the prediction of ICU admission, ML had a sensitivity of 0.86 (95% CI, 0.78-0.92), a specificity of 0.81 (95% CI, 0.66-0.91), and an AUC of 0.91 (95% CI, 0.88-0.93). For the prediction of ventilation, ML had a sensitivity of 0.81 (95% CI, 0.68-0.90), a specificity of 0.78 (95% CI, 0.66-0.87), and an AUC of 0.87 (95% CI, 0.83-0.89). Meta-regression analyses indicated that algorithm, population, study design, and source of dataset influenced the pooled estimate.

CONCLUSION

This meta-analysis demonstrated the satisfactory performance of ML in predicting prognostic outcomes in patients with COVID-19, suggesting the potential value of ML to support clinical decision-making. However, improvements to methodology and validation are still necessary before its application in routine clinical practice.