1
|
AlMuhaideb S, bin Shawyah A, Alhamid MF, Alabbad A, Alabbad M, Alsergani H, Alswailem O. Beyond the Bedside: Machine Learning-Guided Length of Stay (LOS) Prediction for Cardiac Patients in Tertiary Care. Healthcare (Basel) 2024; 12:1110. [PMID: 38891185 PMCID: PMC11171809 DOI: 10.3390/healthcare12111110] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/26/2024] [Revised: 05/19/2024] [Accepted: 05/28/2024] [Indexed: 06/21/2024] Open
Abstract
Efficient management of hospital resources is essential for providing high-quality healthcare while ensuring sustainability. Length of stay (LOS), measuring the duration from admission to discharge, directly impacts patient outcomes and resource utilization. Accurate LOS prediction offers numerous benefits, including reducing re-admissions, ensuring appropriate staffing, and facilitating informed discharge planning. While conventional methods rely on statistical models and clinical expertise, recent advances in machine learning (ML) present promising avenues for enhancing LOS prediction. This research focuses on developing an ML-based LOS prediction model trained on a comprehensive real-world dataset and discussing the important factors towards practical deployment of trained ML models in clinical settings. This research involves the development of a comprehensive adult cardiac patient dataset (SaudiCardioStay (SCS)) from the King Faisal Specialist Hospital & Research Centre (KFSH&RC) hospital in Saudi Arabia, comprising 4930 patient encounters for 3611 unique patients collected from 2019 to 2022 (excluding 2020). A diverse range of classical ML models (i.e., Random Forest (RF), Extreme Gradient Boosting (XGBoost), Light Gradient Boosting Machine (LGBM), artificial neural networks (ANNs), Average Voting Regression (AvgVotReg)) are implemented for the SCS dataset to explore the potential of existing ML models in LOS prediction. In addition, this study introduces a novel approach for LOS prediction by incorporating a dedicated LOS classifier within a sophisticated ensemble methodology (i.e., Two-Level Sequential Cascade Generalization (2LSCG), Three-Level Sequential Cascade Generalization (3LSCG), Parallel Cascade Generalization (PCG)), aiming to enhance prediction accuracy and capture nuanced patterns in healthcare data. The experimental results indicate the best mean absolute error (MAE) of 0.1700 for the 3LSCG model. Relatively comparable performance was observed for the AvgVotReg model, with a MAE of 0.1703. In the end, a detailed analysis of the practical implications, limitations, and recommendations concerning the deployment of ML approaches in actual clinical settings is presented.
Collapse
Affiliation(s)
- Sarab AlMuhaideb
- Department of Computer Science, College of Computer and Information Sciences, King Saud University, P.O. Box 266, Riyadh 11362, Saudi Arabia;
| | - Alanoud bin Shawyah
- Department of Computer Science, College of Computer and Information Sciences, King Saud University, P.O. Box 266, Riyadh 11362, Saudi Arabia;
| | - Mohammed F. Alhamid
- Healthcare Information Technology Affairs (HITA), King Faisal Specialist Hospital & Research Center, P.O. Box 3354, Riyadh 11211, Saudi Arabia; (M.F.A.); (A.A.); (M.A.); (O.A.)
| | - Arwa Alabbad
- Healthcare Information Technology Affairs (HITA), King Faisal Specialist Hospital & Research Center, P.O. Box 3354, Riyadh 11211, Saudi Arabia; (M.F.A.); (A.A.); (M.A.); (O.A.)
| | - Maram Alabbad
- Healthcare Information Technology Affairs (HITA), King Faisal Specialist Hospital & Research Center, P.O. Box 3354, Riyadh 11211, Saudi Arabia; (M.F.A.); (A.A.); (M.A.); (O.A.)
| | - Hani Alsergani
- Heart Center, King Faisal Specialist Hospital & Research Center, P.O. Box 3354, Riyadh 11211, Saudi Arabia;
| | - Osama Alswailem
- Healthcare Information Technology Affairs (HITA), King Faisal Specialist Hospital & Research Center, P.O. Box 3354, Riyadh 11211, Saudi Arabia; (M.F.A.); (A.A.); (M.A.); (O.A.)
| |
Collapse
|
2
|
Zang T, Zhu Y, Huang X, Yang X, Chen Q, Yu J, Tang F. Enhancing length of stay prediction by learning similarity-aware representations for hospitalized patients. Artif Intell Med 2023; 144:102660. [PMID: 37783550 DOI: 10.1016/j.artmed.2023.102660] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/26/2022] [Revised: 08/01/2023] [Accepted: 09/04/2023] [Indexed: 10/04/2023]
Abstract
This paper focuses on predicting the length of stay for patients on the first day of admission and propose a predictive model named DGLoS. In order to capture the influence of various complex factors on the length of stay as well as the dependencies among various factors, DGLoS uses a deep neural network to model both the patient information and diagnostic information. Targeting at different attribution types, we utilize different coding methods to convert raw data to the input features. Besides, we find that similar patients have closer lengths of stay. Therefore, we further design a module based on graph representation learning to generate patients' similarity-aware representations, capturing the similarity between patients and therefore enhancing predictions. These similarity-aware representations are incorporated into the output of the deep neural network to jointly perform the prediction. We have conducted comprehensive experiments on a real-world hospitalization dataset. The performance comparison shows that our proposed DGLoS model improves predictive performance and the significance test demonstrates the improvement is significant. The ablation study verifies the effectiveness of each of the proposed components and the hyper-parameter investigation shows the robustness of the proposed model.
Collapse
Affiliation(s)
- Tianzi Zang
- Shanghai Jiao Tong University, Shanghai, China; Nanjing University of Aeronautics and Astronautics, Nanjing, China
| | - Yanmin Zhu
- Shanghai Jiao Tong University, Shanghai, China.
| | | | - Xinchen Yang
- East China University of Science and Technology, Shanghai, China
| | | | - Jiadi Yu
- Shanghai Jiao Tong University, Shanghai, China
| | | |
Collapse
|
3
|
Harerimana G, Kim JW, Jang B. A deep attention model to forecast the Length Of Stay and the in-hospital mortality right on admission from ICD codes and demographic data. J Biomed Inform 2021; 118:103778. [PMID: 33872817 DOI: 10.1016/j.jbi.2021.103778] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/24/2020] [Revised: 03/15/2021] [Accepted: 04/06/2021] [Indexed: 11/28/2022]
Abstract
Leveraging the Electronic Health Records (EHR) longitudinal data to produce actionable clinical insights has always been a critical issue for recent studies. Non-forecasted extended hospitalizations account for a disproportionate amount of resource use, the mediocre quality of inpatient care, and avoidable fatalities. The capability to predict the Length of Stay (LoS) and mortality in the early stages of the admission provides opportunities to improve care and prevent many preventable losses. Forecasting the in-hospital mortality is important in providing clinicians with enough insights to make decisions and hospitals to allocate resources, hence predicting the LoS and mortality within the first day of admission is a difficult but a paramount endeavor. The biggest challenge is that few data are available by this time, thus the prediction has to bring in the previous admissions history and free text diagnosis that are recorded immediately on admission. We propose a model that uses the multi-modal EHR structured medical codes and key demographic information to classify the LoS in 3 classes; Short Los (LoS⩽10 days), Medium LoS (10<LoS⩽30 days) and Long LoS (LoS>30 days) as well as mortality as a binary classification of a patient's death during current admission. The prediction has to use data available only within 24 h of admission. The key predictors include previous ICD9 diagnosis codes, ICD9 procedures, key demographic data, and free text diagnosis of the current admission recorded right on admission. We propose a Hierarchical Attention Network (HAN-LoS and HAN-Mor) model and train it to a dataset of over 45321 admissions recorded in the de-identified MIMIC-III dataset. For improved prediction, our attention mechanisms can focus on the most influential past admissions and most influential codes in these admissions. For fair performance evaluation, we implemented and compared the HAN model with previous approaches. With dataset balancing techniques HAN-LoS achieved an AUROC of over 0.82 and a Micro-F1 score of 0.24 and HAN-Mor achieved AUC-ROC of 0.87 hence outperforming the existing baselines that use structured medical codes as well as clinical time series for LoS and Mortality forecasting. By predicting mortality and LoS using the same model, we show that with little tuning the proposed model can be used for other clinical predictive tasks like phenotyping, decompensation,re-admission prediction, and survival analysis.
Collapse
Affiliation(s)
- Gaspard Harerimana
- Department of Computer Science, Sangmyung University, Seoul, Republic of Korea.
| | - Jong Wook Kim
- Department of Computer Science, Sangmyung University, Seoul, Republic of Korea.
| | - Beakcheol Jang
- Graduate School of Information, Yonsei University, Seoul, Republic of Korea.
| |
Collapse
|
4
|
ICU Days-to-Discharge Analysis with Machine Learning Technology. Artif Intell Med 2021. [DOI: 10.1007/978-3-030-77211-6_11] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
|
5
|
Bacchi S, Tan Y, Oakden-Rayner L, Jannes J, Kleinig T, Koblar S. Machine Learning in the Prediction of Medical Inpatient Length of Stay. Intern Med J 2020; 52:176-185. [PMID: 33094899 DOI: 10.1111/imj.14962] [Citation(s) in RCA: 12] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/30/2019] [Revised: 05/30/2020] [Accepted: 06/16/2020] [Indexed: 11/30/2022]
Abstract
BACKGROUND Length of stay (LOS) estimates are important for patients, doctors and hospital administrators. However, making accurate estimates of LOS can be difficult for medical patients. AIMS This review was conducted with the aim of identifying and assessing previous studies on the application of machine learning to the prediction of total hospital inpatient LOS for medical patients. METHODS A review of machine learning in the prediction of total hospital LOS for medical inpatients was conducted using the databases PubMed, EMBASE and Web of Science. RESULTS Of the 673 publications returned by the initial search, 21 articles met inclusion criteria. Of these articles the most commonly represented medical specialty was cardiology. Studies were also identified that had specifically evaluated machine learning LOS prediction in patients with diabetes and tuberculosis. The performance of the machine learning models in the identified studies varied significantly depending on factors including differing input datasets and different LOS thresholds and outcome metrics. Common methodological shortcomings included a lack of reporting of patient demographics and lack of reporting of clinical details of included patients. CONCLUSIONS The variable performance reported by the studies identified in this review supports the need for further research of the utility of machine learning in the prediction of total inpatient LOS in medical patients. Future studies should follow and report a more standardised methodology to better assess performance and to allow replication and validation. In particular, prospective validation studies and studies assessing the clinical impact of such machine learning models would be beneficial. This article is protected by copyright. All rights reserved.
Collapse
Affiliation(s)
- Stephen Bacchi
- Royal Adelaide Hospital, Adelaide, South Australia, 5000, Australia.,University of Adelaide, Adelaide, South Australia, 5005, Australia
| | - Yiran Tan
- Royal Adelaide Hospital, Adelaide, South Australia, 5000, Australia.,University of Adelaide, Adelaide, South Australia, 5005, Australia
| | - Luke Oakden-Rayner
- Royal Adelaide Hospital, Adelaide, South Australia, 5000, Australia.,University of Adelaide, Adelaide, South Australia, 5005, Australia
| | - Jim Jannes
- Royal Adelaide Hospital, Adelaide, South Australia, 5000, Australia.,University of Adelaide, Adelaide, South Australia, 5005, Australia
| | - Timothy Kleinig
- Royal Adelaide Hospital, Adelaide, South Australia, 5000, Australia.,University of Adelaide, Adelaide, South Australia, 5005, Australia
| | - Simon Koblar
- Royal Adelaide Hospital, Adelaide, South Australia, 5000, Australia.,University of Adelaide, Adelaide, South Australia, 5005, Australia
| |
Collapse
|
6
|
Sarasa Cabezuelo A. Application of Machine Learning Techniques to Analyze Patient Returns to the Emergency Department. J Pers Med 2020; 10:E81. [PMID: 32784609 PMCID: PMC7563563 DOI: 10.3390/jpm10030081] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/08/2020] [Revised: 07/22/2020] [Accepted: 08/06/2020] [Indexed: 11/17/2022] Open
Abstract
The study of the quality of hospital emergency services is based on analyzing a set of indicators such as the average time of first medical attention, the average time spent in the emergency department, degree of completion of the medical report and others. In this paper, an analysis is presented of one of the quality indicators: the rate of return of patients to the emergency service less than 72 h from their discharge. The objective of the analysis was to know the variables that influence the rate of return and which prediction model is the best. In order to do this, the data of the activity of the emergency service of a hospital of a reference population of 290,000 inhabitants were analyzed, and prediction models were created for the binary objective variable (rate of return to emergencies) using the logistic regression techniques, neural networks, random forest, gradient boosting and assembly models. Each of the models was analyzed and the result shows that the best model is achieved through a neural network with activation function tanh, algorithm levmar and three nodes in the hidden layer. This model obtains the lowest mean squared error (MSE) and the best area under the curve (AUC) with respect to the rest of the models used.
Collapse
Affiliation(s)
- Antonio Sarasa Cabezuelo
- Department of Computer Systems and Computing, School of Computer Science, Complutensian University of Madrid, 28040 Madrid, Spain
| |
Collapse
|