1
|
Song X, Tong Y, Xian F, Luo Y, Tong R. Predicting 1 year readmission for heart failure: A comparative study of machine learning and the LACE index. ESC Heart Fail 2024. [PMID: 38778700 DOI: 10.1002/ehf2.14855] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/23/2024] [Revised: 03/29/2024] [Accepted: 04/24/2024] [Indexed: 05/25/2024] Open
Abstract
AIMS There is a lack of tools for accurately identifying the risk of readmission for heart failure in elderly patients with arrhythmia. The aim of this study was to establish and compare the performance of the LACE [length of stay ('L'), acute (emergent) admission ('A'), Charlson comorbidity index ('C') and visits to the emergency department during the previous 6 months ('E')] index and machine learning in predicting 1 year readmission for heart failure in elderly patients with arrhythmia. METHODS Elderly patients with arrhythmia who were hospitalized at Sichuan Provincial People's Hospital between 1 June 2018 and 31 May 2020 were enrolled. The LACE index was calculated for each patient, and the area under the receiver operating characteristic curve (AUROC) was calculated. Six machine learning algorithms, combined with three variable selection methods and clinically relevant features available at the time of hospital discharge, were used to develop machine learning models. AUROC and area under the precision-recall curve (AUPRC) were used to assess discrimination. Shapley additive explanations (SHAP) analysis was used to explain the contributions of the features. RESULTS A total of 523 patients were enrolled, and 108 patients experienced 1 year hospital readmission for heart failure. The AUROC of the LACE index was 0.5886. The complete machine learning model had the best predictive performance, with an AUROC of 0.7571 and an AUPRC of 0.4096. The most important predictors for 1 year readmission were educational level, total triiodothyronine (TT3), aspartate aminotransferase/alanine aminotransferase (AST/ALT), number of medications (NOM) and triglyceride (TG) level. CONCLUSIONS Compared with the LACE index, the machine learning model can accurately identify the risk of 1 year readmission for heart failure in elderly patients with arrhythmia.
Collapse
Affiliation(s)
- Xuewu Song
- Department of Pharmacy, Sichuan Provincial People's Hospital, University of Electronic Science and Technology of China, Chengdu, China
| | - Yitong Tong
- Chengdu Second People's Hospital, Chengdu, China
| | - Feng Xian
- Department of Oncology, Nanchong Central Hospital, the Second Clinical Medical College, North Sichuan Medical College, Nanchong, China
| | - Yi Luo
- Department of Pharmacy, Sichuan Provincial People's Hospital, University of Electronic Science and Technology of China, Chengdu, China
| | - Rongsheng Tong
- Department of Pharmacy, Sichuan Provincial People's Hospital, University of Electronic Science and Technology of China, Chengdu, China
| |
Collapse
|
2
|
Siskind D, Dhansew T, Burns A, Burns E. Increasing illness severity of skilled nursing facility patients over time: Implications for readmission penalties. J Am Geriatr Soc 2024; 72:160-169. [PMID: 37873563 DOI: 10.1111/jgs.18629] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/20/2022] [Revised: 07/25/2023] [Accepted: 09/16/2023] [Indexed: 10/25/2023]
Abstract
BACKGROUND Current financial penalties for rehospitalization of skilled nursing facilities (SNFs) patients are based in part on the studies by Ouslander et al., 2011, and Mor et al., 2010, demonstrating that many SNF hospitalizations were avoidable. With increasing age, complex illness severity, and use of SNFs for subacute rehabilitation, readmission metrics and financial penalties based on previous data may be due for reevaluation. METHODS Retrospective electronic medical record (EMR) review of 21,591 admissions and discharges between 2010 and 2019 inclusive. Data extracted included demographics, LACE, Charlson comorbidity index (CCI), and simplified HOSPITAL score parameters. The scores were calculated for the study years from the extracted data. Patients readmitted to the hospital within 30 days were identified. RESULTS Mean yearly score of all three indices rose steadily: LACE score 10.76-12.04 (0.43 estimated annual increase, 95% CI [0.39, 0.46]), CCI 4.26-5.05 (0.31 estimated annual increase, 95% CI [0.27, 0.34]), and simplified HOSPITAL score 3.46-4.03 (0.21 estimated annual increase, 95% CI [0.18, 0.24]). The estimated probability of readmission across observed CCI scores ranged from 15.4% to 15.9%, 95% CI bounds (10.8%, 22.7%). The estimated probability of readmission across observed LACE scores ranged from 4.7% to 36.3%, 95% CI bounds (3.4%, 54.7%). The estimated probability of readmission across observed HOSPITAL scores ranged from 5.8% to 54.1%, 95% CI bounds (6.2%, 66.0%). CONCLUSIONS AND IMPLICATIONS The study confirms anecdotal experience that the illness acuity of patients admitted to SNFs increased progressively over time and was associated with an increased risk of 30-day readmissions to the hospital. Our study suggests that the use of clinically validated readmission risk assessment tools instead of the Skilled Nursing Facility Value-Based Purchasing Program (SNF VBP) current risk adjustors may be a more accurate reflection of the current illness severity of a facility's patient population at the time of payment adjustment.
Collapse
Affiliation(s)
- David Siskind
- Stern Family Center for Rehabilitation, Division of Geriatrics and Palliative Medicine, Zucker School of Medicine, Manhasset, New York, USA
| | - Tarayn Dhansew
- Division of Geriatrics and Palliative Medicine, Zucker School of Medicine, Northwell Health, Manhasset, New York, USA
| | - Amira Burns
- Department of Statistics, Colorado State University, Fort Collins, Colorado, USA
| | - Edith Burns
- Division of Geriatrics and Palliative Medicine, Zucker School of Medicine, Northwell Health, Manhasset, New York, USA
| |
Collapse
|
3
|
Bioletto F, Evangelista A, Ciccone G, Brunani A, Ponzo V, Migliore E, Pagano E, Comazzi I, Merlo FD, Rahimi F, Ghigo E, Bo S. Prediction of Early and Long-Term Hospital Readmission in Patients with Severe Obesity: A Retrospective Cohort Study. Nutrients 2023; 15:3648. [PMID: 37630838 PMCID: PMC10458036 DOI: 10.3390/nu15163648] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/26/2023] [Revised: 08/14/2023] [Accepted: 08/18/2023] [Indexed: 08/27/2023] Open
Abstract
Adults with obesity have a higher risk of hospitalization and high hospitalization-related healthcare costs. However, a predictive model for the risk of readmission in patients with severe obesity is lacking. We conducted a retrospective cohort study enrolling all patients admitted for severe obesity (BMI ≥ 40 kg/m2) between 2009 and 2018 to the Istituto Auxologico Italiano in Piancavallo. For each patient, all subsequent hospitalizations were identified from the regional database by a deterministic record-linkage procedure. A total of 1136 patients were enrolled and followed up for a median of 5.7 years (IQR: 3.1-8.2). The predictive factors associated with hospital readmission were age (HR = 1.02, 95%CI: 1.01-1.03, p < 0.001), BMI (HR = 1.02, 95%CI: 1.01-1.03, p = 0.001), smoking habit (HR = 1.17, 95%CI: 0.99-1.38, p = 0.060), serum creatinine (HR = 1.22, 95%CI: 1.04-1.44, p = 0.016), diabetes (HR = 1.17, 95%CI: 1.00-1.36, p = 0.045), and number of admissions in the previous two years (HR = 1.15, 95%CI: 1.07-1.23, p < 0.001). BMI lost its predictive role when restricting the analysis to readmissions within 90 days. BMI and diabetes lost their predictive roles when further restricting the analysis to readmissions within 30 days. In conclusion, in this study, we identified predictive variables associated with early and long-term hospital readmission in patients with severe obesity. Whether addressing modifiable risk factors could improve the outcome remains to be established.
Collapse
Affiliation(s)
- Fabio Bioletto
- Department of Medical Sciences, University of Turin, 10126 Turin, Italy; (F.B.); (V.P.); (I.C.); (E.G.)
| | - Andrea Evangelista
- Unit of Clinical Epidemiology, CPO, Città della Salute e della Scienza Hospital, 10126 Turin, Italy; (A.E.); (G.C.); (E.M.); (E.P.)
| | - Giovannino Ciccone
- Unit of Clinical Epidemiology, CPO, Città della Salute e della Scienza Hospital, 10126 Turin, Italy; (A.E.); (G.C.); (E.M.); (E.P.)
| | - Amelia Brunani
- Rehabilitation Medicine Unit, IRCCS Istituto Auxologico Italiano Piancavallo, 28824 Oggebbio, Italy;
| | - Valentina Ponzo
- Department of Medical Sciences, University of Turin, 10126 Turin, Italy; (F.B.); (V.P.); (I.C.); (E.G.)
| | - Enrica Migliore
- Unit of Clinical Epidemiology, CPO, Città della Salute e della Scienza Hospital, 10126 Turin, Italy; (A.E.); (G.C.); (E.M.); (E.P.)
| | - Eva Pagano
- Unit of Clinical Epidemiology, CPO, Città della Salute e della Scienza Hospital, 10126 Turin, Italy; (A.E.); (G.C.); (E.M.); (E.P.)
| | - Isabella Comazzi
- Department of Medical Sciences, University of Turin, 10126 Turin, Italy; (F.B.); (V.P.); (I.C.); (E.G.)
| | - Fabio Dario Merlo
- Dietetic Unit, Città della Salute e della Scienza Hospital, 10126 Turin, Italy; (F.D.M.); (F.R.)
| | - Farnaz Rahimi
- Dietetic Unit, Città della Salute e della Scienza Hospital, 10126 Turin, Italy; (F.D.M.); (F.R.)
| | - Ezio Ghigo
- Department of Medical Sciences, University of Turin, 10126 Turin, Italy; (F.B.); (V.P.); (I.C.); (E.G.)
| | - Simona Bo
- Department of Medical Sciences, University of Turin, 10126 Turin, Italy; (F.B.); (V.P.); (I.C.); (E.G.)
| |
Collapse
|
4
|
Song X, Tong Y, Luo Y, Chang H, Gao G, Dong Z, Wu X, Tong R. Predicting 7-day unplanned readmission in elderly patients with coronary heart disease using machine learning. Front Cardiovasc Med 2023; 10:1190038. [PMID: 37614939 PMCID: PMC10442485 DOI: 10.3389/fcvm.2023.1190038] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/20/2023] [Accepted: 07/24/2023] [Indexed: 08/25/2023] Open
Abstract
Background Short-term unplanned readmission is always neglected, especially for elderly patients with coronary heart disease (CHD). However, tools to predict unplanned readmission are lacking. This study aimed to establish the most effective predictive model for the unplanned 7-day readmission in elderly CHD patients using machine learning (ML) algorithms. Methods The detailed clinical data of elderly CHD patients were collected retrospectively. Five ML algorithms, including extreme gradient boosting (XGB), random forest, multilayer perceptron, categorical boosting, and logistic regression, were used to establish predictive models. We used the area under the receiver operating characteristic curve (AUC), accuracy, precision, recall, the F1 value, the Brier score, the area under the precision-recall curve (AUPRC), and the calibration curve to evaluate the performance of ML models. The SHapley Additive exPlanations (SHAP) value was used to interpret the best model. Results The final study included 834 elderly CHD patients, whose average age was 73.5 ± 8.4 years, among whom 426 (51.08%) were men and 139 had 7-day unplanned readmissions. The XGB model had the best performance, exhibiting the highest AUC (0.9729), accuracy (0.9173), F1 value (0.9134), and AUPRC (0.9766). The Brier score of the XGB model was 0.08. The calibration curve of the XGB model showed good performance. The SHAP method showed that fracture, hypertension, length of stay, aspirin, and D-dimer were the most important indicators for the risk of 7-day unplanned readmissions. The top 10 variables were used to build a compact XGB, which also showed good predictive performance. Conclusions In this study, five ML algorithms were used to predict 7-day unplanned readmissions in elderly patients with CHD. The XGB model had the best predictive performance and potential clinical application perspective.
Collapse
Affiliation(s)
- Xuewu Song
- Department of Pharmacy, Sichuan Provincial People’s Hospital, University of Electronic Science and Technology of China, Chengdu, China
- Chinese Academy of Sciences Sichuan Translational Medicine Research Hospital, Chengdu, China
| | - Yitong Tong
- Chengdu Second People’s Hospital, Chengdu, China
| | - Yi Luo
- Department of Pharmacy, Sichuan Provincial People’s Hospital, University of Electronic Science and Technology of China, Chengdu, China
- Chinese Academy of Sciences Sichuan Translational Medicine Research Hospital, Chengdu, China
| | - Huan Chang
- Department of Pharmacy, Sichuan Provincial People’s Hospital, University of Electronic Science and Technology of China, Chengdu, China
- Chinese Academy of Sciences Sichuan Translational Medicine Research Hospital, Chengdu, China
| | - Guangjie Gao
- Department of Pharmacy, Sichuan Provincial People’s Hospital, University of Electronic Science and Technology of China, Chengdu, China
- Chinese Academy of Sciences Sichuan Translational Medicine Research Hospital, Chengdu, China
| | - Ziyi Dong
- Department of Pharmacy, Sichuan Provincial People’s Hospital, University of Electronic Science and Technology of China, Chengdu, China
- Chinese Academy of Sciences Sichuan Translational Medicine Research Hospital, Chengdu, China
| | - Xingwei Wu
- Department of Pharmacy, Sichuan Provincial People’s Hospital, University of Electronic Science and Technology of China, Chengdu, China
- Chinese Academy of Sciences Sichuan Translational Medicine Research Hospital, Chengdu, China
| | - Rongsheng Tong
- Department of Pharmacy, Sichuan Provincial People’s Hospital, University of Electronic Science and Technology of China, Chengdu, China
- Chinese Academy of Sciences Sichuan Translational Medicine Research Hospital, Chengdu, China
| |
Collapse
|
5
|
Gasperini G, Bouazzi L, Sanchez A, Marotte L, Kézachian L, Bellec G, Cazes N, Rosetti M, Bousquet C, Renard A, Sanchez S. Healthcare-associated adverse events and readmission to the emergency departments within seven days after a first consultation. Front Public Health 2023; 11:1189939. [PMID: 37483920 PMCID: PMC10359972 DOI: 10.3389/fpubh.2023.1189939] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/20/2023] [Accepted: 06/23/2023] [Indexed: 07/25/2023] Open
Abstract
Introduction The use of emergency hospital service has become increasingly frequent with a rise of approximately 3.6%. in annual emergency department visits. The objective of this study was to describe the reasons for reconsultations to emergency departments and to identify the risk and protective factors of reconsultations linked to healthcare-associated adverse events. Materials and methods A retrospective, descriptive, multicenter study was performed in the emergency department of Troyes Hospital and the Sainte Anne Army Training Hospital in Toulon, France from January 1 to December 31, 2019. Patients over 18 years of age who returned to the emergency department for a reconsultation within 7 days were included. Healthcare-associated adverse events in the univariate analysis (p < 0.10) were introduced into a multivariate logistic regression model. Model performance was examined using the Hosmer-Lemeshow test and calculated with c-statistic. Results Weekend visits and performing radiology examinations were risk factors linked to healthcare associated adverse events. Biological examinations and the opinion of a specialist were protective factors. Discussion Numerous studies have reported that a first consultation occurring on a weekend is a reconsultation risk factor for healthcare-associated adverse events, however, performing radiology examinations were subjected to confusion bias. Patients having radiology examinations due to trauma-related pathologies were more apt for a reconsultation. Conclusion Our study supports the need for better emergency departments access to biological examinations and specialist second medical opinions. An appropriate patient to doctor ratio in hospital emergency departments may be necessary at all times.
Collapse
Affiliation(s)
- Guillaume Gasperini
- Emergency Hospital Services, Sainte Anne Army Training Hospital, Toulon, France
| | - Leila Bouazzi
- University Committee of Resources for Research in Health (CURRS), University of Reims Champagne-Ardenne, Reims, France
| | | | - Louis Marotte
- Emergency Hospital Services, Sainte Anne Army Training Hospital, Toulon, France
| | - Laury Kézachian
- Medical Educational Institute Les Farfadets, UGECAM PACA-Corse, La Valette-du-Var, France
| | - Guillaume Bellec
- Emergency Hospital Services, Sainte Anne Army Training Hospital, Toulon, France
| | - Nicolas Cazes
- Emergency Medical Aid Services, Battalion of Marine Firefighters of Marseille, Marseille, France
| | - Maxime Rosetti
- Emergency Hospital Services, Troyes Hospital, Troyes, France
| | - Claire Bousquet
- Emergency Hospital Services, Troyes Hospital, Troyes, France
| | - Aurélien Renard
- Emergency Medical Aid Services, Battalion of Marine Firefighters of Marseille, Marseille, France
| | - Stéphane Sanchez
- University Committee of Resources for Research in Health (CURRS), University of Reims Champagne-Ardenne, Reims, France
- Public Health and Performance Department, Champagne Sud Hospital, Troyes, France
| |
Collapse
|
6
|
Sun CH, Chou YY, Lee YS, Weng SC, Lin CF, Kuo FH, Hsu PS, Lin SY. Prediction of 30-Day Readmission in Hospitalized Older Adults Using Comprehensive Geriatric Assessment and LACE Index and HOSPITAL Score. INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH 2022; 20:348. [PMID: 36612671 PMCID: PMC9819393 DOI: 10.3390/ijerph20010348] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 10/19/2022] [Revised: 12/07/2022] [Accepted: 12/21/2022] [Indexed: 06/17/2023]
Abstract
(1) Background: Elders have higher rates of rehospitalization, especially those with functional decline. We aimed to investigate potential predictors of 30-day readmission risk by comprehensive geriatric assessment (CGA) in hospitalized patients aged 65 years or older and to examine the predictive ability of the LACE index and HOSPITAL score in older patients with a combination of malnutrition and physical dysfunction. (2) Methods: We included patients admitted to a geriatric ward in a tertiary hospital from July 2012 to August 2018. CGA components including cognitive, functional, nutritional, and social parameters were assessed at admission and recorded, as well as clinical information. The association factors with 30-day hospital readmission were analyzed by multivariate logistic regression analysis. The predictive ability of the LACE and HOSPITAL score was assessed using receiver operator characteristic curve analysis. (3) Results: During the study period, 1509 patients admitted to a ward were recorded. Of these patients, 233 (15.4%) were readmitted within 30 days. Those who were readmitted presented with higher comorbidity numbers and poorer performance of CGA, including gait ability, activities of daily living (ADL), and nutritional status. Multivariate regression analysis showed that male gender and moderately impaired gait ability were independently correlated with 30-day hospital readmissions, while other components such as functional impairment (as ADL) and nutritional status were not associated with 30-day rehospitalization. The receiver operating characteristics for the LACE index and HOSPITAL score showed that both predicting scores performed poorly at predicting 30-day hospital readmission (C-statistic = 0.59) and did not perform better in any of the subgroups. (4) Conclusions: Our study showed that only some components of CGA, mobile disability, and gender were independently associated with increased risk of readmission. However, the LACE index and HOSPITAL score had a poor discriminating ability for predicting 30-day hospitalization in all and subgroup patients. Further identifiers are required to better estimate the 30-day readmission rates in this patient population.
Collapse
Affiliation(s)
- Chia-Hui Sun
- Department of Family Medicine, Taichung Veterans General Hospital, Taichung 40705, Taiwan
| | - Yin-Yi Chou
- Center for Geriatrics & Gerontology, Taichung Veterans General Hospital, Taichung 40705, Taiwan
- Division of Allergy, Immunology and Rheumatology, Department of Internal Medicine, Taichung Veterans General Hospital, Taichung 40705, Taiwan
| | - Yu-Shan Lee
- Center for Geriatrics & Gerontology, Taichung Veterans General Hospital, Taichung 40705, Taiwan
- Department of Neurology, Neurological Institute, Taichung Veterans General Hospital, Taichung 40705, Taiwan
| | - Shuo-Chun Weng
- Center for Geriatrics & Gerontology, Taichung Veterans General Hospital, Taichung 40705, Taiwan
- Division of Nephrology, Department of Internal Medicine, Taichung Veterans General Hospital, Taichung 40705, Taiwan
| | - Cheng-Fu Lin
- Center for Geriatrics & Gerontology, Taichung Veterans General Hospital, Taichung 40705, Taiwan
- Division of Occupational Medicine, Department of Emergency, Taichung Veterans General Hospital, Taichung 40705, Taiwan
| | - Fu-Hsuan Kuo
- Center for Geriatrics & Gerontology, Taichung Veterans General Hospital, Taichung 40705, Taiwan
- Department of Neurology, Neurological Institute, Taichung Veterans General Hospital, Taichung 40705, Taiwan
| | - Pi-Shan Hsu
- Department of Family Medicine, Taichung Veterans General Hospital, Taichung 40705, Taiwan
| | - Shih-Yi Lin
- Center for Geriatrics & Gerontology, Taichung Veterans General Hospital, Taichung 40705, Taiwan
- Division of Endocrinology and Metabolism, Department of Internal Medicine, Taichung Veterans General Hospital, Taichung 40705, Taiwan
| |
Collapse
|