Validity of the LACE index for identifying frequent early readmissions after hospital discharge in children

Predictive Value of LACE Scores for Pediatric Readmissions

INTRODUCTION

Hospital readmissions are recognized as a prevalent, yet potentially preventable, personal and economic burden. Length of stay, Acuity of admission, Comorbidities, and number of Emergency Department visits in the preceding 6 months can be quantified into one score, the LACE score. LACE scores have previously been identified to correlate with hospital readmissions within 30 days of discharge, but research specific to the pediatric population is scant. The objective of the present study was to investigate if LACE scores, in addition to other factors, can be utilized to create a predictive pediatric hospital readmission model that may ultimately be used to decrease readmission rates.

METHODS

This study included 25,616 hospitalizations of patients under the age of 18 years. Data were extracted from a hospital network electronic medical record. Demographics included LACE scores, age, gender, race/ethnicity, median household income, and medical centers. The primary exposure variable was LACE score. The main outcome measures were readmissions within 7, 14, and 30 days. The area under the curve (AUC) was used to assess the predictive capability of the regression model on patient 30-day admission.

RESULTS

LACE scores, age, gender, race/ethnicity, median household income, and medical centers were examined in a multivariable model to assess patient risk of a 30-day readmission. Only age and LACE score were observed to be statistically significant. The AUC for the combined model was 0.69.

DISCUSSION

As only age and LACE score were observed to be statistically significant and the AUC for the combined model was 0.69, this model is considered to have poor predictive capability.

CONCLUSIONS

In this study, LACE scores, as well the other factors, had a poor predictive capability for pediatric readmissions.

Machine learning for hospital readmission prediction in pediatric population

BACKGROUND AND OBJECTIVE

Pediatric readmissions are a burden on patients, families, and the healthcare system. In order to identify patients at higher readmission risk, more accurate techniques, as machine learning (ML), could be a good strategy to expand the knowledge in this area. The aim of this study was to develop predictive models capable of identifying children and adolescents at high risk of potentially avoidable 30-day readmission using ML.

METHODS

Retrospective cohort study was carried out with 9,080 patients under 18 years old admitted to a tertiary university hospital. Demographic, clinical, and biochemical data were collected from electronic databases. We randomly divided the dataset into training (75 %) and testing (25 %), applied downsampling, repeated cross-validation with five folds and ten repetitions, and the hyperparameter was optimized of each technique using a grid search via racing with ANOVA models. We applied six ML classification algorithms to build the predictive models, including classification and regression tree (CART), random forest (RF), gradient boosting machine (GBM), extreme gradient boosting (XGBoost), decision tree and logistic regression (LR). The area under the receiver operating curve (AUC), sensitivity, specificity, Youden's J-index and accuracy were used to evaluate the performance of each model.

RESULTS

The avoidable 30-day hospital readmissions rate was 9.5 %. Some algorithms presented similar AUC, both in the dataset training and in the dataset testing, such as XGBoost, RF, GBM and CART. Considering the Youden's J-index, the algorithm that presented the best index was XGBoost with bagging imputation, with AUC of 0.814 (J-index of 0.484). Cancer diagnosis, age, red blood cells, leukocytes, red cell distribution width and sodium levels, elective admission, and multimorbidity were the most important characteristics to classify between readmission and non-readmission groups.

CONCLUSION

Machine learning approaches, especially XGBoost, can predict potentially avoidable 30-day pediatric hospital readmission into tertiary assistance. If implemented in the computer hospital system, our model can help in the early and more accurate identification of patients at readmission risk, targeting health strategic interventions.

A validation study of the high acuity readmission risk pediatric screen (HARRPS) tool©: Predicting readmission risk within the pediatric population

BACKGROUND

The initial research study of the High Acuity Readmission Risk Pediatric Screen (HARRPS) Tool © focused on using retrospective data to apply weighted values to the questions within the tool, identify overall risk score, and attribute risk categories (low, moderate, high risk) to the overall risk score. This study focused on validating the data from the initial study, as well as cross examining the need to include admission diagnosis within the tool.

METHOD

Study was a single-centered, retrospective chart review study using a different subset of patients from the initial study. Pediatric patients with thirty-day readmissions were compared to pediatric patients without a thirty-day readmission over a twelve-month period. Utilized same statistical software and methodology from initial study to identify if readmission risk probability could be replicated with a different population.

RESULTS

The initial study performed in 2018 demonstrated a c-statistic score/ area under the curve (AUC) of 0.68 [95% CI: 0.67, 0.69]. In addition, the initial study demonstrated as risk score increases, the probability of readmission gradually increased until a patient had a risk score of seven or greater, at which point readmission risk plateaued. This resulted in low, moderate, and high readmission risk categories. The current study performed using data from 2019 demonstrated an improved c-statistic score / AUC of 0.83 [95% CI: 0.80, 0.87] with admission diagnosis included, and a c-statistic score / AUC of 0.80 [95% CI: 0.76, 0.83] without the admission diagnosis included. The analysis of overall risk score demonstrated a substantial difference in how to interpret final readmission risk scores. Both the initial study and validation study were consistent in demonstrating a risk score of three or less was associated with low readmission risk. However, in the validation study, there was no substantial difference between moderate or high risk, leading to updating the tool from 3 risk categories into 2 risk categories of low risk and at risk of readmission.

CONCLUSION

Based on the finding from the validation study, the admission diagnosis was removed from the HARRPS Tool© as the difference in c-statistic score was nominal, and the risk categories were changed from three categories (low, moderate, high risk) to two categories of low risk (score 0-2) and at risk of readmission for a score of 3+. The ability of the HARRPS Tool© to predict readmission risk preforms best with a c-statistic = 0.80, outperforming the following tools: LACE (0.65), LACE -SDH (0.67), LACE + (0.61), Epic's readmission risk model (0.69), and SQLAPE ® (0.71) (Ryan, et al., 2021; Hwang, et al., 2021).

Validation of the HOSPITAL score as predictor of 30-day potentially avoidable readmissions in pediatric hospitalized population: retrospective cohort study

Potentially avoidable pediatric readmissions are a burden to patients and their families. Identifying patients with higher risk of readmission could help minimize hospital costs and facilitate the targeting of care interventions. HOSPITAL score is a tool developed and widely used to predict adult patient's readmissions; however its predictive capacity for pediatric readmissions has not yet been evaluated. The aim of the study was to validate the HOSPITAL score application to predict 30-day potentially avoidable readmissions in a pediatric hospitalized population. This is a retrospective cohort study with patients under 18 years old admitted to a tertiary university hospital (n = 6,344). The HOSPITAL score was estimated for each admission. Subsequently, we classified the patients as low (0-4), intermediate (5-6), and high (7-12) risk groups. In order to estimate the discrimination power, the sensitivity, specificity, and accuracy were determined by the receiver operating characteristics (ROC) and the calibration by the Hosmer-Lemeshow goodness-of-fit. The 30-day hospital readmission was 11.70% (745). The accuracy was 0.80 (CI 95%, 0.77, 0.83), with a sensitivity of 70.96% and specificity of 78.29%, and a good calibration (p = 0.34).    Conclusion: HOSPITAL score showed a good discrimination and can be used to predict 30-day potentially avoidable readmission in a large pediatric population with different medical diagnoses. Our study validates and expands the usefulness of the HOSPITAL score as a tool to predict avoidable hospital readmissions for pediatric population. What is Known: •   Pediatric readmissions burden patients, the family network, and the health system. In addition, it influences negatively child development. •   The HOSPITAL score is one of the tools developed and widely used to identify patients at high risk of hospital readmission, but its predictive capacity for pediatric readmissions has not been yet assessed. What is New: • The HOSPITAL score showed good ability to identify a risk of 30-day potentially avoidable readmission in a pediatric population in different clinical contexts and diagnoses. • Our study expands the usefulness of the HOSPITAL score as a tool for predicting hospital readmissions for children and adolescents.

Prediction of 30-Day Readmission in Hospitalized Older Adults Using Comprehensive Geriatric Assessment and LACE Index and HOSPITAL Score

(1) Background: Elders have higher rates of rehospitalization, especially those with functional decline. We aimed to investigate potential predictors of 30-day readmission risk by comprehensive geriatric assessment (CGA) in hospitalized patients aged 65 years or older and to examine the predictive ability of the LACE index and HOSPITAL score in older patients with a combination of malnutrition and physical dysfunction. (2) Methods: We included patients admitted to a geriatric ward in a tertiary hospital from July 2012 to August 2018. CGA components including cognitive, functional, nutritional, and social parameters were assessed at admission and recorded, as well as clinical information. The association factors with 30-day hospital readmission were analyzed by multivariate logistic regression analysis. The predictive ability of the LACE and HOSPITAL score was assessed using receiver operator characteristic curve analysis. (3) Results: During the study period, 1509 patients admitted to a ward were recorded. Of these patients, 233 (15.4%) were readmitted within 30 days. Those who were readmitted presented with higher comorbidity numbers and poorer performance of CGA, including gait ability, activities of daily living (ADL), and nutritional status. Multivariate regression analysis showed that male gender and moderately impaired gait ability were independently correlated with 30-day hospital readmissions, while other components such as functional impairment (as ADL) and nutritional status were not associated with 30-day rehospitalization. The receiver operating characteristics for the LACE index and HOSPITAL score showed that both predicting scores performed poorly at predicting 30-day hospital readmission (C-statistic = 0.59) and did not perform better in any of the subgroups. (4) Conclusions: Our study showed that only some components of CGA, mobile disability, and gender were independently associated with increased risk of readmission. However, the LACE index and HOSPITAL score had a poor discriminating ability for predicting 30-day hospitalization in all and subgroup patients. Further identifiers are required to better estimate the 30-day readmission rates in this patient population.

Targeted Clinical Interventions for Reducing Pediatric Readmissions

BACKGROUND

In this interventional study, we addressed the selection and application of clinical interventions on pediatric patients identified as at risk by a predictive model for readmissions.

METHODS

A predictive model for readmissions was implemented, and a team of providers expanded corresponding clinical interventions for at-risk patients at a freestanding children's hospital. Interventions encompassed social determinants of health, outpatient care, medication reconciliation, inpatient and discharge planning, and postdischarge calls and/or follow-up. Statistical process control charts were used to compare readmission rates for the 3-year period preceding adoption of the model and clinical interventions with those for the 2-year period after adoption of the model and clinical interventions. Potential financial savings were estimated by using national estimates of the cost of pediatric inpatient readmissions.

RESULTS

The 30-day all-cause readmission rates during the periods before and after predictive modeling (and corresponding 95% confidence intervals [CI]) were 12.5% (95% CI: 12.2%-12.8%) and 11.1% (95% CI: 10.8%-11.5%), respectively. More modest but similar improvements were observed for 7-day readmissions. Statistical process control charts indicated nonrandom reductions in readmissions after predictive model adoption. The national estimate of the cost of pediatric readmissions indicates an associated health care savings due to reduced 30-day readmission during the 2-year predictive modeling period at $2 673 264 (95% CI: $2 612 431-$2 735 364).

CONCLUSIONS

A combination of predictive modeling and targeted clinical interventions to improve the management of pediatric patients at high risk for readmission was successful in reducing the rate of readmission and reducing overall health care costs. The continued prioritization of patients with potentially modifiable outcomes is key to improving patient outcomes.