Machine Learning-Assisted Ensemble Analysis for the Prediction of Acute Pancreatitis with Acute Kidney Injury

Predictive model of acute kidney injury in critically ill patients with acute pancreatitis: a machine learning approach using the MIMIC-IV database

BACKGROUND

Acute kidney injury (AKI) is a common and serious complication in severe acute pancreatitis (AP), associated with high mortality rate. Early detection of AKI is crucial for prompt intervention and better outcomes. This study aims to develop and validate predictive models using machine learning (ML) to identify the onset of AKI in patients with AP.

METHODS

Patients with AP were extracted from the MIMIC-IV database. We performed feature selection using the random forest method. Model construction involved an ensemble of ML, including random forest (RF), support vector machine (SVM), k-nearest neighbors (KNN), naive Bayes (NB), neural network (NNET), generalized linear model (GLM), and gradient boosting machine (GBM). The best-performing model was fine-tuned and evaluated through split-set validation.

RESULTS

We analyzed 1,235 critically ill patients with AP, of which 667 cases (54%) experienced AKI during hospitalization. We used 49 variables to construct models, including GBM, GLM, KNN, NB, NNET, RF, and SVM. The AUC for these models was 0.814 (95% CI, 0.763 to 0.865), 0.812 (95% CI, 0.769 to 0.854), 0.671 (95% CI, 0.622 to 0.719), 0.812 (95% CI, 0.780 to 0.864), 0.688 (95% CI, 0.624 to 0.752), 0.809 (95% CI, 0.766 to 0.851), and 0.810 (95% CI, 0.763 to 0.856) respectively. In the test set, the GBM's performance was consistent, with an area of 0.867 (95% CI, 0.831 to 0.903).

CONCLUSIONS

The GBM model's precision is crucial, aiding clinicians in identifying high-risk patients and enabling timely interventions to reduce mortality rates in critical care.

Establishment and Validation of an Early Predictive Model for Severe Acute Pancreatitis

Objective

The purpose of this study is to establishment and validation of an early predictive model for severe acute pancreatitis (SAP).

Methods

From January 2015 to August 2022, 2986 AP patients admitted to Changsha Central Hospital were enrolled in this study. They were randomly divided into a modeling group (n = 2112) and a validation group (n = 874). In the modeling group, identify risk factors through logistic regression models and draw column charts. Use internal validation method to verify the accuracy of column chart prediction. Apply calibration curves to evaluate the consistency between nomograms and ideal observations. Draw a DCA curve to evaluate the net benefits of the prediction model.

Results

Nine variables including respiratory rate, heart rate, WBC, PDW, PT, SCR, AMY, CK, and TG are the risk factors for SAP. The column chart risk prediction model which was constructed based on these 9 independent factors has high prediction accuracy (modeling group AUC = 0.788, validation group AUC = 7.789). The calibration curve analysis shows that the prediction probabilities of the modeling and validation groups are consistent with the observation probabilities. By drawing a DCA curve, it shows that the model has a wide threshold range (0.01-0.88).

Conclusion

The study developed an intuitive nomogram containing readily available laboratory parameters to predict the incidence rate of SAP.

Automated machine learning for early prediction of acute kidney injury in acute pancreatitis

BACKGROUND

Acute kidney injury (AKI) represents a frequent and grave complication associated with acute pancreatitis (AP), substantially elevating both mortality rates and the financial burden of hospitalization. The aim of our study is to construct a predictive model utilizing automated machine learning (AutoML) algorithms for the early prediction of AKI in patients with AP.

METHODS

We retrospectively analyzed patients who were diagnosed with AP in our hospital from January 2017 to December 2021. These patients were randomly allocated into a training set and a validation set at a ratio of 7:3. To develop predictive models for each set, we employed the least absolute shrinkage and selection operator (LASSO) algorithm along with AutoML. A nomogram was developed based on multivariate logistic regression analysis outcomes. The model's efficacy was assessed using receiver operating characteristic (ROC) curves, calibration curves, and decision curve analysis (DCA). Additionally, the performance of the model constructed via AutoML was evaluated using decision curve analysis (DCA), feature importance, SHapley Additive exPlanations (SHAP) plots, and locally interpretable model-agnostic explanations (LIME).

RESULTS

This study incorporated a total of 437 patients who met the inclusion criteria. Out of these, 313 were assigned to the training cohort and 124 to the validation cohort. In the training and validation cohorts, AKI occurred in 68 (21.7%) and 29(23.4%) patients, respectively. Comparative analysis revealed that the AutoML models exhibited enhanced performance over traditional logistic regression (LR). Furthermore, the deep learning (DL) model demonstrated superior predictive accuracy, evidenced by an area under the ROC curve of 0.963 in the training set and 0.830 in the validation set, surpassing other comparative models. The key variables identified as significant in the DL model within the training dataset included creatinine (Cr), urea (Urea), international normalized ratio (INR), etiology, smoking, alanine aminotransferase (ALT), hypertension, prothrombin time (PT), lactate dehydrogenase (LDH), and diabetes.

CONCLUSION

The AutoML model, utilizing DL algorithm, offers considerable clinical significance in the early detection of AKI among patients with AP.

Construction and validation of machine learning models for sepsis prediction in patients with acute pancreatitis

BACKGROUND

This study aimed to construct predictive models for the risk of sepsis in patients with Acute pancreatitis (AP) using machine learning methods and compared optimal one with the logistic regression (LR) model and scoring systems.

METHODS

In this retrospective cohort study, data were collected from the Medical Information Mart for Intensive Care III (MIMIC III) database between 2001 and 2012 and the MIMIC IV database between 2008 and 2019. Patients were randomly divided into training and test sets (8:2). The least absolute shrinkage and selection operator (LASSO) regression plus 5-fold cross-validation were used to screen and confirm the predictive factors. Based on the selected predictive factors, 6 machine learning models were constructed, including support vector machine (SVM), K-nearest neighbour (KNN), multi-layer perceptron (MLP), LR, gradient boosting decision tree (GBDT) and adaptive enhancement algorithm (AdaBoost). The models and scoring systems were evaluated and compared using sensitivity, specificity, positive predictive value (PPV), negative predictive value (NPV), accuracy, and the area under the curve (AUC).

RESULTS

A total of 1, 672 patients were eligible for participation. In the training set, 261 AP patients (19.51%) were diagnosed with sepsis. The predictive factors for the risk of sepsis in AP patients included age, insurance, vasopressors, mechanical ventilation, Glasgow Coma Scale (GCS), heart rate, respiratory rate, temperature, SpO2, platelet, red blood cell distribution width (RDW), International Normalized Ratio (INR), and blood urea nitrogen (BUN). The AUC of the GBDT model for sepsis prediction in the AP patients in the testing set was 0.985. The GBDT model showed better performance in sepsis prediction than the LR, systemic inflammatory response syndrome (SIRS) score, bedside index for severity in acute pancreatitis (BISAP) score, sequential organ failure assessment (SOFA) score, quick-SOFA (qSOFA), and simplified acute physiology score II (SAPS II).

CONCLUSION

The present findings suggest that compared to the classical LR model and SOFA, qSOFA, SAPS II, SIRS, and BISAP scores, the machine learning model-GBDT model had a better performance in predicting sepsis in the AP patients, which is a useful tool for early identification of high-risk patients and timely clinical interventions.

Bibliometric and visual analysis of machine learning-based research in acute kidney injury worldwide

Background

Acute kidney injury (AKI) is a serious clinical complication associated with adverse short-term and long-term outcomes. In recent years, with the rapid popularization of electronic health records and artificial intelligence machine learning technology, the detection rate and treatment of AKI have been greatly improved. At present, there are many studies in this field, and a large number of articles have been published, but we do not know much about the quality of research production in this field, as well as the focus and trend of current research.

Methods

Based on the Web of Science Core Collection, studies reporting machine learning-based AKI research that were published from 2013 to 2022 were retrieved and collected after manual review. VOSviewer and other software were used for bibliometric visualization analysis, including publication trends, geographical distribution characteristics, journal distribution characteristics, author contributions, citations, funding source characteristics, and keyword clustering.

Results

A total of 336 documents were analyzed. Since 2018, publications and citations have increased dramatically, with the United States (143) and China (101) as the main contributors. Regarding authors, Bihorac, A and Ozrazgat-Baslanti, T from the Kansas City Medical Center have published 10 articles. Regarding institutions, the University of California (18) had the most publications. Approximately 1/3 of the publications were published in Q1 and Q2 journals, of which Scientific Reports (19) was the most prolific journal. Tomašev et al.'s study that was published in 2019 has been widely cited by researchers. The results of cluster analysis of co-occurrence keywords suggest that the construction of AKI prediction model related to critical patients and sepsis patients is the research frontier, and XGBoost algorithm is also popular.

Conclusion

This study first provides an updated perspective on machine learning-based AKI research, which may be beneficial for subsequent researchers to choose suitable journals and collaborators and may provide a more convenient and in-depth understanding of the research basis, hotspots and frontiers.

Machine learning for acute kidney injury: Changing the traditional disease prediction mode

Acute kidney injury (AKI) is a serious clinical comorbidity with clear short-term and long-term prognostic implications for inpatients. The diversity of risk factors for AKI has been recognized in previous studies, and a series of predictive models have been developed using traditional statistical methods in conjunction with its preventability, but they have failed to meet the expectations in limited clinical applications, the rapid spread of electronic health records and artificial intelligence machine learning technology has brought new hope for the construction of AKI prediction models. In this article, we systematically review the definition and classification of machine learning methods, modeling ideas and evaluation methods, and the characteristics and current status of modeling studies. According to the modeling objectives, we subdivided them into critical care medical setting models, all medical environment models, special surgery models, special disease models, and special nephrotoxin exposure models. As the first review article to comprehensively summarize and analyze machine learning prediction models for AKI, we aim to objectively describe the advantages and disadvantages of machine learning approaches to modeling, and help other researchers more quickly and intuitively understand the current status of modeling research, inspire ideas and learn from experience, so as to guide and stimulate more research and more in-depth exploration in the future, which will ultimately provide greater help to improve the overall status of AKI diagnosis and treatment.

Prediction of acute pancreatitis complications using routine blood parameters during early admission

BACKGROUND

There have been many reports on biomarkers for predicting the severity of acute pancreatitis (AP), but few studies on biomarkers for predicting complications; some simple and inexpensive indicators, in particular, are worth exploring.

METHODS

We retrospectively collected clinical data of 809 AP patients, including medical history and results of routine blood tests, and grouped them according to the occurrence of complications. Differences in clinical characteristics between groups with and without complications were compared using t-test or χ² test. Receiver operating curve (ROC) and area under the curve were calculated to evaluate the ability of predicting the occurrence of complications for the routine blood parameters with statistical differences. Then, through univariate and multivariate analyses, independent risk factors closely associated with complications were identified. Finally, we built a three-parameter prediction system and evaluated its ability to predict AP complications.

RESULTS

Compared with the group without complications, the patients in the complication group had higher white blood cells, neutrophils, C-reactive protein, and erythrocyte sedimentation rate (ESR), and lower red blood cells and hemoglobin (Hb) (all p < .05), and most of them had severe pancreatitis. In addition, pseudocysts were more common in patients with alcoholic etiology, recurrence, low BMI, and high platelet (PLT) and plateletocrit. Acute respiratory failure was more common in patients with first onset and high mean PLT volume (MPV). Sepsis was more common in patients with lipogenic etiology, high MPV, and low lymphocytes. Infectious pancreatic necrosis was more common in patients with alcoholic etiology. Acute renal failure was more common in patients with monocytes and high MPV and low PLT. Multivariate analysis showed that PLT and ESR were risk factors for pseudocyst development. The ROC showed that the combination of Hb, PLT and ESR had a significantly higher predictive ability for pseudocyst than the single parameter.

CONCLUSION

Routine blood parameters can be used to predict the complications of AP. A predictive model combining ESR, PLT, and Hb may be an effective tool for identifying pseudocysts in AP patients.