1
|
Li X, Wang Z, Zhao W, Shi R, Zhu Y, Pan H, Wang D. Machine learning algorithm for predict the in-hospital mortality in critically ill patients with congestive heart failure combined with chronic kidney disease. Ren Fail 2024; 46:2315298. [PMID: 38357763 PMCID: PMC10877653 DOI: 10.1080/0886022x.2024.2315298] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/24/2023] [Accepted: 02/01/2024] [Indexed: 02/16/2024] Open
Abstract
BACKGROUND The objective of this study was to develop and validate a machine learning (ML) model for predict in-hospital mortality among critically ill patients with congestive heart failure (CHF) combined with chronic kidney disease (CKD). METHODS After employing least absolute shrinkage and selection operator regression for feature selection, six distinct methodologies were employed in the construction of the model. The selection of the optimal model was based on the area under the curve (AUC). Furthermore, the interpretation of the chosen model was facilitated through the utilization of SHapley Additive exPlanation (SHAP) values and the Local Interpretable Model-Agnostic Explanations (LIME) algorithm. RESULTS This study collected data and enrolled 5041 patients on CHF combined with CKD from 2008 to 2019, utilizing the Medical Information Mart for Intensive Care Unit. After selection, 22 of the 47 variables collected post-intensive care unit admission were identified as mortality-associated and subsequently utilized in the development of ML models. Among the six models generated, the eXtreme Gradient Boosting (XGBoost) model demonstrated the highest AUC at 0.837. Notably, the SHAP values highlighted the sequential organ failure assessment score, age, simplified acute physiology score II, and urine output as the four most influential variables in the XGBoost model. In addition, the LIME algorithm explains the individualized predictions. CONCLUSIONS In conclusion, our study accomplished the successful development and validation of ML models for predicting in-hospital mortality in critically ill patients with CHF combined with CKD. Notably, the XGBoost model emerged as the most efficacious among all the ML models employed.
Collapse
Affiliation(s)
- Xunliang Li
- Department of Nephrology, The Second Affiliated Hospital of Anhui Medical University, Hefei, China
- Institute of Kidney Disease, Inflammation and Immunity Mediated Diseases, The Second Affiliated Hospital of Anhui Medical University, Hefei, China
| | - Zhijuan Wang
- Department of Nephrology, The Second Affiliated Hospital of Anhui Medical University, Hefei, China
- Institute of Kidney Disease, Inflammation and Immunity Mediated Diseases, The Second Affiliated Hospital of Anhui Medical University, Hefei, China
| | - Wenman Zhao
- Department of Nephrology, The Second Affiliated Hospital of Anhui Medical University, Hefei, China
- Institute of Kidney Disease, Inflammation and Immunity Mediated Diseases, The Second Affiliated Hospital of Anhui Medical University, Hefei, China
| | - Rui Shi
- Department of Nephrology, The Second Affiliated Hospital of Anhui Medical University, Hefei, China
- Institute of Kidney Disease, Inflammation and Immunity Mediated Diseases, The Second Affiliated Hospital of Anhui Medical University, Hefei, China
| | - Yuyu Zhu
- Department of Nephrology, The Second Affiliated Hospital of Anhui Medical University, Hefei, China
- Institute of Kidney Disease, Inflammation and Immunity Mediated Diseases, The Second Affiliated Hospital of Anhui Medical University, Hefei, China
| | - Haifeng Pan
- Institute of Kidney Disease, Inflammation and Immunity Mediated Diseases, The Second Affiliated Hospital of Anhui Medical University, Hefei, China
- Department of Epidemiology and Biostatistics, School of Public Health, Anhui Medical University, Hefei, China
- Inflammation and Immune Mediated Diseases Laboratory of Anhui Province, Hefei, China
| | - Deguang Wang
- Department of Nephrology, The Second Affiliated Hospital of Anhui Medical University, Hefei, China
- Institute of Kidney Disease, Inflammation and Immunity Mediated Diseases, The Second Affiliated Hospital of Anhui Medical University, Hefei, China
| |
Collapse
|
2
|
Zuo Y, Liu Q, Li N, Li P, Fang Y, Bian L, Zhang J, Song S. Explainable 18F-FDG PET/CT radiomics model for predicting EGFR mutation status in lung adenocarcinoma: a two-center study. J Cancer Res Clin Oncol 2024; 150:469. [PMID: 39436414 PMCID: PMC11496337 DOI: 10.1007/s00432-024-05998-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/01/2024] [Accepted: 10/14/2024] [Indexed: 10/23/2024]
Abstract
PURPOSE To establish an explainable 18F-FDG PET/CT-derived prediction model to identify EGFR mutation status and subtypes (EGFR wild, EGFR-E19, and EGFR-E21) in lung adenocarcinoma (LUAD). METHODS Baseline 18F-FDG PET/CT images of 478 patients with LUAD from 2 hospitals were collected. Data from hospital A (n = 390) was randomly split into a training group (n = 312) and an internal test group (n = 78), with data from hospital B (n = 88) utilized for external test. Further, a total of 4,760 handcrafted radiomics features (HRFs) were extracted from PET/CT scans. Candidates for the prediction model were constructed by cross-combinations of 11 feature selection methods and 7 classifiers. The optimal model was determined by combining the results of cross-center data validation and model visualization (Yellowbrick). The predictive performance was assessed via receiver operating characteristic curve, confusion matrix and classification report. Four explainable artificial intelligence technologies were used for optimal model interpretation. RESULTS Sex and SUVmax were selected as clinical risk factors, which were then combined with 8 robust PET/CT HRFs to establish the models. The optimal performance was obtained by combining a light gradient boosting machine classifier with random forest feature selection method achieving an optimal performance with a macro-average AUC of 0.75 in the internal test group and 0.81 in the external test group. CONCLUSION The explainable EGFR mutation status prediction model have certain clinical practicability and good generalization performance, which may help in the timely selection of treatment options and prognosis prediction in patients with LUAD.
Collapse
Affiliation(s)
- Yan Zuo
- Department of Nuclear Medicine, Fudan University Shanghai Cancer Center, Fudan University, Shanghai, 200032, P. R. China
- Shanghai Key Laboratory of Bioactive Small Molecules, Fudan University, Shanghai, 200032, P. R. China
- Department of Oncology, Shanghai Medical College, Fudan University, shanghai, 200032, P. R. China
- Center for Biomedical Imaging, Fudan University, shanghai, 200032, P. R. China
- Shanghai Engineering Research Center of Molecular Imaging Probes, shanghai, 200032, P. R. China
- Key Laboratory of Nuclear Physics and Ion-beam Application (MOE), Fudan University, shanghai, 200433, P. R. China
| | - Qiufang Liu
- Department of Nuclear Medicine, Fudan University Shanghai Cancer Center, Fudan University, Shanghai, 200032, P. R. China
- Department of Oncology, Shanghai Medical College, Fudan University, shanghai, 200032, P. R. China
- Center for Biomedical Imaging, Fudan University, shanghai, 200032, P. R. China
- Shanghai Engineering Research Center of Molecular Imaging Probes, shanghai, 200032, P. R. China
- Key Laboratory of Nuclear Physics and Ion-beam Application (MOE), Fudan University, shanghai, 200433, P. R. China
| | - Nan Li
- Department of Nuclear Medicine, Fudan University Shanghai Cancer Center, Fudan University, Shanghai, 200032, P. R. China
- Department of Oncology, Shanghai Medical College, Fudan University, shanghai, 200032, P. R. China
- Center for Biomedical Imaging, Fudan University, shanghai, 200032, P. R. China
- Shanghai Engineering Research Center of Molecular Imaging Probes, shanghai, 200032, P. R. China
- Key Laboratory of Nuclear Physics and Ion-beam Application (MOE), Fudan University, shanghai, 200433, P. R. China
| | - Panli Li
- Department of Nuclear Medicine, Fudan University Shanghai Cancer Center, Fudan University, Shanghai, 200032, P. R. China
- Shanghai Key Laboratory of Bioactive Small Molecules, Fudan University, Shanghai, 200032, P. R. China
- Department of Oncology, Shanghai Medical College, Fudan University, shanghai, 200032, P. R. China
- Center for Biomedical Imaging, Fudan University, shanghai, 200032, P. R. China
- Shanghai Engineering Research Center of Molecular Imaging Probes, shanghai, 200032, P. R. China
- Key Laboratory of Nuclear Physics and Ion-beam Application (MOE), Fudan University, shanghai, 200433, P. R. China
| | - Yichong Fang
- College of Chemistry and Materials Science, Shanghai Normal University, Shanghai, 200233, P. R. China
| | - Linjie Bian
- Department of Nuclear Medicine, Fudan University Shanghai Cancer Center, Fudan University, Shanghai, 200032, P. R. China
- Department of Oncology, Shanghai Medical College, Fudan University, shanghai, 200032, P. R. China
- Center for Biomedical Imaging, Fudan University, shanghai, 200032, P. R. China
- Shanghai Engineering Research Center of Molecular Imaging Probes, shanghai, 200032, P. R. China
- Key Laboratory of Nuclear Physics and Ion-beam Application (MOE), Fudan University, shanghai, 200433, P. R. China
| | - Jianping Zhang
- Department of Nuclear Medicine, Fudan University Shanghai Cancer Center, Fudan University, Shanghai, 200032, P. R. China
- Shanghai Key Laboratory of Bioactive Small Molecules, Fudan University, Shanghai, 200032, P. R. China
- Department of Oncology, Shanghai Medical College, Fudan University, shanghai, 200032, P. R. China
- Center for Biomedical Imaging, Fudan University, shanghai, 200032, P. R. China
- Shanghai Engineering Research Center of Molecular Imaging Probes, shanghai, 200032, P. R. China
- Key Laboratory of Nuclear Physics and Ion-beam Application (MOE), Fudan University, shanghai, 200433, P. R. China
| | - Shaoli Song
- Department of Nuclear Medicine, Fudan University Shanghai Cancer Center, Fudan University, Shanghai, 200032, P. R. China.
- Department of Oncology, Shanghai Medical College, Fudan University, shanghai, 200032, P. R. China.
- Center for Biomedical Imaging, Fudan University, shanghai, 200032, P. R. China.
- Shanghai Engineering Research Center of Molecular Imaging Probes, shanghai, 200032, P. R. China.
- Key Laboratory of Nuclear Physics and Ion-beam Application (MOE), Fudan University, shanghai, 200433, P. R. China.
| |
Collapse
|
3
|
Guo J, Dong R, Zhang R, Yang F, Wang Y, Miao W. Interpretable machine learning model for predicting the prognosis of antibody positive autoimmune encephalitis patients. J Affect Disord 2024; 369:352-363. [PMID: 39374738 DOI: 10.1016/j.jad.2024.10.010] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/18/2024] [Revised: 09/28/2024] [Accepted: 10/02/2024] [Indexed: 10/09/2024]
Abstract
OBJECTIVE The objective was to utilize nine machine learning (ML) methods to predict the prognosis of antibody positive autoimmune encephalitis (AE) patients. METHODS The encephalitis data from the Global Burden of Disease (GBD) study is analyzed to reflect the disease burden of encephalitis. This study included 187 patients with AE. 121 patients as training set and 67 patients as validation set. Decision trees (DT), random forest (RF), extreme gradient boosting (XGBoost), k-nearest neighbor (KNN), support vector machine (SVM), naive bayes (NB), neural network (NN), light gradient boosting machine (LGBM), and logistic regression (LR) are ML methods used to construct predictive models. The constructed models were validated for discrimination, calibration and clinical applicability using validation set data. Shapley additive explanation (SHAP) analysis was used to explain the model. RESULTS The number of encephalitis worldwide deaths, incidence and prevalence is increasing every year from 2010 to 2021. The training set included 121 patients with AE. Univariate analysis and LASSO screening identified six variables. The results of constructing models using 9 ML methods showed RF had the highest accuracy (0.860), followed by XGBoost (0.826), with F1 scores of 0.844 and 0.807, respectively. Validation set data showed good discrimination, calibration and clinical applicability of the model. The SHAP values of infection, CSF monocyte percentage, and prealbumin were 0.906, 0.790, and 0.644, respectively. LIMITATIONS As a rare disease, the sample size of this study is relatively small. CONCLUSION The model constructed using RF and XGBoost has good performance, good discrimination, calibration, clinical applicability, and interpretability.
Collapse
Affiliation(s)
- Junshuang Guo
- Neuro-Intensive Care Unit of the First Affiliated Hospital of Zhengzhou University, Zhengzhou, Henan Province, China; Department of Immunology, School of Basic Medical Science, Central South University, Changsha City, Hunan Province, China
| | - Ruirui Dong
- Neuro-Intensive Care Unit of the First Affiliated Hospital of Zhengzhou University, Zhengzhou, Henan Province, China
| | - Ruike Zhang
- Neuro-Intensive Care Unit of the First Affiliated Hospital of Zhengzhou University, Zhengzhou, Henan Province, China
| | - Fan Yang
- Neuro-Intensive Care Unit of the First Affiliated Hospital of Zhengzhou University, Zhengzhou, Henan Province, China
| | - Yating Wang
- Neuro-Intensive Care Unit of the First Affiliated Hospital of Zhengzhou University, Zhengzhou, Henan Province, China
| | - Wang Miao
- Neuro-Intensive Care Unit of the First Affiliated Hospital of Zhengzhou University, Zhengzhou, Henan Province, China.
| |
Collapse
|
4
|
Raina R, Nada A, Shah R, Aly H, Kadatane S, Abitbol C, Aggarwal M, Koyner J, Neyra J, Sethi SK. Artificial intelligence in early detection and prediction of pediatric/neonatal acute kidney injury: current status and future directions. Pediatr Nephrol 2024; 39:2309-2324. [PMID: 37889281 DOI: 10.1007/s00467-023-06191-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/01/2023] [Revised: 08/27/2023] [Accepted: 09/26/2023] [Indexed: 10/28/2023]
Abstract
Acute kidney injury (AKI) has a significant impact on the short-term and long-term clinical outcomes of pediatric and neonatal patients, and it is imperative in these populations to mitigate the pathways leading to AKI and be prepared for early diagnosis and treatment intervention of established AKI. Recently, artificial intelligence (AI) has provided more advent predictive models for early detection/prediction of AKI utilizing machine learning (ML). By providing strong detail and evidence from risk scores and electronic alerts, this review outlines a comprehensive and holistic insight into the current state of AI in AKI in pediatric/neonatal patients. In the pediatric population, AI models including XGBoost, logistic regression, support vector machines, decision trees, naïve Bayes, and risk stratification scores (Renal Angina Index (RAI), Nephrotoxic Injury Negated by Just-in-time Action (NINJA)) have shown success in predicting AKI using variables like serum creatinine, urine output, and electronic health record (EHR) alerts. Similarly, in the neonatal population, using the "Baby NINJA" model showed a decrease in nephrotoxic medication exposure by 42%, the rate of AKI by 78%, and the number of days with AKI by 68%. Furthermore, the "STARZ" risk stratification AI model showed a predictive ability of AKI within 7 days of NICU admission of AUC 0.93 and AUC of 0.96 in the validation and derivation cohorts, respectively. Many studies have reported the superiority of using biomarkers to predict AKI in pediatric patients and neonates as well. Future directions include the application of AI along with biomarkers (NGAL, CysC, OPN, IL-18, B2M, etc.) in a Labelbox configuration to create a more robust and accurate model for predicting and detecting pediatric/neonatal AKI.
Collapse
Affiliation(s)
- Rupesh Raina
- Akron Nephrology Associates/Cleveland Clinic Akron General Medical Center, Akron, OH, USA.
- Department of Nephrology, Akron Children's Hospital, Akron, OH, USA.
- Department of Medicine, Northeast Ohio Medical University, Rootstown, OH, USA.
| | - Arwa Nada
- Le Bonheur Children's Hospital & St. Jude Research Hospital, The University of Tennessee Health Science Center, Memphis, TN, USA
| | - Raghav Shah
- Akron Nephrology Associates/Cleveland Clinic Akron General Medical Center, Akron, OH, USA
- Department of Medicine, Northeast Ohio Medical University, Rootstown, OH, USA
| | - Hany Aly
- Department of Neonatology, Cleveland Clinic Children's, Cleveland, OH, USA
| | - Saurav Kadatane
- Department of Medicine, Northeast Ohio Medical University, Rootstown, OH, USA
| | - Carolyn Abitbol
- Department of Pediatrics, Division of Pediatric Nephrology, University of Miami Miller School of Medicine/Holtz Children's Hospital, Miami, FL, USA
| | - Mihika Aggarwal
- Paediatric Nephrology & Paediatric Kidney Transplantation, Kidney and Urology Institute, Medanta, The Medicity Hospital, Gurgaon, India
| | - Jay Koyner
- Section of Nephrology, Department of Medicine, University of Chicago, Pritzker School of Medicine, Chicago, IL, USA
| | - Javier Neyra
- Department of Medicine, Division of Nephrology, University of Alabama at Birmingham, Birmingham, AL, USA
| | - Sidharth Kumar Sethi
- Paediatric Nephrology & Paediatric Kidney Transplantation, Kidney and Urology Institute, Medanta, The Medicity Hospital, Gurgaon, India
| |
Collapse
|
5
|
He B, Qiu Z. Development and validation of an interpretable machine learning for mortality prediction in patients with sepsis. Front Artif Intell 2024; 7:1348907. [PMID: 39040922 PMCID: PMC11262051 DOI: 10.3389/frai.2024.1348907] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/03/2023] [Accepted: 06/26/2024] [Indexed: 07/24/2024] Open
Abstract
Introduction Sepsis is a leading cause of death. However, there is a lack of useful model to predict outcome in sepsis. Herein, the aim of this study was to develop an explainable machine learning (ML) model for predicting 28-day mortality in patients with sepsis based on Sepsis 3.0 criteria. Methods We obtained the data from the Medical Information Mart for Intensive Care (MIMIC)-III database (version 1.4). The overall data was randomly assigned to the training and testing sets at a ratio of 3:1. Following the application of LASSO regression analysis to identify the modeling variables, we proceeded to develop models using Extreme Gradient Boost (XGBoost), Logistic Regression (LR), Support Vector Machine (SVM), and Random Forest (RF) techniques with 5-fold cross-validation. The optimal model was selected based on its area under the curve (AUC). Finally, the Shapley additive explanations (SHAP) method was used to interpret the optimal model. Results A total of 5,834 septic adults were enrolled, the median age was 66 years (IQR, 54-78 years) and 2,342 (40.1%) were women. After feature selection, 14 variables were included for developing model in the training set. The XGBoost model (AUC: 0.806) showed superior performance with AUC, compared with RF (AUC: 0.794), LR (AUC: 0.782) and SVM model (AUC: 0.687). SHAP summary analysis for XGBoost model showed that urine output on day 1, age, blood urea nitrogen and body mass index were the top four contributors. SHAP dependence analysis demonstrated insightful nonlinear interactive associations between factors and outcome. SHAP force analysis provided three samples for model prediction. Conclusion In conclusion, our study successfully demonstrated the efficacy of ML models in predicting 28-day mortality in sepsis patients, while highlighting the potential of the SHAP method to enhance model transparency and aid in clinical decision-making.
Collapse
Affiliation(s)
- Bihua He
- Department of Neurology, Third People's Hospital of Hubei Province, Wuhan, China
- Department of Neurology, Hubei NO. 3 People’s Hospital of Jianghan University, Wuhan, China
| | - Zheng Qiu
- Department of Neurology, Third People's Hospital of Hubei Province, Wuhan, China
- Department of Neurology, Hubei NO. 3 People’s Hospital of Jianghan University, Wuhan, China
| |
Collapse
|
6
|
Li X, Wang P, Zhu Y, Zhao W, Pan H, Wang D. Interpretable machine learning model for predicting acute kidney injury in critically ill patients. BMC Med Inform Decis Mak 2024; 24:148. [PMID: 38822285 PMCID: PMC11140965 DOI: 10.1186/s12911-024-02537-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/03/2023] [Accepted: 05/17/2024] [Indexed: 06/02/2024] Open
Abstract
BACKGROUND This study aimed to create a method for promptly predicting acute kidney injury (AKI) in intensive care patients by applying interpretable, explainable artificial intelligence techniques. METHODS Population data regarding intensive care patients were derived from the Medical Information Mart for Intensive Care IV database from 2008 to 2019. Machine learning (ML) techniques with six methods were created to construct the predicted models for AKI. The performance of each ML model was evaluated by comparing the areas under the curve (AUC). Local Interpretable Model-Agnostic Explanations (LIME) method and Shapley Additive exPlanation values were used to decipher the best model. RESULTS According to inclusion and exclusion criteria, 53,150 severely sick individuals were included in the present study, of which 42,520 (80%) were assigned to the training group, and 10,630 (20%) were allocated to the validation group. Compared to the other five ML models, the eXtreme Gradient Boosting (XGBoost) model greatly predicted AKI following ICU admission, with an AUC of 0.816. The top four contributing variables of the XGBoost model were SOFA score, weight, mechanical ventilation, and the Simplified Acute Physiology Score II. An AKI and Non-AKI cases were predicted separately using the LIME algorithm. CONCLUSION Overall, the constructed clinical feature-based ML models are excellent in predicting AKI in intensive care patients. It would be constructive for physicians to provide early support and timely intervention measures to intensive care patients at risk of AKI.
Collapse
Affiliation(s)
- Xunliang Li
- Department of Nephrology, The Second Affiliated Hospital of Anhui Medical University, Hefei, China
| | - Peng Wang
- Teaching Center for Preventive Medicine, School of Public Health, Anhui Medical University, Hefei, China
| | - Yuke Zhu
- Department of Nephrology, The Second Affiliated Hospital of Anhui Medical University, Hefei, China
| | - Wenman Zhao
- Department of Nephrology, The Second Affiliated Hospital of Anhui Medical University, Hefei, China
| | - Haifeng Pan
- Department of Epidemiology and Biostatistics, School of Public Health, Anhui Medical University, Hefei, China
| | - Deguang Wang
- Department of Nephrology, The Second Affiliated Hospital of Anhui Medical University, Hefei, China.
| |
Collapse
|
7
|
Tang D, Ma C, Xu Y. Interpretable machine learning model for early prediction of delirium in elderly patients following intensive care unit admission: a derivation and validation study. Front Med (Lausanne) 2024; 11:1399848. [PMID: 38828233 PMCID: PMC11140063 DOI: 10.3389/fmed.2024.1399848] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/12/2024] [Accepted: 04/22/2024] [Indexed: 06/05/2024] Open
Abstract
Background and objective Delirium is the most common neuropsychological complication among older adults admitted to the intensive care unit (ICU) and is often associated with a poor prognosis. This study aimed to construct and validate an interpretable machine learning (ML) for early delirium prediction in older ICU patients. Methods This was a retrospective observational cohort study and patient data were extracted from the Medical Information Mart for Intensive Care-IV database. Feature variables associated with delirium, including predisposing factors, disease-related factors, and iatrogenic and environmental factors, were selected using least absolute shrinkage and selection operator regression, and prediction models were built using logistic regression, decision trees, support vector machines, extreme gradient boosting (XGBoost), k-nearest neighbors and naive Bayes methods. Multiple metrics were used for evaluation of performance of the models, including the area under the receiver operating characteristic curve (AUC), accuracy, sensitivity, specificity, recall, F1 score, calibration plot, and decision curve analysis. SHapley Additive exPlanations (SHAP) were used to improve the interpretability of the final model. Results Nine thousand seven hundred forty-eight adults aged 65 years or older were included for analysis. Twenty-six features were selected to construct ML prediction models. Among the models compared, the XGBoost model demonstrated the best performance including the highest AUC (0.836), accuracy (0.765), sensitivity (0.713), recall (0.713), and F1 score (0.725) in the training set. It also exhibited excellent discrimination with AUC of 0.810, good calibration, and had the highest net benefit in the validation cohort. The SHAP summary analysis showed that Glasgow Coma Scale, mechanical ventilation, and sedation were the top three risk features for outcome prediction. The SHAP dependency plot and SHAP force analysis interpreted the model at both the factor level and individual level, respectively. Conclusion ML is a reliable tool for predicting the risk of critical delirium in elderly patients. By combining XGBoost and SHAP, it can provide clear explanations for personalized risk prediction and more intuitive understanding of the effect of key features in the model. The establishment of such a model would facilitate the early risk assessment and prompt intervention for delirium.
Collapse
Affiliation(s)
| | - Chengyong Ma
- Department of Critical Care Medicine, West China Hospital, Sichuan University, Chengdu, China
| | - Yu Xu
- Department of Critical Care Medicine, West China Hospital, Sichuan University, Chengdu, China
| |
Collapse
|
8
|
Zhang K, Han Y, Gao YX, Gu FM, Cai T, Gu ZX, Yu ZJ, Min G, Gao YF, Hu R, Huang MX. Association between the triglyceride glucose index and length of hospital stay in patients with heart failure and type 2 diabetes in the intensive care unit: a retrospective cohort study. Front Endocrinol (Lausanne) 2024; 15:1354614. [PMID: 38800470 PMCID: PMC11127565 DOI: 10.3389/fendo.2024.1354614] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/12/2023] [Accepted: 03/25/2024] [Indexed: 05/29/2024] Open
Abstract
Background The coexistence of heart failure and diabetes is prevalent, particularly in Intensive Care Units (ICU). However, the relationship between the triglyceride-glucose (TyG) index, heart failure, diabetes, and the length of hospital stay (LHS) in patients with cerebrovascular disease in the ICU remains uncertain. This study aims to investigate the association between the TyG index and LHS in patients with heart failure and diabetes. Methods This retrospective study utilized the Medical Information Mart for Intensive Care (MIMIC)-IV database to analyze patients with diabetes and heart failure. Participants were categorized into quartiles based on the TyG index, and the primary outcome was LHS. The association between the TyG index at ICU admission and LHS was examined through multivariable logistic regression models, restricted cubic spline regression, and subgroup analysis. Results The study included 635 patients with concurrent diabetes and heart failure. The fully adjusted model demonstrated a positive association between the TyG index and LHS. As a tertile variable (Q2 and Q3 vs Q1), the beta (β) values were 0.88 and 2.04, with a 95% confidence interval (95%CI) of -0.68 to 2.44 and 0.33 to 3.74, respectively. As a continuous variable, per 1 unit increment, the β (95% CI) was 1.13 (0.18 to 2.08). The TyG index's relationship with LHS showed linearity (non-linear p = 0.751). Stratified analyses further confirmed the robustness of this correlation. Conclusion The TyG index exhibited a linearly positive association with the LHS in patients with both heart failure and diabetes. Nevertheless, prospective, randomized, controlled studies are imperative to substantiate and validate the findings presented in this investigation.
Collapse
Affiliation(s)
- Kai Zhang
- Cardiovascular Surgery Department, The Second Hospital of Jilin University, Changchun, China
| | - Yu Han
- Department of Ophthalmology, First Hospital of Jilin University, Changchun, China
| | - Yu Xuan Gao
- Cardiovascular Surgery Department, The Second Hospital of Jilin University, Changchun, China
| | - Fang Ming Gu
- Cardiovascular Surgery Department, The Second Hospital of Jilin University, Changchun, China
| | - Tianyi Cai
- Department of Ophthalmology, Second Hospital of Jilin University, Changchun, China
| | - Zhao Xuan Gu
- Cardiovascular Surgery Department, The Second Hospital of Jilin University, Changchun, China
| | - Zhao Jia Yu
- Cardiovascular Surgery Department, The Second Hospital of Jilin University, Changchun, China
| | - Gao Min
- Department of Cancer Center, The First Hospital of Jilin University, Changchun, China
| | - Ya Fang Gao
- Department of Ophthalmology, Second Hospital of Jilin University, Changchun, China
| | - Rui Hu
- Department of Ophthalmology, Second Hospital of Jilin University, Changchun, China
| | - Mao Xun Huang
- Cardiovascular Surgery Department, The Second Hospital of Jilin University, Changchun, China
| |
Collapse
|
9
|
Hu C, Gao C, Li T, Liu C, Peng Z. Explainable artificial intelligence model for mortality risk prediction in the intensive care unit: a derivation and validation study. Postgrad Med J 2024; 100:219-227. [PMID: 38244550 DOI: 10.1093/postmj/qgad144] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/28/2023] [Revised: 12/11/2023] [Accepted: 12/18/2023] [Indexed: 01/22/2024]
Abstract
BACKGROUND The lack of transparency is a prevalent issue among the current machine-learning (ML) algorithms utilized for predicting mortality risk. Herein, we aimed to improve transparency by utilizing the latest ML explicable technology, SHapley Additive exPlanation (SHAP), to develop a predictive model for critically ill patients. METHODS We extracted data from the Medical Information Mart for Intensive Care IV database, encompassing all intensive care unit admissions. We employed nine different methods to develop the models. The most accurate model, with the highest area under the receiver operating characteristic curve, was selected as the optimal model. Additionally, we used SHAP to explain the workings of the ML model. RESULTS The study included 21 395 critically ill patients, with a median age of 68 years (interquartile range, 56-79 years), and most patients were male (56.9%). The cohort was randomly split into a training set (N = 16 046) and a validation set (N = 5349). Among the nine models developed, the Random Forest model had the highest accuracy (87.62%) and the best area under the receiver operating characteristic curve value (0.89). The SHAP summary analysis showed that Glasgow Coma Scale, urine output, and blood urea nitrogen were the top three risk factors for outcome prediction. Furthermore, SHAP dependency analysis and SHAP force analysis were used to interpret the Random Forest model at the factor level and individual level, respectively. CONCLUSION A transparent ML model for predicting outcomes in critically ill patients using SHAP methodology is feasible and effective. SHAP values significantly improve the explainability of ML models.
Collapse
Affiliation(s)
- Chang Hu
- Department of Critical Care Medicine, Zhongnan Hospital of Wuhan University, Wuhan 430071, Hubei, China
- Clinical Research Center of Hubei Critical Care Medicine, Wuhan 430071, Hubei, China
| | - Chao Gao
- Department of Critical Care Medicine, Zhongnan Hospital of Wuhan University, Wuhan 430071, Hubei, China
- Clinical Research Center of Hubei Critical Care Medicine, Wuhan 430071, Hubei, China
| | - Tianlong Li
- Department of Critical Care Medicine, Zhongnan Hospital of Wuhan University, Wuhan 430071, Hubei, China
- Clinical Research Center of Hubei Critical Care Medicine, Wuhan 430071, Hubei, China
| | - Chang Liu
- Department of Critical Care Medicine, Zhongnan Hospital of Wuhan University, Wuhan 430071, Hubei, China
- Clinical Research Center of Hubei Critical Care Medicine, Wuhan 430071, Hubei, China
| | - Zhiyong Peng
- Department of Critical Care Medicine, Zhongnan Hospital of Wuhan University, Wuhan 430071, Hubei, China
- Clinical Research Center of Hubei Critical Care Medicine, Wuhan 430071, Hubei, China
| |
Collapse
|
10
|
Singer P, Robinson E, Raphaeli O. The future of artificial intelligence in clinical nutrition. Curr Opin Clin Nutr Metab Care 2024; 27:200-206. [PMID: 37650706 DOI: 10.1097/mco.0000000000000977] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 09/01/2023]
Abstract
PURPOSE OF REVIEW Artificial intelligence has reached the clinical nutrition field. To perform personalized medicine, numerous tools can be used. In this review, we describe how the physician can utilize the growing healthcare databases to develop deep learning and machine learning algorithms, thus helping to improve screening, assessment, prediction of clinical events and outcomes related to clinical nutrition. RECENT FINDINGS Artificial intelligence can be applied to all the fields of clinical nutrition. Improving screening tools, identifying malnourished cancer patients or obesity using large databases has been achieved. In intensive care, machine learning has been able to predict enteral feeding intolerance, diarrhea, or refeeding hypophosphatemia. The outcome of patients with cancer can also be improved. Microbiota and metabolomics profiles are better integrated with the clinical condition using machine learning. However, ethical considerations and limitations of the use of artificial intelligence should be considered. SUMMARY Artificial intelligence is here to support the decision-making process of health professionals. Knowing not only its limitations but also its power will allow precision medicine in clinical nutrition as well as in the rest of the medical practice.
Collapse
Affiliation(s)
- Pierre Singer
- Herzlia Medical Center, Intensive Care Unit, Herzlia
- Critical Care Department and Institute for Nutrition Research, Rabin Medical Center, Beilinson Hospital, affiliated to the Sackler School of Medicine, Tel Aviv University, Tel Aviv
| | - Eyal Robinson
- Critical Care Department and Institute for Nutrition Research, Rabin Medical Center, Beilinson Hospital, affiliated to the Sackler School of Medicine, Tel Aviv University, Tel Aviv
| | - Orit Raphaeli
- Critical Care Department and Institute for Nutrition Research, Rabin Medical Center, Beilinson Hospital, affiliated to the Sackler School of Medicine, Tel Aviv University, Tel Aviv
- Ariel University, Department of Industrial Engineering & Management, Ariel, Israel
| |
Collapse
|
11
|
Ghosh SK, Khandoker AH. Investigation on explainable machine learning models to predict chronic kidney diseases. Sci Rep 2024; 14:3687. [PMID: 38355876 PMCID: PMC10866953 DOI: 10.1038/s41598-024-54375-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/11/2023] [Accepted: 02/12/2024] [Indexed: 02/16/2024] Open
Abstract
Chronic kidney disease (CKD) is a major worldwide health problem, affecting a large proportion of the world's population and leading to higher morbidity and death rates. The early stages of CKD sometimes present without visible symptoms, causing patients to be unaware. Early detection and treatments are critical in reducing complications and improving the overall quality of life for people afflicted. In this work, we investigate the use of an explainable artificial intelligence (XAI)-based strategy, leveraging clinical characteristics, to predict CKD. This study collected clinical data from 491 patients, comprising 56 with CKD and 435 without CKD, encompassing clinical, laboratory, and demographic variables. To develop the predictive model, five machine learning (ML) methods, namely logistic regression (LR), random forest (RF), decision tree (DT), Naïve Bayes (NB), and extreme gradient boosting (XGBoost), were employed. The optimal model was selected based on accuracy and area under the curve (AUC). Additionally, the SHAP (SHapley Additive exPlanations) and LIME (Local Interpretable Model-agnostic Explanations) algorithms were utilized to demonstrate the influence of the features on the optimal model. Among the five models developed, the XGBoost model achieved the best performance with an AUC of 0.9689 and an accuracy of 93.29%. The analysis of feature importance revealed that creatinine, glycosylated hemoglobin type A1C (HgbA1C), and age were the three most influential features in the XGBoost model. The SHAP force analysis further illustrated the model's visualization of individualized CKD predictions. For further insights into individual predictions, we also utilized the LIME algorithm. This study presents an interpretable ML-based approach for the early prediction of CKD. The SHAP and LIME methods enhance the interpretability of ML models and help clinicians better understand the rationale behind the predicted outcomes more effectively.
Collapse
Affiliation(s)
- Samit Kumar Ghosh
- Department of Biomedical Engineering & Biotechnology, Khalifa University, Abu Dhabi, United Arab Emirates.
| | - Ahsan H Khandoker
- Department of Biomedical Engineering & Biotechnology, Khalifa University, Abu Dhabi, United Arab Emirates
| |
Collapse
|
12
|
Tian J, Cui R, Song H, Zhao Y, Zhou T. Prediction of acute kidney injury in patients with liver cirrhosis using machine learning models: evidence from the MIMIC-III and MIMIC-IV. Int Urol Nephrol 2024; 56:237-247. [PMID: 37256426 DOI: 10.1007/s11255-023-03646-6] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/02/2023] [Accepted: 05/23/2023] [Indexed: 06/01/2023]
Abstract
PURPOSE To develop and validate a machine learning (ML)-based prediction model for acute kidney injury (AKI) in patients with liver cirrhosis. METHODS Data on liver cirrhosis patients were extracted from the Medical Information Mart for Intensive Care III (MIMIC-III) and MIMIC-IV databases in this retrospective cohort study. ML algorithms, including random forest (RF), extreme gradient boosting (XGB), light gradient boosting machine (LGBM), and gradient boosting decision tree (GBDT) were applied to construct prediction models. Predictors were screened via univariate logistic regression, and then the models were developed with all data of the included patients. A bootstrap resampling method was adopted to validate the models. The predictive abilities of our final model were compared with those of the sequential organ failure assessment score (SOFA), simplified acute physiology score II (SAPS II), Model for End-stage Liver Disease (MELD), and MELD Na. RESULTS This study included 950 patients, of which 429 (45.16%) had AKI. Mechanical ventilation, vasopressor, international normalized ratio (INR), bilirubin, Charlson comorbidity index (CCI), prothrombin time (PT), estimated glomerular filtration rate (EGFR), partial thromboplastin time (PTT), and heart rate served as predictors. In the derivation set, the developed RF [area under curve (AUC) = 0.747], XGB (AUC = 0.832), LGBM (AUC = 0.785), and GBDT (AUC = 0.811) models exhibited significantly greater predictive performance than the logistic regression model (AUC = 0.699) (all P < 0.05). Among the ML-based models, the XGB model had the greatest AUC. In internal validation, the predictive capacity of the XGB model (AUC = 0.833) was significantly superior to that of the logistic regression model (AUC = 0.701) (P = 0.045). Hence, the XGB model was selected as the final model for AKI prediction. In contrast to the XGB model (AUC = 0.832), the SOFA (AUC = 0.609), MELD (AUC = 0.690), MELD Na (AUC = 0.690), and SAPS II (AUC = 0.641) had significantly lower predictive abilities in the derivation set (all P < 0.001). The XGB model was internally validated to have an AUC of 0.833, which was significantly higher than the SOFA (AUC = 0.609), MELD (AUC = 0.690), MELD Na (AUC = 0.688), and SAPS II (AUC = 0.641) (all P < 0.05). CONCLUSION The XGB model had a better performance than the logistic regression model, SOFA, MELD, MELD Na, and SAPS II in AKI prediction for cirrhosis patients, which may help identify patients at a risk of AKI, and then provide timely interventions.
Collapse
Affiliation(s)
- Jia Tian
- Department of Nephrology, The Fourth Affiliated Hospital of Harbin Medical University, Harbin, 150001, Heilongjiang, People's Republic of China
| | - Rui Cui
- Department of Nephrology, The Fourth Affiliated Hospital of Harbin Medical University, Harbin, 150001, Heilongjiang, People's Republic of China
| | - Huinan Song
- Department of Nephrology, The Fourth Affiliated Hospital of Harbin Medical University, Harbin, 150001, Heilongjiang, People's Republic of China
| | - Yingzi Zhao
- Department of Nephrology, The Fourth Affiliated Hospital of Harbin Medical University, Harbin, 150001, Heilongjiang, People's Republic of China
| | - Ting Zhou
- The Ward No. 2, Department of Gastroenterology, The Fourth Affiliated Hospital of Harbin Medical University, No. 37 Yiyuan Street, Nangang District, Harbin, 150001, Heilongjiang, People's Republic of China.
| |
Collapse
|
13
|
Lang FF, Liu LY, Wang SW. Predictive modeling of perioperative blood transfusion in lumbar posterior interbody fusion using machine learning. Front Physiol 2023; 14:1306453. [PMID: 38187137 PMCID: PMC10767743 DOI: 10.3389/fphys.2023.1306453] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/04/2023] [Accepted: 11/06/2023] [Indexed: 01/09/2024] Open
Abstract
Background: Accurate estimation of perioperative blood transfusion risk in lumbar posterior interbody fusion is essential to reduce the number, cost, and complications associated with blood transfusions. Machine learning algorithms have the potential to outperform traditional prediction methods in predicting perioperative blood transfusion. This study aimed to construct a machine learning-based perioperative transfusion risk prediction model for lumbar posterior interbody fusion in order to improve the efficacy of surgical decision-making. Methods: We retrospectively collected clinical data on 1905 patients who underwent lumbar posterior interbody fusion surgery at the Second Hospital of Shanxi Medical University between January 2021 and March 2023. All the data was randomly divided into a training set and a validation set, and the "feature_importances" method provided by eXtreme Gradient Boosting (XGBoost) algorithm was applied to select statistically significant features on the training set to establish five machine learning prediction models. The optimal model was identified by utilizing the area under the curve (AUC) and the probability calibration curve on the validation set. Shapley additive explanations (SHAP) and local interpretable model-agnostic explanations (LIME) were employed for interpretable analysis of the optimal model. Results: In the postoperative outcomes of patients, the number of hospital days in the transfusion group was longer than that in the non-transfusion group. Additionally, the transfusion group experienced higher total hospital costs, 90-day readmission rates, and complication rates within 90 days after surgery than the non-transfusion group. A total of 9 features were selected for the models. The XGBoost model performed best with an AUC value of 0.958. The SHAP values showed that intraoperative blood loss, intraoperative fluid infusion, and number of fused segments were the top 3 most important features affecting perioperative blood transfusion in lumbar posterior interbody fusion. The LIME algorithm was used to interpret the individualized prediction. Conclusion: Surgery, ASA class, levels fused, total intraoperative blood loss, operative time, and preoperative Hb are viable predictors of perioperative blood transfusion in lumbar posterior interbody fusion. The XGBoost model has demonstrated superior predictive efficacy compared to the traditional logistic regression model, making it a more effective decision-making tool for perioperative blood transfusion.
Collapse
Affiliation(s)
- Fang-Fang Lang
- School of Public Health, Shanxi Medical University, Taiyuan, China
| | - Li-Ying Liu
- School of Public Health, Shanxi Medical University, Taiyuan, China
| | - Shao-Wei Wang
- Department of Orthopedics, The Second Hospital of Shanxi Medical University, Taiyuan, China
| |
Collapse
|
14
|
Ali S, Akhlaq F, Imran AS, Kastrati Z, Daudpota SM, Moosa M. The enlightening role of explainable artificial intelligence in medical & healthcare domains: A systematic literature review. Comput Biol Med 2023; 166:107555. [PMID: 37806061 DOI: 10.1016/j.compbiomed.2023.107555] [Citation(s) in RCA: 27] [Impact Index Per Article: 27.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/07/2023] [Revised: 08/13/2023] [Accepted: 09/28/2023] [Indexed: 10/10/2023]
Abstract
In domains such as medical and healthcare, the interpretability and explainability of machine learning and artificial intelligence systems are crucial for building trust in their results. Errors caused by these systems, such as incorrect diagnoses or treatments, can have severe and even life-threatening consequences for patients. To address this issue, Explainable Artificial Intelligence (XAI) has emerged as a popular area of research, focused on understanding the black-box nature of complex and hard-to-interpret machine learning models. While humans can increase the accuracy of these models through technical expertise, understanding how these models actually function during training can be difficult or even impossible. XAI algorithms such as Local Interpretable Model-Agnostic Explanations (LIME) and SHapley Additive exPlanations (SHAP) can provide explanations for these models, improving trust in their predictions by providing feature importance and increasing confidence in the systems. Many articles have been published that propose solutions to medical problems by using machine learning models alongside XAI algorithms to provide interpretability and explainability. In our study, we identified 454 articles published from 2018-2022 and analyzed 93 of them to explore the use of these techniques in the medical domain.
Collapse
Affiliation(s)
- Subhan Ali
- Department of Computer Science, Norwegian University of Science & Technology (NTNU), Gjøvik, 2815, Norway.
| | - Filza Akhlaq
- Department of Computer Science, Sukkur IBA University, Sukkur, 65200, Sindh, Pakistan.
| | - Ali Shariq Imran
- Department of Computer Science, Norwegian University of Science & Technology (NTNU), Gjøvik, 2815, Norway.
| | - Zenun Kastrati
- Department of Informatics, Linnaeus University, Växjö, 351 95, Sweden.
| | | | - Muhammad Moosa
- Department of Computer Science, Norwegian University of Science & Technology (NTNU), Gjøvik, 2815, Norway.
| |
Collapse
|
15
|
Liu Y, Lu Y, Li W, Wang Y, Zhang Z, Yang X, Yang Y, Li R, Zhou X. Prognostic prediction of idiopathic membranous nephropathy using interpretable machine learning. Ren Fail 2023; 45:2251597. [PMID: 37724550 PMCID: PMC10512811 DOI: 10.1080/0886022x.2023.2251597] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/04/2023] [Accepted: 08/19/2023] [Indexed: 09/21/2023] Open
Abstract
BACKGROUND Established prognostic models of idiopathic membranous nephropathy (IMN) were limited to traditional modeling methods and did not comprehensively consider clinical and pathological patient data. Based on the electronic medical record (EMR) system, machine learning (ML) was used to construct a risk prediction model for the prognosis of IMN. METHODS Data from 418 patients with IMN were diagnosed by renal biopsy at the Fifth Clinical Medical College of Shanxi Medical University. Fifty-nine medical features of the patients could be obtained from EMR, and prediction models were established based on five ML algorithms. The area under the curve, recall rate, accuracy, and F1 were used to evaluate and compare the performances of the models. Shapley additive explanation (SHAP) was used to explain the results of the best-performing model. RESULTS One hundred and seventeen patients (28.0%) with IMN experienced adverse events, 28 of them had compound outcomes (ESRD or double serum creatinine (SCr)), and 89 had relapsed. The gradient boosting machine (LightGBM) model had the best performance, with the highest AUC (0.892 ± 0.052, 95% CI 0.840-0.945), accuracy (0.909 ± 0.016), recall (0.741 ± 0.092), precision (0.906 ± 0.027), and F1 (0.905 ± 0.020). Recursive feature elimination with random forest and SHAP plots based on LightGBM showed that anti-phospholipase A2 receptor (anti-PLA2R), immunohistochemical immunoglobulin G4 (IHC IgG4), D-dimer (D-DIMER), triglyceride (TG), serum albumin (ALB), aspartate transaminase (AST), β2-microglobulin (BMG), SCr, and fasting plasma glucose (FPG) were important risk factors for the prognosis of IMN. Increased risk of adverse events in IMN patients was correlated with high anti-PLA2R and low IHC IgG4. CONCLUSIONS This study established a risk prediction model for the prognosis of IMN using ML based on clinical and pathological patient data. The LightGBM model may become a tool for personalized management of IMN patients.
Collapse
Affiliation(s)
- Yanqin Liu
- Big data Center for Nephropathy, The Fifth Clinical Medical College of Shanxi Medical University, Shanxi Provincial People’s Hospital, Taiyuan, China
| | - Yuanyue Lu
- Big data Center for Nephropathy, The Fifth Clinical Medical College of Shanxi Medical University, Shanxi Provincial People’s Hospital, Taiyuan, China
| | - Wangxing Li
- Big data Center for Nephropathy, The Fifth Clinical Medical College of Shanxi Medical University, Shanxi Provincial People’s Hospital, Taiyuan, China
| | - Yanru Wang
- Big data Center for Nephropathy, The Fifth Clinical Medical College of Shanxi Medical University, Shanxi Provincial People’s Hospital, Taiyuan, China
| | - Ziting Zhang
- Big data Center for Nephropathy, The Fifth Clinical Medical College of Shanxi Medical University, Shanxi Provincial People’s Hospital, Taiyuan, China
| | - Xiaoyu Yang
- Big data Center for Nephropathy, The Fifth Clinical Medical College of Shanxi Medical University, Shanxi Provincial People’s Hospital, Taiyuan, China
| | - Yuxuan Yang
- Big data Center for Nephropathy, The Fifth Clinical Medical College of Shanxi Medical University, Shanxi Provincial People’s Hospital, Taiyuan, China
| | - Rongshan Li
- Big data Center for Nephropathy, The Fifth Clinical Medical College of Shanxi Medical University, Shanxi Provincial People’s Hospital, Taiyuan, China
- Shanxi Kidney Disease Institute, Taiyuan, China
| | - Xiaoshuang Zhou
- Big data Center for Nephropathy, The Fifth Clinical Medical College of Shanxi Medical University, Shanxi Provincial People’s Hospital, Taiyuan, China
- Shanxi Kidney Disease Institute, Taiyuan, China
| |
Collapse
|
16
|
Han Y, Jang K, Kim U, Huang X, Kim M. The Possible Effect of Dietary Fiber Intake on the Metabolic Patterns of Dyslipidemia Subjects: Cross-Sectional Research Using Nontargeted Metabolomics. J Nutr 2023; 153:2552-2560. [PMID: 37541542 DOI: 10.1016/j.tjnut.2023.07.014] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/18/2023] [Revised: 06/22/2023] [Accepted: 07/31/2023] [Indexed: 08/06/2023] Open
Abstract
BACKGROUND Dyslipidemia is important because of its association with various metabolic complications. Numerous studies have sought to obtain scientific evidence for managing dyslipidemia patients. OBJECTIVES This study aims to identify differences in the nutritional traits of dyslipidemia subjects based on metabolite patterns. METHODS Dyslipidemia (n = 73) and control (n = 80) subjects were included. Dyslipidemia was defined as triglycerides ≥200 mg/dL, total cholesterol ≥240 mg/dL, low density lipoprotein cholesterol ≥160 mg/dL, high-density lipoprotein cholesterol <40 mg/dL (men) or 50 mg/dL (women), or lipid-lowering medicine use. Nontargeted metabolomics based on ultra-high performance liquid chromatography-mass spectrometry identified plasma metabolites, and K-means clustering was used to reconstitute groups based on the similarity of metabolomic patterns across all subjects. Then, with eXtreme Gradient Boosting, metabolites significantly contributing to the new grouping were selected. Statistical analysis was conducted to analyze traits demonstrating appreciable differences between the groups. RESULTS Dyslipidemia subjects were divided into 2 groups based on whether they were (n = 24) or were not (n = 56) in a similar metabolic state as the controls by K-means clustering. The considerable contribution of 4 metabolites (3-hydroxybutyrylcarnitine, 2-octenal, 1,3,5-heptatriene, and 5β-cholanic acid) to this new subset of dyslipidemia was confirmed by eXtreme Gradient Boosting. Furthermore, fiber intake was significantly higher in dyslipidemia subjects whose metabolic state was similar to that of the control than in the dissimilar group (P = 0.002). Moreover, significant correlations were observed between the 4 metabolites and fiber intake. Regression analysis determined that the ideal cutoff for fiber intake was 17.28 g/d. CONCLUSIONS Dyslipidemia patients who consume 17.28 g/d or more of dietary fiber may maintain similar metabolic patterns to healthy individuals, with substantial effects on the changes in the concentrations of 4 metabolites. Our findings could be applied to developing dietary guidelines for dyslipidemia patients.
Collapse
Affiliation(s)
- Youngmin Han
- Institute for Health Promotion, Graduate School of Public Health, Yonsei University, Seoul, Republic of Korea
| | - Kyunghye Jang
- Nakdonggang National Institute of Biological Resources, Sangju, Gyeongsangbuk-do, Republic of Korea
| | - Unchong Kim
- Institute for Health Promotion, Graduate School of Public Health, Yonsei University, Seoul, Republic of Korea
| | - Ximei Huang
- Department of Food and Nutrition, College of Life Science and Nano Technology, Hannam University, Daejeon, Republic of Korea
| | - Minjoo Kim
- Department of Food and Nutrition, College of Life Science and Nano Technology, Hannam University, Daejeon, Republic of Korea.
| |
Collapse
|
17
|
Akimoto H, Hayakawa T, Nagashima T, Minagawa K, Takahashi Y, Asai S. Detection of potential drug-drug interactions for risk of acute kidney injury: a population-based case-control study using interpretable machine-learning models. Front Pharmacol 2023; 14:1176096. [PMID: 37288110 PMCID: PMC10242015 DOI: 10.3389/fphar.2023.1176096] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/28/2023] [Accepted: 05/09/2023] [Indexed: 06/09/2023] Open
Abstract
Background: Acute kidney injury (AKI), with an increase in serum creatinine, is a common adverse drug event. Although various clinical studies have investigated whether a combination of two nephrotoxic drugs has an increased risk of AKI using traditional statistical models such as multivariable logistic regression (MLR), the evaluation metrics have not been evaluated despite the fact that traditional statistical models may over-fit the data. The aim of the present study was to detect drug-drug interactions with an increased risk of AKI by interpreting machine-learning models to avoid overfitting. Methods: We developed six machine-learning models trained using electronic medical records: MLR, logistic least absolute shrinkage and selection operator regression (LLR), random forest, extreme gradient boosting (XGB) tree, and two support vector machine models (kernel = linear function and radial basis function). In order to detect drug-drug interactions, the XGB and LLR models that showed good predictive performance were interpreted by SHapley Additive exPlanations (SHAP) and relative excess risk due to interaction (RERI), respectively. Results: Among approximately 2.5 million patients, 65,667 patients were extracted from the electronic medical records, and assigned to case (N = 5,319) and control (N = 60,348) groups. In the XGB model, a combination of loop diuretic and histamine H2 blocker [mean (|SHAP|) = 0.011] was identified as a relatively important risk factor for AKI. The combination of loop diuretic and H2 blocker showed a significant synergistic interaction on an additive scale (RERI 1.289, 95% confidence interval 0.226-5.591) also in the LLR model. Conclusion: The present population-based case-control study using interpretable machine-learning models suggested that although the relative importance of the individual and combined effects of loop diuretics and H2 blockers is lower than that of well-known risk factors such as older age and sex, concomitant use of a loop diuretic and histamine H2 blocker is associated with increased risk of AKI.
Collapse
Affiliation(s)
- Hayato Akimoto
- Division of Pharmacology, Department of Biomedical Sciences, Nihon University School of Medicine, Itabashi-ku, Tokyo, Japan
- Division of Genomic Epidemiology and Clinical Trials, Clinical Trials Research Center, Nihon University School of Medicine, Itabashi-ku, Tokyo, Japan
| | - Takashi Hayakawa
- Division of Pharmacology, Department of Biomedical Sciences, Nihon University School of Medicine, Itabashi-ku, Tokyo, Japan
- Division of Genomic Epidemiology and Clinical Trials, Clinical Trials Research Center, Nihon University School of Medicine, Itabashi-ku, Tokyo, Japan
| | - Takuya Nagashima
- Division of Pharmacology, Department of Biomedical Sciences, Nihon University School of Medicine, Itabashi-ku, Tokyo, Japan
- Division of Genomic Epidemiology and Clinical Trials, Clinical Trials Research Center, Nihon University School of Medicine, Itabashi-ku, Tokyo, Japan
| | - Kimino Minagawa
- Division of Genomic Epidemiology and Clinical Trials, Clinical Trials Research Center, Nihon University School of Medicine, Itabashi-ku, Tokyo, Japan
| | - Yasuo Takahashi
- Division of Genomic Epidemiology and Clinical Trials, Clinical Trials Research Center, Nihon University School of Medicine, Itabashi-ku, Tokyo, Japan
| | - Satoshi Asai
- Division of Pharmacology, Department of Biomedical Sciences, Nihon University School of Medicine, Itabashi-ku, Tokyo, Japan
- Division of Genomic Epidemiology and Clinical Trials, Clinical Trials Research Center, Nihon University School of Medicine, Itabashi-ku, Tokyo, Japan
| |
Collapse
|
18
|
Yu X, Wu R, Ji Y, Feng Z. Bibliometric and visual analysis of machine learning-based research in acute kidney injury worldwide. Front Public Health 2023; 11:1136939. [PMID: 37006534 PMCID: PMC10063840 DOI: 10.3389/fpubh.2023.1136939] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/03/2023] [Accepted: 03/01/2023] [Indexed: 03/19/2023] Open
Abstract
Background Acute kidney injury (AKI) is a serious clinical complication associated with adverse short-term and long-term outcomes. In recent years, with the rapid popularization of electronic health records and artificial intelligence machine learning technology, the detection rate and treatment of AKI have been greatly improved. At present, there are many studies in this field, and a large number of articles have been published, but we do not know much about the quality of research production in this field, as well as the focus and trend of current research. Methods Based on the Web of Science Core Collection, studies reporting machine learning-based AKI research that were published from 2013 to 2022 were retrieved and collected after manual review. VOSviewer and other software were used for bibliometric visualization analysis, including publication trends, geographical distribution characteristics, journal distribution characteristics, author contributions, citations, funding source characteristics, and keyword clustering. Results A total of 336 documents were analyzed. Since 2018, publications and citations have increased dramatically, with the United States (143) and China (101) as the main contributors. Regarding authors, Bihorac, A and Ozrazgat-Baslanti, T from the Kansas City Medical Center have published 10 articles. Regarding institutions, the University of California (18) had the most publications. Approximately 1/3 of the publications were published in Q1 and Q2 journals, of which Scientific Reports (19) was the most prolific journal. Tomašev et al.'s study that was published in 2019 has been widely cited by researchers. The results of cluster analysis of co-occurrence keywords suggest that the construction of AKI prediction model related to critical patients and sepsis patients is the research frontier, and XGBoost algorithm is also popular. Conclusion This study first provides an updated perspective on machine learning-based AKI research, which may be beneficial for subsequent researchers to choose suitable journals and collaborators and may provide a more convenient and in-depth understanding of the research basis, hotspots and frontiers.
Collapse
Affiliation(s)
- Xiang Yu
- State Key Laboratory of Kidney Diseases, Department of Nephrology, Chinese People's Liberation Army General Hospital, Chinese People's Liberation Army Institute of Nephrology, National Clinical Research Center of Kidney Diseases, Beijing, China
| | - RiLiGe Wu
- Medical Big Data Research Center, Chinese People's Liberation Army General Hospital, Beijing, China
| | - YuWei Ji
- State Key Laboratory of Kidney Diseases, Department of Nephrology, Chinese People's Liberation Army General Hospital, Chinese People's Liberation Army Institute of Nephrology, National Clinical Research Center of Kidney Diseases, Beijing, China
| | - Zhe Feng
- State Key Laboratory of Kidney Diseases, Department of Nephrology, Chinese People's Liberation Army General Hospital, Chinese People's Liberation Army Institute of Nephrology, National Clinical Research Center of Kidney Diseases, Beijing, China
| |
Collapse
|
19
|
Wang YX, Li XL, Zhang LH, Li HN, Liu XM, Song W, Pang XF. Machine learning algorithms assist early evaluation of enteral nutrition in ICU patients. Front Nutr 2023; 10:1060398. [PMID: 37125050 PMCID: PMC10140307 DOI: 10.3389/fnut.2023.1060398] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/03/2022] [Accepted: 03/27/2023] [Indexed: 05/02/2023] Open
Abstract
Background This study applied machine learning (ML) algorithms to construct a model for predicting EN initiation for patients in the intensive care unit (ICU) and identifying populations in need of EN at an early stage. Methods This study collected patient information from the Medical Information Mart for Intensive Care IV database. All patients enrolled were split randomly into a training set and a validation set. Six ML models were established to evaluate the initiation of EN, and the best model was determined according to the area under curve (AUC) and accuracy. The best model was interpreted using the Local Interpretable Model-Agnostic Explanations (LIME) algorithm and SHapley Additive exPlanation (SHAP) values. Results A total of 53,150 patients participated in the study. They were divided into a training set (42,520, 80%) and a validation set (10,630, 20%). In the validation set, XGBoost had the optimal prediction performance with an AUC of 0.895. The SHAP values revealed that sepsis, sequential organ failure assessment score, and acute kidney injury were the three most important factors affecting EN initiation. The individualized forecasts were displayed using the LIME algorithm. Conclusion The XGBoost model was established and validated for early prediction of EN initiation in ICU patients.
Collapse
Affiliation(s)
- Ya-Xi Wang
- Department of Hospital-acquired Infection Control, The Affiliated Hospital of Qingdao University, Qingdao, Shandong, China
| | - Xun-Liang Li
- Department of Nephrology, The Second Hospital of Anhui Medical University, Hefei, Anhui, China
| | - Ling-Hui Zhang
- School of Nursing, Qingdao University, Qingdao, Shandong, China
| | - Hai-Na Li
- Department of Nephrology, The Affiliated Hospital of Qingdao University, Qingdao, Shandong, China
| | - Xiao-Min Liu
- Department of Critical Care Medicine, The Affiliated Hospital of Qingdao University, Qingdao, Shandong, China
| | - Wen Song
- Department of Endoscopy, The Affiliated Hospital of Qingdao University, Qingdao, Shandong, China
| | - Xu-Feng Pang
- Department of Hospital-acquired Infection Control, The Affiliated Hospital of Qingdao University, Qingdao, Shandong, China
- *Correspondence: Xu-Feng Pang,
| |
Collapse
|
20
|
Sheu RK, Pardeshi MS. A Survey on Medical Explainable AI (XAI): Recent Progress, Explainability Approach, Human Interaction and Scoring System. SENSORS (BASEL, SWITZERLAND) 2022; 22:8068. [PMID: 36298417 PMCID: PMC9609212 DOI: 10.3390/s22208068] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 09/23/2022] [Revised: 10/18/2022] [Accepted: 10/18/2022] [Indexed: 06/16/2023]
Abstract
The emerging field of eXplainable AI (XAI) in the medical domain is considered to be of utmost importance. Meanwhile, incorporating explanations in the medical domain with respect to legal and ethical AI is necessary to understand detailed decisions, results, and current status of the patient's conditions. Successively, we will be presenting a detailed survey for the medical XAI with the model enhancements, evaluation methods, significant overview of case studies with open box architecture, medical open datasets, and future improvements. Potential differences in AI and XAI methods are provided with the recent XAI methods stated as (i) local and global methods for preprocessing, (ii) knowledge base and distillation algorithms, and (iii) interpretable machine learning. XAI characteristics details with future healthcare explainability is included prominently, whereas the pre-requisite provides insights for the brainstorming sessions before beginning a medical XAI project. Practical case study determines the recent XAI progress leading to the advance developments within the medical field. Ultimately, this survey proposes critical ideas surrounding a user-in-the-loop approach, with an emphasis on human-machine collaboration, to better produce explainable solutions. The surrounding details of the XAI feedback system for human rating-based evaluation provides intelligible insights into a constructive method to produce human enforced explanation feedback. For a long time, XAI limitations of the ratings, scores and grading are present. Therefore, a novel XAI recommendation system and XAI scoring system are designed and approached from this work. Additionally, this paper encourages the importance of implementing explainable solutions into the high impact medical field.
Collapse
Affiliation(s)
- Ruey-Kai Sheu
- Department of Computer Science, Tunghai University, No. 1727, Section 4, Taiwan Blvd, Xitun District, Taichung 407224, Taiwan
| | - Mayuresh Sunil Pardeshi
- AI Center, Tunghai University, No. 1727, Section 4, Taiwan Blvd, Xitun District, Taichung 407224, Taiwan
| |
Collapse
|