1
|
Huang D, Gong L, Wei C, Wang X, Liang Z. An explainable machine learning-based model to predict intensive care unit admission among patients with community-acquired pneumonia and connective tissue disease. Respir Res 2024; 25:246. [PMID: 38890628 PMCID: PMC11186131 DOI: 10.1186/s12931-024-02874-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/01/2024] [Accepted: 06/09/2024] [Indexed: 06/20/2024] Open
Abstract
BACKGROUND There is no individualized prediction model for intensive care unit (ICU) admission on patients with community-acquired pneumonia (CAP) and connective tissue disease (CTD) so far. In this study, we aimed to establish a machine learning-based model for predicting the need for ICU admission among those patients. METHODS This was a retrospective study on patients admitted into a University Hospital in China between November 2008 and November 2021. Patients were included if they were diagnosed with CAP and CTD during admission and hospitalization. Data related to demographics, CTD types, comorbidities, vital signs and laboratory results during the first 24 h of hospitalization were collected. The baseline variables were screened to identify potential predictors via three methods, including univariate analysis, least absolute shrinkage and selection operator (Lasso) regression and Boruta algorithm. Nine supervised machine learning algorithms were used to build prediction models. We evaluated the performances of differentiation, calibration, and clinical utility of all models to determine the optimal model. The Shapley Additive Explanations (SHAP) and Local Interpretable Model-Agnostic Explanations (LIME) techniques were performed to interpret the optimal model. RESULTS The included patients were randomly divided into the training set (1070 patients) and the testing set (459 patients) at a ratio of 70:30. The intersection results of three feature selection approaches yielded 16 predictors. The eXtreme gradient boosting (XGBoost) model achieved the highest area under the receiver operating characteristic curve (AUC) (0.941) and accuracy (0.913) among various models. The calibration curve and decision curve analysis (DCA) both suggested that the XGBoost model outperformed other models. The SHAP summary plots illustrated the top 6 features with the greatest importance, including higher N-terminal pro-B-type natriuretic peptide (NT-proBNP) and C-reactive protein (CRP), lower level of CD4 + T cell, lymphocyte and serum sodium, and positive serum (1,3)-β-D-glucan test (G test). CONCLUSION We successfully developed, evaluated and explained a machine learning-based model for predicting ICU admission in patients with CAP and CTD. The XGBoost model could be clinical referenced after external validation and improvement.
Collapse
Affiliation(s)
- Dong Huang
- Department of Respiratory and Critical Care Medicine, West China Hospital, Sichuan University, No. 37 Guoxue Alley, Chengdu, Sichuan, 610041, China
| | - Linjing Gong
- Department of Respiratory and Critical Care Medicine, West China Hospital, Sichuan University, No. 37 Guoxue Alley, Chengdu, Sichuan, 610041, China
| | - Chang Wei
- Department of Respiratory and Critical Care Medicine, West China Hospital, Sichuan University, No. 37 Guoxue Alley, Chengdu, Sichuan, 610041, China
| | - Xinyu Wang
- Department of Respiratory and Critical Care Medicine, West China Hospital, Sichuan University, No. 37 Guoxue Alley, Chengdu, Sichuan, 610041, China
| | - Zongan Liang
- Department of Respiratory and Critical Care Medicine, West China Hospital, Sichuan University, No. 37 Guoxue Alley, Chengdu, Sichuan, 610041, China.
| |
Collapse
|
2
|
Bianchi V, Giambusso M, De Iacob A, Chiarello MM, Brisinda G. Artificial intelligence in the diagnosis and treatment of acute appendicitis: a narrative review. Updates Surg 2024; 76:783-792. [PMID: 38472633 PMCID: PMC11129994 DOI: 10.1007/s13304-024-01801-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/06/2024] [Accepted: 02/24/2024] [Indexed: 03/14/2024]
Abstract
Artificial intelligence is transforming healthcare. Artificial intelligence can improve patient care by analyzing large amounts of data to help make more informed decisions regarding treatments and enhance medical research through analyzing and interpreting data from clinical trials and research projects to identify subtle but meaningful trends beyond ordinary perception. Artificial intelligence refers to the simulation of human intelligence in computers, where systems of artificial intelligence can perform tasks that require human-like intelligence like speech recognition, visual perception, pattern-recognition, decision-making, and language processing. Artificial intelligence has several subdivisions, including machine learning, natural language processing, computer vision, and robotics. By automating specific routine tasks, artificial intelligence can improve healthcare efficiency. By leveraging machine learning algorithms, the systems of artificial intelligence can offer new opportunities for enhancing both the efficiency and effectiveness of surgical procedures, particularly regarding training of minimally invasive surgery. As artificial intelligence continues to advance, it is likely to play an increasingly significant role in the field of surgical learning. Physicians have assisted to a spreading role of artificial intelligence in the last decade. This involved different medical specialties such as ophthalmology, cardiology, urology, but also abdominal surgery. In addition to improvements in diagnosis, ascertainment of efficacy of treatment and autonomous actions, artificial intelligence has the potential to improve surgeons' ability to better decide if acute surgery is indicated or not. The role of artificial intelligence in the emergency departments has also been investigated. We considered one of the most common condition the emergency surgeons have to face, acute appendicitis, to assess the state of the art of artificial intelligence in this frequent acute disease. The role of artificial intelligence in diagnosis and treatment of acute appendicitis will be discussed in this narrative review.
Collapse
Affiliation(s)
- Valentina Bianchi
- Emergency Surgery and Trauma Center, Department of Abdominal and Endocrine Metabolic Medical and Surgical Sciences, IRCCS, Fondazione Policlinico Universitario A Gemelli, Largo Agostino Gemelli 8, 00168, Rome, Italy
| | - Mauro Giambusso
- General Surgery Operative Unit, Vittorio Emanuele Hospital, 93012, Gela, Italy
| | - Alessandra De Iacob
- Emergency Surgery and Trauma Center, Department of Abdominal and Endocrine Metabolic Medical and Surgical Sciences, IRCCS, Fondazione Policlinico Universitario A Gemelli, Largo Agostino Gemelli 8, 00168, Rome, Italy
| | - Maria Michela Chiarello
- Department of Surgery, General Surgery Operative Unit, Azienda Sanitaria Provinciale Cosenza, 87100, Cosenza, Italy
| | - Giuseppe Brisinda
- Emergency Surgery and Trauma Center, Department of Abdominal and Endocrine Metabolic Medical and Surgical Sciences, IRCCS, Fondazione Policlinico Universitario A Gemelli, Largo Agostino Gemelli 8, 00168, Rome, Italy.
- Catholic School of Medicine, University Department of Translational Medicine and Surgery, 00168, Rome, Italy.
| |
Collapse
|
3
|
Gulla A, Jakiunaite I, Juchneviciute I, Dzemyda G. A narrative review: predicting liver transplant graft survival using artificial intelligence modeling. FRONTIERS IN TRANSPLANTATION 2024; 3:1378378. [PMID: 38993758 PMCID: PMC11235265 DOI: 10.3389/frtra.2024.1378378] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 01/29/2024] [Accepted: 04/22/2024] [Indexed: 07/13/2024]
Abstract
Liver transplantation is the only treatment for patients with liver failure. As demand for liver transplantation grows, it remains a challenge to predict the short- and long-term survival of the liver graft. Recently, artificial intelligence models have been used to evaluate the short- and long-term survival of the liver transplant. To make the models more accurate, suitable liver transplantation characteristics must be used as input to train them. In this narrative review, we reviewed studies concerning liver transplantations published in the PubMed, Web of Science, and Cochrane databases between 2017 and 2022. We picked out 17 studies using our selection criteria and analyzed them, evaluating which medical characteristics were used as input for creation of artificial intelligence models. In eight studies, models estimating only short-term liver graft survival were created, while in five of the studies, models for the prediction of only long-term liver graft survival were built. In four of the studies, artificial intelligence algorithms evaluating both the short- and long-term liver graft survival were created. Medical characteristics that were used as input in reviewed studies and had the biggest impact on the accuracy of the model were the recipient's age, recipient's body mass index, creatinine levels in the recipient's serum, recipient's international normalized ratio, diabetes mellitus, and recipient's model of end-stage liver disease score. To conclude, in order to define important liver transplantation characteristics that could be used as an input for artificial intelligence algorithms when predicting liver graft survival, more models need to be created and analyzed, in order to fully support the results of this review.
Collapse
Affiliation(s)
- Aiste Gulla
- Faculty of Medicine, Institute of Clinical Medicine, Vilnius University, Vilnius, Lithuania
| | | | - Ivona Juchneviciute
- Faculty of Mathematics and Informatics, Institute of Data Science and Digital Technologies, Vilnius University, Vilnius, Lithuania
| | - Gintautas Dzemyda
- Faculty of Mathematics and Informatics, Institute of Data Science and Digital Technologies, Vilnius University, Vilnius, Lithuania
| |
Collapse
|
4
|
Tong YT, Gao GJ, Chang H, Wu XW, Li MT. Development and economic assessment of machine learning models to predict glycosylated hemoglobin in type 2 diabetes. Front Pharmacol 2023; 14:1216182. [PMID: 37456748 PMCID: PMC10347387 DOI: 10.3389/fphar.2023.1216182] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/03/2023] [Accepted: 06/19/2023] [Indexed: 07/18/2023] Open
Abstract
Background: Glycosylated hemoglobin (HbA1c) is recommended for diagnosing and monitoring type 2 diabetes. However, the monitoring frequency in real-world applications has not yet reached the recommended frequency in the guidelines. Developing machine learning models to screen patients with poor glycemic control in patients with T2D could optimize management and decrease medical service costs. Methods: This study was carried out on patients with T2D who were examined for HbA1c at the Sichuan Provincial People's Hospital from April 2018 to December 2019. Characteristics were extracted from interviews and electronic medical records. The data (excluded FBG or included FBG) were randomly divided into a training dataset and a test dataset with a radio of 8:2 after data pre-processing. Four imputing methods, four screening methods, and six machine learning algorithms were used to optimize data and develop models. Models were compared on the basis of predictive performance metrics, especially on the model benefit (MB, a confusion matrix combined with economic burden associated with therapeutic inertia). The contributions of features were interpreted using SHapley Additive exPlanation (SHAP). Finally, we validated the sample size on the best model. Results: The study included 980 patients with T2D, of whom 513 (52.3%) were defined as positive (need to perform the HbA1c test). The results indicated that the model trained in the data (included FBG) presented better forecast performance than the models that excluded the FBG value. The best model used modified random forest as the imputation method, ElasticNet as the feature screening method, and the LightGBM algorithms and had the best performance. The MB, AUC, and AUPRC of the best model, among a total of 192 trained models, were 43475.750 (¥), 0.972, 0.944, and 0.974, respectively. The FBG values, previous HbA1c values, having a rational and reasonable diet, health status scores, type of manufacturers of metformin, interval of measurement, EQ-5D scores, occupational status, and age were the most significant contributors to the prediction model. Conclusion: We found that MB could be an indicator to evaluate the model prediction performance. The proposed model performed well in identifying patients with T2D who need to undergo the HbA1c test and could help improve individualized T2D management.
Collapse
Affiliation(s)
- Yi-Tong Tong
- Chengdu Second People’s Hospital, Chengdu, Sichuan, China
| | - Guang-Jie Gao
- Personalized Drug Therapy Key Laboratory of Sichuan Province, Department of Pharmacy, Sichuan Provincial People’s Hospital, School of Medicine, University of Electronic Science and Technology of China, Chengdu, Sichuan, China
| | - Huan Chang
- Personalized Drug Therapy Key Laboratory of Sichuan Province, Department of Pharmacy, Sichuan Provincial People’s Hospital, School of Medicine, University of Electronic Science and Technology of China, Chengdu, Sichuan, China
| | - Xing-Wei Wu
- Personalized Drug Therapy Key Laboratory of Sichuan Province, Department of Pharmacy, Sichuan Provincial People’s Hospital, School of Medicine, University of Electronic Science and Technology of China, Chengdu, Sichuan, China
- Chinese Academy of Sciences Sichuan Translational Medicine Research Hospital, Chengdu, Sichuan, China
| | - Meng-Ting Li
- Personalized Drug Therapy Key Laboratory of Sichuan Province, Department of Pharmacy, Sichuan Provincial People’s Hospital, School of Medicine, University of Electronic Science and Technology of China, Chengdu, Sichuan, China
| |
Collapse
|
5
|
Zabara ML, Popescu I, Burlacu A, Geman O, Dabija RAC, Popa IV, Lupascu C. Machine Learning Model Validated to Predict Outcomes of Liver Transplantation Recipients with Hepatitis C: The Romanian National Transplant Agency Cohort Experience. SENSORS (BASEL, SWITZERLAND) 2023; 23:2149. [PMID: 36850756 PMCID: PMC9961494 DOI: 10.3390/s23042149] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 01/23/2023] [Revised: 02/07/2023] [Accepted: 02/13/2023] [Indexed: 06/18/2023]
Abstract
BACKGROUND AND OBJECTIVES In the early period after liver transplantation, patients are exposed to a high rate of complications and several scores are currently available to predict adverse postoperative outcomes. However, an ideal, universally accepted and validated score to predict adverse events in liver transplant recipients with hepatitis C is lacking. Therefore, we aimed to establish and validate a machine learning (ML) model to predict short-term outcomes of hepatitis C patients who underwent liver transplantation. MATERIALS AND METHODS We conducted a retrospective observational two-center cohort study involving hepatitis C patients who underwent liver transplantation. Based on clinical and laboratory parameters, the dataset was used to train a deep-learning model for predicting short-term postoperative complications (within one month following liver transplantation). Adverse events prediction in the postoperative setting was the primary study outcome. RESULTS A total of 90 liver transplant recipients with hepatitis C were enrolled in the present study, 80 patients in the training cohort and ten in the validation cohort, respectively. The age range of the participants was 12-68 years, 51 (56,7%) were male, and 39 (43.3%) were female. Throughout the 85 training epochs, the model achieved a very good performance, with the accuracy ranging between 99.76% and 100%. After testing the model on the validation set, the deep-learning classifier confirmed the performance in predicting postoperative complications, achieving an accuracy of 100% on unseen data. CONCLUSIONS We successfully developed a ML model to predict postoperative complications following liver transplantation in hepatitis C patients. The model demonstrated an excellent performance for accurate adverse event prediction. Consequently, the present study constitutes the foundation for careful and non-invasive identification of high-risk patients who might benefit from a more intensive postoperative monitoring strategy.
Collapse
Affiliation(s)
- Mihai Lucian Zabara
- Faculty of Medicine, University of Medicine and Pharmacy “Grigore T Popa”, 700115 Iasi, Romania
- Department of Surgery, St. Spiridon Emergency Hospital, 700111 Iasi, Romania
| | - Irinel Popescu
- Fundeni Clinical Institute, 022328 Bucharest, Romania
- Center for Excellence in Translational Medicine, 022328 Bucharest, Romania
| | - Alexandru Burlacu
- Faculty of Medicine, University of Medicine and Pharmacy “Grigore T Popa”, 700115 Iasi, Romania
- Institute of Cardiovascular Diseases, 700503 Iasi, Romania
| | - Oana Geman
- The Computer, Electronics and Automation Department, Faculty of Electrical Engineering and Computer Science, University Stefan cel Mare, 720229 Suceava, Romania
| | - Radu Adrian Crisan Dabija
- Faculty of Medicine, University of Medicine and Pharmacy “Grigore T Popa”, 700115 Iasi, Romania
- Pulmonology Department, Clinic of Pulmonary Diseases, 700115 Iasi, Romania
| | - Iolanda Valentina Popa
- Faculty of Medicine, University of Medicine and Pharmacy “Grigore T Popa”, 700115 Iasi, Romania
| | - Cristian Lupascu
- Faculty of Medicine, University of Medicine and Pharmacy “Grigore T Popa”, 700115 Iasi, Romania
- Department of Surgery, St. Spiridon Emergency Hospital, 700111 Iasi, Romania
| |
Collapse
|
6
|
Lee KS, Kim ES. Explainable Artificial Intelligence in the Early Diagnosis of Gastrointestinal Disease. Diagnostics (Basel) 2022; 12:2740. [PMID: 36359583 PMCID: PMC9689865 DOI: 10.3390/diagnostics12112740] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/03/2022] [Revised: 11/03/2022] [Accepted: 11/06/2022] [Indexed: 08/29/2023] Open
Abstract
This study reviews the recent progress of explainable artificial intelligence for the early diagnosis of gastrointestinal disease (GID). The source of data was eight original studies in PubMed. The search terms were "gastrointestinal" (title) together with "random forest" or "explainable artificial intelligence" (abstract). The eligibility criteria were the dependent variable of GID or a strongly associated disease, the intervention(s) of artificial intelligence, the outcome(s) of accuracy and/or the area under the receiver operating characteristic curve (AUC), the outcome(s) of variable importance and/or the Shapley additive explanations (SHAP), a publication year of 2020 or later, and the publication language of English. The ranges of performance measures were reported to be 0.70-0.98 for accuracy, 0.04-0.25 for sensitivity, and 0.54-0.94 for the AUC. The following factors were discovered to be top-10 predictors of gastrointestinal bleeding in the intensive care unit: mean arterial pressure (max), bicarbonate (min), creatinine (max), PMN, heart rate (mean), Glasgow Coma Scale, age, respiratory rate (mean), prothrombin time (max) and aminotransferase aspartate (max). In a similar vein, the following variables were found to be top-10 predictors for the intake of almond, avocado, broccoli, walnut, whole-grain barley, and/or whole-grain oat: Roseburia undefined, Lachnospira spp., Oscillibacter undefined, Subdoligranulum spp., Streptococcus salivarius subsp. thermophiles, Parabacteroides distasonis, Roseburia spp., Anaerostipes spp., Lachnospiraceae ND3007 group undefined, and Ruminiclostridium spp. Explainable artificial intelligence provides an effective, non-invasive decision support system for the early diagnosis of GID.
Collapse
Affiliation(s)
- Kwang-Sig Lee
- AI Center, Korea University Anam Hospital, Seoul 02841, Korea
| | - Eun Sun Kim
- Department of Gastroenterology, Korea University Anam Hospital, Seoul 02841, Korea
| |
Collapse
|