1
|
Hellen DJ, Fay ME, Lee DH, Klindt-Morgan C, Bennett A, Pachura KJ, Grakoui A, Huppert SS, Dawson PA, Lam WA, Karpen SJ. BiliQML: a supervised machine-learning model to quantify biliary forms from digitized whole slide liver histopathological images. Am J Physiol Gastrointest Liver Physiol 2024; 327:G1-G15. [PMID: 38651949 DOI: 10.1152/ajpgi.00058.2024] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/22/2024] [Revised: 04/03/2024] [Accepted: 04/09/2024] [Indexed: 04/25/2024]
Abstract
The progress of research focused on cholangiocytes and the biliary tree during development and following injury is hindered by limited available quantitative methodologies. Current techniques include two-dimensional standard histological cell-counting approaches, which are rapidly performed, error prone, and lack architectural context or three-dimensional analysis of the biliary tree in opacified livers, which introduce technical issues along with minimal quantitation. The present study aims to fill these quantitative gaps with a supervised machine-learning model (BiliQML) able to quantify biliary forms in the liver of anti-keratin 19 antibody-stained whole slide images. Training utilized 5,019 researcher-labeled biliary forms, which following feature selection, and algorithm optimization, generated an F score of 0.87. Application of BiliQML on seven separate cholangiopathy models [genetic (Afp-CRE;Pkd1l1null/Fl, Alb-CRE;Rbp-jkfl/fl, and Albumin-CRE;ROSANICD), surgical (bile duct ligation), toxicological (3,5-diethoxycarbonyl-1,4-dihydrocollidine), and therapeutic (Cyp2c70-/- with ileal bile acid transporter inhibition)] allowed for a means to validate the capabilities and utility of this platform. The results from BiliQML quantification revealed biological and pathological differences across these seven diverse models, indicating a highly sensitive, robust, and scalable methodology for the quantification of distinct biliary forms. BiliQML is the first comprehensive machine-learning platform for biliary form analysis, adding much-needed morphologic context to standard immunofluorescence-based histology, and provides clinical and basic science researchers with a novel tool for the characterization of cholangiopathies.NEW & NOTEWORTHY BiliQML is the first comprehensive machine-learning platform for biliary form analysis in whole slide histopathological images. This platform provides clinical and basic science researchers with a novel tool for the improved quantification and characterization of biliary tract disorders.
Collapse
Affiliation(s)
- Dominick J Hellen
- Division of Pediatric Gastroenterology, Hepatology, and Nutrition, Department of Pediatrics, Children's Healthcare of Atlanta and Emory University School of Medicine, Atlanta, Georgia, United States
| | - Meredith E Fay
- The Wallace H. Coulter Department of Biomedical Engineering, Georgia Institute of Technology and Emory University, Atlanta, Georgia, United States
- Department of Pediatrics, Division of Pediatric Hematology/Oncology, Aflac Cancer Center and Blood Disorders Service of Children's Healthcare of Atlanta, Emory University School of Medicine, Atlanta, Georgia, United States
| | - David H Lee
- Division of Pediatric Gastroenterology, Hepatology, and Nutrition, Department of Pediatrics, Children's Healthcare of Atlanta and Emory University School of Medicine, Atlanta, Georgia, United States
| | - Caroline Klindt-Morgan
- Division of Pediatric Gastroenterology, Hepatology, and Nutrition, Department of Pediatrics, Children's Healthcare of Atlanta and Emory University School of Medicine, Atlanta, Georgia, United States
| | - Ashley Bennett
- Division of Pediatric Gastroenterology, Hepatology, and Nutrition, Department of Pediatrics, Children's Healthcare of Atlanta and Emory University School of Medicine, Atlanta, Georgia, United States
| | - Kimberly J Pachura
- Division of Pediatric Gastroenterology, Hepatology, and Nutrition, Department of Pediatrics, Children's Healthcare of Atlanta and Emory University School of Medicine, Atlanta, Georgia, United States
| | - Arash Grakoui
- Emory National Primate Research Center, Division of Microbiology and Immunology, Emory Vaccine Center, Emory University School of Medicine, Atlanta, Georgia, United States
| | - Stacey S Huppert
- Division of Gastroenterology, Hepatology, and Nutrition, Cincinnati Children's Hospital Medical Center, Cincinnati, Ohio, United States
- Department of Pediatrics, University of Cincinnati College of Medicine, Cincinnati, Ohio, United States
| | - Paul A Dawson
- Division of Pediatric Gastroenterology, Hepatology, and Nutrition, Department of Pediatrics, Children's Healthcare of Atlanta and Emory University School of Medicine, Atlanta, Georgia, United States
| | - Wilbur A Lam
- The Wallace H. Coulter Department of Biomedical Engineering, Georgia Institute of Technology and Emory University, Atlanta, Georgia, United States
- Department of Pediatrics, Division of Pediatric Hematology/Oncology, Aflac Cancer Center and Blood Disorders Service of Children's Healthcare of Atlanta, Emory University School of Medicine, Atlanta, Georgia, United States
| | - Saul J Karpen
- Division of Pediatric Gastroenterology, Hepatology, and Nutrition, Department of Pediatrics, Children's Healthcare of Atlanta and Emory University School of Medicine, Atlanta, Georgia, United States
| |
Collapse
|
2
|
Liu L, Zhang R, Shi Y, Sun J, Xu X. Automated machine learning for predicting liver metastasis in patients with gastrointestinal stromal tumor: a SEER-based analysis. Sci Rep 2024; 14:12415. [PMID: 38816560 PMCID: PMC11139903 DOI: 10.1038/s41598-024-62311-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/08/2024] [Accepted: 05/15/2024] [Indexed: 06/01/2024] Open
Abstract
Gastrointestinal stromal tumors (GISTs) are a rare type of tumor that can develop liver metastasis (LIM), significantly impacting the patient's prognosis. This study aimed to predict LIM in GIST patients by constructing machine learning (ML) algorithms to assist clinicians in the decision-making process for treatment. Retrospective analysis was performed using the Surveillance, Epidemiology, and End Results (SEER) database, and cases from 2010 to 2015 were assigned to the developing sets, while cases from 2016 to 2017 were assigned to the testing set. Missing values were addressed using the multiple imputation technique. Four algorithms were utilized to construct the models, comprising traditional logistic regression (LR) and automated machine learning (AutoML) analysis such as gradient boost machine (GBM), deep neural net (DL), and generalized linear model (GLM). We evaluated the models' performance using LR-based metrics, including the area under the receiver operating characteristic curve (AUC), calibration curve, and decision curve analysis (DCA), as well as AutoML-based metrics, such as feature importance, SHapley Additive exPlanation (SHAP) Plots, and Local Interpretable Model Agnostic Explanation (LIME). A total of 6207 patients were included in this study, with 2683, 1780, and 1744 patients allocated to the training, validation, and test sets, respectively. Among the different models evaluated, the GBM model demonstrated the highest performance in the training, validation, and test cohorts, with respective AUC values of 0.805, 0.780, and 0.795. Furthermore, the GBM model outperformed other AutoML models in terms of accuracy, achieving 0.747, 0.700, and 0.706 in the training, validation, and test cohorts, respectively. Additionally, the study revealed that tumor size and tumor location were the most significant predictors influencing the AutoML model's ability to accurately predict LIM. The AutoML model utilizing the GBM algorithm for GIST patients can effectively predict the risk of LIM and provide clinicians with a reference for developing individualized treatment plans.
Collapse
Affiliation(s)
- Luojie Liu
- Department of Gastroenterology, Changshu Hospital Affiliated to Soochow University, Suzhou, China
| | - Rufa Zhang
- Department of Gastroenterology, Changshu Hospital Affiliated to Soochow University, Suzhou, China
| | - Ying Shi
- Department of Gastroenterology, Changshu Hospital Affiliated to Soochow University, Suzhou, China
| | - Jinbing Sun
- Department of General Surgery, Changshu Hospital Affiliated to Soochow University, Suzhou, China.
| | - Xiaodan Xu
- Department of Gastroenterology, Changshu Hospital Affiliated to Soochow University, Suzhou, China.
| |
Collapse
|
3
|
Brunese MC, Avella P, Cappuccio M, Spiezia S, Pacella G, Bianco P, Greco S, Ricciardelli L, Lucarelli NM, Caiazzo C, Vallone G. Future Perspectives on Radiomics in Acute Liver Injury and Liver Trauma. J Pers Med 2024; 14:572. [PMID: 38929793 PMCID: PMC11204538 DOI: 10.3390/jpm14060572] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/02/2024] [Revised: 05/02/2024] [Accepted: 05/09/2024] [Indexed: 06/28/2024] Open
Abstract
Background: Acute liver injury occurs most frequently due to trauma, but it can also occur because of sepsis or drug-induced injury. This review aims to analyze artificial intelligence (AI)'s ability to detect and quantify liver injured areas in adults and pediatric patients. Methods: A literature analysis was performed on the PubMed Dataset. We selected original articles published from 2018 to 2023 and cohorts with ≥10 adults or pediatric patients. Results: Six studies counting 564 patients were collected, including 170 (30%) children and 394 adults. Four (66%) articles reported AI application after liver trauma, one (17%) after sepsis, and one (17%) due to chemotherapy. In five (83%) studies, Computed Tomography was performed, while in one (17%), FAST-UltraSound was performed. The studies reported a high diagnostic performance; in particular, three studies reported a specificity rate > 80%. Conclusions: Radiomics models seem reliable and applicable to clinical practice in patients affected by acute liver injury. Further studies are required to achieve larger validation cohorts.
Collapse
Affiliation(s)
- Maria Chiara Brunese
- Department of Medicine and Health Science “V. Tiberio”, University of Molise, 86100 Campobasso, Italy; (M.C.B.)
| | - Pasquale Avella
- Department of Clinical Medicine and Surgery, University of Naples Federico II, 80131 Naples, Italy
- Hepatobiliary and Pancreatic Surgery Unit, Pineta Grande Hospital, 81030 Castel Volturno, Italy
| | - Micaela Cappuccio
- Department of Clinical Medicine and Surgery, University of Naples Federico II, 80131 Naples, Italy
| | - Salvatore Spiezia
- Department of Medicine and Health Science “V. Tiberio”, University of Molise, 86100 Campobasso, Italy; (M.C.B.)
| | - Giulia Pacella
- Department of Medicine and Health Science “V. Tiberio”, University of Molise, 86100 Campobasso, Italy; (M.C.B.)
| | - Paolo Bianco
- Hepatobiliary and Pancreatic Surgery Unit, Pineta Grande Hospital, 81030 Castel Volturno, Italy
| | - Sara Greco
- Interdisciplinary Department of Medicine, Section of Radiology and Radiation Oncology, University of Bari “Aldo Moro”, 70124 Bari, Italy
| | | | - Nicola Maria Lucarelli
- Interdisciplinary Department of Medicine, Section of Radiology and Radiation Oncology, University of Bari “Aldo Moro”, 70124 Bari, Italy
| | - Corrado Caiazzo
- Department of Medicine and Health Science “V. Tiberio”, University of Molise, 86100 Campobasso, Italy; (M.C.B.)
| | - Gianfranco Vallone
- Department of Medicine and Health Science “V. Tiberio”, University of Molise, 86100 Campobasso, Italy; (M.C.B.)
| |
Collapse
|
4
|
Lu F, Meng Y, Song X, Li X, Liu Z, Gu C, Zheng X, Jing Y, Cai W, Pinyopornpanish K, Mancuso A, Romeiro FG, Méndez-Sánchez N, Qi X. Artificial Intelligence in Liver Diseases: Recent Advances. Adv Ther 2024; 41:967-990. [PMID: 38286960 DOI: 10.1007/s12325-024-02781-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/12/2023] [Accepted: 01/03/2024] [Indexed: 01/31/2024]
Abstract
Liver diseases cause a significant burden on public health worldwide. In spite of great advances during recent years, there are still many challenges in the diagnosis and treatment of liver diseases. During recent years, artificial intelligence (AI) has been widely used for the diagnosis, risk stratification, and prognostic prediction of various diseases based on clinical datasets and medical images. Accumulative studies have shown its performance for diagnosing patients with nonalcoholic fatty liver disease and liver fibrosis and assessing their severity, and for predicting treatment response and recurrence of hepatocellular carcinoma, outcomes of liver transplantation recipients, and risk of drug-induced liver injury. Herein, we aim to comprehensively summarize the current evidence regarding diagnostic, prognostic, and/or therapeutic role of AI in these common liver diseases.
Collapse
Affiliation(s)
- Feifei Lu
- College of Medicine and Biological Information Engineering, Northeastern University, Shenyang, China
- Liver Cirrhosis Study Group, Department of Gastroenterology, General Hospital of Northern Theater Command, No. 83 Wenhua Road, Shenyang, 110840, Liaoning Province, China
| | - Yao Meng
- Liver Cirrhosis Study Group, Department of Gastroenterology, General Hospital of Northern Theater Command, No. 83 Wenhua Road, Shenyang, 110840, Liaoning Province, China
- Postgraduate College, Dalian Medical University, Dalian, China
| | - Xiaoting Song
- Liver Cirrhosis Study Group, Department of Gastroenterology, General Hospital of Northern Theater Command, No. 83 Wenhua Road, Shenyang, 110840, Liaoning Province, China
- Postgraduate College, Dalian Medical University, Dalian, China
| | - Xiaotong Li
- Liver Cirrhosis Study Group, Department of Gastroenterology, General Hospital of Northern Theater Command, No. 83 Wenhua Road, Shenyang, 110840, Liaoning Province, China
- Postgraduate College, China Medical University, Shenyang, China
| | - Zhuang Liu
- Liver Cirrhosis Study Group, Department of Gastroenterology, General Hospital of Northern Theater Command, No. 83 Wenhua Road, Shenyang, 110840, Liaoning Province, China
- Postgraduate College, China Medical University, Shenyang, China
| | - Chunru Gu
- Liver Cirrhosis Study Group, Department of Gastroenterology, General Hospital of Northern Theater Command, No. 83 Wenhua Road, Shenyang, 110840, Liaoning Province, China
- Postgraduate College, China Medical University, Shenyang, China
| | - Xiaojie Zheng
- Liver Cirrhosis Study Group, Department of Gastroenterology, General Hospital of Northern Theater Command, No. 83 Wenhua Road, Shenyang, 110840, Liaoning Province, China
- Postgraduate College, China Medical University, Shenyang, China
| | - Yi Jing
- Neusoft Research of Intelligent Healthcare Technology, Co. Ltd., Shenyang, China
| | - Wei Cai
- Neusoft Research of Intelligent Healthcare Technology, Co. Ltd., Shenyang, China
| | - Kanokwan Pinyopornpanish
- Department of Internal Medicine, Faculty of Medicine, Chiang Mai University, Chiang Mai, Thailand
| | - Andrea Mancuso
- Medicina Interna 1, Azienda di Rilievo Nazionale Ad Alta Specializzazione Civico-Di Cristina-Benfratelli, Palermo, Italy.
| | | | - Nahum Méndez-Sánchez
- Liver Research Unit, Medica Sur Clinic and Foundation, National Autonomous University of Mexico, Mexico City, Mexico.
| | - Xingshun Qi
- College of Medicine and Biological Information Engineering, Northeastern University, Shenyang, China.
- Liver Cirrhosis Study Group, Department of Gastroenterology, General Hospital of Northern Theater Command, No. 83 Wenhua Road, Shenyang, 110840, Liaoning Province, China.
- Postgraduate College, Dalian Medical University, Dalian, China.
- Postgraduate College, China Medical University, Shenyang, China.
| |
Collapse
|
5
|
Grignaffini F, Barbuto F, Troiano M, Piazzo L, Simeoni P, Mangini F, De Stefanis C, Onetti Muda A, Frezza F, Alisi A. The Use of Artificial Intelligence in the Liver Histopathology Field: A Systematic Review. Diagnostics (Basel) 2024; 14:388. [PMID: 38396427 PMCID: PMC10887838 DOI: 10.3390/diagnostics14040388] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/27/2023] [Revised: 02/02/2024] [Accepted: 02/06/2024] [Indexed: 02/25/2024] Open
Abstract
Digital pathology (DP) has begun to play a key role in the evaluation of liver specimens. Recent studies have shown that a workflow that combines DP and artificial intelligence (AI) applied to histopathology has potential value in supporting the diagnosis, treatment evaluation, and prognosis prediction of liver diseases. Here, we provide a systematic review of the use of this workflow in the field of hepatology. Based on the PRISMA 2020 criteria, a search of the PubMed, SCOPUS, and Embase electronic databases was conducted, applying inclusion/exclusion filters. The articles were evaluated by two independent reviewers, who extracted the specifications and objectives of each study, the AI tools used, and the results obtained. From the 266 initial records identified, 25 eligible studies were selected, mainly conducted on human liver tissues. Most of the studies were performed using whole-slide imaging systems for imaging acquisition and applying different machine learning and deep learning methods for image pre-processing, segmentation, feature extractions, and classification. Of note, most of the studies selected demonstrated good performance as classifiers of liver histological images compared to pathologist annotations. Promising results to date bode well for the not-too-distant inclusion of these techniques in clinical practice.
Collapse
Affiliation(s)
- Flavia Grignaffini
- Department of Information Engineering, Electronics and Telecommunications (DIET), “La Sapienza”, University of Rome, 00184 Rome, Italy; (F.G.); (F.B.); (L.P.); (F.M.); (F.F.)
| | - Francesco Barbuto
- Department of Information Engineering, Electronics and Telecommunications (DIET), “La Sapienza”, University of Rome, 00184 Rome, Italy; (F.G.); (F.B.); (L.P.); (F.M.); (F.F.)
| | - Maurizio Troiano
- Research Unit of Genetics of Complex Phenotypes, Bambino Gesù Children’s Hospital, IRCCS, 00165 Rome, Italy; (M.T.); (C.D.S.)
| | - Lorenzo Piazzo
- Department of Information Engineering, Electronics and Telecommunications (DIET), “La Sapienza”, University of Rome, 00184 Rome, Italy; (F.G.); (F.B.); (L.P.); (F.M.); (F.F.)
| | - Patrizio Simeoni
- National Transport Authority (NTA), D02 WT20 Dublin, Ireland;
- Faculty of Lifelong Learning, South East Technological University (SETU), R93 V960 Carlow, Ireland
| | - Fabio Mangini
- Department of Information Engineering, Electronics and Telecommunications (DIET), “La Sapienza”, University of Rome, 00184 Rome, Italy; (F.G.); (F.B.); (L.P.); (F.M.); (F.F.)
| | - Cristiano De Stefanis
- Research Unit of Genetics of Complex Phenotypes, Bambino Gesù Children’s Hospital, IRCCS, 00165 Rome, Italy; (M.T.); (C.D.S.)
| | | | - Fabrizio Frezza
- Department of Information Engineering, Electronics and Telecommunications (DIET), “La Sapienza”, University of Rome, 00184 Rome, Italy; (F.G.); (F.B.); (L.P.); (F.M.); (F.F.)
| | - Anna Alisi
- Research Unit of Genetics of Complex Phenotypes, Bambino Gesù Children’s Hospital, IRCCS, 00165 Rome, Italy; (M.T.); (C.D.S.)
| |
Collapse
|
6
|
Xie H, Wang B, Hong Y. A deep learning approach for acute liver failure prediction with combined fully connected and convolutional neural networks. Technol Health Care 2024; 32:555-564. [PMID: 38759076 PMCID: PMC11191538 DOI: 10.3233/thc-248048] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 05/19/2024]
Abstract
BACKGROUND Acute Liver Failure (ALF) is a critical medical condition with rapid development, often caused by viral infections, hepatotoxic drug abuse, or other severe liver diseases. Timely and accurate prediction of ALF occurrence is clinically crucial. However, predicting ALF poses challenges due to the diverse physiological differences among patients and the dynamic nature of the disease. OBJECTIVE This study introduces a deep learning approach that combines fully connected and convolutional neural networks for effective ALF prediction. The goal is to overcome limitations of traditional machine learning methods and enhance predictive model performance and generalization. METHODS The proposed model integrates a fully connected neural network for handling basic patient features and a convolutional neural network dedicated to capturing temporal patterns in patient data. The combination allows automatic learning of complex patterns and abstract features present in highly dynamic medical data associated with ALF. RESULTS The model's effectiveness is demonstrated through comprehensive experiments and performance evaluations. It outperforms traditional machine learning methods, achieving 94.8% accuracy and superior generalization capabilities. CONCLUSIONS The study highlights the potential of deep learning in ALF prediction, emphasizing the importance of considering individualized medical factors. Future research should focus on improving model robustness, addressing imbalanced data, and further exploring personalized features for enhanced predictive accuracy in real-world clinical scenarios.
Collapse
Affiliation(s)
- Hefu Xie
- Xiamen University School of Information Science and Technology, Xiamen University Xiang’an Campus, Xiamen, Fujian, China
| | - Bingbing Wang
- Xiamen University School of Information Science and Technology, Xiamen University Xiang’an Campus, Xiamen, Fujian, China
- Department of Thoracic Surgery, The First Hospital Affiliated of Xiamen University, School of Medicine, Xiamen University, Xiamen, Fujian, China
| | - Yuanzhen Hong
- Hepatology Department’s Three Wards, Xiamen Hospital, Beijing University of Chinese Medicine, Xiamen, Fujian, China
| |
Collapse
|
7
|
Baek EB, Lee J, Hwang JH, Park H, Lee BS, Kim YB, Jun SY, Her J, Son HY, Cho JW. Application of multiple-finding segmentation utilizing Mask R-CNN-based deep learning in a rat model of drug-induced liver injury. Sci Rep 2023; 13:17555. [PMID: 37845356 PMCID: PMC10579263 DOI: 10.1038/s41598-023-44897-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/22/2023] [Accepted: 10/13/2023] [Indexed: 10/18/2023] Open
Abstract
Drug-induced liver injury (DILI) presents significant diagnostic challenges, and recently artificial intelligence-based deep learning technology has been used to predict various hepatic findings. In this study, we trained a set of Mask R-CNN-based deep algorithms to learn and quantify typical toxicant induced-histopathological lesions, portal area, and connective tissue in Sprague Dawley rats. We compared a set of single-finding models (SFMs) and a combined multiple-finding model (MFM) for their ability to simultaneously detect, classify, and quantify multiple hepatic findings on rat liver slide images. All of the SFMs yielded mean average precision (mAP) values above 85%, suggesting that the models had been successfully established. The MFM showed better performance than the SFMs, with a total mAP value of 92.46%. We compared the model predictions for slide images with ground-truth annotations generated by an accredited pathologist. For the MFM, the overall and individual finding predictions were highly correlated with the annotated areas, with R-squared values of 0.852, 0.952, 0.999, 0.990, and 0.958 being obtained for portal area, infiltration, necrosis, vacuolation, and connective tissue (including fibrosis), respectively. Our results indicate that the proposed MFM could be a useful tool for detecting and predicting multiple hepatic findings in basic non-clinical study settings.
Collapse
Affiliation(s)
- Eun Bok Baek
- College of Veterinary Medicine, Chungnam National University, 99 Daehak-ro, Yuseong-gu, Daejeon, 34134, Republic of Korea
| | - Jaeku Lee
- Research and Development Team, LAC Inc, Seoul, Republic of Korea
| | - Ji-Hee Hwang
- Toxicologic Pathology Research Group, Department of Advanced Toxicology Research, Korea Institute of Toxicology, 141 Gajeong-ro, Yuseong-gu, Daejeon, 34114, Republic of Korea
| | - Heejin Park
- Toxicologic Pathology Research Group, Department of Advanced Toxicology Research, Korea Institute of Toxicology, 141 Gajeong-ro, Yuseong-gu, Daejeon, 34114, Republic of Korea
| | - Byoung-Seok Lee
- Toxicologic Pathology Research Group, Department of Advanced Toxicology Research, Korea Institute of Toxicology, 141 Gajeong-ro, Yuseong-gu, Daejeon, 34114, Republic of Korea
| | - Yong-Bum Kim
- Department of Advanced Toxicology Research, Korea Institute of Toxicology, Daejeon, 34114, Republic of Korea
| | - Sang-Yeop Jun
- Research and Development Team, LAC Inc, Seoul, Republic of Korea
| | - Jun Her
- Research and Development Team, LAC Inc, Seoul, Republic of Korea
| | - Hwa-Young Son
- College of Veterinary Medicine, Chungnam National University, 99 Daehak-ro, Yuseong-gu, Daejeon, 34134, Republic of Korea.
| | - Jae-Woo Cho
- Toxicologic Pathology Research Group, Department of Advanced Toxicology Research, Korea Institute of Toxicology, 141 Gajeong-ro, Yuseong-gu, Daejeon, 34114, Republic of Korea.
| |
Collapse
|
8
|
Allaume P, Rabilloud N, Turlin B, Bardou-Jacquet E, Loréal O, Calderaro J, Khene ZE, Acosta O, De Crevoisier R, Rioux-Leclercq N, Pecot T, Kammerer-Jacquet SF. Artificial Intelligence-Based Opportunities in Liver Pathology-A Systematic Review. Diagnostics (Basel) 2023; 13:diagnostics13101799. [PMID: 37238283 DOI: 10.3390/diagnostics13101799] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/05/2023] [Revised: 05/04/2023] [Accepted: 05/12/2023] [Indexed: 05/28/2023] Open
Abstract
BACKGROUND Artificial Intelligence (AI)-based Deep Neural Networks (DNNs) can handle a wide range of applications in image analysis, ranging from automated segmentation to diagnostic and prediction. As such, they have revolutionized healthcare, including in the liver pathology field. OBJECTIVE The present study aims to provide a systematic review of applications and performances provided by DNN algorithms in liver pathology throughout the Pubmed and Embase databases up to December 2022, for tumoral, metabolic and inflammatory fields. RESULTS 42 articles were selected and fully reviewed. Each article was evaluated through the Quality Assessment of Diagnostic Accuracy Studies (QUADAS-2) tool, highlighting their risks of bias. CONCLUSIONS DNN-based models are well represented in the field of liver pathology, and their applications are diverse. Most studies, however, presented at least one domain with a high risk of bias according to the QUADAS-2 tool. Hence, DNN models in liver pathology present future opportunities and persistent limitations. To our knowledge, this review is the first one solely focused on DNN-based applications in liver pathology, and to evaluate their bias through the lens of the QUADAS2 tool.
Collapse
Affiliation(s)
- Pierre Allaume
- Department of Pathology CHU de Rennes, Rennes 1 University, Pontchaillou Hospital, 2 rue Henri Le Guilloux, CEDEX 09, 35033 Rennes, France
| | - Noémie Rabilloud
- Impact TEAM, Laboratoire Traitement du Signal et de l'Image (LTSI) INSERM, Rennes 1 University, Pontchaillou Hospital, 35033 Rennes, France
| | - Bruno Turlin
- Department of Pathology CHU de Rennes, Rennes 1 University, Pontchaillou Hospital, 2 rue Henri Le Guilloux, CEDEX 09, 35033 Rennes, France
- Research Unit n°UMR1341 NuMeCan-Nutrition, Métabolismes et Cancer, Rennes 1 University, Pontchaillou Hospital, 2 rue Henri Le Guilloux, CEDEX 09, 35033 Rennes, France
| | - Edouard Bardou-Jacquet
- Research Unit n°UMR1341 NuMeCan-Nutrition, Métabolismes et Cancer, Rennes 1 University, Pontchaillou Hospital, 2 rue Henri Le Guilloux, CEDEX 09, 35033 Rennes, France
- Department of Liver Diseases CHU de Rennes, Rennes 1 University, Pontchaillou Hospital, 35033 Rennes, France
| | - Olivier Loréal
- Research Unit n°UMR1341 NuMeCan-Nutrition, Métabolismes et Cancer, Rennes 1 University, Pontchaillou Hospital, 2 rue Henri Le Guilloux, CEDEX 09, 35033 Rennes, France
| | - Julien Calderaro
- Assistance Publique-Hôpitaux de Paris, Department of Pathology Henri Mondor, 94000 Créteil, France
- INSERM U955, Team Pathophysiology and Therapy of Chronic Viral Hepatitis and Related Cancers, 94000 Créteil, France
| | - Zine-Eddine Khene
- Impact TEAM, Laboratoire Traitement du Signal et de l'Image (LTSI) INSERM, Rennes 1 University, Pontchaillou Hospital, 35033 Rennes, France
- Department of Urology, CHU de Rennes, Rennes 1 University, Pontchaillou Hospital, 2 rue Henri Le Guilloux, CEDEX 09, 35033 Rennes, France
| | - Oscar Acosta
- Impact TEAM, Laboratoire Traitement du Signal et de l'Image (LTSI) INSERM, Rennes 1 University, Pontchaillou Hospital, 35033 Rennes, France
| | - Renaud De Crevoisier
- Impact TEAM, Laboratoire Traitement du Signal et de l'Image (LTSI) INSERM, Rennes 1 University, Pontchaillou Hospital, 35033 Rennes, France
- Department of Radiotherapy, Centre Eugène Marquis, 35033 Rennes, France
| | - Nathalie Rioux-Leclercq
- Department of Pathology CHU de Rennes, Rennes 1 University, Pontchaillou Hospital, 2 rue Henri Le Guilloux, CEDEX 09, 35033 Rennes, France
| | - Thierry Pecot
- Biosit Platform UAR 3480 CNRS US18 INSERM U955, Rennes 1 University, Pontchaillou Hospital, 35033 Rennes, France
| | - Solène-Florence Kammerer-Jacquet
- Department of Pathology CHU de Rennes, Rennes 1 University, Pontchaillou Hospital, 2 rue Henri Le Guilloux, CEDEX 09, 35033 Rennes, France
- Impact TEAM, Laboratoire Traitement du Signal et de l'Image (LTSI) INSERM, Rennes 1 University, Pontchaillou Hospital, 35033 Rennes, France
| |
Collapse
|
9
|
Liu L, Zhang R, Shi D, Li R, Wang Q, Feng Y, Lu F, Zong Y, Xu X. Automated machine learning to predict the difficulty for endoscopic resection of gastric gastrointestinal stromal tumor. Front Oncol 2023; 13:1190987. [PMID: 37234977 PMCID: PMC10206233 DOI: 10.3389/fonc.2023.1190987] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/21/2023] [Accepted: 04/26/2023] [Indexed: 05/28/2023] Open
Abstract
Background Accurate preoperative assessment of surgical difficulty is crucial to the success of the surgery and patient safety. This study aimed to evaluate the difficulty for endoscopic resection (ER) of gastric gastrointestinal stromal tumors (gGISTs) using multiple machine learning (ML) algorithms. Methods From December 2010 to December 2022, 555 patients with gGISTs in multi-centers were retrospectively studied and assigned to a training, validation, and test cohort. A difficult case was defined as meeting one of the following criteria: an operative time ≥ 90 min, severe intraoperative bleeding, or conversion to laparoscopic resection. Five types of algorithms were employed in building models, including traditional logistic regression (LR) and automated machine learning (AutoML) analysis (gradient boost machine (GBM), deep neural net (DL), generalized linear model (GLM), and default random forest (DRF)). We assessed the performance of the models using the areas under the receiver operating characteristic curves (AUC), the calibration curve, and the decision curve analysis (DCA) based on LR, as well as feature importance, SHapley Additive exPlanation (SHAP) Plots and Local Interpretable Model Agnostic Explanation (LIME) based on AutoML. Results The GBM model outperformed other models with an AUC of 0.894 in the validation and 0.791 in the test cohorts. Furthermore, the GBM model achieved the highest accuracy among these AutoML models, with 0.935 and 0.911 in the validation and test cohorts, respectively. In addition, it was found that tumor size and endoscopists' experience were the most prominent features that significantly impacted the AutoML model's performance in predicting the difficulty for ER of gGISTs. Conclusion The AutoML model based on the GBM algorithm can accurately predict the difficulty for ER of gGISTs before surgery.
Collapse
Affiliation(s)
- Luojie Liu
- Department of Gastroenterology, Changshu Hospital Affiliated to Soochow University, Suzhou, China
| | - Rufa Zhang
- Department of Gastroenterology, Changshu Hospital Affiliated to Soochow University, Suzhou, China
| | - Dongtao Shi
- Department of Gastroenterology, The First Affiliated Hospital of Soochow University, Suzhou, China
| | - Rui Li
- Department of Gastroenterology, The First Affiliated Hospital of Soochow University, Suzhou, China
| | - Qinghua Wang
- Department of Gastroenterology, No.1 People’s Hospital of Kunshan, Suzhou, China
| | - Yunfu Feng
- Department of Gastroenterology, No.1 People’s Hospital of Kunshan, Suzhou, China
| | - Fenying Lu
- Department of Gastroenterology, No.2 People’s Hospital of Changshu, Suzhou, China
| | - Yang Zong
- Department of General Surgery, Changshu Hospital Affiliated to Soochow University, Suzhou, China
| | - Xiaodan Xu
- Department of Gastroenterology, Changshu Hospital Affiliated to Soochow University, Suzhou, China
| |
Collapse
|
10
|
Hossain E, Rana R, Higgins N, Soar J, Barua PD, Pisani AR, Turner K. Natural Language Processing in Electronic Health Records in relation to healthcare decision-making: A systematic review. Comput Biol Med 2023; 155:106649. [PMID: 36805219 DOI: 10.1016/j.compbiomed.2023.106649] [Citation(s) in RCA: 25] [Impact Index Per Article: 25.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/03/2022] [Revised: 01/04/2023] [Accepted: 02/07/2023] [Indexed: 02/12/2023]
Abstract
BACKGROUND Natural Language Processing (NLP) is widely used to extract clinical insights from Electronic Health Records (EHRs). However, the lack of annotated data, automated tools, and other challenges hinder the full utilisation of NLP for EHRs. Various Machine Learning (ML), Deep Learning (DL) and NLP techniques are studied and compared to understand the limitations and opportunities in this space comprehensively. METHODOLOGY After screening 261 articles from 11 databases, we included 127 papers for full-text review covering seven categories of articles: (1) medical note classification, (2) clinical entity recognition, (3) text summarisation, (4) deep learning (DL) and transfer learning architecture, (5) information extraction, (6) Medical language translation and (7) other NLP applications. This study follows the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. RESULT AND DISCUSSION EHR was the most commonly used data type among the selected articles, and the datasets were primarily unstructured. Various ML and DL methods were used, with prediction or classification being the most common application of ML or DL. The most common use cases were: the International Classification of Diseases, Ninth Revision (ICD-9) classification, clinical note analysis, and named entity recognition (NER) for clinical descriptions and research on psychiatric disorders. CONCLUSION We find that the adopted ML models were not adequately assessed. In addition, the data imbalance problem is quite important, yet we must find techniques to address this underlining problem. Future studies should address key limitations in studies, primarily identifying Lupus Nephritis, Suicide Attempts, perinatal self-harmed and ICD-9 classification.
Collapse
Affiliation(s)
- Elias Hossain
- School of Engineering & Physical Sciences, North South University, Dhaka 1229, Bangladesh.
| | - Rajib Rana
- School of Mathematics, Physics and Computing, University of Southern Queensland, Springfield Central QLD 4300, Australia
| | - Niall Higgins
- School of Management and Enterprise, University of Southern Queensland, Darling Heights QLD 4350, Australia; School of Nursing, Queensland University of Technology, Kelvin Grove, Brisbane, QLD 4000, Australia; Metro North Mental Health, Herston QLD 4029, Australia
| | - Jeffrey Soar
- School of Business, University of Southern Queensland, Springfield Central QLD 4300, Australia
| | - Prabal Datta Barua
- School of Business, University of Southern Queensland, Springfield Central QLD 4300, Australia
| | - Anthony R Pisani
- Center for the Study and Prevention of Suicide, University of Rochester, Rochester, NY, United States
| | - Kathryn Turner
- School of Nursing, Queensland University of Technology, Kelvin Grove, Brisbane, QLD 4000, Australia
| |
Collapse
|
11
|
Jungo P, Hewer E. Code-free machine learning for classification of central nervous system histopathology images. J Neuropathol Exp Neurol 2023; 82:221-230. [PMID: 36734664 PMCID: PMC9941804 DOI: 10.1093/jnen/nlac131] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/04/2023] Open
Abstract
Machine learning (ML), an application of artificial intelligence, is currently transforming the analysis of biomedical data and specifically of biomedical images including histopathology. The promises of this technology contrast, however, with its currently limited application in routine clinical practice. This discrepancy is in part due to the extent of informatics expertise typically required for implementation of ML. Therefore, we assessed the suitability of 2 publicly accessible code-free ML platforms (Microsoft Custom Vision and Google AutoML), for classification of histopathological images of diagnostic central nervous system tissue samples. When trained with typically 100 to more than 1000 images, both systems were able to perform nontrivial classifications (glioma vs brain metastasis; astrocytoma vs astrocytosis, prediction of 1p/19q co-deletion in IDH-mutant tumors) based on hematoxylin and eosin-stained images with high accuracy (from ∼80% to nearly 100%). External validation of the predicted accuracy and negative control experiments were found to be crucial for verification of the accuracy predicted by the algorithms. Furthermore, we propose a possible diagnostic workflow for pathologists to implement classification of histopathological images based on code-free machine platforms.
Collapse
Affiliation(s)
- Patric Jungo
- Institute of Pathology, University of Bern, Bern, Switzerland
| | - Ekkehard Hewer
- Institute of Pathology, University of Bern, Bern, Switzerland
| |
Collapse
|
12
|
Lin J, Li M, Mak W, Shi Y, Zhu X, Tang Z, He Q, Xiang X. Applications of In Silico Models to Predict Drug-Induced Liver Injury. TOXICS 2022; 10:788. [PMID: 36548621 PMCID: PMC9785299 DOI: 10.3390/toxics10120788] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 10/21/2022] [Revised: 12/09/2022] [Accepted: 12/13/2022] [Indexed: 06/17/2023]
Abstract
Drug-induced liver injury (DILI) is a major cause of the withdrawal of pre-marketed drugs, typically attributed to oxidative stress, mitochondrial damage, disrupted bile acid homeostasis, and innate immune-related inflammation. DILI can be divided into intrinsic and idiosyncratic DILI with cholestatic liver injury as an important manifestation. The diagnosis of DILI remains a challenge today and relies on clinical judgment and knowledge of the insulting agent. Early prediction of hepatotoxicity is an important but still unfulfilled component of drug development. In response, in silico modeling has shown good potential to fill the missing puzzle. Computer algorithms, with machine learning and artificial intelligence as a representative, can be established to initiate a reaction on the given condition to predict DILI. DILIsym is a mechanistic approach that integrates physiologically based pharmacokinetic modeling with the mechanisms of hepatoxicity and has gained increasing popularity for DILI prediction. This article reviews existing in silico approaches utilized to predict DILI risks in clinical medication and provides an overview of the underlying principles and related practical applications.
Collapse
Affiliation(s)
| | | | | | | | | | | | - Qingfeng He
- Correspondence: (Q.H.); (X.X.); Tel.: +86-21-51980024 (X.X.)
| | - Xiaoqiang Xiang
- Correspondence: (Q.H.); (X.X.); Tel.: +86-21-51980024 (X.X.)
| |
Collapse
|
13
|
|
14
|
Region-Based Convolutional Neural Network for Wind Turbine Wake Characterization in Complex Terrain. REMOTE SENSING 2021. [DOI: 10.3390/rs13214438] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
We present a proof of concept of wind turbine wake identification and characterization using a region-based convolutional neural network (CNN) applied to lidar arc scan images taken at a wind farm in complex terrain. We show that the CNN successfully identifies and characterizes wakes in scans with varying resolutions and geometries, and can capture wake characteristics in spatially heterogeneous fields resulting from data quality control procedures and complex background flow fields. The geometry, spatial extent and locations of wakes and wake fragments exhibit close accord with results from visual inspection. The model exhibits a 95% success rate in identifying wakes when they are present in scans and characterizing their shape. To test model robustness to varying image quality, we reduced the scan density to half the original resolution through down-sampling range gates. This causes a reduction in skill, yet 92% of wakes are still successfully identified. When grouping scans by meteorological conditions and utilizing the CNN for wake characterization under full and half resolution, wake characteristics are consistent with a priori expectations for wake behavior in different inflow and stability conditions.
Collapse
|
15
|
Vall A, Sabnis Y, Shi J, Class R, Hochreiter S, Klambauer G. The Promise of AI for DILI Prediction. Front Artif Intell 2021; 4:638410. [PMID: 33937745 PMCID: PMC8080874 DOI: 10.3389/frai.2021.638410] [Citation(s) in RCA: 26] [Impact Index Per Article: 8.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/06/2020] [Accepted: 02/02/2021] [Indexed: 12/11/2022] Open
Abstract
Drug-induced liver injury (DILI) is a common reason for the withdrawal of a drug from the market. Early assessment of DILI risk is an essential part of drug development, but it is rendered challenging prior to clinical trials by the complex factors that give rise to liver damage. Artificial intelligence (AI) approaches, particularly those building on machine learning, range from random forests to more recent techniques such as deep learning, and provide tools that can analyze chemical compounds and accurately predict some of their properties based purely on their structure. This article reviews existing AI approaches to predicting DILI and elaborates on the challenges that arise from the as yet limited availability of data. Future directions are discussed focusing on rich data modalities, such as 3D spheroids, and the slow but steady increase in drugs annotated with DILI risk labels.
Collapse
Affiliation(s)
- Andreu Vall
- LIT AI Lab, Johannes Kepler University Linz, Linz, Austria.,Institute for Machine Learning, Johannes Kepler University Linz, Linz, Austria
| | | | - Jiye Shi
- UCB Biopharma SRL, Braine-l'Alleud, Belgium
| | | | - Sepp Hochreiter
- LIT AI Lab, Johannes Kepler University Linz, Linz, Austria.,Institute for Machine Learning, Johannes Kepler University Linz, Linz, Austria.,Institute of Advanced Research in Artificial Intelligence (IARAI), Vienna, Austria
| | - Günter Klambauer
- LIT AI Lab, Johannes Kepler University Linz, Linz, Austria.,Institute for Machine Learning, Johannes Kepler University Linz, Linz, Austria
| |
Collapse
|
16
|
Abstract
Machine learning (ML) has been slowly entering every aspect of our lives and its positive impact has been astonishing. To accelerate embedding ML in more applications and incorporating it in real-world scenarios, automated machine learning (AutoML) is emerging. The main purpose of AutoML is to provide seamless integration of ML in various industries, which will facilitate better outcomes in everyday tasks. In healthcare, AutoML has been already applied to easier settings with structured data such as tabular lab data. However, there is still a need for applying AutoML for interpreting medical text, which is being generated at a tremendous rate. For this to happen, a promising method is AutoML for clinical notes analysis, which is an unexplored research area representing a gap in ML research. The main objective of this paper is to fill this gap and provide a comprehensive survey and analytical study towards AutoML for clinical notes. To that end, we first introduce the AutoML technology and review its various tools and techniques. We then survey the literature of AutoML in the healthcare industry and discuss the developments specific to clinical settings, as well as those using general AutoML tools for healthcare applications. With this background, we then discuss challenges of working with clinical notes and highlight the benefits of developing AutoML for medical notes processing. Next, we survey relevant ML research for clinical notes and analyze the literature and the field of AutoML in the healthcare industry. Furthermore, we propose future research directions and shed light on the challenges and opportunities this emerging field holds. With this, we aim to assist the community with the implementation of an AutoML platform for medical notes, which if realized can revolutionize patient outcomes.
Collapse
|