1
|
Zhang P, Gao C, Huang Y, Chen X, Pan Z, Wang L, Dong D, Li S, Qi X. Artificial intelligence in liver imaging: methods and applications. Hepatol Int 2024; 18:422-434. [PMID: 38376649 DOI: 10.1007/s12072-023-10630-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/15/2023] [Accepted: 12/18/2023] [Indexed: 02/21/2024]
Abstract
Liver disease is regarded as one of the major health threats to humans. Radiographic assessments hold promise in terms of addressing the current demands for precisely diagnosing and treating liver diseases, and artificial intelligence (AI), which excels at automatically making quantitative assessments of complex medical image characteristics, has made great strides regarding the qualitative interpretation of medical imaging by clinicians. Here, we review the current state of medical-imaging-based AI methodologies and their applications concerning the management of liver diseases. We summarize the representative AI methodologies in liver imaging with focusing on deep learning, and illustrate their promising clinical applications across the spectrum of precise liver disease detection, diagnosis and treatment. We also address the current challenges and future perspectives of AI in liver imaging, with an emphasis on feature interpretability, multimodal data integration and multicenter study. Taken together, it is revealed that AI methodologies, together with the large volume of available medical image data, might impact the future of liver disease care.
Collapse
Affiliation(s)
- Peng Zhang
- Institute for TCM-X, MOE Key Laboratory of Bioinformatics, Bioinformatics Division, BNRIST, Department of Automation, Tsinghua University, Beijing, China
| | - Chaofei Gao
- Institute for TCM-X, MOE Key Laboratory of Bioinformatics, Bioinformatics Division, BNRIST, Department of Automation, Tsinghua University, Beijing, China
| | - Yifei Huang
- Department of Gastroenterology, The Third Affiliated Hospital of Sun Yat-sen University, Guangzhou, China
| | - Xiangyi Chen
- Institute for TCM-X, MOE Key Laboratory of Bioinformatics, Bioinformatics Division, BNRIST, Department of Automation, Tsinghua University, Beijing, China
| | - Zhuoshi Pan
- Institute for TCM-X, MOE Key Laboratory of Bioinformatics, Bioinformatics Division, BNRIST, Department of Automation, Tsinghua University, Beijing, China
| | - Lan Wang
- Institute for TCM-X, MOE Key Laboratory of Bioinformatics, Bioinformatics Division, BNRIST, Department of Automation, Tsinghua University, Beijing, China
| | - Di Dong
- CAS Key Laboratory of Molecular Imaging, Beijing Key Laboratory of Molecular Imaging, Institute of Automation, Chinese Academy of Sciences, Beijing, 100190, China
| | - Shao Li
- Institute for TCM-X, MOE Key Laboratory of Bioinformatics, Bioinformatics Division, BNRIST, Department of Automation, Tsinghua University, Beijing, China.
| | - Xiaolong Qi
- Center of Portal Hypertension, Department of Radiology, Zhongda Hospital, Medical School, Nurturing Center of Jiangsu Province for State Laboratory of AI Imaging & Interventional Radiology, Southeast University, Nanjing, China.
| |
Collapse
|
2
|
Chongo G, Soldera J. Use of machine learning models for the prognostication of liver transplantation: A systematic review. World J Transplant 2024; 14:88891. [PMID: 38576762 PMCID: PMC10989468 DOI: 10.5500/wjt.v14.i1.88891] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/13/2023] [Revised: 11/08/2023] [Accepted: 12/11/2023] [Indexed: 03/15/2024] Open
Abstract
BACKGROUND Liver transplantation (LT) is a life-saving intervention for patients with end-stage liver disease. However, the equitable allocation of scarce donor organs remains a formidable challenge. Prognostic tools are pivotal in identifying the most suitable transplant candidates. Traditionally, scoring systems like the model for end-stage liver disease have been instrumental in this process. Nevertheless, the landscape of prognostication is undergoing a transformation with the integration of machine learning (ML) and artificial intelligence models. AIM To assess the utility of ML models in prognostication for LT, comparing their per formance and reliability to established traditional scoring systems. METHODS Following the Preferred Reporting Items for Systematic Reviews and Meta-Analysis guidelines, we conducted a thorough and standardized literature search using the PubMed/MEDLINE database. Our search imposed no restrictions on publication year, age, or gender. Exclusion criteria encompassed non-English stu dies, review articles, case reports, conference papers, studies with missing data, or those exhibiting evident methodological flaws. RESULTS Our search yielded a total of 64 articles, with 23 meeting the inclusion criteria. Among the selected studies, 60.8% originated from the United States and China combined. Only one pediatric study met the criteria. Notably, 91% of the studies were published within the past five years. ML models consistently demonstrated satisfactory to excellent area under the receiver operating characteristic curve values (ranging from 0.6 to 1) across all studies, surpassing the performance of traditional scoring systems. Random forest exhibited superior predictive capa bilities for 90-d mortality following LT, sepsis, and acute kidney injury (AKI). In contrast, gradient boosting excelled in predicting the risk of graft-versus-host disease, pneumonia, and AKI. CONCLUSION This study underscores the potential of ML models in guiding decisions related to allograft allocation and LT, marking a significant evolution in the field of prognostication.
Collapse
Affiliation(s)
- Gidion Chongo
- Department of Gastroenterology, University of South Wales, Cardiff CF37 1DL, United Kingdom
| | - Jonathan Soldera
- Department of Gastroenterology, University of South Wales, Cardiff CF37 1DL, United Kingdom
| |
Collapse
|
3
|
Lu F, Meng Y, Song X, Li X, Liu Z, Gu C, Zheng X, Jing Y, Cai W, Pinyopornpanish K, Mancuso A, Romeiro FG, Méndez-Sánchez N, Qi X. Artificial Intelligence in Liver Diseases: Recent Advances. Adv Ther 2024; 41:967-990. [PMID: 38286960 DOI: 10.1007/s12325-024-02781-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/12/2023] [Accepted: 01/03/2024] [Indexed: 01/31/2024]
Abstract
Liver diseases cause a significant burden on public health worldwide. In spite of great advances during recent years, there are still many challenges in the diagnosis and treatment of liver diseases. During recent years, artificial intelligence (AI) has been widely used for the diagnosis, risk stratification, and prognostic prediction of various diseases based on clinical datasets and medical images. Accumulative studies have shown its performance for diagnosing patients with nonalcoholic fatty liver disease and liver fibrosis and assessing their severity, and for predicting treatment response and recurrence of hepatocellular carcinoma, outcomes of liver transplantation recipients, and risk of drug-induced liver injury. Herein, we aim to comprehensively summarize the current evidence regarding diagnostic, prognostic, and/or therapeutic role of AI in these common liver diseases.
Collapse
Affiliation(s)
- Feifei Lu
- College of Medicine and Biological Information Engineering, Northeastern University, Shenyang, China
- Liver Cirrhosis Study Group, Department of Gastroenterology, General Hospital of Northern Theater Command, No. 83 Wenhua Road, Shenyang, 110840, Liaoning Province, China
| | - Yao Meng
- Liver Cirrhosis Study Group, Department of Gastroenterology, General Hospital of Northern Theater Command, No. 83 Wenhua Road, Shenyang, 110840, Liaoning Province, China
- Postgraduate College, Dalian Medical University, Dalian, China
| | - Xiaoting Song
- Liver Cirrhosis Study Group, Department of Gastroenterology, General Hospital of Northern Theater Command, No. 83 Wenhua Road, Shenyang, 110840, Liaoning Province, China
- Postgraduate College, Dalian Medical University, Dalian, China
| | - Xiaotong Li
- Liver Cirrhosis Study Group, Department of Gastroenterology, General Hospital of Northern Theater Command, No. 83 Wenhua Road, Shenyang, 110840, Liaoning Province, China
- Postgraduate College, China Medical University, Shenyang, China
| | - Zhuang Liu
- Liver Cirrhosis Study Group, Department of Gastroenterology, General Hospital of Northern Theater Command, No. 83 Wenhua Road, Shenyang, 110840, Liaoning Province, China
- Postgraduate College, China Medical University, Shenyang, China
| | - Chunru Gu
- Liver Cirrhosis Study Group, Department of Gastroenterology, General Hospital of Northern Theater Command, No. 83 Wenhua Road, Shenyang, 110840, Liaoning Province, China
- Postgraduate College, China Medical University, Shenyang, China
| | - Xiaojie Zheng
- Liver Cirrhosis Study Group, Department of Gastroenterology, General Hospital of Northern Theater Command, No. 83 Wenhua Road, Shenyang, 110840, Liaoning Province, China
- Postgraduate College, China Medical University, Shenyang, China
| | - Yi Jing
- Neusoft Research of Intelligent Healthcare Technology, Co. Ltd., Shenyang, China
| | - Wei Cai
- Neusoft Research of Intelligent Healthcare Technology, Co. Ltd., Shenyang, China
| | - Kanokwan Pinyopornpanish
- Department of Internal Medicine, Faculty of Medicine, Chiang Mai University, Chiang Mai, Thailand
| | - Andrea Mancuso
- Medicina Interna 1, Azienda di Rilievo Nazionale Ad Alta Specializzazione Civico-Di Cristina-Benfratelli, Palermo, Italy.
| | | | - Nahum Méndez-Sánchez
- Liver Research Unit, Medica Sur Clinic and Foundation, National Autonomous University of Mexico, Mexico City, Mexico.
| | - Xingshun Qi
- College of Medicine and Biological Information Engineering, Northeastern University, Shenyang, China.
- Liver Cirrhosis Study Group, Department of Gastroenterology, General Hospital of Northern Theater Command, No. 83 Wenhua Road, Shenyang, 110840, Liaoning Province, China.
- Postgraduate College, Dalian Medical University, Dalian, China.
- Postgraduate College, China Medical University, Shenyang, China.
| |
Collapse
|
4
|
Xia T, Zhao B, Li B, Lei Y, Song Y, Wang Y, Tang T, Ju S. MRI-Based Radiomics and Deep Learning in Biological Characteristics and Prognosis of Hepatocellular Carcinoma: Opportunities and Challenges. J Magn Reson Imaging 2024; 59:767-783. [PMID: 37647155 DOI: 10.1002/jmri.28982] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/20/2023] [Revised: 08/15/2023] [Accepted: 08/16/2023] [Indexed: 09/01/2023] Open
Abstract
Hepatocellular carcinoma (HCC) is the fifth most common malignancy and the third leading cause of cancer-related death worldwide. HCC exhibits strong inter-tumor heterogeneity, with different biological characteristics closely associated with prognosis. In addition, patients with HCC often distribute at different stages and require diverse treatment options at each stage. Due to the variability in tumor sensitivity to different therapies, determining the optimal treatment approach can be challenging for clinicians prior to treatment. Artificial intelligence (AI) technology, including radiomics and deep learning approaches, has emerged as a unique opportunity to improve the spectrum of HCC clinical care by predicting biological characteristics and prognosis in the medical imaging field. The radiomics approach utilizes handcrafted features derived from specific mathematical formulas to construct various machine-learning models for medical applications. In terms of the deep learning approach, convolutional neural network models are developed to achieve high classification performance based on automatic feature extraction from images. Magnetic resonance imaging offers the advantage of superior tissue resolution and functional information. This comprehensive evaluation plays a vital role in the accurate assessment and effective treatment planning for HCC patients. Recent studies have applied radiomics and deep learning approaches to develop AI-enabled models to improve accuracy in predicting biological characteristics and prognosis, such as microvascular invasion and tumor recurrence. Although AI-enabled models have demonstrated promising potential in HCC with biological characteristics and prognosis prediction with high performance, one of the biggest challenges, interpretability, has hindered their implementation in clinical practice. In the future, continued research is needed to improve the interpretability of AI-enabled models, including aspects such as domain knowledge, novel algorithms, and multi-dimension data sources. Overcoming these challenges would allow AI-enabled models to significantly impact the care provided to HCC patients, ultimately leading to their deployment for clinical use. LEVEL OF EVIDENCE: 5 TECHNICAL EFFICACY: Stage 2.
Collapse
Affiliation(s)
- Tianyi Xia
- Jiangsu Key Laboratory of Molecular and Functional Imaging, Department of Radiology, Zhongda Hospital, School of Medicine, Southeast University, Nanjing, China
| | - Ben Zhao
- Jiangsu Key Laboratory of Molecular and Functional Imaging, Department of Radiology, Zhongda Hospital, School of Medicine, Southeast University, Nanjing, China
| | - Binrong Li
- Jiangsu Key Laboratory of Molecular and Functional Imaging, Department of Radiology, Zhongda Hospital, School of Medicine, Southeast University, Nanjing, China
| | - Ying Lei
- Jiangsu Key Laboratory of Molecular and Functional Imaging, Department of Radiology, Zhongda Hospital, School of Medicine, Southeast University, Nanjing, China
| | - Yang Song
- MR Scientific Marketing, Siemens Healthineers Ltd., Shanghai, China
| | - Yuancheng Wang
- Jiangsu Key Laboratory of Molecular and Functional Imaging, Department of Radiology, Zhongda Hospital, School of Medicine, Southeast University, Nanjing, China
| | - Tianyu Tang
- Jiangsu Key Laboratory of Molecular and Functional Imaging, Department of Radiology, Zhongda Hospital, School of Medicine, Southeast University, Nanjing, China
| | - Shenghong Ju
- Jiangsu Key Laboratory of Molecular and Functional Imaging, Department of Radiology, Zhongda Hospital, School of Medicine, Southeast University, Nanjing, China
| |
Collapse
|
5
|
Amador K, Gutierrez A, Winder A, Fiehler J, Wilms M, Forkert ND. Providing clinical context to the spatio-temporal analysis of 4D CT perfusion to predict acute ischemic stroke lesion outcomes. J Biomed Inform 2024; 149:104567. [PMID: 38096945 DOI: 10.1016/j.jbi.2023.104567] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/09/2023] [Revised: 10/25/2023] [Accepted: 12/07/2023] [Indexed: 12/18/2023]
Abstract
Acute ischemic stroke is a leading cause of mortality and morbidity worldwide. Timely identification of the extent of a stroke is crucial for effective treatment, whereas spatio-temporal (4D) Computed Tomography Perfusion (CTP) imaging is playing a critical role in this process. Recently, the first deep learning-based methods that leverage the full spatio-temporal nature of perfusion imaging for predicting stroke lesion outcomes have been proposed. However, clinical information is typically not integrated into the learning process, which may be helpful to improve the tissue outcome prediction given the known influence of various factors (i.e., physiological, demographic, and treatment factors) on lesion growth. Cross-attention, a multimodal fusion strategy, has been successfully used to combine information from multiple sources, but it has yet to be applied to stroke lesion outcome prediction. Therefore, this work aimed to develop and evaluate a novel multimodal and spatio-temporal deep learning model that utilizes cross-attention to combine information from 4D CTP and clinical metadata simultaneously to predict stroke lesion outcomes. The proposed model was evaluated using a dataset of 70 acute ischemic stroke patients, demonstrating significantly improved volume estimates (mean error = 19 ml) compared to a baseline unimodal approach (mean error = 35 ml, p< 0.05). The proposed model allows generating attention maps and counterfactual outcome scenarios to investigate the relevance of clinical variables in predicting stroke lesion outcomes at a patient level, helping to provide a better understanding of the model's decision-making process.
Collapse
Affiliation(s)
- Kimberly Amador
- Biomedical Engineering Graduate Program, University of Calgary, Calgary, Canada; Department of Radiology, University of Calgary, Calgary, Canada; Hotchkiss Brain Institute, University of Calgary, Calgary, Canada; Alberta Children's Hospital Research Institute, University of Calgary, Calgary, Canada.
| | - Alejandro Gutierrez
- Biomedical Engineering Graduate Program, University of Calgary, Calgary, Canada; Department of Radiology, University of Calgary, Calgary, Canada; Hotchkiss Brain Institute, University of Calgary, Calgary, Canada; Alberta Children's Hospital Research Institute, University of Calgary, Calgary, Canada
| | - Anthony Winder
- Department of Radiology, University of Calgary, Calgary, Canada; Hotchkiss Brain Institute, University of Calgary, Calgary, Canada
| | - Jens Fiehler
- Department of Diagnostic and Interventional Neuroradiology, University Medical Center Hamburg-Eppendorf, Hamburg, Germany
| | - Matthias Wilms
- Hotchkiss Brain Institute, University of Calgary, Calgary, Canada; Alberta Children's Hospital Research Institute, University of Calgary, Calgary, Canada; Departments of Pediatrics and Community Health Sciences, University of Calgary, Calgary, Canada
| | - Nils D Forkert
- Department of Radiology, University of Calgary, Calgary, Canada; Hotchkiss Brain Institute, University of Calgary, Calgary, Canada; Alberta Children's Hospital Research Institute, University of Calgary, Calgary, Canada; Department of Clinical Neurosciences, University of Calgary, Calgary, Canada
| |
Collapse
|
6
|
Sharma P, Nayak DR, Balabantaray BK, Tanveer M, Nayak R. A survey on cancer detection via convolutional neural networks: Current challenges and future directions. Neural Netw 2024; 169:637-659. [PMID: 37972509 DOI: 10.1016/j.neunet.2023.11.006] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/01/2023] [Revised: 10/21/2023] [Accepted: 11/04/2023] [Indexed: 11/19/2023]
Abstract
Cancer is a condition in which abnormal cells uncontrollably split and damage the body tissues. Hence, detecting cancer at an early stage is highly essential. Currently, medical images play an indispensable role in detecting various cancers; however, manual interpretation of these images by radiologists is observer-dependent, time-consuming, and tedious. An automatic decision-making process is thus an essential need for cancer detection and diagnosis. This paper presents a comprehensive survey on automated cancer detection in various human body organs, namely, the breast, lung, liver, prostate, brain, skin, and colon, using convolutional neural networks (CNN) and medical imaging techniques. It also includes a brief discussion about deep learning based on state-of-the-art cancer detection methods, their outcomes, and the possible medical imaging data used. Eventually, the description of the dataset used for cancer detection, the limitations of the existing solutions, future trends, and challenges in this domain are discussed. The utmost goal of this paper is to provide a piece of comprehensive and insightful information to researchers who have a keen interest in developing CNN-based models for cancer detection.
Collapse
Affiliation(s)
- Pallabi Sharma
- School of Computer Science, UPES, Dehradun, 248007, Uttarakhand, India.
| | - Deepak Ranjan Nayak
- Department of Computer Science and Engineering, Malaviya National Institute of Technology, Jaipur, 302017, Rajasthan, India.
| | - Bunil Kumar Balabantaray
- Computer Science and Engineering, National Institute of Technology Meghalaya, Shillong, 793003, Meghalaya, India.
| | - M Tanveer
- Department of Mathematics, Indian Institute of Technology Indore, Simrol, 453552, Indore, India.
| | - Rajashree Nayak
- School of Applied Sciences, Birla Global University, Bhubaneswar, 751029, Odisha, India.
| |
Collapse
|
7
|
Bazoge A, Morin E, Daille B, Gourraud PA. Applying Natural Language Processing to Textual Data From Clinical Data Warehouses: Systematic Review. JMIR Med Inform 2023; 11:e42477. [PMID: 38100200 PMCID: PMC10757232 DOI: 10.2196/42477] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/05/2022] [Revised: 01/16/2023] [Accepted: 09/07/2023] [Indexed: 12/17/2023] Open
Abstract
BACKGROUND In recent years, health data collected during the clinical care process have been often repurposed for secondary use through clinical data warehouses (CDWs), which interconnect disparate data from different sources. A large amount of information of high clinical value is stored in unstructured text format. Natural language processing (NLP), which implements algorithms that can operate on massive unstructured textual data, has the potential to structure the data and make clinical information more accessible. OBJECTIVE The aim of this review was to provide an overview of studies applying NLP to textual data from CDWs. It focuses on identifying the (1) NLP tasks applied to data from CDWs and (2) NLP methods used to tackle these tasks. METHODS This review was performed according to the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines. We searched for relevant articles in 3 bibliographic databases: PubMed, Google Scholar, and ACL Anthology. We reviewed the titles and abstracts and included articles according to the following inclusion criteria: (1) focus on NLP applied to textual data from CDWs, (2) articles published between 1995 and 2021, and (3) written in English. RESULTS We identified 1353 articles, of which 194 (14.34%) met the inclusion criteria. Among all identified NLP tasks in the included papers, information extraction from clinical text (112/194, 57.7%) and the identification of patients (51/194, 26.3%) were the most frequent tasks. To address the various tasks, symbolic methods were the most common NLP methods (124/232, 53.4%), showing that some tasks can be partially achieved with classical NLP techniques, such as regular expressions or pattern matching that exploit specialized lexica, such as drug lists and terminologies. Machine learning (70/232, 30.2%) and deep learning (38/232, 16.4%) have been increasingly used in recent years, including the most recent approaches based on transformers. NLP methods were mostly applied to English language data (153/194, 78.9%). CONCLUSIONS CDWs are central to the secondary use of clinical texts for research purposes. Although the use of NLP on data from CDWs is growing, there remain challenges in this field, especially with regard to languages other than English. Clinical NLP is an effective strategy for accessing, extracting, and transforming data from CDWs. Information retrieved with NLP can assist in clinical research and have an impact on clinical practice.
Collapse
Affiliation(s)
- Adrien Bazoge
- Nantes Université, École Centrale Nantes, CNRS, LS2N, UMR 6004, F-44000 Nantes, France
- Nantes Université, CHU de Nantes, Pôle Hospitalo-Universitaire 11: Santé Publique, Clinique des données, INSERM, CIC 1413, F-44000 Nantes, France
| | - Emmanuel Morin
- Nantes Université, École Centrale Nantes, CNRS, LS2N, UMR 6004, F-44000 Nantes, France
| | - Béatrice Daille
- Nantes Université, École Centrale Nantes, CNRS, LS2N, UMR 6004, F-44000 Nantes, France
| | - Pierre-Antoine Gourraud
- Nantes Université, CHU de Nantes, Pôle Hospitalo-Universitaire 11: Santé Publique, Clinique des données, INSERM, CIC 1413, F-44000 Nantes, France
- Nantes Université, INSERM, CHU de Nantes, École Centrale Nantes, Centre de Recherche Translationnelle en Transplantation et Immunologie, CR2TI, F-44000 Nantes, France
| |
Collapse
|
8
|
Rabindranath M, Naghibzadeh M, Zhao X, Holdsworth S, Brudno M, Sidhu A, Bhat M. Clinical Deployment of Machine Learning Tools in Transplant Medicine: What Does the Future Hold? Transplantation 2023:00007890-990000000-00616. [PMID: 38059716 DOI: 10.1097/tp.0000000000004876] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/08/2023]
Abstract
Medical applications of machine learning (ML) have shown promise in analyzing patient data to support clinical decision-making and provide patient-specific outcomes. In transplantation, several applications of ML exist which include pretransplant: patient prioritization, donor-recipient matching, organ allocation, and posttransplant outcomes. Numerous studies have shown the development and utility of ML models, which have the potential to augment transplant medicine. Despite increasing efforts to develop robust ML models for clinical use, very few of these tools are deployed in the healthcare setting. Here, we summarize the current applications of ML in transplant and discuss a potential clinical deployment framework using examples in organ transplantation. We identified that creating an interdisciplinary team, curating a reliable dataset, addressing the barriers to implementation, and understanding current clinical evaluation models could help in deploying ML models into the transplant clinic setting.
Collapse
Affiliation(s)
- Madhumitha Rabindranath
- Transplant AI Initiative, Ajmera Transplant Program, University Health Network, Toronto, ON, Canada
- Institute of Medical Science, University of Toronto, Toronto, ON, Canada
- Toronto General Hospital Research Institute, University Health Network, Toronto, ON, Canada
| | - Maryam Naghibzadeh
- Transplant AI Initiative, Ajmera Transplant Program, University Health Network, Toronto, ON, Canada
| | - Xun Zhao
- Transplant AI Initiative, Ajmera Transplant Program, University Health Network, Toronto, ON, Canada
| | - Sandra Holdsworth
- Transplant AI Initiative, Ajmera Transplant Program, University Health Network, Toronto, ON, Canada
| | - Michael Brudno
- Transplant AI Initiative, Ajmera Transplant Program, University Health Network, Toronto, ON, Canada
- Department of Computer Science, University of Toronto, Toronto, ON, Canada
| | - Aman Sidhu
- Transplant AI Initiative, Ajmera Transplant Program, University Health Network, Toronto, ON, Canada
- Department of Medicine, University of Toronto, Toronto, ON, Canada
| | - Mamatha Bhat
- Transplant AI Initiative, Ajmera Transplant Program, University Health Network, Toronto, ON, Canada
- Institute of Medical Science, University of Toronto, Toronto, ON, Canada
- Toronto General Hospital Research Institute, University Health Network, Toronto, ON, Canada
- Department of Medicine, University of Toronto, Toronto, ON, Canada
| |
Collapse
|
9
|
Nie P, Zhang J, Miao W, Duan S, Wang T, Zhang J, Gu J, Wang N, Zhang R, Wang X, Yang G, Rao W, Wang Z. Incremental value of radiomics-based heterogeneity to the existing risk criteria in predicting recurrence of hepatocellular carcinoma after liver transplantation. Eur Radiol 2023; 33:6608-6618. [PMID: 37012548 DOI: 10.1007/s00330-023-09591-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/16/2022] [Revised: 01/02/2023] [Accepted: 02/17/2023] [Indexed: 04/05/2023]
Abstract
OBJECTIVES The aim of the study was to evaluate the association between the radiomics-based intratumoral heterogeneity (ITH) and the recurrence risk in hepatocellular carcinoma (HCC) patients after liver transplantation (LT), and to assess its incremental to the Milan, University of California San Francisco (UCSF), Metro-Ticket 2.0, and Hangzhou criteria. METHODS A multicenter cohort of 196 HCC patients were investigated. The endpoint was recurrence-free survival (RFS) after LT. A CT-based radiomics signature (RS) was constructed and assessed in the whole cohort and in the subgroups stratified by the Milan, UCSF, Metro-Ticket 2.0, and Hangzhou criteria. The R-Milan, R-UCSF, R-Metro-Ticket 2.0, and R-Hangzhou nomograms which combined RS and the four existing risk criteria were developed respectively. The incremental value of RS to the four existing risk criteria in RFS prediction was evaluated. RESULTS RS was significantly associated with RFS in the training and test cohorts as well as in the subgroups stratified by the existing risk criteria. The four combined nomograms showed better predictive capability than the existing risk criteria did with higher C-indices (R-Milan [training/test] vs. Milan, 0.745/0.765 vs. 0.677; R-USCF vs. USCF, 0.748/0.767 vs. 0.675; R-Metro-Ticket 2.0 vs. Metro-Ticket 2.0, 0.756/0.783 vs. 0.670; R-Hangzhou vs. Hangzhou, 0.751/0.760 vs. 0.691) and higher clinical net benefit. CONCLUSIONS The radiomics-based ITH can predict outcomes and provide incremental value to the existing risk criteria in HCC patients after LT. Incorporating radiomics-based ITH in HCC risk criteria may facilitate candidate selection, surveillance, and adjuvant trial design. KEY POINTS • Milan, USCF, Metro-Ticket 2.0, and Hangzhou criteria may be insufficient for outcome prediction in HCC after LT. • Radiomics allows for the characterization of tumor heterogeneity. • Radiomics adds incremental value to the existing criteria in outcome prediction.
Collapse
Affiliation(s)
- Pei Nie
- Department of Radiology, The Affiliated Hospital of Qingdao University, Qingdao, Shandong, China
| | - Juntao Zhang
- GE Healthcare, Precision Health Institution, Shanghai, China
| | - Wenjie Miao
- Department of Nuclear Medicine, The Affiliated Hospital of Qingdao University, No. 59, Haier Road, Qingdao, Shandong, 266061, China
| | - Shaofeng Duan
- GE Healthcare, Precision Health Institution, Shanghai, China
| | - Tongyu Wang
- Department of Radiology, The Affiliated Hospital of Qingdao University, Qingdao, Shandong, China
| | - Ju Zhang
- Department of Nuclear Medicine, The Affiliated Hospital of Qingdao University, No. 59, Haier Road, Qingdao, Shandong, 266061, China
| | - Jinyang Gu
- Department of Transplantation, Xinhua Hospital Affiliated to Shanghai Jiao Tong University School of Medicine, Shanghai, China
| | - Ning Wang
- Department of Radiology, Shandong Provincial Hospital Affiliated to Shandong First Medical University, No. 324, Jingwu Road, Jinan, Shandong, 250021, China
| | - Ran Zhang
- Huiying Medical Technology Co. Ltd, Beijing, China
| | - Ximing Wang
- Department of Radiology, Shandong Provincial Hospital Affiliated to Shandong First Medical University, No. 324, Jingwu Road, Jinan, Shandong, 250021, China.
| | - Guangjie Yang
- Department of Nuclear Medicine, The Affiliated Hospital of Qingdao University, No. 59, Haier Road, Qingdao, Shandong, 266061, China.
| | - Wei Rao
- Division of Hepatology, Liver Disease Center, Organ Transplantation Center, The Affiliated Hospital of Qingdao University, No. 59, Haier Road, Qingdao, Shandong, 266061, China.
| | - Zhenguang Wang
- Department of Nuclear Medicine, The Affiliated Hospital of Qingdao University, No. 59, Haier Road, Qingdao, Shandong, 266061, China.
| |
Collapse
|
10
|
Xu Y, Zhao J, Chen Q, Wang F, Lin L, Hu H, Tong R, Li J, Chen YW. Contrastive Learning for Preoperative Early Recurrence Prediction of Hepatocellular Carcinoma with Liver CT Image and Tumor Mask. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2023; 2023:1-4. [PMID: 38083328 DOI: 10.1109/embc40787.2023.10340893] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/18/2023]
Abstract
High early recurrence (ER) rate is the main factor leading to the poor outcome of patients with hepatocellular carcinoma (HCC). Accurate preoperative prediction of ER is thus highly desired for HCC treatment. Many radiomics solutions have been proposed for the preoperative prediction of HCC using CT images based on machine learning and deep learning methods. Nevertheless, most current radiomics approaches extract features only from segmented tumor regions that neglect the liver tissue information which is useful for HCC prognosis. In this work, we propose a deep prediction network based on CT images of full liver combined with tumor mask that provides tumor location information for better feature extraction to predict the ER of HCC. While, due to the complex imaging characteristics of HCC, the image-based ER prediction methods suffer from limited capability. Therefore, on the one hand, we propose to employ supervised contrastive loss to jointly train the deep prediction model with cross-entropy loss to alleviate the problem of intra-class variation and inter-class similarity of HCC. On the other hand, we incorporate the clinical data to further improve the prediction ability of the model. Experiments are extensively conducted to verify the effectiveness of our proposed deep prediction model and the contribution of liver tissue for prognosis assessment of HCC.
Collapse
|
11
|
Bhat M, Rabindranath M, Chara BS, Simonetto DA. Artificial intelligence, machine learning, and deep learning in liver transplantation. J Hepatol 2023; 78:1216-1233. [PMID: 37208107 DOI: 10.1016/j.jhep.2023.01.006] [Citation(s) in RCA: 14] [Impact Index Per Article: 14.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/15/2022] [Revised: 01/11/2023] [Accepted: 01/16/2023] [Indexed: 05/21/2023]
Abstract
Liver transplantation (LT) is a life-saving treatment for individuals with end-stage liver disease. The management of LT recipients is complex, predominantly because of the need to consider demographic, clinical, laboratory, pathology, imaging, and omics data in the development of an appropriate treatment plan. Current methods to collate clinical information are susceptible to some degree of subjectivity; thus, clinical decision-making in LT could benefit from the data-driven approach offered by artificial intelligence (AI). Machine learning and deep learning could be applied in both the pre- and post-LT settings. Some examples of AI applications pre-transplant include optimising transplant candidacy decision-making and donor-recipient matching to reduce waitlist mortality and improve post-transplant outcomes. In the post-LT setting, AI could help guide the management of LT recipients, particularly by predicting patient and graft survival, along with identifying risk factors for disease recurrence and other associated complications. Although AI shows promise in medicine, there are limitations to its clinical deployment which include dataset imbalances for model training, data privacy issues, and a lack of available research practices to benchmark model performance in the real world. Overall, AI tools have the potential to enhance personalised clinical decision-making, especially in the context of liver transplant medicine.
Collapse
Affiliation(s)
- Mamatha Bhat
- Ajmera Transplant Program, University Health Network, Toronto, ON, Canada; Toronto General Hospital Research Institute, University Health Network, Toronto, ON, Canada; Institute of Medical Science, University of Toronto, Toronto, ON, Canada; Division of Gastroenterology & Hepatology, Department of Medicine, University of Toronto, Toronto, ON, Canada.
| | - Madhumitha Rabindranath
- Ajmera Transplant Program, University Health Network, Toronto, ON, Canada; Toronto General Hospital Research Institute, University Health Network, Toronto, ON, Canada; Institute of Medical Science, University of Toronto, Toronto, ON, Canada
| | - Beatriz Sordi Chara
- Division of Gastroenterology and Hepatology, Mayo Clinic, Rochester, Minnesota, USA
| | - Douglas A Simonetto
- Division of Gastroenterology and Hepatology, Mayo Clinic, Rochester, Minnesota, USA
| |
Collapse
|
12
|
Moroney J, Trivella J, George B, White SB. A Paradigm Shift in Primary Liver Cancer Therapy Utilizing Genomics, Molecular Biomarkers, and Artificial Intelligence. Cancers (Basel) 2023; 15:2791. [PMID: 37345129 DOI: 10.3390/cancers15102791] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/15/2023] [Revised: 05/02/2023] [Accepted: 05/10/2023] [Indexed: 06/23/2023] Open
Abstract
Primary liver cancer is the sixth most common cancer worldwide and the third leading cause of cancer-related death. Conventional therapies offer limited survival benefit despite improvements in locoregional liver-directed therapies, which highlights the underlying complexity of liver cancers. This review explores the latest research in primary liver cancer therapies, focusing on developments in genomics, molecular biomarkers, and artificial intelligence. Attention is also given to ongoing research and future directions of immunotherapy and locoregional therapies of primary liver cancers.
Collapse
Affiliation(s)
- James Moroney
- Division of Vascular and Interventional Radiology, Department of Radiology, Medical College of Wisconsin, Milwaukee, WI 53226, USA
| | - Juan Trivella
- Division of Gastroenterology and Hepatology, Department of Medicine, Medical College of Wisconsin, Milwaukee, WI 53226, USA
| | - Ben George
- Division of Hematology and Oncology, Department of Medicine, Medical College of Wisconsin, Milwaukee, WI 53226, USA
| | - Sarah B White
- Division of Vascular and Interventional Radiology, Department of Radiology, Medical College of Wisconsin, Milwaukee, WI 53226, USA
| |
Collapse
|
13
|
Iseke S, Zeevi T, Kucukkaya AS, Raju R, Gross M, Haider SP, Petukhova-Greenstein A, Kuhn TN, Lin M, Nowak M, Cooper K, Thomas E, Weber MA, Madoff DC, Staib L, Batra R, Chapiro J. Machine Learning Models for Prediction of Posttreatment Recurrence in Early-Stage Hepatocellular Carcinoma Using Pretreatment Clinical and MRI Features: A Proof-of-Concept Study. AJR Am J Roentgenol 2023; 220:245-255. [PMID: 35975886 PMCID: PMC10015590 DOI: 10.2214/ajr.22.28077] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/04/2023]
Abstract
BACKGROUND. Posttreatment recurrence is an unpredictable complication after liver transplant for hepatocellular carcinoma (HCC) that is associated with poor survival. Biomarkers are needed to estimate recurrence risk before organ allocation. OBJECTIVE. This proof-of-concept study evaluated the use of machine learning (ML) to predict recurrence from pretreatment laboratory, clinical, and MRI data in patients with early-stage HCC initially eligible for liver transplant. METHODS. This retrospective study included 120 patients (88 men, 32 women; median age, 60.0 years) with early-stage HCC diagnosed who were initially eligible for liver transplant and underwent treatment by transplant, resection, or thermal ablation between June 2005 and March 2018. Patients underwent pretreatment MRI and posttreatment imaging surveillance. Imaging features were extracted from postcontrast phases of pretreatment MRI examinations using a pretrained convolutional neural network. Pretreatment clinical characteristics (including laboratory data) and extracted imaging features were integrated to develop three ML models (clinical model, imaging model, combined model) for predicting recurrence within six time frames ranging from 1 through 6 years after treatment. Kaplan-Meier analysis with time to recurrence as the endpoint was used to assess the clinical relevance of model predictions. RESULTS. Tumor recurred in 44 of 120 (36.7%) patients during follow-up. The three models predicted recurrence with AUCs across the six time frames of 0.60-0.78 (clinical model), 0.71-0.85 (imaging model), and 0.62-0.86 (combined model). The mean AUC was higher for the imaging model than the clinical model (0.76 vs 0.68, respectively; p = .03), but the mean AUC was not significantly different between the clinical and combined models or between the imaging and combined models (p > .05). Kaplan-Meier curves were significantly different between patients predicted to be at low risk and those predicted to be at high risk by all three models for the 2-, 3-, 4-, 5-, and 6-year time frames (p < .05). CONCLUSION. The findings suggest that ML-based models can predict recurrence before therapy allocation in patients with early-stage HCC initially eligible for liver transplant. Adding MRI data as model input improved predictive performance over clinical parameters alone. The combined model did not surpass the imaging model's performance. CLINICAL IMPACT. ML-based models applied to currently underutilized imaging features may help design more reliable criteria for organ allocation and liver transplant eligibility.
Collapse
Affiliation(s)
- Simon Iseke
- Department of Radiology and Biomedical Imaging, Yale University School of Medicine, 300 Cedar St, New Haven, CT 06520
- Department of Diagnostic and Interventional Radiology, Pediatric Radiology and Neuroradiology, Rostock University Medical Center, Rostock, Germany
| | - Tal Zeevi
- Department of Radiology and Biomedical Imaging, Yale University School of Medicine, 300 Cedar St, New Haven, CT 06520
| | - Ahmet S Kucukkaya
- Department of Radiology and Biomedical Imaging, Yale University School of Medicine, 300 Cedar St, New Haven, CT 06520
- Charité Center for Diagnostic and Interventional Radiology, Charité-Universitätsmedizin Berlin, Berlin, Germany
| | - Rajiv Raju
- Department of Radiology and Biomedical Imaging, Yale University School of Medicine, 300 Cedar St, New Haven, CT 06520
| | - Moritz Gross
- Department of Radiology and Biomedical Imaging, Yale University School of Medicine, 300 Cedar St, New Haven, CT 06520
- Charité Center for Diagnostic and Interventional Radiology, Charité-Universitätsmedizin Berlin, Berlin, Germany
| | - Stefan P Haider
- Department of Radiology and Biomedical Imaging, Yale University School of Medicine, 300 Cedar St, New Haven, CT 06520
| | - Alexandra Petukhova-Greenstein
- Department of Radiology and Biomedical Imaging, Yale University School of Medicine, 300 Cedar St, New Haven, CT 06520
- Charité Center for Diagnostic and Interventional Radiology, Charité-Universitätsmedizin Berlin, Berlin, Germany
| | - Tom N Kuhn
- Department of Radiology and Biomedical Imaging, Yale University School of Medicine, 300 Cedar St, New Haven, CT 06520
- Department of Diagnostic and Interventional Radiology, Heinrich Heine University Duesseldorf, Duesseldorf, Germany
| | - MingDe Lin
- Department of Radiology and Biomedical Imaging, Yale University School of Medicine, 300 Cedar St, New Haven, CT 06520
- Clinical Research North America, Visage Imaging, Inc., San Diego, CA
| | - Michal Nowak
- Department of Radiology and Biomedical Imaging, Yale University School of Medicine, 300 Cedar St, New Haven, CT 06520
| | - Kirsten Cooper
- Department of Radiology and Biomedical Imaging, Yale University School of Medicine, 300 Cedar St, New Haven, CT 06520
| | - Elizabeth Thomas
- Department of Radiology and Biomedical Imaging, Yale University School of Medicine, 300 Cedar St, New Haven, CT 06520
| | - Marc-André Weber
- Department of Diagnostic and Interventional Radiology, Pediatric Radiology and Neuroradiology, Rostock University Medical Center, Rostock, Germany
| | - David C Madoff
- Department of Radiology and Biomedical Imaging, Yale University School of Medicine, 300 Cedar St, New Haven, CT 06520
- Department of Internal Medicine, Yale University School of Medicine, New Haven, CT
| | - Lawrence Staib
- Department of Radiology and Biomedical Imaging, Yale University School of Medicine, 300 Cedar St, New Haven, CT 06520
| | - Ramesh Batra
- Department of Surgery, Transplantation and Immunology, Yale University School of Medicine, New Haven, CT
| | - Julius Chapiro
- Department of Radiology and Biomedical Imaging, Yale University School of Medicine, 300 Cedar St, New Haven, CT 06520
| |
Collapse
|
14
|
Wei J, Jiang H, Zhou Y, Tian J, Furtado FS, Catalano OA. Radiomics: A radiological evidence-based artificial intelligence technique to facilitate personalized precision medicine in hepatocellular carcinoma. Dig Liver Dis 2023:S1590-8658(22)00863-5. [PMID: 36641292 DOI: 10.1016/j.dld.2022.12.015] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/28/2022] [Revised: 12/15/2022] [Accepted: 12/19/2022] [Indexed: 01/16/2023]
Abstract
The high postoperative recurrence rates in hepatocellular carcinoma (HCC) remain a major hurdle in its management. Appropriate staging and treatment selection may alleviate the extent of fatal recurrence. However, effective methods to preoperatively evaluate pathophysiologic and molecular characteristics of HCC are lacking. Imaging plays a central role in HCC diagnosis and stratification due to the non-invasive diagnostic criteria. Vast and crucial information is hidden within image data. Other than providing a morphological sketch for lesion diagnosis, imaging could provide new insights to describe the pathophysiological and genetic landscape of HCC. Radiomics aims to facilitate diagnosis and prognosis of HCC using artificial intelligence techniques to harness the immense information contained in medical images. Radiomics produces a set of archetypal and robust imaging features that are correlated to key pathological or molecular biomarkers to preoperatively risk-stratify HCC patients. Inferred with outcome data, comprehensive combination of radiomic, clinical and/or multi-omics data could also improve direct prediction of response to treatment and prognosis. The evolution of radiomics is changing our understanding of personalized precision medicine in HCC management. Herein, we review the key techniques and clinical applications in HCC radiomics and discuss current limitations and future opportunities to improve clinical decision making.
Collapse
Affiliation(s)
- Jingwei Wei
- Key Laboratory of Molecular Imaging, Institute of Automation, Chinese Academy of Sciences, Beijing 100190, PR. China; Beijing Key Laboratory of Molecular Imaging, Beijing 100190, PR. China.
| | - Hanyu Jiang
- Department of Radiology, West China Hospital, Sichuan University, Chengdu, Sichuan, 610041, PR. China
| | - Yu Zhou
- Key Laboratory of Molecular Imaging, Institute of Automation, Chinese Academy of Sciences, Beijing 100190, PR. China; Beijing Key Laboratory of Molecular Imaging, Beijing 100190, PR. China; School of Life Science and Technology, Xidian University, Xi'an, PR. China
| | - Jie Tian
- Key Laboratory of Molecular Imaging, Institute of Automation, Chinese Academy of Sciences, Beijing 100190, PR. China; Beijing Key Laboratory of Molecular Imaging, Beijing 100190, PR. China; Beijing Advanced Innovation Center for Big Data-Based Precision Medicine, School of Medicine, Beihang University, Beijing, 100191, PR. China; Engineering Research Center of Molecular and Neuro Imaging of Ministry of Education, School of Life Science and Technology, Xidian University, Xi'an, Shaanxi, 710126, PR. China.
| | - Felipe S Furtado
- Department of Radiology, Massachusetts General Hospital, Boston, MA 02114, United States; Harvard Medical School, 25 Shattuck St, Boston, MA 02115, United States
| | - Onofrio A Catalano
- Department of Radiology, Massachusetts General Hospital, Boston, MA 02114, United States; Harvard Medical School, 25 Shattuck St, Boston, MA 02115, United States.
| |
Collapse
|
15
|
Wong PK, Chan IN, Yan HM, Gao S, Wong CH, Yan T, Yao L, Hu Y, Wang ZR, Yu HH. Deep learning based radiomics for gastrointestinal cancer diagnosis and treatment: A minireview. World J Gastroenterol 2022; 28:6363-6379. [PMID: 36533112 PMCID: PMC9753055 DOI: 10.3748/wjg.v28.i45.6363] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/20/2022] [Revised: 10/25/2022] [Accepted: 11/17/2022] [Indexed: 12/02/2022] Open
Abstract
Gastrointestinal (GI) cancers are the major cause of cancer-related mortality globally. Medical imaging is an important auxiliary means for the diagnosis, assessment and prognostic prediction of GI cancers. Radiomics is an emerging and effective technology to decipher the encoded information within medical images, and traditional machine learning is the most commonly used tool. Recent advances in deep learning technology have further promoted the development of radiomics. In the field of GI cancer, although there are several surveys on radiomics, there is no specific review on the application of deep-learning-based radiomics (DLR). In this review, a search was conducted on Web of Science, PubMed, and Google Scholar with an emphasis on the application of DLR for GI cancers, including esophageal, gastric, liver, pancreatic, and colorectal cancers. Besides, the challenges and recommendations based on the findings of the review are comprehensively analyzed to advance DLR.
Collapse
Affiliation(s)
- Pak Kin Wong
- Department of Electromechanical Engineering, University of Macau, Taipa 999078, Macau, China
| | - In Neng Chan
- Department of Electromechanical Engineering, University of Macau, Taipa 999078, Macau, China
| | - Hao-Ming Yan
- School of Clinical Medicine, China Medical University, Shenyang 110013, Liaoning Province, China
| | - Shan Gao
- Department of Gastroenterology, Xiangyang Central Hospital, Affiliated Hospital of Hubei University of Arts and Science, Xiangyang 441021, Hubei Province, China
| | - Chi Hong Wong
- Faculty of Medicine, Macau University of Science and Technology, Taipa 999078, Macau, China
| | - Tao Yan
- School of Mechanical Engineering, Hubei University of Arts and Science, Xiangyang 441053, Hubei Province, China
| | - Liang Yao
- Department of Electromechanical Engineering, University of Macau, Taipa 999078, Macau, China
- Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, Guangdong Province, China
| | - Ying Hu
- Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, Guangdong Province, China
| | - Zhong-Ren Wang
- School of Mechanical Engineering, Hubei University of Arts and Science, Xiangyang 441053, Hubei Province, China
| | - Hon Ho Yu
- Department of Gastroenterology, Kiang Wu Hospital, Macau 999078, China
| |
Collapse
|
16
|
Multiradiographic Diagnosis of Primary Hepatocellular Carcinoma and Evaluation of Its Postoperative Observation after Interventional Treatment. CONTRAST MEDIA & MOLECULAR IMAGING 2022; 2022:5292200. [PMID: 36017024 PMCID: PMC9371817 DOI: 10.1155/2022/5292200] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/17/2022] [Revised: 07/08/2022] [Accepted: 07/14/2022] [Indexed: 12/01/2022]
Abstract
Objective To investigate the focal imaging performance of MRI and CT multiphase dynamic enhancement scan examination in primary liver cancer patients, analyze its clinical diagnostic value, and provide a basis for early diagnosis of the disease. Methods 236 patients with primary liver cancer admitted to our hospital from May 2019 to November 2021 were randomly divided into two groups, the control group was given MRI multiphase dynamic enhancement scan diagnostic method, and the observation group was given CT scan combined with the MRI diagnostic method. The patients' examination results and pathological examination results were compared and analyzed, and the therapeutic effects of patients in the two groups after interventional treatment were compared. Results After the imaging and pathological examinations of patients in both groups, it was found that the diagnostic accuracy of patients in the observation group and the therapeutic effect after interventional treatment were significantly better than those in the control group. Conclusions Compared with CT multiphase dynamic enhancement scan, MRI multiphase dynamic enhancement scan can show multidirectional and multiangle lesions in primary hepatocellular carcinoma patients, with better characteristics of blood supply to hepatocellular carcinoma and a higher accuracy rate.
Collapse
|
17
|
Sabitha P, Meeragandhi G. A dual stage AlexNet-HHO-DrpXLM archetype for an effective feature extraction, classification and prediction of liver cancer based on histopathology images. Biomed Signal Process Control 2022. [DOI: 10.1016/j.bspc.2022.103833] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/02/2022]
|
18
|
A Survey on Deep Learning for Precision Oncology. Diagnostics (Basel) 2022; 12:diagnostics12061489. [PMID: 35741298 PMCID: PMC9222056 DOI: 10.3390/diagnostics12061489] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/25/2022] [Revised: 06/14/2022] [Accepted: 06/14/2022] [Indexed: 12/27/2022] Open
Abstract
Precision oncology, which ensures optimized cancer treatment tailored to the unique biology of a patient’s disease, has rapidly developed and is of great clinical importance. Deep learning has become the main method for precision oncology. This paper summarizes the recent deep-learning approaches relevant to precision oncology and reviews over 150 articles within the last six years. First, we survey the deep-learning approaches categorized by various precision oncology tasks, including the estimation of dose distribution for treatment planning, survival analysis and risk estimation after treatment, prediction of treatment response, and patient selection for treatment planning. Secondly, we provide an overview of the studies per anatomical area, including the brain, bladder, breast, bone, cervix, esophagus, gastric, head and neck, kidneys, liver, lung, pancreas, pelvis, prostate, and rectum. Finally, we highlight the challenges and discuss potential solutions for future research directions.
Collapse
|
19
|
Tran J, Sharma D, Gotlieb N, Xu W, Bhat M. Application of machine learning in liver transplantation: a review. Hepatol Int 2022; 16:495-508. [PMID: 35020154 DOI: 10.1007/s12072-021-10291-7] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/22/2021] [Accepted: 12/15/2021] [Indexed: 12/12/2022]
Abstract
BACKGROUND Machine learning (ML) has been increasingly applied in the health-care and liver transplant setting. The demand for liver transplantation continues to expand on an international scale, and with advanced aging and complex comorbidities, many challenges throughout the transplantation decision-making process must be better addressed. There exist massive datasets with hidden, non-linear relationships between demographic, clinical, laboratory, genetic, and imaging parameters that conventional methods fail to capitalize on when reviewing their predictive potential. Pre-transplant challenges include addressing efficacies of liver segmentation, hepatic steatosis assessment, and graft allocation. Post-transplant applications include predicting patient survival, graft rejection and failure, and post-operative morbidity risk. AIM In this review, we describe a comprehensive summary of ML applications in liver transplantation including the clinical context and how to overcome challenges for clinical implementation. METHODS Twenty-nine articles were identified from Ovid MEDLINE, MEDLINE Epub Ahead of Print and In-Process and Other Non-Indexed Citations, Embase, Cochrane Database of Systematic Reviews, and Cochrane Central Register of Controlled Trials. CONCLUSION ML is vastly interrogated in liver transplantation with promising applications in pre- and post-transplant settings. Although challenges exist including site-specific training requirements, the demand for more multi-center studies, and optimization hurdles for clinical interpretability, the powerful potential of ML merits further exploration to enhance patient care.
Collapse
Affiliation(s)
- Jason Tran
- Department of Medicine, University of Ottawa, Ottawa, Canada
| | - Divya Sharma
- Department of Biostatistics, Dalla Lana School of Public Health, University of Toronto, Toronto, ON, Canada
- Department of Biostatistics, Princess Margaret Cancer Center, University Health Network, Toronto, ON, Canada
| | - Neta Gotlieb
- Ajmera Transplant Program, University Health Network, Toronto, ON, Canada
| | - Wei Xu
- Department of Biostatistics, Dalla Lana School of Public Health, University of Toronto, Toronto, ON, Canada
- Department of Biostatistics, Princess Margaret Cancer Center, University Health Network, Toronto, ON, Canada
| | - Mamatha Bhat
- Ajmera Transplant Program, University Health Network, Toronto, ON, Canada.
- Division of Gastroenterology, Department of Medicine, University of Toronto, 585 University Avenue, Toronto, ON, M5G 2N2, Canada.
| |
Collapse
|
20
|
Liu Z, Xu J, Que S, Geng L, Zhou L, Mardinoglu A, Zheng S. Recent Progress and Future Direction for the Application of Multiomics Data in Clinical Liver Transplantation. J Clin Transl Hepatol 2022; 10:363-373. [PMID: 35528975 PMCID: PMC9039708 DOI: 10.14218/jcth.2021.00219] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/10/2021] [Revised: 08/14/2021] [Accepted: 10/07/2021] [Indexed: 12/04/2022] Open
Abstract
Omics data address key issues in liver transplantation (LT) as the most effective therapeutic means for end-stage liver disease. The purpose of this study was to review the current application and future direction for omics in LT. We reviewed the use of multiomics to elucidate the pathogenesis leading to LT and prognostication. Future directions with respect to the use of omics in LT are also described based on perspectives of surgeons with experience in omics. Significant molecules were identified and summarized based on omics, with a focus on post-transplant liver fibrosis, early allograft dysfunction, tumor recurrence, and graft failure. We emphasized the importance omics for clinicians who perform LTs and prioritized the directions that should be established. We also outlined the ideal workflow for omics in LT. In step with advances in technology, the quality of omics data can be guaranteed using an improved algorithm at a lower price. Concerns should be addressed on the translational value of omics for better therapeutic effects in patients undergoing LT.
Collapse
Affiliation(s)
- Zhengtao Liu
- Shulan International Medical College, Zhejiang Shuren University, Hangzhou, Zhejiang, China
- Division of Hepatobiliary and Pancreatic Surgery, Department of Surgery, First Affiliated Hospital, School of Medicine, Zhejiang University, Hangzhou, Zhejiang, China
- NHC Key Laboratory of Combined Multi-organ Transplantation, Key Laboratory of the diagnosis and treatment of organ Transplantation, CAMS, First Affiliated Hospital, School of Medicine, Zhejiang University, Hangzhou, Zhejiang, China
- Key Laboratory of Organ Transplantation, Zhejiang Province, First Affiliated Hospital, School of Medicine, Zhejiang University, Hangzhou, Zhejiang, China
| | - Jun Xu
- Division of Hepatobiliary and Pancreatic Surgery, Department of Surgery, First Affiliated Hospital, School of Medicine, Zhejiang University, Hangzhou, Zhejiang, China
| | - Shuping Que
- DingXiang Clinics, Hangzhou, Zhejiang, China
| | - Lei Geng
- Division of Hepatobiliary and Pancreatic Surgery, Department of Surgery, First Affiliated Hospital, School of Medicine, Zhejiang University, Hangzhou, Zhejiang, China
| | - Lin Zhou
- NHC Key Laboratory of Combined Multi-organ Transplantation, Key Laboratory of the diagnosis and treatment of organ Transplantation, CAMS, First Affiliated Hospital, School of Medicine, Zhejiang University, Hangzhou, Zhejiang, China
- Key Laboratory of Organ Transplantation, Zhejiang Province, First Affiliated Hospital, School of Medicine, Zhejiang University, Hangzhou, Zhejiang, China
| | - Adil Mardinoglu
- Science for Life Laboratory, KTH-Royal Institute of Technology, Stockholm, Sweden
- Centre for Host-Microbiome Interactions, Faculty of Dentistry, Oral & Craniofacial Sciences, King’s College London, London, UK
- Correspondence to: Adil Mardinoglu, Science for Life Laboratory, KTH-Royal Institute of Technology, Stockholm, Sweden. ORCID: https://orcid.org/0000-0002-4254-6090. Tel: +46-31-772-3140, Fax: +46-31-772-3801, E-mail: ; Shusen Zheng, Division of Hepatobiliary and Pancreatic Surgery, Department of Surgery, First Affiliated Hospital, School of Medicine, Zhejiang University, Hangzhou, Zhejiang 310003, China. ORCID: https://orcid.org/0000-0003-1459-8261. Tel/Fax: +86-571-87236570, E-mail:
| | - Shusen Zheng
- Shulan International Medical College, Zhejiang Shuren University, Hangzhou, Zhejiang, China
- Division of Hepatobiliary and Pancreatic Surgery, Department of Surgery, First Affiliated Hospital, School of Medicine, Zhejiang University, Hangzhou, Zhejiang, China
- NHC Key Laboratory of Combined Multi-organ Transplantation, Key Laboratory of the diagnosis and treatment of organ Transplantation, CAMS, First Affiliated Hospital, School of Medicine, Zhejiang University, Hangzhou, Zhejiang, China
- Key Laboratory of Organ Transplantation, Zhejiang Province, First Affiliated Hospital, School of Medicine, Zhejiang University, Hangzhou, Zhejiang, China
- Correspondence to: Adil Mardinoglu, Science for Life Laboratory, KTH-Royal Institute of Technology, Stockholm, Sweden. ORCID: https://orcid.org/0000-0002-4254-6090. Tel: +46-31-772-3140, Fax: +46-31-772-3801, E-mail: ; Shusen Zheng, Division of Hepatobiliary and Pancreatic Surgery, Department of Surgery, First Affiliated Hospital, School of Medicine, Zhejiang University, Hangzhou, Zhejiang 310003, China. ORCID: https://orcid.org/0000-0003-1459-8261. Tel/Fax: +86-571-87236570, E-mail:
| |
Collapse
|
21
|
Linna N, Kahn CE. Applications of Natural Language Processing in Radiology: A Systematic Review. Int J Med Inform 2022; 163:104779. [DOI: 10.1016/j.ijmedinf.2022.104779] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/07/2022] [Revised: 03/28/2022] [Accepted: 04/21/2022] [Indexed: 12/27/2022]
|
22
|
Nam D, Chapiro J, Paradis V, Seraphin TP, Kather JN. Artificial intelligence in liver diseases: improving diagnostics, prognostics and response prediction. JHEP REPORTS : INNOVATION IN HEPATOLOGY 2022; 4:100443. [PMID: 35243281 PMCID: PMC8867112 DOI: 10.1016/j.jhepr.2022.100443] [Citation(s) in RCA: 50] [Impact Index Per Article: 25.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 11/13/2021] [Revised: 12/26/2021] [Accepted: 01/11/2022] [Indexed: 12/18/2022]
Abstract
Clinical routine in hepatology involves the diagnosis and treatment of a wide spectrum of metabolic, infectious, autoimmune and neoplastic diseases. Clinicians integrate qualitative and quantitative information from multiple data sources to make a diagnosis, prognosticate the disease course, and recommend a treatment. In the last 5 years, advances in artificial intelligence (AI), particularly in deep learning, have made it possible to extract clinically relevant information from complex and diverse clinical datasets. In particular, histopathology and radiology image data contain diagnostic, prognostic and predictive information which AI can extract. Ultimately, such AI systems could be implemented in clinical routine as decision support tools. However, in the context of hepatology, this requires further large-scale clinical validation and regulatory approval. Herein, we summarise the state of the art in AI in hepatology with a particular focus on histopathology and radiology data. We present a roadmap for the further development of novel biomarkers in hepatology and outline critical obstacles which need to be overcome.
Collapse
|
23
|
Stahlschmidt SR, Ulfenborg B, Synnergren J. Multimodal deep learning for biomedical data fusion: a review. Brief Bioinform 2022; 23:6516346. [PMID: 35089332 PMCID: PMC8921642 DOI: 10.1093/bib/bbab569] [Citation(s) in RCA: 68] [Impact Index Per Article: 34.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/21/2021] [Revised: 12/06/2021] [Accepted: 12/11/2021] [Indexed: 02/06/2023] Open
Abstract
Biomedical data are becoming increasingly multimodal and thereby capture the underlying complex relationships among biological processes. Deep learning (DL)-based data fusion strategies are a popular approach for modeling these nonlinear relationships. Therefore, we review the current state-of-the-art of such methods and propose a detailed taxonomy that facilitates more informed choices of fusion strategies for biomedical applications, as well as research on novel methods. By doing so, we find that deep fusion strategies often outperform unimodal and shallow approaches. Additionally, the proposed subcategories of fusion strategies show different advantages and drawbacks. The review of current methods has shown that, especially for intermediate fusion strategies, joint representation learning is the preferred approach as it effectively models the complex interactions of different levels of biological organization. Finally, we note that gradual fusion, based on prior biological knowledge or on search strategies, is a promising future research path. Similarly, utilizing transfer learning might overcome sample size limitations of multimodal data sets. As these data sets become increasingly available, multimodal DL approaches present the opportunity to train holistic models that can learn the complex regulatory dynamics behind health and disease.
Collapse
Affiliation(s)
| | | | - Jane Synnergren
- Systems Biology Research Center, University of Skövde, Sweden
| |
Collapse
|