1
|
Xie W, Jiang S, Xin F, Jiang Z, Pan W, Zhou X, Xiang S, Xu Z, Lu Y, Wang D. Prediction of CD8+T lymphocyte infiltration levels in gastric cancer from contrast-enhanced CT and clinical factors using machine learning. Med Phys 2024. [PMID: 39153226 DOI: 10.1002/mp.17350] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/06/2024] [Revised: 07/04/2024] [Accepted: 07/31/2024] [Indexed: 08/19/2024] Open
Abstract
BACKGROUND CD8+ T lymphocyte infiltration is closely associated with the prognosis and immunotherapy response of gastric cancer (GC). For now, the examination of CD8 infiltration levels relies on endoscopic biopsy, which is invasive and unsuitable for longitude assessment during anti-tumor therapy. PURPOSE This work aims to develop and validate a noninvasive workflow based on contrast-enhanced CT (CECT) images to evaluate the CD8+ T-cell infiltration profiles of GC. METHODS GC patients were retrospectively and consecutively enrolled and randomly assigned to the training (validation) or test cohort at a 7:3 ratio. All patients were binary classified into the CD8-high (infiltrated proportion ≥ 20%) or CD8-low group (infiltrated proportion < 20%) group. A total of 1170 radiomics features were extracted from each presurgical CECT series. After feature selection, fifteen radiomics features were transmitted to three independent machine-learning models for the computation of predictive radiological scores. Multilayer perceptron (MLP) was applied to merge the radiological scores with clinical factors. The predictive efficacy of the radiological scores and of the combined model was evaluated by receiver operating characteristic curve, calibration curve, and decision curve analysis in both the training and test cohorts. RESULTS A total of 210 patients were enrolled in this study (mean age: 63.22 ± 8.74 years, 151 men), and were randomly assigned to the training set (n = 147) or the test set (n = 63). The merged radiological score was correlated with CD8 infiltration in both the training (p = 1.8e-10) and test cohorts (p = 0.00026). The combined model integrating the radiological scores and clinical features achieved an area under the curve (AUC) value of 0.916 (95% CI: 0.872-0.960) in the training set and 0.844 (95% CI: 0.742-0.946) in the test set for classifying CD8-high GCs. The model was well-calibrated and exhibited net benefit over "treat-all" and"treat-none" strategies in decision curve analysis. CONCLUSIONS Artificial intelligent systems combining radiological features and clinical factors could accurately predict CD8 infiltration levels of GC, which may benefit personalized treatment of GC in the context of immunotherapy.
Collapse
Affiliation(s)
- Wentao Xie
- Department of Gastrointestinal Surgery, Xihaian Center, The Affiliated Hospital of Qingdao University, Qingdao, Shandong, China
| | - Sheng Jiang
- Qingdao Medical College, Qingdao University, Qingdao, Shandong, China
| | - Fangjie Xin
- Department of Pathology, Xihaian Center, The Affiliated Hospital of Qingdao University, Qingdao, Shandong, China
| | - Zinian Jiang
- Qingdao Medical College, Qingdao University, Qingdao, Shandong, China
| | - Wenjun Pan
- Qingdao Medical College, Qingdao University, Qingdao, Shandong, China
| | - Xiaoming Zhou
- Department of Radiology, Xihaian Center, The Affiliated Hospital of Qingdao University, Qingdao, Shandong, China
| | - Shuai Xiang
- Qingdao Medical College, Qingdao University, Qingdao, Shandong, China
| | - Zhenying Xu
- Qingdao Medical College, Qingdao University, Qingdao, Shandong, China
| | - Yun Lu
- Department of Gastrointestinal Surgery, Xihaian Center, The Affiliated Hospital of Qingdao University, Qingdao, Shandong, China
- Qingdao Medical College, Qingdao University, Qingdao, Shandong, China
- Shandong Key Laboratory of Digital Medicine and Computer Assisted Surgery, Qingdao, Shandong, China
- Department of Gastrointestinal Surgery, Lingshui People's Hospital, Hainan, China
| | - Dongsheng Wang
- Department of Gastrointestinal Surgery, Xihaian Center, The Affiliated Hospital of Qingdao University, Qingdao, Shandong, China
- Qingdao Medical College, Qingdao University, Qingdao, Shandong, China
| |
Collapse
|
2
|
Xu C, Feng J, Yue Y, Cheng W, He D, Qi S, Zhang G. A hybrid few-shot multiple-instance learning model predicting the aggressiveness of lymphoma in PET/CT images. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2024; 243:107872. [PMID: 37922655 DOI: 10.1016/j.cmpb.2023.107872] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/03/2023] [Revised: 09/29/2023] [Accepted: 10/16/2023] [Indexed: 11/07/2023]
Abstract
BACKGROUND AND OBJECTIVE Patients with aggressive non-Hodgkin lymphoma (NHL) undergo distinct therapy strategies compared with indolent NHL patients. However, it is challenging to estimate NHL aggressiveness based on visual inspection of positron emission tomography (PET) or computed tomography (CT) images. Since diffuse large B-cell lymphoma (DLBCL) and Follicular lymphoma (FL) are the most typical and dominant aggressive and indolent NHL, respectively, this study aims to develop an artificial-intelligence-enabled model to distinguish DLBCL from FL in PET/CT images as the first step to tackle this challenge. METHODS We propose a hybrid few-shot multiple-instance learning model to predict the aggressiveness of the NHL. First, rotation-based self-supervision learning (SSL) has been employed to train the encoder on a large-scale, publicly available CT image dataset. Second, hybrid instance-level features are obtained for each NHL lesion by combining deep features with the radiomics features from both PET and CT modalities. Third, instance-level features are transformed into bag-level (or patient-level) representations. Finally, bag-level representations are fed into a distance-based classifier through few-shot learning to predict NHL aggressiveness. RESULTS Our model achieves an accuracy of 0.751 ± 0.008, a sensitivity of 0.787 ± 0.012, a specificity of 0.715 ± 0.013, an F1-score of 0.753 ± 0.009, and an area under the curve (AUC) of 0.795 ± 0.009 at the bag level. It outperforms the typical counterparts that use the radiomic features, random forest for feature selection, and support vector machines (SVMs) as classifiers. The three counterparts yield accuracies of 0.714 ± 0.023, 0.705 ± 0.008, and 0.698 ± 0.008, respectively. Moreover, settings of the SSL training dataset (Deep lesion) and task (rotation), hybrid CT and radiomic PET features, the pool-layer strategy of maximum, and distance-based classifier generate the best model. CONCLUSIONS A hybrid few-shot multiple-instance learning model can predict lymphoma aggressiveness in PET/CT images and could be a potential tool for determining therapy strategies. Hybrid features and the combination of SSL, few-shot learning, and weakly supervised learning are the two powerful pillars of the model, and these can be expanded to other medical applications with limited samples and incomplete annotations.
Collapse
Affiliation(s)
- Caiwen Xu
- College of Medicine and Biological Information Engineering, Northeastern University, Shenyang, China; Key Laboratory of Intelligent Computing in Medical Image, Ministry of Education, Northeastern University, Shenyang, China
| | - Jie Feng
- School of Chemical Equipment, Shenyang University of Technology, Liaoyang, China
| | - Yong Yue
- Department of Radiology, Shengjing Hospital of China Medical University, Shenyang, China
| | - Wanjun Cheng
- Neusoft Research of Intelligent Healthcare Technology, Co. Ltd., Shenyang, China
| | - Dianning He
- College of Medicine and Biological Information Engineering, Northeastern University, Shenyang, China
| | - Shouliang Qi
- College of Medicine and Biological Information Engineering, Northeastern University, Shenyang, China; Key Laboratory of Intelligent Computing in Medical Image, Ministry of Education, Northeastern University, Shenyang, China.
| | - Guojun Zhang
- Department of Hematology, Shengjing Hospital of China Medical University, Shenyang, China.
| |
Collapse
|
3
|
Ghimire P, Kinnersley B, Karami G, Arumugam P, Houlston R, Ashkan K, Modat M, Booth TC. Radiogenomic biomarkers for immunotherapy in glioblastoma: A systematic review of magnetic resonance imaging studies. Neurooncol Adv 2024; 6:vdae055. [PMID: 38680991 PMCID: PMC11046988 DOI: 10.1093/noajnl/vdae055] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 05/01/2024] Open
Abstract
Background Immunotherapy is an effective "precision medicine" treatment for several cancers. Imaging signatures of the underlying genome (radiogenomics) in glioblastoma patients may serve as preoperative biomarkers of the tumor-host immune apparatus. Validated biomarkers would have the potential to stratify patients during immunotherapy clinical trials, and if trials are beneficial, facilitate personalized neo-adjuvant treatment. The increased use of whole genome sequencing data, and the advances in bioinformatics and machine learning make such developments plausible. We performed a systematic review to determine the extent of development and validation of immune-related radiogenomic biomarkers for glioblastoma. Methods A systematic review was performed following PRISMA guidelines using the PubMed, Medline, and Embase databases. Qualitative analysis was performed by incorporating the QUADAS 2 tool and CLAIM checklist. PROSPERO registered: CRD42022340968. Extracted data were insufficiently homogenous to perform a meta-analysis. Results Nine studies, all retrospective, were included. Biomarkers extracted from magnetic resonance imaging volumes of interest included apparent diffusion coefficient values, relative cerebral blood volume values, and image-derived features. These biomarkers correlated with genomic markers from tumor cells or immune cells or with patient survival. The majority of studies had a high risk of bias and applicability concerns regarding the index test performed. Conclusions Radiogenomic immune biomarkers have the potential to provide early treatment options to patients with glioblastoma. Targeted immunotherapy, stratified by these biomarkers, has the potential to allow individualized neo-adjuvant precision treatment options in clinical trials. However, there are no prospective studies validating these biomarkers, and interpretation is limited due to study bias with little evidence of generalizability.
Collapse
Affiliation(s)
- Prajwal Ghimire
- Department of Neurosurgery, Kings College Hospital NHS Foundation Trust, London, UK
- School of Biomedical Engineering & Imaging Sciences, King’s College London, London, UK
| | - Ben Kinnersley
- Department of Oncology, University College London, London, UK
| | | | | | - Richard Houlston
- Division of Genetics and Epidemiology, The Institute of Cancer Research, Sutton, UK
| | - Keyoumars Ashkan
- Department of Neurosurgery, Kings College Hospital NHS Foundation Trust, London, UK
| | - Marc Modat
- School of Biomedical Engineering & Imaging Sciences, King’s College London, London, UK
| | - Thomas C Booth
- School of Biomedical Engineering & Imaging Sciences, King’s College London, London, UK
| |
Collapse
|
4
|
Choi Y, Jang J, Kim BS, Ahn KJ. Pretreatment MR-based radiomics in patients with glioblastoma: A systematic review and meta-analysis of prognostic endpoints. Eur J Radiol 2023; 168:111130. [PMID: 37827087 DOI: 10.1016/j.ejrad.2023.111130] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/27/2023] [Revised: 09/23/2023] [Accepted: 09/30/2023] [Indexed: 10/14/2023]
Abstract
PURPOSE Recent studies have shown promise of MR-based radiomics in predicting the survival of patients with untreated glioblastoma. This study aimed to comprehensively collate evidence to assess the prognostic value of radiomics in glioblastoma. METHODS PubMed-MEDLINE, Embase, and Web of Science were searched to find original articles investigating the prognostic value of MR-based radiomics in glioblastoma published up to July 14, 2023. Concordance indexes (C-indexes) and Cox proportional hazards ratios (HRs) of overall survival (OS) and progression-free survival (PFS) were pooled via random-effects modeling. For studies aimed at classifying long-term and short-term PFS, a hierarchical regression model was used to calculate pooled sensitivity and specificity. Between-study heterogeneity was assessed using the Higgin inconsistency index (I2). Subgroup regression analysis was performed to find potential factors contributing to heterogeneity. Publication bias was assessed via funnel plots and the Egger test. RESULTS Among 1371 abstracts, 18 and 17 studies were included for qualitative and quantitative data synthesis, respectively. Respective pooled C-indexes and HRs for OS were 0.65 (95 % confidence interval [CI], 0.58-0.72) and 2.88 (95 % CI, 2.28-3.64), whereas those for PFS were 0.61 (95 % CI, 0.55-0.66) and 2.78 (95 % CI, 1.91-4.03). Among 4 studies that predicted short-term PFS, the pooled sensitivity and specificity were 0.77 (95 % CI, 0.58-0.89) and 0.60 (95 % CI, 0.45-0.73), respectively. There was a substantial between-study heterogeneity among studies with the survival endpoint of OS C-index (n = 9, I2 = 83.8 %). Publication bias was not observed overall. CONCLUSION Pretreatment MR-based radiomics provided modest prognostic value in both OS and PFS in patients with glioblastoma.
Collapse
Affiliation(s)
- Yangsean Choi
- Department of Radiology, Seoul St. Mary's Hospital, College of Medicine, The Catholic University of Korea, Republic of Korea; Department of Radiology and Research Institute of Radiology, University of Ulsan College of Medicine, Asan Medical Centre, Seoul, Republic of Korea
| | - Jinhee Jang
- Department of Radiology, Seoul St. Mary's Hospital, College of Medicine, The Catholic University of Korea, Republic of Korea
| | - Bum-Soo Kim
- Department of Radiology, Seoul St. Mary's Hospital, College of Medicine, The Catholic University of Korea, Republic of Korea
| | - Kook-Jin Ahn
- Department of Radiology, Seoul St. Mary's Hospital, College of Medicine, The Catholic University of Korea, Republic of Korea.
| |
Collapse
|
5
|
Deng S, Zhu Y. Prediction of Glioma Grade by Tumor Heterogeneity Radiomic Analysis Based on Multiparametric MRI. INT J COMPUT INT SYS 2023. [DOI: 10.1007/s44196-023-00230-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 04/08/2023] Open
Abstract
AbstractPredicting glioma grade plays a pivotal role in treatment and prognosis. However, several current methods for grading depend on the characteristics of the whole tumor. Predicting grade by analyzing tumor subregions has not been thoroughly investigated, which aims to improve the prediction performance. To predict glioma grade via analysis of tumor heterogeneity with features extracted from tumor subregions, it is mainly divided into four magnetic resonance imaging (MRI) sequences, including T2-weighted (T2), fluid-attenuated inversion recovery (FLAIR), pre-gadolinium T1-weighted (T1), and post-gadolinium T1-weighted methods. This study included the data of 97 patients with glioblastomas and 42 patients with low-grade gliomas before surgery. Three subregions, including enhanced tumor (ET), non-enhanced tumor, and peritumoral edema, were obtained based on segmentation labels generated by the GLISTRBoost algorithm. One hundred radiomic features were extracted from each subregion. Feature selection was performed using the cross-validated recursive feature elimination with a support vector machine (SVM) algorithm. SVM classifiers with grid search were established to predict glioma grade based on unparametric and multiparametric MRI. The area under the receiver operating characteristic curve (AUC) was used to evaluate the performance of the classifiers, and the performance of the subregions was compared with the results of the whole tumor. In uniparametric analysis, the features from the ET subregion yielded a higher AUC value of 0.8697, 0.8474, and 0.8474 than those of the whole tumor of FLAIR, T1, and T2. In multiparametric analysis, the ET subregion achieved the best performance (AUC = 0.8755), which was higher than the uniparametric results. Radiomic features from the tumor subregion can potentially be used as clinical markers to improve the predictive accuracy of glioma grades.
Collapse
|
6
|
Salome P, Sforazzini F, Grugnara G, Kudak A, Dostal M, Herold-Mende C, Heiland S, Debus J, Abdollahi A, Knoll M. MR Intensity Normalization Methods Impact Sequence Specific Radiomics Prognostic Model Performance in Primary and Recurrent High-Grade Glioma. Cancers (Basel) 2023; 15:cancers15030965. [PMID: 36765922 PMCID: PMC9913466 DOI: 10.3390/cancers15030965] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/07/2023] [Revised: 01/30/2023] [Accepted: 01/31/2023] [Indexed: 02/05/2023] Open
Abstract
PURPOSE This study investigates the impact of different intensity normalization (IN) methods on the overall survival (OS) radiomics models' performance of MR sequences in primary (pHGG) and recurrent high-grade glioma (rHGG). METHODS MR scans acquired before radiotherapy were retrieved from two independent cohorts (rHGG C1: 197, pHGG C2: 141) from multiple scanners (15, 14). The sequences are T1 weighted (w), contrast-enhanced T1w (T1wce), T2w, and T2w-FLAIR. Sequence-specific significant features (SF) associated with OS, extracted from the tumour volume, were derived after applying 15 different IN methods. Survival analyses were conducted using Cox proportional hazard (CPH) and Poisson regression (POI) models. A ranking score was assigned based on the 10-fold cross-validated (CV) concordance index (C-I), mean square error (MSE), and the Akaike information criterion (AICs), to evaluate the methods' performance. RESULTS Scatter plots of the 10-CV C-I and MSE against the AIC showed an impact on the survival predictions between the IN methods and MR sequences (C1/C2 C-I range: 0.62-0.71/0.61-0.72, MSE range: 0.20-0.42/0.13-0.22). White stripe showed stable results for T1wce (C1/C2 C-I: 0.71/0.65, MSE: 0.21/0.14). Combat (0.68/0.62, 0.22/0.15) and histogram matching (HM, 0.67/0.64, 0.22/0.15) showed consistent prediction results for T2w models. They were also the top-performing methods for T1w in C2 (Combat: 0.67, 0.13; HM: 0.67, 0.13); however, only HM achieved high predictions in C1 (0.66, 0.22). After eliminating IN impacted SF using Spearman's rank-order correlation coefficient, a mean decrease in the C-I and MSE of 0.05 and 0.03 was observed in all four sequences. CONCLUSION The IN method impacted the predictive power of survival models; thus, performance is sequence-dependent.
Collapse
Affiliation(s)
- Patrick Salome
- Clinical Cooperation Unit (CCU) Radiation Oncology, German Cancer Research Centre, INF 280, 69120 Heidelberg, Germany
- Heidelberg Medical Faculty, Heidelberg University, 69120 Heidelberg, Germany
- German Cancer Consortium (DKTK) Core Centre Heidelberg, 69120 Heidelberg, Germany
- Heidelberg Ion-Beam Therapy Centre (HIT), INF 450, 69120 Heidelberg, Germany
- Correspondence: (P.S.); (M.K.)
| | - Francesco Sforazzini
- Clinical Cooperation Unit (CCU) Radiation Oncology, German Cancer Research Centre, INF 280, 69120 Heidelberg, Germany
- Heidelberg Medical Faculty, Heidelberg University, 69120 Heidelberg, Germany
- German Cancer Consortium (DKTK) Core Centre Heidelberg, 69120 Heidelberg, Germany
| | - Gianluca Grugnara
- Department of Neuroradiology, Heidelberg University Hospital, 69120 Heidelberg, Germany
| | - Andreas Kudak
- Heidelberg Ion-Beam Therapy Centre (HIT), INF 450, 69120 Heidelberg, Germany
- Department of Radiation Oncology, Heidelberg University Hospital, INF 400, 69120 Heidelberg, Germany
- CCU Radiation Therapy, German Cancer Research Centre, INF 280, 69120 Heidelberg, Germany
| | - Matthias Dostal
- Heidelberg Ion-Beam Therapy Centre (HIT), INF 450, 69120 Heidelberg, Germany
- Department of Radiation Oncology, Heidelberg University Hospital, INF 400, 69120 Heidelberg, Germany
- CCU Radiation Therapy, German Cancer Research Centre, INF 280, 69120 Heidelberg, Germany
| | - Christel Herold-Mende
- Brain Tumour Group, European Organization for Research and Treatment of Cancer, 1200 Brussels, Belgium
- Division of Neurosurgical Research, Department of Neurosurgery, Heidelberg University Hospital, 69120 Heidelberg, Germany
| | - Sabine Heiland
- Department of Neuroradiology, Heidelberg University Hospital, 69120 Heidelberg, Germany
| | - Jürgen Debus
- German Cancer Consortium (DKTK) Core Centre Heidelberg, 69120 Heidelberg, Germany
- Heidelberg Ion-Beam Therapy Centre (HIT), INF 450, 69120 Heidelberg, Germany
- Department of Radiation Oncology, Heidelberg University Hospital, INF 400, 69120 Heidelberg, Germany
| | - Amir Abdollahi
- Clinical Cooperation Unit (CCU) Radiation Oncology, German Cancer Research Centre, INF 280, 69120 Heidelberg, Germany
- German Cancer Consortium (DKTK) Core Centre Heidelberg, 69120 Heidelberg, Germany
- Heidelberg Ion-Beam Therapy Centre (HIT), INF 450, 69120 Heidelberg, Germany
- Department of Radiation Oncology, Heidelberg University Hospital, INF 400, 69120 Heidelberg, Germany
| | - Maximilian Knoll
- Clinical Cooperation Unit (CCU) Radiation Oncology, German Cancer Research Centre, INF 280, 69120 Heidelberg, Germany
- German Cancer Consortium (DKTK) Core Centre Heidelberg, 69120 Heidelberg, Germany
- Heidelberg Ion-Beam Therapy Centre (HIT), INF 450, 69120 Heidelberg, Germany
- Department of Radiation Oncology, Heidelberg University Hospital, INF 400, 69120 Heidelberg, Germany
- Correspondence: (P.S.); (M.K.)
| |
Collapse
|
7
|
Alleman K, Knecht E, Huang J, Zhang L, Lam S, DeCuypere M. Multimodal Deep Learning-Based Prognostication in Glioma Patients: A Systematic Review. Cancers (Basel) 2023; 15:cancers15020545. [PMID: 36672494 PMCID: PMC9856816 DOI: 10.3390/cancers15020545] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/30/2022] [Revised: 01/05/2023] [Accepted: 01/08/2023] [Indexed: 01/18/2023] Open
Abstract
Malignant brain tumors pose a substantial burden on morbidity and mortality. As clinical data collection improves, along with the capacity to analyze it, novel predictive clinical tools may improve prognosis prediction. Deep learning (DL) holds promise for integrating clinical data of various modalities. A systematic review of the DL-based prognostication of gliomas was performed using the Embase (Elsevier), PubMed MEDLINE (National library of Medicine), and Scopus (Elsevier) databases, in accordance with PRISMA guidelines. All included studies focused on the prognostication of gliomas, and predicted overall survival (13 studies, 81%), overall survival as well as genotype (2 studies, 12.5%), and response to immunotherapy (1 study, 6.2%). Multimodal analyses were varied, with 6 studies (37.5%) combining MRI with clinical data; 6 studies (37.5%) integrating MRI with histologic, clinical, and biomarker data; 3 studies (18.8%) combining MRI with genomic data; and 1 study (6.2%) combining histologic imaging with clinical data. Studies that compared multimodal models to unimodal-only models demonstrated improved predictive performance. The risk of bias was mixed, most commonly due to inconsistent methodological reporting. Overall, the use of multimodal data in DL assessments of gliomas leads to a more accurate overall survival prediction. However, due to data limitations and a lack of transparency in model and code reporting, the full extent of multimodal DL as a resource for brain tumor patients has not yet been realized.
Collapse
Affiliation(s)
- Kaitlyn Alleman
- Chicago Medical School, Rosalind Franklin University of Science and Medicine, Chicago, IL 60064, USA
| | - Erik Knecht
- Chicago Medical School, Rosalind Franklin University of Science and Medicine, Chicago, IL 60064, USA
| | - Jonathan Huang
- Division of Pediatric Neurosurgery, Ann and Robert H. Lurie Children’s Hospital of Chicago, Chicago, IL 60611, USA
| | - Lu Zhang
- Division of Pediatric Neurosurgery, Ann and Robert H. Lurie Children’s Hospital of Chicago, Chicago, IL 60611, USA
| | - Sandi Lam
- Division of Pediatric Neurosurgery, Ann and Robert H. Lurie Children’s Hospital of Chicago, Chicago, IL 60611, USA
- Department of Neurological Surgery, Northwestern University Feinberg School of Medicine, Chicago, IL 60611, USA
- Malnati Brain Tumor Institute of the Lurie Comprehensive Cancer Center, Northwestern University Feinberg School of Medicine, Chicago, IL 60611, USA
| | - Michael DeCuypere
- Division of Pediatric Neurosurgery, Ann and Robert H. Lurie Children’s Hospital of Chicago, Chicago, IL 60611, USA
- Department of Neurological Surgery, Northwestern University Feinberg School of Medicine, Chicago, IL 60611, USA
- Malnati Brain Tumor Institute of the Lurie Comprehensive Cancer Center, Northwestern University Feinberg School of Medicine, Chicago, IL 60611, USA
- Correspondence:
| |
Collapse
|
8
|
Chaddad A, Peng J, Xu J, Bouridane A. Survey of Explainable AI Techniques in Healthcare. SENSORS (BASEL, SWITZERLAND) 2023; 23:634. [PMID: 36679430 PMCID: PMC9862413 DOI: 10.3390/s23020634] [Citation(s) in RCA: 33] [Impact Index Per Article: 33.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/07/2022] [Revised: 12/14/2022] [Accepted: 12/29/2022] [Indexed: 05/27/2023]
Abstract
Artificial intelligence (AI) with deep learning models has been widely applied in numerous domains, including medical imaging and healthcare tasks. In the medical field, any judgment or decision is fraught with risk. A doctor will carefully judge whether a patient is sick before forming a reasonable explanation based on the patient's symptoms and/or an examination. Therefore, to be a viable and accepted tool, AI needs to mimic human judgment and interpretation skills. Specifically, explainable AI (XAI) aims to explain the information behind the black-box model of deep learning that reveals how the decisions are made. This paper provides a survey of the most recent XAI techniques used in healthcare and related medical imaging applications. We summarize and categorize the XAI types, and highlight the algorithms used to increase interpretability in medical imaging topics. In addition, we focus on the challenging XAI problems in medical applications and provide guidelines to develop better interpretations of deep learning models using XAI concepts in medical image and text analysis. Furthermore, this survey provides future directions to guide developers and researchers for future prospective investigations on clinical topics, particularly on applications with medical imaging.
Collapse
Affiliation(s)
- Ahmad Chaddad
- School of Artificial Intelligence, Guilin University of Electronic Technology, Jinji Road, Guilin 541004, China
- The Laboratory for Imagery Vision and Artificial Intelligence, Ecole de Technologie Superieure, 1100 Rue Notre Dame O, Montreal, QC H3C 1K3, Canada
| | - Jihao Peng
- School of Artificial Intelligence, Guilin University of Electronic Technology, Jinji Road, Guilin 541004, China
| | - Jian Xu
- School of Artificial Intelligence, Guilin University of Electronic Technology, Jinji Road, Guilin 541004, China
| | - Ahmed Bouridane
- Centre for Data Analytics and Cybersecurity, University of Sharjah, Sharjah 27272, United Arab Emirates
| |
Collapse
|
9
|
Dercle L, McGale J, Sun S, Marabelle A, Yeh R, Deutsch E, Mokrane FZ, Farwell M, Ammari S, Schoder H, Zhao B, Schwartz LH. Artificial intelligence and radiomics: fundamentals, applications, and challenges in immunotherapy. J Immunother Cancer 2022; 10:jitc-2022-005292. [PMID: 36180071 PMCID: PMC9528623 DOI: 10.1136/jitc-2022-005292] [Citation(s) in RCA: 28] [Impact Index Per Article: 14.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 09/01/2022] [Indexed: 11/04/2022] Open
Abstract
Immunotherapy offers the potential for durable clinical benefit but calls into question the association between tumor size and outcome that currently forms the basis for imaging-guided treatment. Artificial intelligence (AI) and radiomics allow for discovery of novel patterns in medical images that can increase radiology’s role in management of patients with cancer, although methodological issues in the literature limit its clinical application. Using keywords related to immunotherapy and radiomics, we performed a literature review of MEDLINE, CENTRAL, and Embase from database inception through February 2022. We removed all duplicates, non-English language reports, abstracts, reviews, editorials, perspectives, case reports, book chapters, and non-relevant studies. From the remaining articles, the following information was extracted: publication information, sample size, primary tumor site, imaging modality, primary and secondary study objectives, data collection strategy (retrospective vs prospective, single center vs multicenter), radiomic signature validation strategy, signature performance, and metrics for calculation of a Radiomics Quality Score (RQS). We identified 351 studies, of which 87 were unique reports relevant to our research question. The median (IQR) of cohort sizes was 101 (57–180). Primary stated goals for radiomics model development were prognostication (n=29, 33.3%), treatment response prediction (n=24, 27.6%), and characterization of tumor phenotype (n=14, 16.1%) or immune environment (n=13, 14.9%). Most studies were retrospective (n=75, 86.2%) and recruited patients from a single center (n=57, 65.5%). For studies with available information on model testing, most (n=54, 65.9%) used a validation set or better. Performance metrics were generally highest for radiomics signatures predicting treatment response or tumor phenotype, as opposed to immune environment and overall prognosis. Out of a possible maximum of 36 points, the median (IQR) of RQS was 12 (10–16). While a rapidly increasing number of promising results offer proof of concept that AI and radiomics could drive precision medicine approaches for a wide range of indications, standardizing the data collection as well as optimizing the methodological quality and rigor are necessary before these results can be translated into clinical practice.
Collapse
Affiliation(s)
- Laurent Dercle
- Radiology, NewYork-Presbyterian/Columbia University Medical Center, New York, New York, USA
| | - Jeremy McGale
- Radiology, NewYork-Presbyterian/Columbia University Medical Center, New York, New York, USA
| | - Shawn Sun
- Radiology, NewYork-Presbyterian/Columbia University Medical Center, New York, New York, USA
| | - Aurelien Marabelle
- Therapeutic Innovation and Early Trials, Gustave Roussy, Villejuif, Île-de-France, France
| | - Randy Yeh
- Molecular Imaging and Therapy Service, Memorial Sloan Kettering Cancer Center, New York, New York, USA
| | - Eric Deutsch
- Radiation Oncology, Gustave Roussy, Villejuif, Île-de-France, France
| | | | - Michael Farwell
- Division of Nuclear Medicine and Molecular Imaging, Hospital of the University of Pennsylvania, Philadelphia, Pennsylvania, USA
| | - Samy Ammari
- Radiation Oncology, Gustave Roussy, Villejuif, Île-de-France, France.,Radiology, Institut de Cancérologie Paris Nord, Sarcelles, France
| | - Heiko Schoder
- Radiology, Memorial Sloan Kettering Cancer Center, New York, New York, USA
| | - Binsheng Zhao
- Radiology, NewYork-Presbyterian/Columbia University Medical Center, New York, New York, USA
| | - Lawrence H Schwartz
- Radiology, NewYork-Presbyterian/Columbia University Medical Center, New York, New York, USA
| |
Collapse
|
10
|
Xu C, Peng Y, Zhu W, Chen Z, Li J, Tan W, Zhang Z, Chen X. An automated approach for predicting glioma grade and survival of LGG patients using CNN and radiomics. Front Oncol 2022; 12:969907. [PMID: 36033433 PMCID: PMC9413530 DOI: 10.3389/fonc.2022.969907] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/16/2022] [Accepted: 07/15/2022] [Indexed: 12/24/2022] Open
Abstract
Objectives To develop and validate an efficient and automatically computational approach for stratifying glioma grades and predicting survival of lower-grade glioma (LGG) patients using an integration of state-of-the-art convolutional neural network (CNN) and radiomics. Method This retrospective study reviewed 470 preoperative MR images of glioma from BraTs public dataset (n=269) and Jinling hospital (n=201). A fully automated pipeline incorporating tumor segmentation and grading was developed, which can avoid variability and subjectivity of manual segmentations. First, an integrated approach by fusing CNN features and radiomics features was employed to stratify glioma grades. Then, a deep-radiomics signature based on the integrated approach for predicting survival of LGG patients was developed and subsequently validated in an independent cohort. Results The performance of tumor segmentation achieved a Dice coefficient of 0.81. The intraclass correlation coefficients (ICCs) of the radiomics features between the segmentation network and physicians were all over 0.75. The performance of glioma grading based on integrated approach achieved the area under the curve (AUC) of 0.958, showing the effectiveness of the integrated approach. The multivariable Cox regression results demonstrated that the deep-radiomics signature remained an independent prognostic factor and the integrated nomogram showed significantly better performance than the clinical nomogram in predicting overall survival of LGG patients (C-index: 0.865 vs. 0.796, P=0.005). Conclusion The proposed integrated approach can be noninvasively and efficiently applied in prediction of gliomas grade and survival. Moreover, our fully automated pipeline successfully achieved computerized segmentation instead of manual segmentation, which shows the potential to be a reproducible approach in clinical practice.
Collapse
Affiliation(s)
- Chenan Xu
- State Key Laboratory of Radiation Medicine and Protection, Collaborative Innovation Center of Radiological Medicine of Jiangsu Higher Education Institutions, and School for Radiological and Interdisciplinary Sciences (RAD-X), Soochow University, Suzhou, China
| | - Yuanyuan Peng
- School of Electronics and Information Engineering and Medical Image Processing, Analysis and Visualization Lab, Soochow University, Suzhou, China
| | - Weifang Zhu
- School of Electronics and Information Engineering and Medical Image Processing, Analysis and Visualization Lab, Soochow University, Suzhou, China
| | - Zhongyue Chen
- School of Electronics and Information Engineering and Medical Image Processing, Analysis and Visualization Lab, Soochow University, Suzhou, China
| | - Jianrui Li
- Department of Diagnostic Radiology, Affiliated Jinling Hospital, Medical School of Nanjing University, Nanjing, China
| | - Wenhao Tan
- School of Electronics and Information Engineering and Medical Image Processing, Analysis and Visualization Lab, Soochow University, Suzhou, China
| | - Zhiqiang Zhang
- Department of Diagnostic Radiology, Affiliated Jinling Hospital, Medical School of Nanjing University, Nanjing, China
- State Key Laboratory of Analytical Chemistry for Life Science, Nanjing University, Nanjing, China
- *Correspondence: Zhiqiang Zhang, ; Xinjian Chen,
| | - Xinjian Chen
- State Key Laboratory of Radiation Medicine and Protection, Collaborative Innovation Center of Radiological Medicine of Jiangsu Higher Education Institutions, and School for Radiological and Interdisciplinary Sciences (RAD-X), Soochow University, Suzhou, China
- School of Electronics and Information Engineering and Medical Image Processing, Analysis and Visualization Lab, Soochow University, Suzhou, China
- *Correspondence: Zhiqiang Zhang, ; Xinjian Chen,
| |
Collapse
|
11
|
Radiomic Signatures Associated with CD8+ Tumour-Infiltrating Lymphocytes: A Systematic Review and Quality Assessment Study. Cancers (Basel) 2022; 14:cancers14153656. [PMID: 35954318 PMCID: PMC9367613 DOI: 10.3390/cancers14153656] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/16/2022] [Revised: 07/23/2022] [Accepted: 07/25/2022] [Indexed: 02/04/2023] Open
Abstract
The tumour immune microenvironment influences the efficacy of immune checkpoint inhibitors. Within this microenvironment are CD8-expressing tumour-infiltrating lymphocytes (CD8+ TILs), which are an important mediator and marker of anti-tumour response. In practice, the assessment of CD8+ TILs via tissue sampling involves logistical challenges. Radiomics, the high-throughput extraction of features from medical images, may offer a novel and non-invasive alternative. We performed a systematic review of the available literature reporting radiomic signatures associated with CD8+ TILs. We also aimed to evaluate the methodological quality of the identified studies using the Radiomics Quality Score (RQS) tool, and the risk of bias and applicability with the Quality Assessment of Diagnostic Accuracy Studies (QUADAS-2) tool. Articles were searched from inception until 31 December 2021, in three electronic databases, and screened against eligibility criteria. Twenty-seven articles were included. A wide variety of cancers have been studied. The reported radiomic signatures were heterogeneous, with very limited reproducibility between studies of the same cancer group. The overall quality of studies was found to be less than desirable (mean RQS = 33.3%), indicating a need for technical maturation. Some potential avenues for further investigation are also discussed.
Collapse
|