1
|
Zhou W, Wen J, Huang Q, Zeng Y, Zhou Z, Zhu Y, Chen L, Guan Y, Xie F, Zhuang D, Hua T. Development and validation of clinical-radiomics analysis for preoperative prediction of IDH mutation status and WHO grade in diffuse gliomas: a consecutive L-[methyl-11C] methionine cohort study with two PET scanners. Eur J Nucl Med Mol Imaging 2024; 51:1423-1435. [PMID: 38110710 DOI: 10.1007/s00259-023-06562-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/04/2023] [Accepted: 12/04/2023] [Indexed: 12/20/2023]
Abstract
PURPOSE Determination of isocitrate dehydrogenase (IDH) genotype is crucial in the stratification of diagnosis and prognostication in diffuse gliomas. We sought to build and validate radiomics models and clinical features incorporated nomogram for preoperative prediction of IDH mutation status and WHO grade of diffuse gliomas with L-[methyl-11C] methionine ([11C]MET) PET/CT imaging according to the 2016 WHO classification of tumors of the central nervous system. METHODS Consecutive 178 preoperative [11C]MET PET/CT images were retrospectively studied for radiomics analysis. One hundred six patients from PET scanner 1 were used as training dataset, and 72 patients from PET scanner 2 were used for validation dataset. [11C]MET PET and integrated CT radiomics features were extracted, respectively; three independent predictive models were built based on PET features, CT features, and combined PET/CT features, respectively. The SelectKBest method, Spearman correlation analysis, Least Absolute Shrinkage and Selection Operator (LASSO) regression, and machine learning algorithms were applied for feature selection and model building. After filtering the satisfactory predictive model, key clinical features were incorporated for the nomogram establishment. RESULTS The combined [11C]MET PET/CT radiomics model, which consisted of four PET features and eight integrated CT features, was significantly associated with IDH genotype (p < 0.0001 for both training and validation datasets). Nomogram based on the [11C]MET PET/CT radiomics score, patients' age, and dichotomous tumor location status showed satisfactory discrimination capacity, and the AUC was 0.880 (95% CI, 0.726-0.998) in the training dataset and 0.866 (95% CI, 0.777-0.956) in the validation dataset. In IDH stratified WHO grade prediction, the final radiomics model consists of four PET features and two CT features had reasonable and stable differential efficacy of WHO grade II and III patients from grade IV patients in IDH-wildtype patients, and the AUC was 0.820 (95% CI, 0.541-1.000) in the training dataset and 0.766 (95% CI, 0.612-0.921) in the validation dataset. CONCLUSION [11C]MET PET radiomics features could benefit non-invasive IDH genotype prediction, and integrated CT radiomics features could enhance the efficacy. Radiomics and clinical features incorporation could establish satisfactory nomogram for clinical application. This non-invasive predictive investigation based on our consecutive cohort from two PET scanners could provide the perspective to observe the differential efficacy and the stability of radiomics-based investigation in untreated diffuse gliomas.
Collapse
Affiliation(s)
- Weiyan Zhou
- Department of Nuclear Medicine & PET Center, Huashan Hospital, Fudan University, Shanghai, China
| | - Jianbo Wen
- Department of Radiology, Huashan Hospital, Shanghai Medical College, Fudan University, Shanghai, China
| | - Qi Huang
- Department of Nuclear Medicine & PET Center, Huashan Hospital, Fudan University, Shanghai, China
| | - Yan Zeng
- Department of Research Center, Shanghai United Imaging Intelligence Co., Ltd., Shanghai, China
| | - Zhirui Zhou
- Radiation Oncology Center, Huashan Hospital, Fudan University, Shanghai, China
| | - Yuhua Zhu
- Department of Nuclear Medicine & PET Center, Huashan Hospital, Fudan University, Shanghai, China
| | - Lei Chen
- Department of Research Center, Shanghai United Imaging Intelligence Co., Ltd., Shanghai, China
| | - Yihui Guan
- Department of Nuclear Medicine & PET Center, Huashan Hospital, Fudan University, Shanghai, China
| | - Fang Xie
- Department of Nuclear Medicine & PET Center, Huashan Hospital, Fudan University, Shanghai, China.
| | - Dongxiao Zhuang
- Department of Neurosurgery, Huashan Hospital, Shanghai Medical College, Fudan University, Shanghai, China.
- National Center for Neurological Disorders, Shanghai, China.
- Shanghai Key Laboratory of Brain Function and Restoration and Neural Regeneration, Shanghai, China.
- Neurosurgical Institute of Fudan University, Shanghai, China.
- Shanghai Clinical Medical Center of Neurosurgery, Shanghai, China.
| | - Tao Hua
- Department of Nuclear Medicine & PET Center, Huashan Hospital, Fudan University, Shanghai, China.
| |
Collapse
|
2
|
Ahrari S, Zaragori T, Zinsz A, Oster J, Imbert L, Verger A. Application of PET imaging delta radiomics for predicting progression-free survival in rare high-grade glioma. Sci Rep 2024; 14:3256. [PMID: 38332004 PMCID: PMC10853227 DOI: 10.1038/s41598-024-53693-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/16/2023] [Accepted: 02/03/2024] [Indexed: 02/10/2024] Open
Abstract
This study assesses the feasibility of using a sample-efficient model to investigate radiomics changes over time for predicting progression-free survival in rare diseases. Eighteen high-grade glioma patients underwent two L-3,4-dihydroxy-6-[18F]-fluoro-phenylalanine positron emission tomography (PET) dynamic scans: the first during treatment and the second at temozolomide chemotherapy discontinuation. Radiomics features from static/dynamic parametric images, alongside conventional features, were extracted. After excluding highly correlated features, 16 different models were trained by combining various feature selection methods and time-to-event survival algorithms. Performance was assessed using cross-validation. To evaluate model robustness, an additional dataset including 35 patients with a single PET scan at therapy discontinuation was used. Model performance was compared with a strategy extracting informative features from the set of 35 patients and applying them to the 18 patients with 2 PET scans. Delta-absolute radiomics achieved the highest performance when the pipeline was directly applied to the 18-patient subset (support vector machine (SVM) and recursive feature elimination (RFE): C-index = 0.783 [0.744-0.818]). This result remained consistent when transferring informative features from 35 patients (SVM + RFE: C-index = 0.751 [0.716-0.784], p = 0.06). In addition, it significantly outperformed delta-absolute conventional (C-index = 0.584 [0.548-0.620], p < 0.001) and single-time-point radiomics features (C-index = 0.546 [0.512-0.580], p < 0.001), highlighting the considerable potential of delta radiomics in rare cancer cohorts.
Collapse
Affiliation(s)
- Shamimeh Ahrari
- Imagerie Adaptative Diagnostique et Interventionnelle, Institut National de la Santé et de la Recherche Médicale U1254, Université de Lorraine, 54000, Nancy, France
- Nancyclotep Imaging Platform, Université de Lorraine, 54000, Nancy, France
| | - Timothée Zaragori
- Imagerie Adaptative Diagnostique et Interventionnelle, Institut National de la Santé et de la Recherche Médicale U1254, Université de Lorraine, 54000, Nancy, France
- Nancyclotep Imaging Platform, Université de Lorraine, 54000, Nancy, France
| | - Adeline Zinsz
- Department of Nuclear Medicine, Centre Hospitalier Régional Universitaire de Nancy, 54000, Nancy, France
| | - Julien Oster
- Imagerie Adaptative Diagnostique et Interventionnelle, Institut National de la Santé et de la Recherche Médicale U1254, Université de Lorraine, 54000, Nancy, France
| | - Laetitia Imbert
- Imagerie Adaptative Diagnostique et Interventionnelle, Institut National de la Santé et de la Recherche Médicale U1254, Université de Lorraine, 54000, Nancy, France
- Nancyclotep Imaging Platform, Université de Lorraine, 54000, Nancy, France
- Department of Nuclear Medicine, Centre Hospitalier Régional Universitaire de Nancy, 54000, Nancy, France
| | - Antoine Verger
- Imagerie Adaptative Diagnostique et Interventionnelle, Institut National de la Santé et de la Recherche Médicale U1254, Université de Lorraine, 54000, Nancy, France.
- Nancyclotep Imaging Platform, Université de Lorraine, 54000, Nancy, France.
- Department of Nuclear Medicine, Centre Hospitalier Régional Universitaire de Nancy, 54000, Nancy, France.
| |
Collapse
|
3
|
Moradi S, Spielvogel C, Krajnc D, Brandner C, Hillmich S, Wille R, Traub-Weidinger T, Li X, Hacker M, Drexler W, Papp L. Error mitigation enables PET radiomic cancer characterization on quantum computers. Eur J Nucl Med Mol Imaging 2023; 50:3826-3837. [PMID: 37540237 PMCID: PMC10611844 DOI: 10.1007/s00259-023-06362-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/21/2023] [Accepted: 07/24/2023] [Indexed: 08/05/2023]
Abstract
BACKGROUND Cancer is a leading cause of death worldwide. While routine diagnosis of cancer is performed mainly with biopsy sampling, it is suboptimal to accurately characterize tumor heterogeneity. Positron emission tomography (PET)-driven radiomic research has demonstrated promising results when predicting clinical endpoints. This study aimed to investigate the added value of quantum machine learning both in simulator and in real quantum computers utilizing error mitigation techniques to predict clinical endpoints in various PET cancer patients. METHODS Previously published PET radiomics datasets including 11C-MET PET glioma, 68GA-PSMA-11 PET prostate and lung 18F-FDG PET with 3-year survival, low-vs-high Gleason risk and 2-year survival as clinical endpoints respectively were utilized in this study. Redundancy reduction with 0.7, 0.8, and 0.9 Spearman rank thresholds (SRT), followed by selecting 8 and 16 features from all cohorts, was performed, resulting in 18 dataset variants. Quantum advantage was estimated by Geometric Difference (GDQ) score in each dataset variant. Five classic machine learning (CML) and their quantum versions (QML) were trained and tested in simulator environments across the dataset variants. Quantum circuit optimization and error mitigation were performed, followed by training and testing selected QML methods on the 21-qubit IonQ Aria quantum computer. Predictive performances were estimated by test balanced accuracy (BACC) values. RESULTS On average, QML outperformed CML in simulator environments with 16-features (BACC 70% and 69%, respectively), while with 8-features, CML outperformed QML with + 1%. The highest average QML advantage was + 4%. The GDQ scores were ≤ 1.0 in all the 8-feature cases, while they were > 1.0 when QML outperformed CML in 9 out of 11 cases. The test BACC of selected QML methods and datasets in the IonQ device without error mitigation (EM) were 69.94% BACC, while EM increased test BACC to 75.66% (76.77% in noiseless simulators). CONCLUSIONS We demonstrated that with error mitigation, quantum advantage can be achieved in real existing quantum computers when predicting clinical endpoints in clinically relevant PET cancer cohorts. Quantum advantage can already be achieved in simulator environments in these cohorts when relying on QML.
Collapse
Affiliation(s)
- S Moradi
- Applied Quantum Computing Group, Center for Medical Physics and Biomedical Engineering, Medical University of Vienna, Waehringer Guertel 18-20, T1090, Vienna, Austria
| | - Clemens Spielvogel
- Division of Nuclear Medicine, Medical University of Vienna, Vienna, Austria
| | - Denis Krajnc
- Center for Medical Physics and Biomedical Engineering, Medical University of Vienna, Vienna, Austria
| | - C Brandner
- Applied Quantum Computing Group, Center for Medical Physics and Biomedical Engineering, Medical University of Vienna, Waehringer Guertel 18-20, T1090, Vienna, Austria
| | - S Hillmich
- Institute for Integrated Circuits, Johannes Kepler University Linz, Linz, Austria
| | - R Wille
- Chair for Design Automation, Technical University of Munich, Munich, Germany
| | - T Traub-Weidinger
- Division of Nuclear Medicine, Medical University of Vienna, Vienna, Austria
| | - X Li
- Division of Nuclear Medicine, Medical University of Vienna, Vienna, Austria
| | - M Hacker
- Division of Nuclear Medicine, Medical University of Vienna, Vienna, Austria
| | - W Drexler
- Center for Medical Physics and Biomedical Engineering, Medical University of Vienna, Vienna, Austria
| | - L Papp
- Applied Quantum Computing Group, Center for Medical Physics and Biomedical Engineering, Medical University of Vienna, Waehringer Guertel 18-20, T1090, Vienna, Austria.
| |
Collapse
|
4
|
Papp L, Haberl D, Ecsedi B, Spielvogel CP, Krajnc D, Grahovac M, Moradi S, Drexler W. DEBI-NN: Distance-encoding biomorphic-informational neural networks for minimizing the number of trainable parameters. Neural Netw 2023; 167:517-532. [PMID: 37690213 DOI: 10.1016/j.neunet.2023.08.026] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/25/2022] [Revised: 08/11/2023] [Accepted: 08/17/2023] [Indexed: 09/12/2023]
Abstract
Modern artificial intelligence (AI) approaches mainly rely on neural network (NN) or deep NN methodologies. However, these approaches require large amounts of data to train, given, that the number of their trainable parameters has a polynomial relationship to their neuron counts. This property renders deep NNs challenging to apply in fields operating with small, albeit representative datasets such as healthcare. In this paper, we propose a novel neural network architecture which trains spatial positions of neural soma and axon pairs, where weights are calculated by axon-soma distances of connected neurons. We refer to this method as distance-encoding biomorphic-informational (DEBI) neural network. This concept significantly minimizes the number of trainable parameters compared to conventional neural networks. We demonstrate that DEBI models can yield comparable predictive performance in tabular and imaging datasets, where they require a fraction of trainable parameters compared to conventional NNs, resulting in a highly scalable solution.
Collapse
Affiliation(s)
- Laszlo Papp
- Center for Medical Physics and Biomedical Engineering, Medical University of Vienna, Vienna, Austria.
| | - David Haberl
- Division of Nuclear Medicine, Medical University of Vienna, Vienna, Austria
| | - Boglarka Ecsedi
- Center for Medical Physics and Biomedical Engineering, Medical University of Vienna, Vienna, Austria; Georgia Institute of Technology, Atlanta, GA, USA
| | | | - Denis Krajnc
- Center for Medical Physics and Biomedical Engineering, Medical University of Vienna, Vienna, Austria
| | - Marko Grahovac
- Division of Nuclear Medicine, Medical University of Vienna, Vienna, Austria
| | - Sasan Moradi
- Center for Medical Physics and Biomedical Engineering, Medical University of Vienna, Vienna, Austria
| | - Wolfgang Drexler
- Center for Medical Physics and Biomedical Engineering, Medical University of Vienna, Vienna, Austria
| |
Collapse
|
5
|
Basran PS, Shcherban N, Forman M, Chang J, Nelissen S, Recchia BK, Porter IR. Combining ultrasound radiomics, complete blood count, and serum biochemical biomarkers for diagnosing intestinal disorders in cats using machine learning. Vet Radiol Ultrasound 2023; 64:890-903. [PMID: 37394240 DOI: 10.1111/vru.13250] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/06/2023] [Revised: 04/06/2023] [Accepted: 04/15/2023] [Indexed: 07/04/2023] Open
Abstract
This retrospective analytical observational cohort study aimed to model and predict the classification of feline intestinal diseases from segmentations of a transverse section from small intestine ultrasound (US) image, complete blood count (CBC), and serum biochemical profile data using a variety of machine-learning approaches. In 149 cats from three institutions, images were obtained from cats with biopsy-confirmed small cell epitheliotropic lymphoma (lymphoma), inflammatory bowel disease (IBD), no pathology ("healthy"), and other conditions (warrant a biopsy for further diagnosis). CBC, blood serum chemistry, small intestinal ultrasound, and small intestinal biopsy were obtained within a 2-week interval. CBC and serum biomarkers and radiomic features were combined for modeling. Four classification schemes were investigated: (1) normal versus abnormal; (2) warranting or not warranting a biopsy; (3) lymphoma, IBD, healthy, or other conditions; and (4) lymphoma, IBD, or other conditions. Two feature selection methods were used to identify the top 3, 5, 10, and 20 features, and six machine learning models were trained. The average (95% CI) performance of models for all combinations of features, numbers of features, and types of classifiers was 0.886 (0.871-0.912) for Model 1 (normal vs. abnormal), 0.751 (0.735-0.818) for Model 2 (biopsy vs. no biopsy), 0.504 (0.450-0.556) for Model 3 (lymphoma, IBD, healthy, or other), and 0.531 (0.426-0.589), for Model 4 (lymphoma, IBD, or other). Our findings suggest model accuracies above 0.85 can be achieved in Model 1 and 2, and that including CBC and biochemistry data with US radiomics data did not significantly improve accuracy in our models.
Collapse
Affiliation(s)
- Parminder S Basran
- Department of Clinical Sciences, College of Veterinary Medicine, Cornell University, Ithaca, New York, USA
- Department of Biological Sciences, College of Veterinary Medicine, Cornell University, Ithaca, New York, USA
| | - Natalya Shcherban
- Department of Clinical Sciences, College of Veterinary Medicine, Cornell University, Ithaca, New York, USA
| | - Marnin Forman
- Cornell University Veterinary Specialists, Stamford, Connecticut, USA
| | - Jasmine Chang
- Department of Clinical Sciences, College of Veterinary Medicine, Cornell University, Ithaca, New York, USA
| | - Sophie Nelissen
- Department of Biomedical Sciences, Section of Anatomic Pathology, College of Veterinary Medicine, Cornell University, Ithaca, New York, USA
| | | | - Ian R Porter
- Department of Clinical Sciences, College of Veterinary Medicine, Cornell University, Ithaca, New York, USA
| |
Collapse
|
6
|
Jha AK, Mithun S, Sherkhane UB, Dwivedi P, Puts S, Osong B, Traverso A, Purandare N, Wee L, Rangarajan V, Dekker A. Emerging role of quantitative imaging (radiomics) and artificial intelligence in precision oncology. EXPLORATION OF TARGETED ANTI-TUMOR THERAPY 2023; 4:569-582. [PMID: 37720353 PMCID: PMC10501896 DOI: 10.37349/etat.2023.00153] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/22/2022] [Accepted: 04/20/2023] [Indexed: 09/19/2023] Open
Abstract
Cancer is a fatal disease and the second most cause of death worldwide. Treatment of cancer is a complex process and requires a multi-modality-based approach. Cancer detection and treatment starts with screening/diagnosis and continues till the patient is alive. Screening/diagnosis of the disease is the beginning of cancer management and continued with the staging of the disease, planning and delivery of treatment, treatment monitoring, and ongoing monitoring and follow-up. Imaging plays an important role in all stages of cancer management. Conventional oncology practice considers that all patients are similar in a disease type, whereas biomarkers subgroup the patients in a disease type which leads to the development of precision oncology. The utilization of the radiomic process has facilitated the advancement of diverse imaging biomarkers that find application in precision oncology. The role of imaging biomarkers and artificial intelligence (AI) in oncology has been investigated by many researchers in the past. The existing literature is suggestive of the increasing role of imaging biomarkers and AI in oncology. However, the stability of radiomic features has also been questioned. The radiomic community has recognized that the instability of radiomic features poses a danger to the global generalization of radiomic-based prediction models. In order to establish radiomic-based imaging biomarkers in oncology, the robustness of radiomic features needs to be established on a priority basis. This is because radiomic models developed in one institution frequently perform poorly in other institutions, most likely due to radiomic feature instability. To generalize radiomic-based prediction models in oncology, a number of initiatives, including Quantitative Imaging Network (QIN), Quantitative Imaging Biomarkers Alliance (QIBA), and Image Biomarker Standardisation Initiative (IBSI), have been launched to stabilize the radiomic features.
Collapse
Affiliation(s)
- Ashish Kumar Jha
- Department of Radiation Oncology (Maastro), GROW School for Oncology, Maastricht University Medical Centre+, 6200 Maastricht, The Netherlands
- Department of Nuclear Medicine, Tata Memorial Hospital, Mumbai 400012, Maharashtra, India
- Homi Bhabha National Institute, BARC Training School Complex, Anushaktinagar, Mumbai 400094, Maharashtra, India
| | - Sneha Mithun
- Department of Radiation Oncology (Maastro), GROW School for Oncology, Maastricht University Medical Centre+, 6200 Maastricht, The Netherlands
- Department of Nuclear Medicine, Tata Memorial Hospital, Mumbai 400012, Maharashtra, India
- Homi Bhabha National Institute, BARC Training School Complex, Anushaktinagar, Mumbai 400094, Maharashtra, India
| | - Umeshkumar B. Sherkhane
- Department of Radiation Oncology (Maastro), GROW School for Oncology, Maastricht University Medical Centre+, 6200 Maastricht, The Netherlands
- Department of Nuclear Medicine, Tata Memorial Hospital, Mumbai 400012, Maharashtra, India
| | - Pooj Dwivedi
- Homi Bhabha National Institute, BARC Training School Complex, Anushaktinagar, Mumbai 400094, Maharashtra, India
- Department of Nuclear Medicine, Advance Center for Treatment, Research, Education in Cancer, Kharghar, Navi-Mumbai 410210, Maharashtra, India
| | - Senders Puts
- Department of Radiation Oncology (Maastro), GROW School for Oncology, Maastricht University Medical Centre+, 6200 Maastricht, The Netherlands
| | - Biche Osong
- Department of Radiation Oncology (Maastro), GROW School for Oncology, Maastricht University Medical Centre+, 6200 Maastricht, The Netherlands
| | - Alberto Traverso
- Department of Radiation Oncology (Maastro), GROW School for Oncology, Maastricht University Medical Centre+, 6200 Maastricht, The Netherlands
| | - Nilendu Purandare
- Department of Nuclear Medicine, Tata Memorial Hospital, Mumbai 400012, Maharashtra, India
- Homi Bhabha National Institute, BARC Training School Complex, Anushaktinagar, Mumbai 400094, Maharashtra, India
| | - Leonard Wee
- Department of Radiation Oncology (Maastro), GROW School for Oncology, Maastricht University Medical Centre+, 6200 Maastricht, The Netherlands
| | - Venkatesh Rangarajan
- Department of Nuclear Medicine, Tata Memorial Hospital, Mumbai 400012, Maharashtra, India
- Homi Bhabha National Institute, BARC Training School Complex, Anushaktinagar, Mumbai 400094, Maharashtra, India
| | - Andre Dekker
- Department of Radiation Oncology (Maastro), GROW School for Oncology, Maastricht University Medical Centre+, 6200 Maastricht, The Netherlands
| |
Collapse
|
7
|
Marik W, Cardoso PL, Springer E, Bogner W, Preusser M, Widhalm G, Hangel G, Hainfellner JA, Rausch I, Weber M, Schmidbauer V, Traub-Weidinger T, Trattnig S. Evaluation of Gliomas with Magnetic Resonance Fingerprinting with PET Correlation-A Comparative Study. Cancers (Basel) 2023; 15:2740. [PMID: 37345077 DOI: 10.3390/cancers15102740] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/27/2023] [Revised: 05/08/2023] [Accepted: 05/10/2023] [Indexed: 06/23/2023] Open
Abstract
OBJECTIVES Advanced MR imaging of brain tumors is still mainly based on qualitative imaging. PET imaging offers additive metabolic information, and MR fingerprinting (MRF) offers a novel approach to quantitative data acquisition. The purpose of this study was to evaluate the ability of MRF to predict tumor regions and grading in combination with PET. METHODS Seventeen patients with histologically verified infiltrating gliomas and available amino-acid PET data were enrolled. ROIs for solid tumor parts (SPo), perifocal edema (ED1), and normal-appearing white matter (NAWM) were selected on conventional MRI sequences and aligned to the MRF and PET images. The predictability of gliomas by region and grading as well as intermodal correlations were assessed. RESULTS For MRF, we calculated an overall predictability by region (SPo, ED1, and NAWM) for all of the MRF parameters of 76.5%, 47.1%, and 94.1%, respectively. The overall ability to distinguish low- from high-grade gliomas using MRF was 88.9% for LGG and 75% for HGG, with an accuracy of 82.4%, a ppV of 85.71%, and an npV of 80%. PET positivity was found in 13/17 patients for solid tumor parts, and in 3/17 patients for the edema region. However, there was no significant difference in region-specific MRF values between PET positive and PET negative patients. CONCLUSIONS MRF and PET provide quantitative measurements of the tumor tissue characteristics of gliomas, with good predictability. Nonetheless, the results are dissimilar, reflecting the different underlying mechanisms of each method.
Collapse
Affiliation(s)
- Wolfgang Marik
- Division of Neuroradiology and Musculoskeletal Radiology, Department of Biomedical Imaging and Image-Guided Therapy, Medical University of Vienna, 1090 Vienna, Austria
| | - Pedro Lima Cardoso
- High-Field MR Centre, Department of Biomedical Imaging and Image-Guided Therapy, Medical University of Vienna, 1090 Vienna, Austria
| | - Elisabeth Springer
- High-Field MR Centre, Department of Biomedical Imaging and Image-Guided Therapy, Medical University of Vienna, 1090 Vienna, Austria
- Institute of Radiology, Hietzing Hospital, 1130 Vienna, Austria
| | - Wolfgang Bogner
- High-Field MR Centre, Department of Biomedical Imaging and Image-Guided Therapy, Medical University of Vienna, 1090 Vienna, Austria
| | - Matthias Preusser
- Division of Oncology, Department of Internal Medicine I, Medical University of Vienna, 1090 Vienna, Austria
| | - Georg Widhalm
- Department of Neurosurgery, Medical University of Vienna, 1090 Vienna, Austria
| | - Gilbert Hangel
- High-Field MR Centre, Department of Biomedical Imaging and Image-Guided Therapy, Medical University of Vienna, 1090 Vienna, Austria
- Department of Neurosurgery, Medical University of Vienna, 1090 Vienna, Austria
| | - Johannes A Hainfellner
- Division of Neuropathology and Neurochemistry, Department of Neurology, Medical University of Vienna, 1090 Vienna, Austria
| | - Ivo Rausch
- Division of Nuclear Medicine, Department of Biomedical Imaging and Image-Guided Therapy, Medical University of Vienna, 1090 Vienna, Austria
| | - Michael Weber
- Division of Neuroradiology and Musculoskeletal Radiology, Department of Biomedical Imaging and Image-Guided Therapy, Medical University of Vienna, 1090 Vienna, Austria
| | - Victor Schmidbauer
- Division of Neuroradiology and Musculoskeletal Radiology, Department of Biomedical Imaging and Image-Guided Therapy, Medical University of Vienna, 1090 Vienna, Austria
| | - Tatjana Traub-Weidinger
- Division of Nuclear Medicine, Department of Biomedical Imaging and Image-Guided Therapy, Medical University of Vienna, 1090 Vienna, Austria
| | - Siegfried Trattnig
- High-Field MR Centre, Department of Biomedical Imaging and Image-Guided Therapy, Medical University of Vienna, 1090 Vienna, Austria
| |
Collapse
|
8
|
Assis RCD, Monteiro GR, Valentim AB, Maia CSC, Felipe SMDS, Freitas Rabelo CA, Ceccatto VM, Alves CR. Biological properties of bioactive compounds from the fruit and leaves of the genipap tree (Genipa americana L.): A systematic review. FOOD BIOSCI 2023. [DOI: 10.1016/j.fbio.2023.102514] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/05/2023]
|
9
|
Papp L, Rasul S, Spielvogel CP, Krajnc D, Poetsch N, Woehrer A, Patronas EM, Ecsedi B, Furtner J, Mitterhauser M, Rausch I, Widhalm G, Beyer T, Hacker M, Traub-Weidinger T. Sex-specific radiomic features of L-[S-methyl- 11C] methionine PET in patients with newly-diagnosed gliomas in relation to IDH1 predictability. Front Oncol 2023; 13:986788. [PMID: 36816966 PMCID: PMC9936222 DOI: 10.3389/fonc.2023.986788] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/05/2022] [Accepted: 01/23/2023] [Indexed: 02/05/2023] Open
Abstract
Introduction Amino-acid positron emission tomography (PET) is a validated metabolic imaging approach for the diagnostic work-up of gliomas. This study aimed to evaluate sex-specific radiomic characteristics of L-[S-methyl-11Cmethionine (MET)-PET images of glioma patients in consideration of the prognostically relevant biomarker isocitrate dehydrogenase (IDH) mutation status. Methods MET-PET of 35 astrocytic gliomas (13 females, mean age 41 ± 13 yrs. and 22 males, mean age 46 ± 17 yrs.) and known IDH mutation status were included. All patients underwent radiomic analysis following imaging biomarker standardization initiative (IBSI)-conform guidelines both from standardized uptake value (SUV) and tumor-to-background ratio (TBR) PET values. Aligned Monte Carlo (MC) 100-fold split was utilized for SUV and TBR dataset pairs for both sex and IDH-specific analysis. Borderline and outlier scores were calculated for both sex and IDH-specific MC folds. Feature ranking was performed by R-squared ranking and Mann-Whitney U-test together with Bonferroni correction. Correlation of SUV and TBR radiomics in relation to IDH mutational status in male and female patients were also investigated. Results There were no significant features in either SUV or TBR radiomics to distinguish female and male patients. In contrast, intensity histogram coefficient of variation (ih.cov) and intensity skewness (stat.skew) were identified as significant to predict IDH +/-. In addition, IDH+ females had significant ih.cov deviation (0.031) and mean stat.skew (-0.327) differences compared to IDH+ male patients (0.068 and -0.123, respectively) with two-times higher standard deviations of the normal brain background MET uptake as well. Discussion We demonstrated that female and male glioma patients have significantly different radiomic profiles in MET PET imaging data. Future IDH prediction models shall not be built on mixed female-male cohorts, but shall rely on sex-specific cohorts and radiomic imaging biomarkers.
Collapse
Affiliation(s)
- Laszlo Papp
- Center for Medical Physics and Biomedical Engineering, Medical University of Vienna, Vienna, Austria
| | - Sazan Rasul
- Department of Biomedical Imaging and Image-guided Therapy, Medical University of Vienna, Vienna, Austria
| | - Clemens P. Spielvogel
- Department of Biomedical Imaging and Image-guided Therapy, Medical University of Vienna, Vienna, Austria,Christian Doppler Laboratory for Applied Metabolomics , Medical University of Vienna, Vienna, Austria
| | - Denis Krajnc
- Center for Medical Physics and Biomedical Engineering, Medical University of Vienna, Vienna, Austria
| | - Nina Poetsch
- Department of Biomedical Imaging and Image-guided Therapy, Medical University of Vienna, Vienna, Austria
| | - Adelheid Woehrer
- Clinical Institute of Neurology, Medical University of Vienna, Vienna, Austria
| | - Eva-Maria Patronas
- Department of Biomedical Imaging and Image-guided Therapy, Medical University of Vienna, Vienna, Austria,Division of Pharmaceutical Technology and Biopharmaceutics, Department of Pharmaceutical Sciences, University of Vienna, Vienna, Austria
| | - Boglarka Ecsedi
- Center for Medical Physics and Biomedical Engineering, Medical University of Vienna, Vienna, Austria
| | - Julia Furtner
- Department of Biomedical Imaging and Image-guided Therapy, Medical University of Vienna, Vienna, Austria
| | - Markus Mitterhauser
- Department of Biomedical Imaging and Image-guided Therapy, Medical University of Vienna, Vienna, Austria,Ludwig Boltzmann Institute Applied Diagnostics, Medical University of Vienna, Vienna, Austria
| | - Ivo Rausch
- Center for Medical Physics and Biomedical Engineering, Medical University of Vienna, Vienna, Austria
| | - Georg Widhalm
- Clinical University of Neuro-Surgery, Medical University of Vienna, Vienna, Austria
| | - Thomas Beyer
- Center for Medical Physics and Biomedical Engineering, Medical University of Vienna, Vienna, Austria
| | - Marcus Hacker
- Department of Biomedical Imaging and Image-guided Therapy, Medical University of Vienna, Vienna, Austria
| | - Tatjana Traub-Weidinger
- Department of Biomedical Imaging and Image-guided Therapy, Medical University of Vienna, Vienna, Austria,*Correspondence: Tatjana Traub-Weidinger,
| |
Collapse
|
10
|
Spielvogel CP, Stoiber S, Papp L, Krajnc D, Grahovac M, Gurnhofer E, Trachtova K, Bystry V, Leisser A, Jank B, Schnoell J, Kadletz L, Heiduschka G, Beyer T, Hacker M, Kenner L, Haug AR. Radiogenomic markers enable risk stratification and inference of mutational pathway states in head and neck cancer. Eur J Nucl Med Mol Imaging 2023; 50:546-558. [PMID: 36161512 PMCID: PMC9816299 DOI: 10.1007/s00259-022-05973-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/26/2022] [Accepted: 09/15/2022] [Indexed: 01/11/2023]
Abstract
PURPOSE Head and neck squamous cell carcinomas (HNSCCs) are a molecularly, histologically, and clinically heterogeneous set of tumors originating from the mucosal epithelium of the oral cavity, pharynx, and larynx. This heterogeneous nature of HNSCC is one of the main contributing factors to the lack of prognostic markers for personalized treatment. The aim of this study was to develop and identify multi-omics markers capable of improved risk stratification in this highly heterogeneous patient population. METHODS In this retrospective study, we approached this issue by establishing radiogenomics markers to identify high-risk individuals in a cohort of 127 HNSCC patients. Hybrid in vivo imaging and whole-exome sequencing were employed to identify quantitative imaging markers as well as genetic markers on pathway-level prognostic in HNSCC. We investigated the deductibility of the prognostic genetic markers using anatomical and metabolic imaging using positron emission tomography combined with computed tomography. Moreover, we used statistical and machine learning modeling to investigate whether a multi-omics approach can be used to derive prognostic markers for HNSCC. RESULTS Radiogenomic analysis revealed a significant influence of genetic pathway alterations on imaging markers. A highly prognostic radiogenomic marker based on cellular senescence was identified. Furthermore, the radiogenomic biomarkers designed in this study vastly outperformed the prognostic value of markers derived from genetics and imaging alone. CONCLUSION Using the identified markers, a clinically meaningful stratification of patients is possible, guiding the identification of high-risk patients and potentially aiding in the development of effective targeted therapies.
Collapse
Affiliation(s)
- Clemens P Spielvogel
- Christian Doppler Laboratory for Applied Metabolomics, Vienna, Austria
- Department of Biomedical Imaging and Image-Guided Therapy, Division of Nuclear Medicine, Medical University of Vienna, Vienna, Austria
| | - Stefan Stoiber
- Christian Doppler Laboratory for Applied Metabolomics, Vienna, Austria
- Clinical Institute of Pathology, Medical University of Vienna, Vienna, Austria
| | - Laszlo Papp
- Center for Medical Physics and Biomedical Engineering, Medical University of Vienna, Vienna, Austria
| | - Denis Krajnc
- Center for Medical Physics and Biomedical Engineering, Medical University of Vienna, Vienna, Austria
| | - Marko Grahovac
- Department of Biomedical Imaging and Image-Guided Therapy, Division of Nuclear Medicine, Medical University of Vienna, Vienna, Austria
| | - Elisabeth Gurnhofer
- Clinical Institute of Pathology, Medical University of Vienna, Vienna, Austria
| | - Karolina Trachtova
- Christian Doppler Laboratory for Applied Metabolomics, Vienna, Austria
- Department of Biomedical Imaging and Image-Guided Therapy, Division of Nuclear Medicine, Medical University of Vienna, Vienna, Austria
- Centre for Molecular Medicine, Central European Institute of Technology, Brno, Czech Republic
| | - Vojtech Bystry
- Centre for Molecular Medicine, Central European Institute of Technology, Brno, Czech Republic
| | - Asha Leisser
- Department of Biomedical Imaging and Image-Guided Therapy, Division of Nuclear Medicine, Medical University of Vienna, Vienna, Austria
| | - Bernhard Jank
- Department of Otorhinolaryngology, Head and Neck Surgery, Medical University of Vienna, Vienna, Austria
| | - Julia Schnoell
- Department of Otorhinolaryngology, Head and Neck Surgery, Medical University of Vienna, Vienna, Austria
| | - Lorenz Kadletz
- Department of Otorhinolaryngology, Head and Neck Surgery, Medical University of Vienna, Vienna, Austria
| | - Gregor Heiduschka
- Department of Otorhinolaryngology, Head and Neck Surgery, Medical University of Vienna, Vienna, Austria
| | - Thomas Beyer
- Center for Medical Physics and Biomedical Engineering, Medical University of Vienna, Vienna, Austria
| | - Marcus Hacker
- Department of Biomedical Imaging and Image-Guided Therapy, Division of Nuclear Medicine, Medical University of Vienna, Vienna, Austria
| | - Lukas Kenner
- Christian Doppler Laboratory for Applied Metabolomics, Vienna, Austria.
- Clinical Institute of Pathology, Medical University of Vienna, Vienna, Austria.
| | - Alexander R Haug
- Christian Doppler Laboratory for Applied Metabolomics, Vienna, Austria
- Department of Biomedical Imaging and Image-Guided Therapy, Division of Nuclear Medicine, Medical University of Vienna, Vienna, Austria
| |
Collapse
|
11
|
Muacevic A, Adler JR. Role of Artificial Intelligence and Machine Learning in Prediction, Diagnosis, and Prognosis of Cancer. Cureus 2022; 14:e31008. [PMID: 36475188 PMCID: PMC9717523 DOI: 10.7759/cureus.31008] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/30/2022] [Accepted: 11/02/2022] [Indexed: 01/25/2023] Open
Abstract
Cancer is one of the most devastating, fatal, dangerous, and unpredictable ailments. To reduce the risk of fatality in this disease, we need some ways to predict the disease, diagnose it faster and precisely, and predict the prognosis accurately. The incorporation of artificial intelligence (AI), machine learning (ML), and deep learning (DL) algorithms into the healthcare system has already proven to work wonders for patients. Artificial intelligence is a simulation of intelligence that uses data, rules, and information programmed in it to make predictions. The science of machine learning (ML) uses data to enhance performance in a variety of activities and tasks. A bigger family of machine learning techniques built on artificial neural networks and representation learning is deep learning (DL). To clarify, we require AI, ML, and DL to predict cancer risk, survival chances, cancer recurrence, cancer diagnosis, and cancer prognosis. All of these are required to improve patient's quality of life, increase their survival rates, decrease anxiety and fear to some extent, and make a proper personalized treatment plan for the suffering patient. The survival rates of people with diffuse large B-cell lymphoma (DLBCL) can be forecasted. Both solid and non-solid tumors can be diagnosed precisely with the help of AI and ML algorithms. The prognosis of the disease can also be forecasted with AI and its approaches like deep learning. This improvement in cancer care is a turning point in advanced healthcare and will deeply impact patient's life for good.
Collapse
|
12
|
Krajnc D, Spielvogel CP, Grahovac M, Ecsedi B, Rasul S, Poetsch N, Traub-Weidinger T, Haug AR, Ritter Z, Alizadeh H, Hacker M, Beyer T, Papp L. Automated data preparation for in vivo tumor characterization with machine learning. Front Oncol 2022; 12:1017911. [PMID: 36303841 PMCID: PMC9595446 DOI: 10.3389/fonc.2022.1017911] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/12/2022] [Accepted: 09/23/2022] [Indexed: 11/23/2022] Open
Abstract
Background This study proposes machine learning-driven data preparation (MLDP) for optimal data preparation (DP) prior to building prediction models for cancer cohorts. Methods A collection of well-established DP methods were incorporated for building the DP pipelines for various clinical cohorts prior to machine learning. Evolutionary algorithm principles combined with hyperparameter optimization were employed to iteratively select the best fitting subset of data preparation algorithms for the given dataset. The proposed method was validated for glioma and prostate single center cohorts by 100-fold Monte Carlo (MC) cross-validation scheme with 80-20% training-validation split ratio. In addition, a dual-center diffuse large B-cell lymphoma (DLBCL) cohort was utilized with Center 1 as training and Center 2 as independent validation datasets to predict cohort-specific clinical endpoints. Five machine learning (ML) classifiers were employed for building prediction models across all analyzed cohorts. Predictive performance was estimated by confusion matrix analytics over the validation sets of each cohort. The performance of each model with and without MLDP, as well as with manually-defined DP were compared in each of the four cohorts. Results Sixteen of twenty established predictive models demonstrated area under the receiver operator characteristics curve (AUC) performance increase utilizing the MLDP. The MLDP resulted in the highest performance increase for random forest (RF) (+0.16 AUC) and support vector machine (SVM) (+0.13 AUC) model schemes for predicting 36-months survival in the glioma cohort. Single center cohorts resulted in complex (6-7 DP steps) DP pipelines, with a high occurrence of outlier detection, feature selection and synthetic majority oversampling technique (SMOTE). In contrast, the optimal DP pipeline for the dual-center DLBCL cohort only included outlier detection and SMOTE DP steps. Conclusions This study demonstrates that data preparation prior to ML prediction model building in cancer cohorts shall be ML-driven itself, yielding optimal prediction models in both single and multi-centric settings.
Collapse
Affiliation(s)
- Denis Krajnc
- QIMP Team, Center for Medical Physics and Biomedical Engineering, Medical University of Vienna, Vienna, Austria
| | - Clemens P. Spielvogel
- Department of Biomedical Imaging and Image-guided Therapy, Division of Nuclear Medicine, Medical University of Vienna, Vienna, Austria
- Christian Doppler Laboratory for Applied Metabolomics, Medical University of Vienna, Vienna, Austria
| | - Marko Grahovac
- Department of Biomedical Imaging and Image-guided Therapy, Division of Nuclear Medicine, Medical University of Vienna, Vienna, Austria
| | - Boglarka Ecsedi
- QIMP Team, Center for Medical Physics and Biomedical Engineering, Medical University of Vienna, Vienna, Austria
| | - Sazan Rasul
- Department of Biomedical Imaging and Image-guided Therapy, Division of Nuclear Medicine, Medical University of Vienna, Vienna, Austria
| | - Nina Poetsch
- Department of Biomedical Imaging and Image-guided Therapy, Division of Nuclear Medicine, Medical University of Vienna, Vienna, Austria
| | - Tatjana Traub-Weidinger
- Department of Biomedical Imaging and Image-guided Therapy, Division of Nuclear Medicine, Medical University of Vienna, Vienna, Austria
| | - Alexander R. Haug
- Department of Biomedical Imaging and Image-guided Therapy, Division of Nuclear Medicine, Medical University of Vienna, Vienna, Austria
- Christian Doppler Laboratory for Applied Metabolomics, Medical University of Vienna, Vienna, Austria
| | - Zsombor Ritter
- Department of Medical Imaging, University of Pécs, Medical School, Pécs, Hungary
| | - Hussain Alizadeh
- 1st Department of Internal Medicine, University of Pécs, Medical School, Pécs, Hungary
| | - Marcus Hacker
- Department of Biomedical Imaging and Image-guided Therapy, Division of Nuclear Medicine, Medical University of Vienna, Vienna, Austria
| | - Thomas Beyer
- QIMP Team, Center for Medical Physics and Biomedical Engineering, Medical University of Vienna, Vienna, Austria
| | - Laszlo Papp
- QIMP Team, Center for Medical Physics and Biomedical Engineering, Medical University of Vienna, Vienna, Austria
- Applied Quantum Computing group, Center for Medical Physics and Biomedical Engineering, Medical University of Vienna, Vienna, Austria
| |
Collapse
|
13
|
Zhao R, Zhuge Y, Camphausen K, Krauze AV. Machine learning based survival prediction in Glioma using large-scale registry data. Health Informatics J 2022; 28:14604582221135427. [PMID: 36264067 PMCID: PMC10673681 DOI: 10.1177/14604582221135427] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/26/2023]
Abstract
Gliomas are the most common central nervous system tumors exhibiting poor clinical outcomes. The ability to estimate prognosis is crucial for both patients and providers in order to select the most appropriate treatment. Machine learning (ML) allows for sophisticated approaches to survival prediction using real world clinical parameters needed to achieve superior predictive accuracy. We employed Cox Proportional hazards (CPH) model, Support Vector Machine (SVM) model, Random Forest (RF) model in a large glioma dataset (3462 patients, diagnosed 2000-2018) to explore the most optimal approach to survival prediction. Features employed were age, sex, surgical resection status, tumor histology and tumor site, administration of radiation therapy (RT) and chemotherapy status. Concordance index (c-index) was employed to assess the accuracy of survival time prediction. All three models performed well with prediction accuracy (CI 0.767, 0.771, 0.57 for CPH, SVM, RF models respectively) with the best performance achieved when incorporating RT and chemotherapy administration status which emerged as key predictive features. Within the subset of glioblastoma patients, similar prediction accuracy was achieved. These findings should prompt stricter clinician oversight over registry data accuracy through quality assurance as we move towards meaningful predictive ability using ML approaches in glioma.
Collapse
Affiliation(s)
| | | | | | - Andra V Krauze
- 3421National Cancer Institute, NIH, USA; 184934BC Cancer Surrey, Canada
| |
Collapse
|
14
|
Castello A, Castellani M, Florimonte L, Ciccariello G, Mansi L, Lopci E. PET radiotracers in glioma: a review of clinical indications and evidence. Clin Transl Imaging 2022. [DOI: 10.1007/s40336-022-00523-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/01/2022]
|
15
|
Xu J, Meng Y, Qiu K, Topatana W, Li S, Wei C, Chen T, Chen M, Ding Z, Niu G. Applications of Artificial Intelligence Based on Medical Imaging in Glioma: Current State and Future Challenges. Front Oncol 2022; 12:892056. [PMID: 35965542 PMCID: PMC9363668 DOI: 10.3389/fonc.2022.892056] [Citation(s) in RCA: 9] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/24/2022] [Accepted: 06/22/2022] [Indexed: 12/24/2022] Open
Abstract
Glioma is one of the most fatal primary brain tumors, and it is well-known for its difficulty in diagnosis and management. Medical imaging techniques such as magnetic resonance imaging (MRI), positron emission tomography (PET), and spectral imaging can efficiently aid physicians in diagnosing, treating, and evaluating patients with gliomas. With the increasing clinical records and digital images, the application of artificial intelligence (AI) based on medical imaging has reduced the burden on physicians treating gliomas even further. This review will classify AI technologies and procedures used in medical imaging analysis. Additionally, we will discuss the applications of AI in glioma, including tumor segmentation and classification, prediction of genetic markers, and prediction of treatment response and prognosis, using MRI, PET, and spectral imaging. Despite the benefits of AI in clinical applications, several issues such as data management, incomprehension, safety, clinical efficacy evaluation, and ethical or legal considerations, remain to be solved. In the future, doctors and researchers should collaborate to solve these issues, with a particular emphasis on interdisciplinary teamwork.
Collapse
Affiliation(s)
- Jiaona Xu
- Hangzhou First People’s Hospital, Zhejiang University School of Medicine, Hangzhou, China
| | - Yuting Meng
- Hangzhou First People’s Hospital, Zhejiang University School of Medicine, Hangzhou, China
| | - Kefan Qiu
- Hangzhou First People’s Hospital, Zhejiang University School of Medicine, Hangzhou, China
| | - Win Topatana
- Department of General Surgery, Sir Run-Run Shaw Hospital, Zhejiang University School of Medicine, Hangzhou, China
| | - Shijie Li
- Department of General Surgery, Sir Run-Run Shaw Hospital, Zhejiang University School of Medicine, Hangzhou, China
| | - Chao Wei
- Department of Neurology, Affiliated Ningbo First Hospital, Ningbo, China
| | - Tianwen Chen
- Department of Neurology, Affiliated Hangzhou First People’s Hospital, Zhejiang University School of Medicine, Hangzhou, China
| | - Mingyu Chen
- Department of General Surgery, Sir Run-Run Shaw Hospital, Zhejiang University School of Medicine, Hangzhou, China
- *Correspondence: Mingyu Chen, ; Zhongxiang Ding, ; Guozhong Niu,
| | - Zhongxiang Ding
- Department of Radiology, Affiliated Hangzhou First People’s Hospital, Zhejiang University School of Medicine, Hangzhou, China
- *Correspondence: Mingyu Chen, ; Zhongxiang Ding, ; Guozhong Niu,
| | - Guozhong Niu
- Department of Neurology, Affiliated Hangzhou First People’s Hospital, Zhejiang University School of Medicine, Hangzhou, China
- *Correspondence: Mingyu Chen, ; Zhongxiang Ding, ; Guozhong Niu,
| |
Collapse
|
16
|
Jian A, Liu S, Di Ieva A. Artificial Intelligence for Survival Prediction in Brain Tumors on Neuroimaging. Neurosurgery 2022; 91:8-26. [PMID: 35348129 DOI: 10.1227/neu.0000000000001938] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/30/2021] [Accepted: 01/08/2022] [Indexed: 12/30/2022] Open
Abstract
Survival prediction of patients affected by brain tumors provides essential information to guide surgical planning, adjuvant treatment selection, and patient counseling. Current reliance on clinical factors, such as Karnofsky Performance Status Scale, and simplistic radiological characteristics are, however, inadequate for survival prediction in tumors such as glioma that demonstrate molecular and clinical heterogeneity with variable survival outcomes. Advances in the domain of artificial intelligence have afforded powerful tools to capture a large number of hidden high-dimensional imaging features that reflect abundant information about tumor structure and physiology. Here, we provide an overview of current literature that apply computational analysis tools such as radiomics and machine learning methods to the pipeline of image preprocessing, tumor segmentation, feature extraction, and construction of classifiers to establish survival prediction models based on neuroimaging. We also discuss challenges relating to the development and evaluation of such models and explore ethical issues surrounding the future use of machine learning predictions.
Collapse
Affiliation(s)
- Anne Jian
- Computational NeuroSurgery (CNS) Lab, Macquarie Medical School, Faculty of Medicine, Health and Human Sciences, Macquarie University, Sydney, Australia
- Royal Melbourne Hospital, Melbourne, Australia
| | - Sidong Liu
- Computational NeuroSurgery (CNS) Lab, Macquarie Medical School, Faculty of Medicine, Health and Human Sciences, Macquarie University, Sydney, Australia
- Centre for Health Informatics, Australian Institute of Health Innovation, Faculty of Medicine, Health and Human Sciences, Macquarie University, Sydney, Australia
| | - Antonio Di Ieva
- Computational NeuroSurgery (CNS) Lab, Macquarie Medical School, Faculty of Medicine, Health and Human Sciences, Macquarie University, Sydney, Australia
| |
Collapse
|
17
|
Ritter Z, Papp L, Zámbó K, Tóth Z, Dezső D, Veres DS, Máthé D, Budán F, Karádi É, Balikó A, Pajor L, Szomor Á, Schmidt E, Alizadeh H. Two-Year Event-Free Survival Prediction in DLBCL Patients Based on In Vivo Radiomics and Clinical Parameters. Front Oncol 2022; 12:820136. [PMID: 35756658 PMCID: PMC9216187 DOI: 10.3389/fonc.2022.820136] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/22/2021] [Accepted: 05/18/2022] [Indexed: 12/11/2022] Open
Abstract
Purpose For the identification of high-risk patients in diffuse large B-cell lymphoma (DLBCL), we investigated the prognostic significance of in vivo radiomics derived from baseline [18F]FDG PET/CT and clinical parameters. Methods Pre-treatment [18F]FDG PET/CT scans of 85 patients diagnosed with DLBCL were assessed. The scans were carried out in two clinical centers. Two-year event-free survival (EFS) was defined. After delineation of lymphoma lesions, conventional PET parameters and in vivo radiomics were extracted. For 2-year EFS prognosis assessment, the Center 1 dataset was utilized as the training set and underwent automated machine learning analysis. The dataset of Center 2 was utilized as an independent test set to validate the established predictive model built by the dataset of Center 1. Results The automated machine learning analysis of the Center 1 dataset revealed that the most important features for building 2-year EFS are as follows: max diameter, neighbor gray tone difference matrix (NGTDM) busyness, total lesion glycolysis, total metabolic tumor volume, and NGTDM coarseness. The predictive model built on the Center 1 dataset yielded 79% sensitivity, 83% specificity, 69% positive predictive value, 89% negative predictive value, and 0.85 AUC by evaluating the Center 2 dataset. Conclusion Based on our dual-center retrospective analysis, predicting 2-year EFS built on imaging features is feasible by utilizing high-performance automated machine learning.
Collapse
Affiliation(s)
- Zsombor Ritter
- Department of Medical Imaging, Medical School, University of Pécs, Pécs, Hungary
| | - László Papp
- Medical University of Vienna, Center for Medical Physics and Biomedical Engineering, Vienna, Austria
| | - Katalin Zámbó
- Department of Medical Imaging, Medical School, University of Pécs, Pécs, Hungary
| | - Zoltán Tóth
- University of Kaposvár, PET Medicopus Nonprofit Ltd., Kaposvár, Hungary
| | - Dániel Dezső
- Department of Medical Imaging, Medical School, University of Pécs, Pécs, Hungary
| | - Dániel Sándor Veres
- Department of Biophysics and Radiation Biology, Faculty of Medicine, Semmelweis University, Budapest, Hungary
| | - Domokos Máthé
- Department of Biophysics and Radiation Biology, Faculty of Medicine, Semmelweis University, Budapest, Hungary.,In Vivo Imaging Advanced Core Facility, Hungarian Centre of Excellence for Molecular Medicine, Budapest, Hungary
| | - Ferenc Budán
- Institute of Transdisciplinary Discoveries, Medical School, University of Pécs, Pécs, Hungary.,Institute of Physiology, Medical School, University of Pécs, Pécs, Hungary
| | - Éva Karádi
- Department of Hematology, University of Kaposvár, Kaposvár, Hungary
| | - Anett Balikó
- County Hospital Tolna, János Balassa Hospital, Szekszárd, Hungary
| | - László Pajor
- Department of Pathology, Medical School, University of Pécs, Pécs, Hungary
| | - Árpád Szomor
- 1st Department of Internal Medicine, Medical School, University of Pécs, Pécs, Hungary
| | - Erzsébet Schmidt
- Department of Medical Imaging, Medical School, University of Pécs, Pécs, Hungary
| | - Hussain Alizadeh
- 1st Department of Internal Medicine, Medical School, University of Pécs, Pécs, Hungary
| |
Collapse
|
18
|
Morland D, Triumbari EKA, Boldrini L, Gatta R, Pizzuto D, Annunziata S. Radiomics in Oncological PET Imaging: A Systematic Review-Part 1, Supradiaphragmatic Cancers. Diagnostics (Basel) 2022; 12:1329. [PMID: 35741138 PMCID: PMC9221970 DOI: 10.3390/diagnostics12061329] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/04/2022] [Revised: 05/25/2022] [Accepted: 05/26/2022] [Indexed: 12/10/2022] Open
Abstract
Radiomics is an upcoming field in nuclear oncology, both promising and technically challenging. To summarize the already undertaken work on supradiaphragmatic neoplasia and assess its quality, we performed a literature search in the PubMed database up to 18 February 2022. Inclusion criteria were: studies based on human data; at least one specified tumor type; supradiaphragmatic malignancy; performing radiomics on PET imaging. Exclusion criteria were: studies only based on phantom or animal data; technical articles without a clinically oriented question; fewer than 30 patients in the training cohort. A review database containing PMID, year of publication, cancer type, and quality criteria (number of patients, retrospective or prospective nature, independent validation cohort) was constructed. A total of 220 studies met the inclusion criteria. Among them, 119 (54.1%) studies included more than 100 patients, 21 studies (9.5%) were based on prospectively acquired data, and 91 (41.4%) used an independent validation set. Most studies focused on prognostic and treatment response objectives. Because the textural parameters and methods employed are very different from one article to another, it is complicated to aggregate and compare articles. New contributions and radiomics guidelines tend to help improving quality of the reported studies over the years.
Collapse
Affiliation(s)
- David Morland
- Nuclear Medicine Unit, TracerGLab, Department of Radiology, Radiotherapy and Hematology, Fondazione Policlinico Universitario A. Gemelli, IRCCS, 00168 Rome, Italy; (E.K.A.T.); (D.P.); (S.A.)
- Service de Médecine Nucléaire, Institut Godinot, 51100 Reims, France
- Laboratoire de Biophysique, UFR de Médecine, Université de Reims Champagne-Ardenne, 51100 Reims, France
- CReSTIC (Centre de Recherche en Sciences et Technologies de l’Information et de la Communication), EA 3804, Université de Reims Champagne-Ardenne, 51100 Reims, France
| | - Elizabeth Katherine Anna Triumbari
- Nuclear Medicine Unit, TracerGLab, Department of Radiology, Radiotherapy and Hematology, Fondazione Policlinico Universitario A. Gemelli, IRCCS, 00168 Rome, Italy; (E.K.A.T.); (D.P.); (S.A.)
| | - Luca Boldrini
- Radiotherapy Unit, Radiomics, Department of Radiology, Radiotherapy and Hematology, Fondazione Policlinico Universitario A. Gemelli, IRCCS, 00168 Rome, Italy; (L.B.); (R.G.)
| | - Roberto Gatta
- Radiotherapy Unit, Radiomics, Department of Radiology, Radiotherapy and Hematology, Fondazione Policlinico Universitario A. Gemelli, IRCCS, 00168 Rome, Italy; (L.B.); (R.G.)
- Department of Clinical and Experimental Sciences, University of Brescia, 25121 Brescia, Italy
- Department of Oncology, Lausanne University Hospital, 1011 Lausanne, Switzerland
| | - Daniele Pizzuto
- Nuclear Medicine Unit, TracerGLab, Department of Radiology, Radiotherapy and Hematology, Fondazione Policlinico Universitario A. Gemelli, IRCCS, 00168 Rome, Italy; (E.K.A.T.); (D.P.); (S.A.)
| | - Salvatore Annunziata
- Nuclear Medicine Unit, TracerGLab, Department of Radiology, Radiotherapy and Hematology, Fondazione Policlinico Universitario A. Gemelli, IRCCS, 00168 Rome, Italy; (E.K.A.T.); (D.P.); (S.A.)
| |
Collapse
|
19
|
Jha AK, Mithun S, Purandare NC, Kumar R, Rangarajan V, Wee L, Dekker A. Radiomics: a quantitative imaging biomarker in precision oncology. Nucl Med Commun 2022; 43:483-493. [PMID: 35131965 DOI: 10.1097/mnm.0000000000001543] [Citation(s) in RCA: 9] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/25/2022]
Abstract
Cancer treatment is heading towards precision medicine driven by genetic and biochemical markers. Various genetic and biochemical markers are utilized to render personalized treatment in cancer. In the last decade, noninvasive imaging biomarkers have also been developed to assist personalized decision support systems in oncology. The imaging biomarkers i.e., radiomics is being researched to develop specific digital phenotype of tumor in cancer. Radiomics is a process to extract high throughput data from medical images by using advanced mathematical and statistical algorithms. The radiomics process involves various steps i.e., image generation, segmentation of region of interest (e.g. a tumor), image preprocessing, radiomic feature extraction, feature analysis and selection and finally prediction model development. Radiomics process explores the heterogeneity, irregularity and size parameters of the tumor to calculate thousands of advanced features. Our study investigates the role of radiomics in precision oncology. Radiomics research has witnessed a rapid growth in the last decade with several studies published that show the potential of radiomics in diagnosis and treatment outcome prediction in oncology. Several radiomics based prediction models have been developed and reported in the literature to predict various prediction endpoints i.e., overall survival, progression-free survival and recurrence in various cancer i.e., brain tumor, head and neck cancer, lung cancer and several other cancer types. Radiomics based digital phenotypes have shown promising results in diagnosis and treatment outcome prediction in oncology. In the coming years, radiomics is going to play a significant role in precision oncology.
Collapse
Affiliation(s)
- Ashish Kumar Jha
- Department of Radiation Oncology (Maastro), GROW School for Oncology, Maastricht University Medical Centre+, The Netherlands
- Department of Nuclear Medicine and Molecular Imaging, Tata Memorial Hospital
- Homi Bhabha National Institute (HBNI), Deemed University, Mumbai
| | - Sneha Mithun
- Department of Radiation Oncology (Maastro), GROW School for Oncology, Maastricht University Medical Centre+, The Netherlands
- Department of Nuclear Medicine and Molecular Imaging, Tata Memorial Hospital
- Homi Bhabha National Institute (HBNI), Deemed University, Mumbai
| | - Nilendu C Purandare
- Department of Nuclear Medicine and Molecular Imaging, Tata Memorial Hospital
- Homi Bhabha National Institute (HBNI), Deemed University, Mumbai
| | - Rakesh Kumar
- Department of Nuclear Medicine, All India Institute of Medical Science, New Delhi, India
| | - Venkatesh Rangarajan
- Department of Nuclear Medicine and Molecular Imaging, Tata Memorial Hospital
- Homi Bhabha National Institute (HBNI), Deemed University, Mumbai
| | - Leonard Wee
- Department of Radiation Oncology (Maastro), GROW School for Oncology, Maastricht University Medical Centre+, The Netherlands
| | - Andre Dekker
- Department of Radiation Oncology (Maastro), GROW School for Oncology, Maastricht University Medical Centre+, The Netherlands
| |
Collapse
|
20
|
Minoshima S, Cross D. Application of artificial intelligence in brain molecular imaging. Ann Nucl Med 2022; 36:103-110. [PMID: 35028878 DOI: 10.1007/s12149-021-01697-2] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/10/2021] [Accepted: 11/15/2021] [Indexed: 12/22/2022]
Abstract
Initial development of artificial Intelligence (AI) and machine learning (ML) dates back to the mid-twentieth century. A growing awareness of the potential for AI, as well as increases in computational resources, research, and investment are rapidly advancing AI applications to medical imaging and, specifically, brain molecular imaging. AI/ML can improve imaging operations and decision making, and potentially perform tasks that are not readily possible by physicians, such as predicting disease prognosis, and identifying latent relationships from multi-modal clinical information. The number of applications of image-based AI algorithms, such as convolutional neural network (CNN), is increasing rapidly. The applications for brain molecular imaging (MI) include image denoising, PET and PET/MRI attenuation correction, image segmentation and lesion detection, parametric image formation, and the detection/diagnosis of Alzheimer's disease and other brain disorders. When effectively used, AI will likely improve the quality of patient care, instead of replacing radiologists. A regulatory framework is being developed to facilitate AI adaptation for medical imaging.
Collapse
Affiliation(s)
- Satoshi Minoshima
- Department of Radiology and Imaging Sciences, University of Utah, 30 North 1900 East #1A071, Salt Lake City, UT, 84132, USA.
| | - Donna Cross
- Department of Radiology and Imaging Sciences, University of Utah, 30 North 1900 East #1A071, Salt Lake City, UT, 84132, USA
| |
Collapse
|
21
|
Zhou W, Huang Q, Wen J, Li M, Zhu Y, Liu Y, Dai Y, Guan Y, Zhou Z, Hua T. Integrated CT Radiomics Features Could Enhance the Efficacy of 18F-FET PET for Non-Invasive Isocitrate Dehydrogenase Genotype Prediction in Adult Untreated Gliomas: A Retrospective Cohort Study. Front Oncol 2021; 11:772703. [PMID: 34869011 PMCID: PMC8640504 DOI: 10.3389/fonc.2021.772703] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/08/2021] [Accepted: 11/01/2021] [Indexed: 01/03/2023] Open
Abstract
Purpose We aimed to investigate the predictive models based on O-[2-(18F)fluoroethyl]-l-tyrosine positron emission tomography/computed tomography (18F-FET PET/CT) radiomics features for the isocitrate dehydrogenase (IDH) genotype identification in adult gliomas. Methods Fifty-eight consecutive pathologically confirmed adult glioma patients with pretreatment 18F-FET PET/CT were retrospectively enrolled. One hundred and five radiomics features were extracted for analysis in each modality. Three independent radiomics models (PET-Rad Model, CT-Rad Model and PET/CT-Rad Model) predicting IDH mutation status were generated using the least absolute shrinkage and selection operator (LASSO) regression analysis based on machine learning algorithms. All-subsets regression and cross validation were applied for the filter and calibration of the predictive radiomics models. Besides, semi-quantitative parameters including maximum, peak and mean tumor to background ratio (TBRmax, TBRpeak, TBRmean), standard deviation of glioma lesion standardized uptake value (SUVSD), metabolic tumor volume (MTV) and total lesion tracer uptake (TLU) were obtained and filtered for the simple model construction with clinical feature of brain midline involvement status. The area under the receiver operating characteristic curve (AUC) was applied for the evaluation of the predictive models. Results The AUC of the simple predictive model consists of semi-quantitative parameter SUVSD and dichotomized brain midline involvement status was 0.786 (95% CI 0.659-0.883). The AUC of PET-Rad Model building with three 18F-FET PET radiomics parameters was 0.812 (95% CI 0.688-0.902). The AUC of CT-Rad Model building with three co-registered CT radiomics parameters was 0.883 (95% CI 0.771-0.952). While the AUC of the combined 18F-FET PET/CT-Rad Model building with three CT and one PET radiomics features was 0.912 (95% CI 0.808-0.970). DeLong test results indicated the PET/CT-Rad Model outperformed the PET-Rad Model (p = 0.048) and simple predictive model (p = 0.034). Further combination of the PET/CT-Rad Model with the clinical feature of dichotomized tumor location status could slightly enhance the AUC to 0.917 (95% CI 0.814-0.973). Conclusion The predictive model combining 18F-FET PET and integrated CT radiomics features could significantly enhance and well balance the non-invasive IDH genotype prediction in untreated gliomas, which is important in clinical decision making for personalized treatment.
Collapse
Affiliation(s)
- Weiyan Zhou
- PET Center, Huashan Hospital, Fudan University, Shanghai, China
| | - Qi Huang
- PET Center, Huashan Hospital, Fudan University, Shanghai, China
| | - Jianbo Wen
- Department of Radiology, Huashan Hospital, Fudan University, Shanghai, China
| | - Ming Li
- PET Center, Huashan Hospital, Fudan University, Shanghai, China
| | - Yuhua Zhu
- PET Center, Huashan Hospital, Fudan University, Shanghai, China
| | - Yan Liu
- Suzhou Institute of Biomedical Engineering and Technology, Chinese Academy of Sciences, Suzhou, China.,Jinan Guoke Medical Engineering Technology Development Co., LTD, Jinan, China
| | - Yakang Dai
- Suzhou Institute of Biomedical Engineering and Technology, Chinese Academy of Sciences, Suzhou, China.,Jinan Guoke Medical Engineering Technology Development Co., LTD, Jinan, China
| | - Yihui Guan
- PET Center, Huashan Hospital, Fudan University, Shanghai, China
| | - Zhirui Zhou
- Radiation Oncology Center, Huashan Hospital, Fudan University, Shanghai, China
| | - Tao Hua
- PET Center, Huashan Hospital, Fudan University, Shanghai, China
| |
Collapse
|
22
|
Jian A, Jang K, Russo C, Liu S, Di Ieva A. Foundations of Multiparametric Brain Tumour Imaging Characterisation Using Machine Learning. ACTA NEUROCHIRURGICA. SUPPLEMENT 2021; 134:183-193. [PMID: 34862542 DOI: 10.1007/978-3-030-85292-4_22] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Subscribe] [Scholar Register] [Indexed: 11/30/2022]
Abstract
The heterogeneity of brain tumours at the molecular, metabolic and structural levels poses significant challenge for accurate tissue characterisation. Artificial intelligence and radiomics have emerged as valuable tools to analyse quantitative features extracted from medical images which capture the complex microenvironment of brain tumours. In particular, a number of computational tools including machine learning algorithms have been proposed for image preprocessing, tumour segmentation, feature extraction, classification, and prognostic stratifications as well. In this chapter, we explore the fundamentals of multiparametric brain tumour characterisation, as an understanding of the strengths, limitations and applications of these tools allows clinicians to better develop and evaluate models with improved diagnostic and prognostic value in brain tumour patients.
Collapse
Affiliation(s)
- Anne Jian
- Computational NeuroSurgery (CNS) Lab, Macquarie Medical School, Faculty of Medicine, Health and Human Sciences, Macquarie University, Sydney, NSW, Australia
- Royal Melbourne Hospital, Melbourne, VIC, Australia
| | - Kevin Jang
- Computational NeuroSurgery (CNS) Lab, Macquarie Medical School, Faculty of Medicine, Health and Human Sciences, Macquarie University, Sydney, NSW, Australia
- Faculty of Medicine and Health, The University of Sydney, Sydney, NSW, Australia
| | - Carlo Russo
- Computational NeuroSurgery (CNS) Lab, Macquarie Medical School, Faculty of Medicine, Health and Human Sciences, Macquarie University, Sydney, NSW, Australia
| | - Sidong Liu
- Computational NeuroSurgery (CNS) Lab, Macquarie Medical School, Faculty of Medicine, Health and Human Sciences, Macquarie University, Sydney, NSW, Australia
- Centre for Health Informatics, Macquarie University, Sydney, NSW, Australia
| | - Antonio Di Ieva
- Computational NeuroSurgery (CNS) Lab, Macquarie Medical School, Faculty of Medicine, Health and Human Sciences, Macquarie University, Sydney, NSW, Australia.
| |
Collapse
|
23
|
Cross DJ, Komori S, Minoshima S. Artificial Intelligence for Brain Molecular Imaging. PET Clin 2021; 17:57-64. [PMID: 34809870 DOI: 10.1016/j.cpet.2021.08.001] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022]
Abstract
AI has been applied to brain molecular imaging for over 30 years. The past two decades, have seen explosive progress. AI applications span from operations processes such as attenuation correction and image generation, to disease diagnosis and prediction. As sophistication in AI software platforms increases, and the availability of large imaging data repositories become common, future studies will incorporate more multidimensional datasets and information that may truly reach "superhuman" levels in the field of brain imaging. However, even with a growing level of complexity, these advanced networks will still require human supervision for appropriate application and interpretation in medical practice.
Collapse
Affiliation(s)
- Donna J Cross
- Department of Radiology and Imaging Sciences, University of Utah, 30 North 1900 East #1A71, Salt Lake City, UT 84132-2140, USA.
| | - Seisaku Komori
- Future Design Lab, New Concept Design, Global Strategic Challenge Center, Hamamatsu Photonics K.K. 5000, Hirakuchi, Hamakita-ku, Hamamatsu-City, 434-8601 Japan
| | - Satoshi Minoshima
- Department of Radiology and Imaging Sciences, University of Utah, 30 North 1900 East #1A71, Salt Lake City, UT 84132-2140, USA
| |
Collapse
|
24
|
Application of machine learning to predict the outcome of pediatric traumatic brain injury. Chin J Traumatol 2021; 24:350-355. [PMID: 34284922 PMCID: PMC8606603 DOI: 10.1016/j.cjtee.2021.06.003] [Citation(s) in RCA: 13] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/26/2020] [Revised: 05/23/2021] [Accepted: 06/02/2021] [Indexed: 02/04/2023] Open
Abstract
PURPOSE Traumatic brain injury (TBI) generally causes mortality and disability, particularly in children. Machine learning (ML) is a computer algorithm, applied as a clinical prediction tool. The present study aims to assess the predictability of ML for the functional outcomes of pediatric TBI. METHODS A retrospective cohort study was performed targeting children with TBI who were admitted to the trauma center of southern Thailand between January 2009 and July 2020. The patient was excluded if he/she (1) did not undergo a CT scan of the brain, (2) died within the first 24 h, (3) had unavailable complete medical records during admission, or (4) was unable to provide updated outcomes. Clinical and radiologic characteristics were collected such as vital signs, Glasgow coma scale score, and characteristics of intracranial injuries. The functional outcome was assessed using the King's Outcome Scale for Childhood Head Injury, which was thus dichotomized into favourable outcomes and unfavourable outcomes: good recovery and moderate disability were categorized as the former, whereas death, vegetative state, and severe disability were categorized as the latter. The prognostic factors were estimated using traditional binary logistic regression. By data splitting, 70% of data were used for training the ML models and the remaining 30% were used for testing the ML models. The supervised algorithms including support vector machines, neural networks, random forest, logistic regression, naive Bayes and k-nearest neighbor were performed for training of the ML models. Therefore, the ML models were tested for the predictive performances by the testing datasets. RESULTS There were 828 patients in the cohort. The median age was 72 months (interquartile range 104.7 months, range 2-179 months). Road traffic accident was the most common mechanism of injury, accounting for 68.7%. At hospital discharge, favourable outcomes were achieved in 97.0% of patients, while the mortality rate was 2.2%. Glasgow coma scale score, hypotension, pupillary light reflex, and subarachnoid haemorrhage were associated with TBI outcomes following traditional binary logistic regression; hence, the 4 prognostic factors were used for building ML models and testing performance. The support vector machine model had the best performance for predicting pediatric TBI outcomes: sensitivity 0.95, specificity 0.60, positive predicted value 0.99, negative predictive value 1.0; accuracy 0.94, and area under the receiver operating characteristic curve 0.78. CONCLUSION The ML algorithms of the present study have a high sensitivity; therefore they have the potential to be screening tools for predicting functional outcomes and counselling prognosis in general practice of pediatric TBIs.
Collapse
|
25
|
Robustness of PET Radiomics Features: Impact of Co-Registration with MRI. APPLIED SCIENCES-BASEL 2021. [DOI: 10.3390/app112110170] [Citation(s) in RCA: 13] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/12/2022]
Abstract
Radiomics holds great promise in the field of cancer management. However, the clinical application of radiomics has been hampered by uncertainty about the robustness of the features extracted from the images. Previous studies have reported that radiomics features are sensitive to changes in voxel size resampling and interpolation, image perturbation, or slice thickness. This study aims to observe the variability of positron emission tomography (PET) radiomics features under the impact of co-registration with magnetic resonance imaging (MRI) using the difference percentage coefficient, and the Spearman’s correlation coefficient for three groups of images: (i) original PET, (ii) PET after co-registration with T1-weighted MRI and (iii) PET after co-registration with FLAIR MRI. Specifically, seventeen patients with brain cancers undergoing [11C]-Methionine PET were considered. Successively, PET images were co-registered with MRI sequences and 107 features were extracted for each mentioned group of images. The variability analysis revealed that shape features, first-order features and two subgroups of higher-order features possessed a good robustness, unlike the remaining groups of features, which showed large differences in the difference percentage coefficient. Furthermore, using the Spearman’s correlation coefficient, approximately 40% of the selected features differed from the three mentioned groups of images. This is an important consideration for users conducting radiomics studies with image co-registration constraints to avoid errors in cancer diagnosis, prognosis, and clinical outcome prediction.
Collapse
|
26
|
Yi Z, Long L, Zeng Y, Liu Z. Current Advances and Challenges in Radiomics of Brain Tumors. Front Oncol 2021; 11:732196. [PMID: 34722274 PMCID: PMC8551958 DOI: 10.3389/fonc.2021.732196] [Citation(s) in RCA: 21] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/28/2021] [Accepted: 09/23/2021] [Indexed: 12/12/2022] Open
Abstract
Imaging diagnosis is crucial for early detection and monitoring of brain tumors. Radiomics enable the extraction of a large mass of quantitative features from complex clinical imaging arrays, and then transform them into high-dimensional data which can subsequently be mined to find their relevance with the tumor's histological features, which reflect underlying genetic mutations and malignancy, along with grade, progression, therapeutic effect, or even overall survival (OS). Compared to traditional brain imaging, radiomics provides quantitative information linked to meaningful biologic characteristics and application of deep learning which sheds light on the full automation of imaging diagnosis. Recent studies have shown that radiomics' application is broad in identifying primary tumor, differential diagnosis, grading, evaluation of mutation status and aggression, prediction of treatment response and recurrence in pituitary tumors, gliomas, and brain metastases. In this descriptive review, besides establishing a general understanding among protocols, results, and clinical significance of these studies, we further discuss the current limitations along with future development of radiomics.
Collapse
Affiliation(s)
- Zhenjie Yi
- Department of Neurosurgery, Xiangya Hospital, Central South University, Changsha, China
- XiangYa School of Medicine, Central South University, Changsha, China
- National Clinical Research Center for Geriatric Disorders, Xiangya Hospital, Central South University, Changsha, China
| | - Lifu Long
- XiangYa School of Medicine, Central South University, Changsha, China
| | - Yu Zeng
- Department of Neurosurgery, Xiangya Hospital, Central South University, Changsha, China
- National Clinical Research Center for Geriatric Disorders, Xiangya Hospital, Central South University, Changsha, China
| | - Zhixiong Liu
- Department of Neurosurgery, Xiangya Hospital, Central South University, Changsha, China
- National Clinical Research Center for Geriatric Disorders, Xiangya Hospital, Central South University, Changsha, China
| |
Collapse
|
27
|
Laudicella R, Bauckneht M, Cuppari L, Donegani MI, Arnone A, Baldari S, Burger IA, Quartuccio N. Emerging applications of imaging in glioma: focus on PET/MRI and radiomics. Clin Transl Imaging 2021. [DOI: 10.1007/s40336-021-00464-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/07/2023]
|
28
|
Orlhac F, Nioche C, Klyuzhin I, Rahmim A, Buvat I. Radiomics in PET Imaging:: A Practical Guide for Newcomers. PET Clin 2021; 16:597-612. [PMID: 34537132 DOI: 10.1016/j.cpet.2021.06.007] [Citation(s) in RCA: 27] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/10/2023]
Abstract
Radiomics has undergone considerable development in recent years. In PET imaging, very promising results concerning the ability of handcrafted features to predict the biological characteristics of lesions and to assess patient prognosis or response to treatment have been reported in the literature. This article presents a checklist for designing a reliable radiomic study, gives an overview of the steps of the pipeline, and outlines approaches for data harmonization. Tips are provided for critical reading of the content of articles. The advantages and limitations of handcrafted radiomics compared with deep-learning approaches for the characterization of PET images are also discussed.
Collapse
Affiliation(s)
- Fanny Orlhac
- Institut Curie Centre de Recherche, Centre Universitaire, Bat 101B, Rue Henri Becquerel, CS 90030, 91401 Orsay Cedex, France.
| | - Christophe Nioche
- Institut Curie Centre de Recherche, Centre Universitaire, Bat 101B, Rue Henri Becquerel, CS 90030, 91401 Orsay Cedex, France
| | - Ivan Klyuzhin
- Department of Integrative Oncology, BC Cancer Research Institute, 675 West 10th Avenue, Vancouver, BC V5Z 1L3, Canada; Department of Radiology, University of British Columbia, 675 West 10th Avenue, Vancouver, BC V5Z 1L3, Canada
| | - Arman Rahmim
- Department of Integrative Oncology, BC Cancer Research Institute, 675 West 10th Avenue, Vancouver, BC V5Z 1L3, Canada; Department of Radiology, University of British Columbia, 675 West 10th Avenue, Vancouver, BC V5Z 1L3, Canada
| | - Irène Buvat
- Institut Curie Centre de Recherche, Centre Universitaire, Bat 101B, Rue Henri Becquerel, CS 90030, 91401 Orsay Cedex, France
| |
Collapse
|
29
|
Machine Learning-Based Radiomics of the Optic Chiasm Predict Visual Outcome Following Pituitary Adenoma Surgery. J Pers Med 2021; 11:jpm11100991. [PMID: 34683132 PMCID: PMC8541242 DOI: 10.3390/jpm11100991] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/31/2021] [Revised: 09/25/2021] [Accepted: 09/27/2021] [Indexed: 02/05/2023] Open
Abstract
Preoperative prediction of visual recovery after pituitary adenoma surgery remains a challenge. We aimed to investigate the value of MRI-based radiomics of the optic chiasm in predicting postoperative visual field outcome using machine learning technology. A total of 131 pituitary adenoma patients were retrospectively enrolled and divided into the recovery group (N = 79) and the non-recovery group (N = 52) according to visual field outcome following surgical chiasmal decompression. Radiomic features were extracted from the optic chiasm on preoperative coronal T2-weighted imaging. Least absolute shrinkage and selection operator regression were first used to select optimal features. Then, three machine learning algorithms were employed to develop radiomic models to predict visual recovery, including support vector machine (SVM), random forest and linear discriminant analysis. The prognostic performances of models were evaluated via five-fold cross-validation. The results showed that radiomic models using different machine learning algorithms all achieved area under the curve (AUC) over 0.750. The SVM-based model represented the best predictive performance for visual field recovery, with the highest AUC of 0.824. In conclusion, machine learning-based radiomics of the optic chiasm on routine MR imaging could potentially serve as a novel approach to preoperatively predict visual recovery and allow personalized counseling for individual pituitary adenoma patients.
Collapse
|
30
|
Alamoudi AO. Radiomics, aptamers and nanobodies: New insights in cancer diagnostics and imaging. Hum Antibodies 2021; 29:1-15. [PMID: 33554897 DOI: 10.3233/hab-200436] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/23/2022]
Abstract
At present, cancer is a major health issue and the second leading cause of mortality worldwide. Researchers have been working hard on investigating not only improved therapeutics but also on early detection methods, both critical to increasing treatment efficacy and developing methods for disease prevention. Diagnosis of cancers at an early stage can promote timely medical intervention and effective treatment and will result in inhibiting tumor growth and development. Several advances have been made in the diagnostics and imagining technologies for early tumor detection and deciding an effective therapy these include radiomics, nanobodies, and aptamers. Here in this review, we summarize the main applications of radiomics, aptamers, and the use of nanobody-based probes for molecular imaging applications in diagnosis, treatment planning, and evaluations in the field of oncology to develop quantitative and personalized medicine. The preclinical data reported to date are quite promising, and it is predicted that nanobody-based molecular imaging agents will play an important role in the diagnosis and management of different cancer types in near future.
Collapse
|
31
|
Papp L, Spielvogel CP, Grubmüller B, Grahovac M, Krajnc D, Ecsedi B, Sareshgi RAM, Mohamad D, Hamboeck M, Rausch I, Mitterhauser M, Wadsak W, Haug AR, Kenner L, Mazal P, Susani M, Hartenbach S, Baltzer P, Helbich TH, Kramer G, Shariat SF, Beyer T, Hartenbach M, Hacker M. Supervised machine learning enables non-invasive lesion characterization in primary prostate cancer with [ 68Ga]Ga-PSMA-11 PET/MRI. Eur J Nucl Med Mol Imaging 2021; 48:1795-1805. [PMID: 33341915 PMCID: PMC8113201 DOI: 10.1007/s00259-020-05140-y] [Citation(s) in RCA: 64] [Impact Index Per Article: 21.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/09/2020] [Accepted: 11/29/2020] [Indexed: 12/13/2022]
Abstract
PURPOSE Risk classification of primary prostate cancer in clinical routine is mainly based on prostate-specific antigen (PSA) levels, Gleason scores from biopsy samples, and tumor-nodes-metastasis (TNM) staging. This study aimed to investigate the diagnostic performance of positron emission tomography/magnetic resonance imaging (PET/MRI) in vivo models for predicting low-vs-high lesion risk (LH) as well as biochemical recurrence (BCR) and overall patient risk (OPR) with machine learning. METHODS Fifty-two patients who underwent multi-parametric dual-tracer [18F]FMC and [68Ga]Ga-PSMA-11 PET/MRI as well as radical prostatectomy between 2014 and 2015 were included as part of a single-center pilot to a randomized prospective trial (NCT02659527). Radiomics in combination with ensemble machine learning was applied including the [68Ga]Ga-PSMA-11 PET, the apparent diffusion coefficient, and the transverse relaxation time-weighted MRI scans of each patient to establish a low-vs-high risk lesion prediction model (MLH). Furthermore, MBCR and MOPR predictive model schemes were built by combining MLH, PSA, and clinical stage values of patients. Performance evaluation of the established models was performed with 1000-fold Monte Carlo (MC) cross-validation. Results were additionally compared to conventional [68Ga]Ga-PSMA-11 standardized uptake value (SUV) analyses. RESULTS The area under the receiver operator characteristic curve (AUC) of the MLH model (0.86) was higher than the AUC of the [68Ga]Ga-PSMA-11 SUVmax analysis (0.80). MC cross-validation revealed 89% and 91% accuracies with 0.90 and 0.94 AUCs for the MBCR and MOPR models respectively, while standard routine analysis based on PSA, biopsy Gleason score, and TNM staging resulted in 69% and 70% accuracies to predict BCR and OPR respectively. CONCLUSION Our results demonstrate the potential to enhance risk classification in primary prostate cancer patients built on PET/MRI radiomics and machine learning without biopsy sampling.
Collapse
Affiliation(s)
- L Papp
- QIMP Team, Center for Medical Physics and Biomedical Engineering, Medical University of Vienna, Vienna, Austria
| | - C P Spielvogel
- Department of Biomedical Imaging and Image-guided Therapy, Division of Nuclear Medicine, Medical University of Vienna, Währinger Gürtel 18-20, 1090, Vienna, Austria
- Christian Doppler Laboratory for Applied Metabolomics, Vienna, Austria
| | - B Grubmüller
- Department of Urology, Medical University of Vienna, Vienna, Austria
| | - M Grahovac
- Department of Biomedical Imaging and Image-guided Therapy, Division of Nuclear Medicine, Medical University of Vienna, Währinger Gürtel 18-20, 1090, Vienna, Austria
| | - D Krajnc
- QIMP Team, Center for Medical Physics and Biomedical Engineering, Medical University of Vienna, Vienna, Austria
| | - B Ecsedi
- QIMP Team, Center for Medical Physics and Biomedical Engineering, Medical University of Vienna, Vienna, Austria
| | - R A M Sareshgi
- Department of Biomedical Imaging and Image-guided Therapy, Division of Nuclear Medicine, Medical University of Vienna, Währinger Gürtel 18-20, 1090, Vienna, Austria
| | - D Mohamad
- Department of Biomedical Imaging and Image-guided Therapy, Division of Nuclear Medicine, Medical University of Vienna, Währinger Gürtel 18-20, 1090, Vienna, Austria
| | - M Hamboeck
- Department of Biomedical Imaging and Image-guided Therapy, Division of Nuclear Medicine, Medical University of Vienna, Währinger Gürtel 18-20, 1090, Vienna, Austria
| | - I Rausch
- QIMP Team, Center for Medical Physics and Biomedical Engineering, Medical University of Vienna, Vienna, Austria
| | - M Mitterhauser
- Department of Biomedical Imaging and Image-guided Therapy, Division of Nuclear Medicine, Medical University of Vienna, Währinger Gürtel 18-20, 1090, Vienna, Austria
- Ludwig Boltzmann Institute Applied Diagnostics, Vienna, Austria
| | - W Wadsak
- Department of Biomedical Imaging and Image-guided Therapy, Division of Nuclear Medicine, Medical University of Vienna, Währinger Gürtel 18-20, 1090, Vienna, Austria
| | - A R Haug
- Department of Biomedical Imaging and Image-guided Therapy, Division of Nuclear Medicine, Medical University of Vienna, Währinger Gürtel 18-20, 1090, Vienna, Austria
- Christian Doppler Laboratory for Applied Metabolomics, Vienna, Austria
| | - L Kenner
- Christian Doppler Laboratory for Applied Metabolomics, Vienna, Austria
- Clinical Institute of Pathology, Medical University of Vienna, Vienna, Austria
| | - P Mazal
- Clinical Institute of Pathology, Medical University of Vienna, Vienna, Austria
| | - M Susani
- Clinical Institute of Pathology, Medical University of Vienna, Vienna, Austria
| | | | - P Baltzer
- Department of Biomedical Imaging and Image-guided Therapy, Division of Common General and Pediatric Radiology, Medical University of Vienna, Vienna, Austria
| | - T H Helbich
- Department of Biomedical Imaging and Image-guided Therapy, Division of Common General and Pediatric Radiology, Medical University of Vienna, Vienna, Austria
| | - G Kramer
- Department of Urology, Medical University of Vienna, Vienna, Austria
| | - S F Shariat
- Department of Urology, Medical University of Vienna, Vienna, Austria
| | - T Beyer
- QIMP Team, Center for Medical Physics and Biomedical Engineering, Medical University of Vienna, Vienna, Austria
| | - M Hartenbach
- Department of Biomedical Imaging and Image-guided Therapy, Division of Nuclear Medicine, Medical University of Vienna, Währinger Gürtel 18-20, 1090, Vienna, Austria
| | - M Hacker
- Department of Biomedical Imaging and Image-guided Therapy, Division of Nuclear Medicine, Medical University of Vienna, Währinger Gürtel 18-20, 1090, Vienna, Austria.
| |
Collapse
|
32
|
Chen B, Chen C, Wang J, Teng Y, Ma X, Xu J. Differentiation of Low-Grade Astrocytoma From Anaplastic Astrocytoma Using Radiomics-Based Machine Learning Techniques. Front Oncol 2021; 11:521313. [PMID: 34141605 PMCID: PMC8204041 DOI: 10.3389/fonc.2021.521313] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/18/2019] [Accepted: 05/04/2021] [Indexed: 02/05/2023] Open
Abstract
Purpose To investigate the diagnostic ability of radiomics-based machine learning in differentiating atypical low-grade astrocytoma (LGA) from anaplastic astrocytoma (AA). Methods The current study involved 175 patients diagnosed with LGA (n = 95) or AA (n = 80) and treated in the Neurosurgery Department of West China Hospital from April 2010 to December 2019. Radiomics features were extracted from pre-treatment contrast-enhanced T1 weighted imaging (T1C). Nine diagnostic models were established with three selection methods [Distance Correlation, least absolute shrinkage, and selection operator (LASSO), and Gradient Boosting Decision Tree (GBDT)] and three classification algorithms [Linear Discriminant Analysis (LDA), Support Vector Machine (SVM), and random forest (RF)]. The sensitivity, specificity, accuracy, and areas under receiver operating characteristic curve (AUC) of each model were calculated. Diagnostic ability of each model was evaluated based on these indexes. Results Nine radiomics-based machine learning models with promising diagnostic performances were established. For LDA-based models, the optimal one was the combination of LASSO + LDA with AUC of 0.825. For SVM-based modes, Distance Correlation + SVM represented the most promising diagnostic performance with AUC of 0.808. And for RF-based models, Distance Correlation + RF were observed to be the optimal model with AUC of 0.821. Conclusion Radiomic-based machine-learning has the potential to be utilized in differentiating atypical LGA from AA with reliable diagnostic performance.
Collapse
Affiliation(s)
- Boran Chen
- Department of Neurosurgery, West China Hospital, Sichuan University, Chengdu, China
| | - Chaoyue Chen
- Department of Neurosurgery, West China Hospital, Sichuan University, Chengdu, China.,State Key Laboratory of Biotherapy and Cancer Center, West China Hospital, Sichuan University, and Collaborative Innovation Center for Biotherapy, Chengdu, China
| | - Jian Wang
- School of Computer Science, Nanjing University of Science and Technology, Nanjing, China
| | - Yuen Teng
- Department of Neurosurgery, West China Hospital, Sichuan University, Chengdu, China
| | - Xuelei Ma
- State Key Laboratory of Biotherapy and Cancer Center, West China Hospital, Sichuan University, and Collaborative Innovation Center for Biotherapy, Chengdu, China.,Department of Biotherapy, Cancer Center, West China Hospital, Sichuan University, Chengdu, China
| | - Jianguo Xu
- Department of Neurosurgery, West China Hospital, Sichuan University, Chengdu, China
| |
Collapse
|
33
|
Yin L, Cao Z, Wang K, Tian J, Yang X, Zhang J. A review of the application of machine learning in molecular imaging. ANNALS OF TRANSLATIONAL MEDICINE 2021; 9:825. [PMID: 34268438 PMCID: PMC8246214 DOI: 10.21037/atm-20-5877] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 04/16/2020] [Accepted: 10/02/2020] [Indexed: 12/12/2022]
Abstract
Molecular imaging (MI) is a science that uses imaging methods to reflect the changes of molecular level in living state and conduct qualitative and quantitative studies on its biological behaviors in imaging. Optical molecular imaging (OMI) and nuclear medical imaging are two key research fields of MI. OMI technology refers to the optical information generated by the imaging target (such as tumors) due to drug intervention and other reasons. By collecting the optical information, researchers can track the motion trajectory of the imaging target at the molecular level. Owing to its high specificity and sensitivity, OMI has been widely used in preclinical research and clinical surgery. Nuclear medical imaging mainly detects ionizing radiation emitted by radioactive substances. It can provide molecular information for early diagnosis, effective treatment and basic research of diseases, which has become one of the frontiers and hot topics in the field of medicine in the world today. Both OMI and nuclear medical imaging technology require a lot of data processing and analysis. In recent years, artificial intelligence technology, especially neural network-based machine learning (ML) technology, has been widely used in MI because of its powerful data processing capability. It provides a feasible strategy to deal with large and complex data for the requirement of MI. In this review, we will focus on the applications of ML methods in OMI and nuclear medical imaging.
Collapse
Affiliation(s)
- Lin Yin
- Key Laboratory of Molecular Imaging of Chinese Academy of Sciences, Institute of Automation, Chinese Academy of Sciences, Beijing, China.,School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing, China
| | - Zhen Cao
- Peking University First Hospital, Beijing, China
| | - Kun Wang
- Key Laboratory of Molecular Imaging of Chinese Academy of Sciences, Institute of Automation, Chinese Academy of Sciences, Beijing, China.,School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing, China
| | - Jie Tian
- Key Laboratory of Molecular Imaging of Chinese Academy of Sciences, Institute of Automation, Chinese Academy of Sciences, Beijing, China.,School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing, China.,Beijing Advanced Innovation Center for Big Data-Based Precision Medicine, Beihang University, Beijing, China
| | - Xing Yang
- Peking University First Hospital, Beijing, China
| | | |
Collapse
|
34
|
Boyle AJ, Gaudet VC, Black SE, Vasdev N, Rosa-Neto P, Zukotynski KA. Artificial intelligence for molecular neuroimaging. ANNALS OF TRANSLATIONAL MEDICINE 2021; 9:822. [PMID: 34268435 PMCID: PMC8246223 DOI: 10.21037/atm-20-6220] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 09/01/2020] [Accepted: 01/08/2021] [Indexed: 11/25/2022]
Abstract
In recent years, artificial intelligence (AI) or the study of how computers and machines can gain intelligence, has been increasingly applied to problems in medical imaging, and in particular to molecular imaging of the central nervous system. Many AI innovations in medical imaging include improving image quality, segmentation, and automating classification of disease. These advances have led to an increased availability of supportive AI tools to assist physicians in interpreting images and making decisions affecting patient care. This review focuses on the role of AI in molecular neuroimaging, primarily applied to positron emission tomography (PET) and single photon emission computed tomography (SPECT). We emphasize technical innovations such as AI in computed tomography (CT) generation for the purposes of attenuation correction and disease localization, as well as applications in neuro-oncology and neurodegenerative diseases. Limitations and future prospects for AI in molecular brain imaging are also discussed. Just as new equipment such as SPECT and PET revolutionized the field of medical imaging a few decades ago, AI and its related technologies are now poised to bring on further disruptive changes. An understanding of these new technologies and how they work will help physicians adapt their practices and succeed with these new tools.
Collapse
Affiliation(s)
- Amanda J Boyle
- Azrieli Centre for Neuro-Radiochemistry, Brain Health Imaging Centre, Centre for Addiction and Mental Health, Toronto, Ontario, Canada
| | - Vincent C Gaudet
- Department of Electrical and Computer Engineering, University of Waterloo, Waterloo, Ontario, Canada
| | - Sandra E Black
- Department of Medicine (Neurology), Sunnybrook Health Sciences Centre, University of Toronto, Toronto, Ontario, Canada
| | - Neil Vasdev
- Azrieli Centre for Neuro-Radiochemistry, Brain Health Imaging Centre, Centre for Addiction and Mental Health, Toronto, Ontario, Canada.,Department of Psychiatry, University of Toronto, Toronto, Ontario, Canada
| | - Pedro Rosa-Neto
- Translational Neuroimaging Laboratory, McGill University Research Centre for Studies in Aging, Douglas Research Institute, McGill University, Montréal, Québec, Canada
| | | |
Collapse
|
35
|
Zaidi H, El Naqa I. Quantitative Molecular Positron Emission Tomography Imaging Using Advanced Deep Learning Techniques. Annu Rev Biomed Eng 2021; 23:249-276. [PMID: 33797938 DOI: 10.1146/annurev-bioeng-082420-020343] [Citation(s) in RCA: 25] [Impact Index Per Article: 8.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
The widespread availability of high-performance computing and the popularity of artificial intelligence (AI) with machine learning and deep learning (ML/DL) algorithms at the helm have stimulated the development of many applications involving the use of AI-based techniques in molecular imaging research. Applications reported in the literature encompass various areas, including innovative design concepts in positron emission tomography (PET) instrumentation, quantitative image reconstruction and analysis techniques, computer-aided detection and diagnosis, as well as modeling and prediction of outcomes. This review reflects the tremendous interest in quantitative molecular imaging using ML/DL techniques during the past decade, ranging from the basic principles of ML/DL techniques to the various steps required for obtaining quantitatively accurate PET data, including algorithms used to denoise or correct for physical degrading factors as well as to quantify tracer uptake and metabolic tumor volume for treatment monitoring or radiation therapy treatment planning and response prediction.This review also addresses future opportunities and current challenges facing the adoption of ML/DL approaches and their role in multimodality imaging.
Collapse
Affiliation(s)
- Habib Zaidi
- Division of Nuclear Medicine and Molecular Imaging, Geneva University Hospital, 1211 Geneva, Switzerland; .,Geneva Neuroscience Centre, University of Geneva, 1205 Geneva, Switzerland.,Department of Nuclear Medicine and Molecular Imaging, University of Groningen, 9700 RB Groningen, Netherlands.,Department of Nuclear Medicine, University of Southern Denmark, DK-5000 Odense, Denmark
| | - Issam El Naqa
- Department of Machine Learning, Moffitt Cancer Center, Tampa, Florida 33612, USA.,Department of Radiation Oncology, University of Michigan, Ann Arbor, Michigan 48109, USA.,Department of Oncology, McGill University, Montreal, Quebec H3A 1G5, Canada
| |
Collapse
|
36
|
Krajnc D, Papp L, Nakuz TS, Magometschnigg HF, Grahovac M, Spielvogel CP, Ecsedi B, Bago-Horvath Z, Haug A, Karanikas G, Beyer T, Hacker M, Helbich TH, Pinker K. Breast Tumor Characterization Using [ 18F]FDG-PET/CT Imaging Combined with Data Preprocessing and Radiomics. Cancers (Basel) 2021; 13:cancers13061249. [PMID: 33809057 PMCID: PMC8000810 DOI: 10.3390/cancers13061249] [Citation(s) in RCA: 17] [Impact Index Per Article: 5.7] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/05/2021] [Revised: 03/06/2021] [Accepted: 03/09/2021] [Indexed: 12/20/2022] Open
Abstract
Simple Summary Breast cancer is the second most common diagnosed malignancy in women worldwide. In this study, we examine the feasibility of breast tumor characterization based on [18F]FDG-PET/CT images using machine learning (ML) approaches in combination with data-preprocessing techniques. ML prediction models for breast cancer detection and the identification of breast cancer receptor status, proliferation rate, and molecular subtypes were established and evaluated. Furthermore, the importance of most repeatable features was investigated. Results displayed high performance of malignant/benign tumor differentiation and triple negative tumor subtype ML models. We observed high repeatability of radiomic features for both high performing predictive models. Abstract Background: This study investigated the performance of ensemble learning holomic models for the detection of breast cancer, receptor status, proliferation rate, and molecular subtypes from [18F]FDG-PET/CT images with and without incorporating data pre-processing algorithms. Additionally, machine learning (ML) models were compared with conventional data analysis using standard uptake value lesion classification. Methods: A cohort of 170 patients with 173 breast cancer tumors (132 malignant, 38 benign) was examined with [18F]FDG-PET/CT. Breast tumors were segmented and radiomic features were extracted following the imaging biomarker standardization initiative (IBSI) guidelines combined with optimized feature extraction. Ensemble learning including five supervised ML algorithms was utilized in a 100-fold Monte Carlo (MC) cross-validation scheme. Data pre-processing methods were incorporated prior to machine learning, including outlier and borderline noisy sample detection, feature selection, and class imbalance correction. Feature importance in each model was assessed by calculating feature occurrence by the R-squared method across MC folds. Results: Cross validation demonstrated high performance of the cancer detection model (80% sensitivity, 78% specificity, 80% accuracy, 0.81 area under the curve (AUC)), and of the triple negative tumor identification model (85% sensitivity, 78% specificity, 82% accuracy, 0.82 AUC). The individual receptor status and luminal A/B subtype models yielded low performance (0.46–0.68 AUC). SUVmax model yielded 0.76 AUC in cancer detection and 0.70 AUC in predicting triple negative subtype. Conclusions: Predictive models based on [18F]FDG-PET/CT images in combination with advanced data pre-processing steps aid in breast cancer diagnosis and in ML-based prediction of the aggressive triple negative breast cancer subtype.
Collapse
Affiliation(s)
- Denis Krajnc
- QIMP Team, Center for Medical Physics and Biomedical Engineering, Medical University of Vienna, 1090 Vienna, Austria; (D.K.); (L.P.); (B.E.)
| | - Laszlo Papp
- QIMP Team, Center for Medical Physics and Biomedical Engineering, Medical University of Vienna, 1090 Vienna, Austria; (D.K.); (L.P.); (B.E.)
| | - Thomas S. Nakuz
- Division of Nuclear Medicine, Department of Biomedical Imaging and Image-Guided Therapy, Medical University of Vienna, 1090 Vienna, Austria; (T.S.N.); (M.G.); (C.P.S.); (A.H.); (G.K.); (M.H.)
| | - Heinrich F. Magometschnigg
- Division of Molecular and Gender Imaging, Department of Biomedical Imaging and Image-Guided Therapy, Medical University of Vienna, 1090 Vienna, Austria; (H.F.M.); (T.H.H.); or (K.P.)
| | - Marko Grahovac
- Division of Nuclear Medicine, Department of Biomedical Imaging and Image-Guided Therapy, Medical University of Vienna, 1090 Vienna, Austria; (T.S.N.); (M.G.); (C.P.S.); (A.H.); (G.K.); (M.H.)
- Christian Doppler Laboratory for Applied Metabolomics, Medical University of Vienna, 1090 Vienna, Austria
| | - Clemens P. Spielvogel
- Division of Nuclear Medicine, Department of Biomedical Imaging and Image-Guided Therapy, Medical University of Vienna, 1090 Vienna, Austria; (T.S.N.); (M.G.); (C.P.S.); (A.H.); (G.K.); (M.H.)
- Christian Doppler Laboratory for Applied Metabolomics, Medical University of Vienna, 1090 Vienna, Austria
| | - Boglarka Ecsedi
- QIMP Team, Center for Medical Physics and Biomedical Engineering, Medical University of Vienna, 1090 Vienna, Austria; (D.K.); (L.P.); (B.E.)
| | | | - Alexander Haug
- Division of Nuclear Medicine, Department of Biomedical Imaging and Image-Guided Therapy, Medical University of Vienna, 1090 Vienna, Austria; (T.S.N.); (M.G.); (C.P.S.); (A.H.); (G.K.); (M.H.)
- Christian Doppler Laboratory for Applied Metabolomics, Medical University of Vienna, 1090 Vienna, Austria
| | - Georgios Karanikas
- Division of Nuclear Medicine, Department of Biomedical Imaging and Image-Guided Therapy, Medical University of Vienna, 1090 Vienna, Austria; (T.S.N.); (M.G.); (C.P.S.); (A.H.); (G.K.); (M.H.)
| | - Thomas Beyer
- QIMP Team, Center for Medical Physics and Biomedical Engineering, Medical University of Vienna, 1090 Vienna, Austria; (D.K.); (L.P.); (B.E.)
- Correspondence:
| | - Marcus Hacker
- Division of Nuclear Medicine, Department of Biomedical Imaging and Image-Guided Therapy, Medical University of Vienna, 1090 Vienna, Austria; (T.S.N.); (M.G.); (C.P.S.); (A.H.); (G.K.); (M.H.)
| | - Thomas H. Helbich
- Division of Molecular and Gender Imaging, Department of Biomedical Imaging and Image-Guided Therapy, Medical University of Vienna, 1090 Vienna, Austria; (H.F.M.); (T.H.H.); or (K.P.)
| | - Katja Pinker
- Division of Molecular and Gender Imaging, Department of Biomedical Imaging and Image-Guided Therapy, Medical University of Vienna, 1090 Vienna, Austria; (H.F.M.); (T.H.H.); or (K.P.)
- Memorial Sloan Kettering Cancer Center, Breast Imaging Service, Department of Radiology, New York, NY 10065, USA
| |
Collapse
|
37
|
A Systematic Review of PET Textural Analysis and Radiomics in Cancer. Diagnostics (Basel) 2021; 11:diagnostics11020380. [PMID: 33672285 PMCID: PMC7926413 DOI: 10.3390/diagnostics11020380] [Citation(s) in RCA: 34] [Impact Index Per Article: 11.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/13/2021] [Revised: 02/10/2021] [Accepted: 02/19/2021] [Indexed: 12/12/2022] Open
Abstract
Background: Although many works have supported the utility of PET radiomics, several authors have raised concerns over the robustness and replicability of the results. This study aimed to perform a systematic review on the topic of PET radiomics and the used methodologies. Methods: PubMed was searched up to 15 October 2020. Original research articles based on human data specifying at least one tumor type and PET image were included, excluding those that apply only first-order statistics and those including fewer than 20 patients. Each publication, cancer type, objective and several methodological parameters (number of patients and features, validation approach, among other things) were extracted. Results: A total of 290 studies were included. Lung (28%) and head and neck (24%) were the most studied cancers. The most common objective was prognosis/treatment response (46%), followed by diagnosis/staging (21%), tumor characterization (18%) and technical evaluations (15%). The average number of patients included was 114 (median = 71; range 20–1419), and the average number of high-order features calculated per study was 31 (median = 26, range 1–286). Conclusions: PET radiomics is a promising field, but the number of patients in most publications is insufficient, and very few papers perform in-depth validations. The role of standardization initiatives will be crucial in the upcoming years.
Collapse
|
38
|
Li Z, Kong Z, Chen J, Li J, Li N, Yang Z, Wang Y, Liu Z. 18F-Boramino acid PET/CT in healthy volunteers and glioma patients. Eur J Nucl Med Mol Imaging 2021; 48:3113-3121. [PMID: 33590273 DOI: 10.1007/s00259-021-05212-7] [Citation(s) in RCA: 16] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/03/2020] [Accepted: 01/18/2021] [Indexed: 01/08/2023]
Abstract
PURPOSE In this work, the safety, biodistribution, and radiation dosimetry of large neutral amino acid transporter type-1 (LAT-1) targeting PET tracer 18F-trifluorobborate-derived tyrosine (denoted as 18F-FBY) has been investigated. It is designed as a first-in-human study in healthy volunteers and to assay LAT-1 expression level in glioma patients. METHODS Six healthy volunteers (3 M, 3 F) underwent whole-body PET acquisitions at multiple time points after bolus injection of 18F-FBY. Regions of interest (ROIs) were mapped manually on major organs, and then the time-activity curves (TACs) were obtained. Dosimetry was calculated with the OLINDA/EXM software. Thirteen patients who were suspected of glioma were scanned with PET/CT at 30 min after 18F-FBY injection. Within 7 days after PET/CT, the tumor was removed surgically, and LAT-1 immunohistochemical staining for LAT-1 was performed on tumor samples and correlated with 18F-FBY PET imaging. RESULTS 18F-FBY was well tolerated by all healthy volunteers, and no adverse symptoms were observed or reported. 18F-FBY is rapidly cleared from the blood circulation and excreted mainly through the kidneys and urinary tract. The effective dose (ED) was 0.0039 ± 0.0006 mSv/MBq. In 14 surgical confirmed gliomas (one of the patiens had two gliomas), 18F-FBY uptake increased consistently with tumor grade, with maximum standard uptake values (SUVmax) of 0.28 ± 0.14 and 2.84 ± 0.46 and tumor-to-normal contralateral activity (T/N) ratio of 2.30 ± 1.26 and 24.56 ± 6.32 in low- and high-grade tumors, respectively. In addition to the significant difference in the uptakes between low- and high-grade gliomas (P < 0.001), the immunohistochemical staining confirmed the positive correlations between the SUVmax, LAT-1 expression (r2 = 0.80, P < 0.001), and Ki-67 labeling index (r2 = 0.79, P < 0.001). CONCLUSION 18F-FBY is a PET tracer with favorable dosimetry profile and pharmacokinetics. It has the potential to assay LAT-1 expression in glioma patients and may provide imaging guidance for further boron neutron capture therapy of gliomas. TRIAL REGISTRATION clinicaltrials.gov (NCT03980431).
Collapse
Affiliation(s)
- Zhu Li
- Key laboratory of Carcinogenesis and Translational Research (Ministry of Education/Beijing), Department of nuclear medicine, Peking University Cancer Hospital & Institute, Beijing, 100871, China
| | - Ziren Kong
- Department of Neurosurgery, Peking Union Medical College Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China
| | - Junyi Chen
- Radiochemistry and Radiation Chemistry Key Laboratory of Fundamental Science, Beijing National Laboratory for Molecular Sciences, College of Chemistry and Molecular Engineering, Peking University, Beijing, 100871, China
| | - Jiyuan Li
- Radiochemistry and Radiation Chemistry Key Laboratory of Fundamental Science, Beijing National Laboratory for Molecular Sciences, College of Chemistry and Molecular Engineering, Peking University, Beijing, 100871, China
| | - Nan Li
- Key laboratory of Carcinogenesis and Translational Research (Ministry of Education/Beijing), Department of nuclear medicine, Peking University Cancer Hospital & Institute, Beijing, 100871, China
| | - Zhi Yang
- Key laboratory of Carcinogenesis and Translational Research (Ministry of Education/Beijing), Department of nuclear medicine, Peking University Cancer Hospital & Institute, Beijing, 100871, China.
| | - Yu Wang
- Department of Neurosurgery, Peking Union Medical College Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China.
| | - Zhibo Liu
- Radiochemistry and Radiation Chemistry Key Laboratory of Fundamental Science, Beijing National Laboratory for Molecular Sciences, College of Chemistry and Molecular Engineering, Peking University, Beijing, 100871, China. .,Peking University-Tsinghua University Center for Life Sciences, Beijing, 100871, China.
| |
Collapse
|
39
|
Preoperative Texture Analysis Using 11C-Methionine Positron Emission Tomography Predicts Survival after Surgery for Glioma. Diagnostics (Basel) 2021; 11:diagnostics11020189. [PMID: 33525709 PMCID: PMC7911154 DOI: 10.3390/diagnostics11020189] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/06/2021] [Revised: 01/26/2021] [Accepted: 01/26/2021] [Indexed: 11/16/2022] Open
Abstract
BACKGROUND Positron emission tomography with 11C-methionine (MET) is well established in the diagnostic work-up of malignant brain tumors. Texture analysis is a novel technique for extracting information regarding relationships among surrounding voxels, in order to quantify their inhomogeneity. This study evaluated whether the texture analysis of MET uptake has prognostic value for patients with glioma. METHODS We retrospectively analyzed adults with glioma who had undergone preoperative metabolic imaging at a single center. Tumors were delineated using a threshold of 1.3-fold of the mean standardized uptake value for the contralateral cortex, and then processed to calculate the texture features in glioma. RESULTS The study included 42 patients (median age: 56 years). The World Health Organization classifications were grade II (7 patients), grade III (17 patients), and grade IV (18 patients). Sixteen (16.1%) all-cause deaths were recorded during the median follow-up of 18.8 months. The univariate analyses revealed that overall survival (OS) was associated with age (hazard ratio (HR) 1.04, 95% confidence interval (CI) 1.01-1.08, p = 0.0093), tumor grade (HR 3.64, 95% CI 1.63-9.63, p = 0.0010), genetic status (p < 0.0001), low gray-level run emphasis (LGRE, calculated from the gray-level run-length matrix) (HR 2.30 × 1011, 95% CI 737.11-4.23 × 1019, p = 0.0096), and correlation (calculated from the gray-level co-occurrence matrix) (HR 5.17, 95% CI 1.07-20.93, p = 0.041). The multivariate analyses revealed OS was independently associated with LGRE and correlation. The survival curves were also significantly different (both log-rank p < 0.05). CONCLUSION Textural features obtained using preoperative MET positron emission tomography may compliment the semi-quantitative assessment for prognostication in glioma cases.
Collapse
|
40
|
Lohmann P, Meißner AK, Kocher M, Bauer EK, Werner JM, Fink GR, Shah NJ, Langen KJ, Galldiks N. Feature-based PET/MRI radiomics in patients with brain tumors. Neurooncol Adv 2021; 2:iv15-iv21. [PMID: 33521637 PMCID: PMC7829472 DOI: 10.1093/noajnl/vdaa118] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/11/2022] Open
Abstract
Radiomics allows the extraction of quantitative features from medical images such as CT, MRI, or PET, thereby providing additional, potentially relevant diagnostic information for clinical decision-making. Because the computation of these features is performed highly automated on medical images acquired during routine follow-up, radiomics offers this information at low cost. Further, the radiomics features can be used alone or combined with other clinical or histomolecular parameters to generate predictive or prognostic mathematical models. These models can then be applied for various important diagnostic indications in neuro-oncology, for example, to noninvasively predict relevant biomarkers in glioma patients, to differentiate between treatment-related changes and local brain tumor relapse, or to predict treatment response. In recent years, amino acid PET has become an important diagnostic tool in patients with brain tumors. Therefore, the number of studies in patients with brain tumors investigating the potential of PET radiomics or combined PET/MRI radiomics is steadily increasing. This review summarizes current research regarding feature-based PET as well as combined PET/MRI radiomics in neuro-oncology.
Collapse
Affiliation(s)
- Philipp Lohmann
- Institute of Neuroscience and Medicine (INM-3, -4, -11), Research Center Juelich, Juelich, Germany.,Department of Stereotaxy and Functional Neurosurgery, Faculty of Medicine and University Hospital Cologne, Cologne, Germany
| | - Anna-Katharina Meißner
- Department of Neurosurgery, Faculty of Medicine and University Hospital Cologne, Cologne, Germany
| | - Martin Kocher
- Institute of Neuroscience and Medicine (INM-3, -4, -11), Research Center Juelich, Juelich, Germany.,Department of Stereotaxy and Functional Neurosurgery, Faculty of Medicine and University Hospital Cologne, Cologne, Germany.,Center of Integrated Oncology (CIO), Universities of Aachen, Bonn, Cologne and Duesseldorf, Germany
| | - Elena K Bauer
- Department of Neurology, Faculty of Medicine and University Hospital Cologne, University of Cologne, Cologne, Germany
| | - Jan-Michael Werner
- Department of Neurology, Faculty of Medicine and University Hospital Cologne, University of Cologne, Cologne, Germany
| | - Gereon R Fink
- Institute of Neuroscience and Medicine (INM-3, -4, -11), Research Center Juelich, Juelich, Germany.,Department of Neurology, Faculty of Medicine and University Hospital Cologne, University of Cologne, Cologne, Germany
| | - Nadim J Shah
- Institute of Neuroscience and Medicine (INM-3, -4, -11), Research Center Juelich, Juelich, Germany.,JARA - BRAIN - Translational Medicine, Aachen, Germany.,Department of Neurology, RWTH Aachen University, Aachen, Germany
| | - Karl-Josef Langen
- Institute of Neuroscience and Medicine (INM-3, -4, -11), Research Center Juelich, Juelich, Germany.,Center of Integrated Oncology (CIO), Universities of Aachen, Bonn, Cologne and Duesseldorf, Germany.,JARA - BRAIN - Translational Medicine, Aachen, Germany.,Department of Nuclear Medicine and Comprehensive Diagnostic Center Aachen (CDCA), RWTH Aachen University, Aachen, Germany
| | - Norbert Galldiks
- Institute of Neuroscience and Medicine (INM-3, -4, -11), Research Center Juelich, Juelich, Germany.,Center of Integrated Oncology (CIO), Universities of Aachen, Bonn, Cologne and Duesseldorf, Germany.,Department of Neurology, Faculty of Medicine and University Hospital Cologne, University of Cologne, Cologne, Germany
| |
Collapse
|
41
|
Gupta M, Gupta A, Yadav V, Parvaze SP, Singh A, Saini J, Patir R, Vaishya S, Ahlawat S, Gupta RK. Comparative evaluation of intracranial oligodendroglioma and astrocytoma of similar grades using conventional and T1-weighted DCE-MRI. Neuroradiology 2021; 63:1227-1239. [PMID: 33469693 DOI: 10.1007/s00234-021-02636-8] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/15/2020] [Accepted: 01/05/2021] [Indexed: 11/25/2022]
Abstract
PURPOSE This retrospective study was performed on a 3T MRI to determine the unique conventional MR imaging and T1-weighted DCE-MRI features of oligodendroglioma and astrocytoma and investigate the utility of machine learning algorithms in their differentiation. METHODS Histologically confirmed, 81 treatment-naïve patients were classified into two groups as per WHO 2016 classification: oligodendroglioma (n = 16; grade II, n = 25; grade III) and astrocytoma (n = 10; grade II, n = 30; grade III). The differences in tumor morphology characteristics were evaluated using Z-test. T1-weighted DCE-MRI data were analyzed using an in-house built MATLAB program. The mean 90th percentile of relative cerebral blood flow, relative cerebral blood volume corrected, volume transfer rate from plasma to extracellular extravascular space, and extravascular extracellular space volume values were evaluated using independent Student's t test. Support vector machine (SVM) classifier was constructed to differentiate two groups across grade II, grade III, and grade II+III based on statistically significant features. RESULTS Z-test signified only calcification among conventional MR features to categorize oligodendroglioma and astrocytoma across grade III and grade II+III tumors. No statistical significance was found in the perfusion parameters between two groups and its subtypes. SVM trained on calcification also provided moderate accuracy to differentiate oligodendroglioma from astrocytoma. CONCLUSION We conclude that conventional MR features except calcification and the quantitative T1-weighted DCE-MRI parameters fail to discriminate between oligodendroglioma and astrocytoma. The SVM could not further aid in their differentiation. The study also suggests that the presence of more than 50% T2-FLAIR mismatch may be considered as a more conclusive sign for differentiation of IDH mutant astrocytoma.
Collapse
Affiliation(s)
- Mamta Gupta
- Department of Radiology, Fortis Memorial Research Institute, Sector 44, Gurgaon, Haryana, 122002, India
| | - Abhinav Gupta
- Department of Radiology, Fortis Memorial Research Institute, Sector 44, Gurgaon, Haryana, 122002, India
| | - Virendra Yadav
- Centre for Biomedical Engineering, IIT Delhi, New Delhi, India
| | | | - Anup Singh
- Centre for Biomedical Engineering, IIT Delhi, New Delhi, India
| | - Jitender Saini
- National Institute of Mental Health and Neurosciences, Bangalore, Karnataka, India
| | - Rana Patir
- Department of Neurosurgery, Fortis Memorial Research Institute, Sector 44, Gurgaon, Haryana, India
| | - Sandeep Vaishya
- Department of Neurosurgery, Fortis Memorial Research Institute, Sector 44, Gurgaon, Haryana, India
| | - Sunita Ahlawat
- SRL Diagnostics, Fortis Memorial Research Institute, Sector 44, Gurgaon, Haryana, India
| | - Rakesh Kumar Gupta
- Department of Radiology, Fortis Memorial Research Institute, Sector 44, Gurgaon, Haryana, 122002, India.
| |
Collapse
|
42
|
Reuter G, Moïse M, Roll W, Martin D, Lombard A, Scholtes F, Stummer W, Suero Molina E. Conventional and advanced imaging throughout the cycle of care of gliomas. Neurosurg Rev 2021; 44:2493-2509. [PMID: 33411093 DOI: 10.1007/s10143-020-01448-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/03/2020] [Revised: 11/18/2020] [Accepted: 11/23/2020] [Indexed: 10/22/2022]
Abstract
Although imaging of gliomas has evolved tremendously over the last decades, published techniques and protocols are not always implemented into clinical practice. Furthermore, most of the published literature focuses on specific timepoints in glioma management. This article reviews the current literature on conventional and advanced imaging techniques and chronologically outlines their practical relevance for the clinical management of gliomas throughout the cycle of care. Relevant articles were located through the Pubmed/Medline database and included in this review. Interpretation of conventional and advanced imaging techniques is crucial along the entire process of glioma care, from diagnosis to follow-up. In addition to the described currently existing techniques, we expect deep learning or machine learning approaches to assist each step of glioma management through tumor segmentation, radiogenomics, prognostication, and characterization of pseudoprogression. Thorough knowledge of the specific performance, possibilities, and limitations of each imaging modality is key for their adequate use in glioma management.
Collapse
Affiliation(s)
- Gilles Reuter
- Department of Neurosurgery, University Hospital of Liège, Liège, Belgium. .,GIGA-CRC In-vivo Imaging Center, ULiege, Liège, Belgium.
| | - Martin Moïse
- Department of Radiology, University Hospital of Liège, Liège, Belgium
| | - Wolfgang Roll
- Department of Nuclear Medicine, University Hospital of Münster, Münster, Germany
| | - Didier Martin
- Department of Neurosurgery, University Hospital of Liège, Liège, Belgium
| | - Arnaud Lombard
- Department of Neurosurgery, University Hospital of Liège, Liège, Belgium
| | - Félix Scholtes
- Department of Neurosurgery, University Hospital of Liège, Liège, Belgium.,Department of Neuroanatomy, University of Liège, Liège, Belgium
| | - Walter Stummer
- Department of Neurosurgery, University Hospital of Münster, Münster, Germany
| | - Eric Suero Molina
- Department of Neurosurgery, University Hospital of Münster, Münster, Germany
| |
Collapse
|
43
|
Hussain MM, Shabbir A, Bakhshi SK, Shamim MS. Are Thinking Machines Breaking New Frontiers in Neuro-Oncology? A Narrative Review on the Emerging Role of Machine Learning in Neuro-Oncological Practice. Asian J Neurosurg 2021; 16:8-13. [PMID: 34211861 PMCID: PMC8202358 DOI: 10.4103/ajns.ajns_265_20] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/29/2020] [Revised: 08/07/2020] [Accepted: 09/17/2020] [Indexed: 11/21/2022] Open
Abstract
Medical science in general and oncology in particular are dynamic, rapidly evolving subjects. Brain and spine tumors, whether primary or secondary, constitute a significant number of cases in any oncological practice. With the rapid influx of data in all aspects of neuro-oncological care, it is almost impossible for practicing clinicians to remain abreast with the current trends, or to synthesize the available data for it to be maximally beneficial for their patients. Machine-learning (ML) tools are fast gaining acceptance as an alternative to conventional reliance on online data. ML uses artificial intelligence to provide a computer algorithm-based information to clinicians. Different ML models have been proposed in the literature with a variable degree of precision and database requirements. ML can potentially solve the aforementioned problems for practicing clinicians by not just extracting and analyzing useful data, by minimizing or eliminating certain potential areas of human error, by creating patient-specific treatment plans, and also by predicting outcomes with reasonable accuracy. Current information on ML in neuro-oncology is scattered, and this literature review is an attempt to consolidate it and provide recent updates.
Collapse
Affiliation(s)
| | - Ainsia Shabbir
- Department of Computer and Information Systems Engineering, NED University of Engineering and Technology, Karachi, Pakistan
| | | | | |
Collapse
|
44
|
Annunziata S, Pelliccioni A, Hohaus S, Maiolo E, Cuccaro A, Giordano A. The prognostic role of end-of-treatment FDG-PET/CT in diffuse large B cell lymphoma: a pilot study application of neural networks to predict time-to-event. Ann Nucl Med 2021; 35:102-110. [PMID: 33094420 DOI: 10.1007/s12149-020-01542-y] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/20/2020] [Accepted: 10/12/2020] [Indexed: 12/12/2022]
Abstract
PURPOSE To evaluate the prognostic role of end-of-treatment (EoT) FDG-PET/CT parameters in diffuse large B cell lymphoma (DLBCL), and then to explore a pilot application of Neural Networks (NN) in predicting time-to-relapse. METHODS For conventional survival analysis, parameters as Deauville score (DS) and quantitative extension of DS (qPET) were correlated to adverse events as relapse or progression in the follow-up. To build NN and conventional multi-regression models (MM) for time-to-event prediction, patients with residual FDG uptake (DS ≥ 2) and an adverse event were divided into a training and a test group. Models developed on the training group were evaluated in the test group. Pearson correlation coefficient (R) and mean relative error between observed and forecasted time-to-event were calculated. RESULTS FDG-PET/CT data of 308 patients with DLBCL were analyzed. DS and qPET were prognostic factors in conventional univariate analysis. Positive and negative predictive values, respectively, were 55% and 83% for DS 4-5, 89% and 82% for positive qPET. Focusing on 37 relapsed patients with a residual FDG uptake, R between observed and forecasted time-to-event was of 0.63 in the NN model and 0.49 in the MM. Mean relative error in predicting time-to-event was of 58% for NN and 67% for MM. CONCLUSIONS EoT FDG-PET/CT visual score (DS) is a strong outcome predictor in DLBCL in a large monocentric cohort. The semi-quantitative parameter qPET may increase this prognostic performance. A pilot NN model applied on residual FDG uptake parameters seems to predict time-to-event in the follow-up.
Collapse
Affiliation(s)
- Salvatore Annunziata
- Institute of Nuclear Medicine, Università Cattolica del Sacro Cuore, Largo Agostino Gemelli 8, 00168, Roma, Italia.
| | | | - Stefan Hohaus
- Institute of Hematology, Università Cattolica del Sacro Cuore, Roma, Italia
- Dipartimento Diagnostica Per Immagini, Radioterapia Oncologica ed Ematologia, Fondazione Policlinico A. Gemelli IRCCS, Roma, Italia
| | - Elena Maiolo
- Dipartimento Diagnostica Per Immagini, Radioterapia Oncologica ed Ematologia, Fondazione Policlinico A. Gemelli IRCCS, Roma, Italia
| | - Annarosa Cuccaro
- Dipartimento Diagnostica Per Immagini, Radioterapia Oncologica ed Ematologia, Fondazione Policlinico A. Gemelli IRCCS, Roma, Italia
| | - Alessandro Giordano
- Institute of Nuclear Medicine, Università Cattolica del Sacro Cuore, Largo Agostino Gemelli 8, 00168, Roma, Italia
- Dipartimento Diagnostica Per Immagini, Radioterapia Oncologica ed Ematologia, Fondazione Policlinico A. Gemelli IRCCS, Roma, Italia
| |
Collapse
|
45
|
Jamin A, Abraham P, Humeau-Heurtier A. Machine learning for predictive data analytics in medicine: A review illustrated by cardiovascular and nuclear medicine examples. Clin Physiol Funct Imaging 2020; 41:113-127. [PMID: 33316137 DOI: 10.1111/cpf.12686] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/05/2019] [Revised: 11/01/2020] [Accepted: 12/01/2020] [Indexed: 12/13/2022]
Abstract
The evidence-based medicine allows the physician to evaluate the risk-benefit ratio of a treatment through setting and data. Risk-based choices can be done by the doctor using different information. With the emergence of new technologies, a large amount of data is recorded offering interesting perspectives with machine learning for predictive data analytics. Machine learning is an ensemble of methods that process data to model a learning problem. Supervised machine learning algorithms consist in using annotated data to construct the model. This category allows to solve prediction data analytics problems. In this paper, we detail the use of supervised machine learning algorithms for predictive data analytics problems in medicine. In the medical field, data can be split into two categories: medical images and other data. For brevity, our review deals with any kind of medical data excluding images. In this article, we offer a discussion around four supervised machine learning approaches: information-based, similarity-based, probability-based and error-based approaches. Each method is illustrated with detailed cardiovascular and nuclear medicine examples. Our review shows that model ensemble (ME) and support vector machine (SVM) methods are the most popular. SVM, ME and artificial neural networks often lead to better results than those given by other algorithms. In the coming years, more studies, more data, more tools and more methods will, for sure, be proposed.
Collapse
Affiliation(s)
- Antoine Jamin
- COTTOS Médical, Avrillé, France.,LERIA-Laboratoire d'Etude et de Recherche en Informatique d'Angers, Univ. Angers, Angers, France.,LARIS-Laboratoire Angevin de Recherche en Ingénierie des Systèmes, Univ. Angers, Angers, France
| | - Pierre Abraham
- Sports Medicine Department, UMR Mitovasc CNRS 6015 INSERM 1228, Angers University Hospital, Angers, France
| | - Anne Humeau-Heurtier
- LARIS-Laboratoire Angevin de Recherche en Ingénierie des Systèmes, Univ. Angers, Angers, France
| |
Collapse
|
46
|
Li W, Liu H, Cheng F, Li Y, Li S, Yan J. Artificial intelligence applications for oncological positron emission tomography imaging. Eur J Radiol 2020; 134:109448. [PMID: 33307463 DOI: 10.1016/j.ejrad.2020.109448] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/20/2020] [Revised: 10/07/2020] [Accepted: 11/26/2020] [Indexed: 12/16/2022]
Abstract
Positron emission tomography (PET), a functional and dynamic molecular imaging technique, is generally used to reveal tumors' biological behavior. Radiomics allows a high-throughput extraction of multiple features from images with artificial intelligence (AI) approaches and develops rapidly worldwide. Quantitative and objective features of medical images have been explored to recognize reliable biomarkers, with the development of PET radiomics. This paper will review the current clinical exploration of PET-based classical machine learning and deep learning methods, including disease diagnosis, the prediction of histological subtype, gene mutation status, tumor metastasis, tumor relapse, therapeutic side effects, therapeutic intervention and evaluation of prognosis. The applications of AI in oncology will be mainly discussed. The image-guided biopsy or surgery assisted by PET-based AI will be introduced as well. This paper aims to present the applications and methods of AI for PET imaging, which may offer important details for further clinical studies. Relevant precautions are put forward and future research directions are suggested.
Collapse
Affiliation(s)
- Wanting Li
- Shanxi Medical University, Taiyuan 030009, PR China; Department of Nuclear Medicine, First Hospital of Shanxi Medical University, Taiyuan 030001, PR China; Collaborative Innovation Center for Molecular Imaging, Taiyuan 030001, PR China
| | - Haiyan Liu
- Department of Nuclear Medicine, First Hospital of Shanxi Medical University, Taiyuan 030001, PR China; Collaborative Innovation Center for Molecular Imaging, Taiyuan 030001, PR China; Cellular Physiology Key Laboratory of Ministry of Education, Translational Medicine Research Center, Shanxi Medical University, Taiyuan 030001, PR China
| | - Feng Cheng
- Shanxi Medical University, Taiyuan 030009, PR China
| | - Yanhua Li
- Shanxi Medical University, Taiyuan 030009, PR China
| | - Sijin Li
- Shanxi Medical University, Taiyuan 030009, PR China; Department of Nuclear Medicine, First Hospital of Shanxi Medical University, Taiyuan 030001, PR China; Collaborative Innovation Center for Molecular Imaging, Taiyuan 030001, PR China.
| | - Jiangwei Yan
- Shanxi Medical University, Taiyuan 030009, PR China.
| |
Collapse
|
47
|
Qiu X, Gao J, Yang J, Hu J, Hu W, Kong L, Lu JJ. A Comparison Study of Machine Learning (Random Survival Forest) and Classic Statistic (Cox Proportional Hazards) for Predicting Progression in High-Grade Glioma after Proton and Carbon Ion Radiotherapy. Front Oncol 2020; 10:551420. [PMID: 33194609 PMCID: PMC7662123 DOI: 10.3389/fonc.2020.551420] [Citation(s) in RCA: 9] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/13/2020] [Accepted: 09/29/2020] [Indexed: 12/30/2022] Open
Abstract
Background Machine learning (ML) algorithms are increasingly explored in glioma prognostication. Random survival forest (RSF) is a common ML approach in analyzing time-to-event survival data. However, it is controversial which method between RSF and traditional cornerstone method Cox proportional hazards (CPH) is better fitted. The purpose of this study was to compare RSF and CPH in predicting tumor progression of high-grade glioma (HGG) after particle beam radiotherapy (PBRT). Methods The study enrolled 82 consecutive HGG patients who were treated with PBRT at Shanghai Proton and Heavy Ion Center between 6/2015 and 11/2019. The entire cohort was split into the training and testing set in an 80/20 ratio. Ten variables from patient-related, tumor-related and treatment-related information were utilized for developing CPH and RSF for predicting progression-free survival (PFS). The model performance was compared in concordance index (C-index) for discrimination (accuracy), brier score (BS) for calibration (precision) and variable importance for interpretability. Results The CPH model demonstrated a better performance in terms of integrated C-index (62.9%) and BS (0.159) compared to RSF model (C-index = 61.1%, BS = 0.174). In the context of variable importance, CPH model indicated that age (P = 0.024), WHO grade (P = 0.020), IDH gene (P = 0.019), and MGMT promoter status (P = 0.040) were significantly correlated with PFS in the univariate analysis; multivariate analysis showed that age (P = 0.041), surgical completeness (P = 0.084), IDH gene (P = 0.057), and MGMT promoter (P = 0.092) had a significant or trend toward the relation with PFS. RSF showed that merely IDH and age were of positive importance for predicting PFS. A final nomogram was developed to predict tumor progression at the individual level based on CPH model. Conclusions In a relatively small dataset with HGG patients treated with PBRT, CPH outperformed RSF for predicting tumor progression. A comprehensive criterion with accuracy, precision, and interpretability is recommended in evaluating ML prognostication approaches for clinical deployment.
Collapse
Affiliation(s)
- Xianxin Qiu
- Shanghai Engineering Research Center of Proton and Heavy Ion Radiation Therapy, Shanghai, China.,Department of Radiation Oncology, Shanghai Proton and Heavy Ion Center, Shanghai, China
| | - Jing Gao
- Shanghai Engineering Research Center of Proton and Heavy Ion Radiation Therapy, Shanghai, China.,Department of Radiation Oncology, Shanghai Proton and Heavy Ion Center, Shanghai, China
| | - Jing Yang
- Shanghai Engineering Research Center of Proton and Heavy Ion Radiation Therapy, Shanghai, China.,Department of Radiation Oncology, Shanghai Proton and Heavy Ion Center, Shanghai, China
| | - Jiyi Hu
- Shanghai Engineering Research Center of Proton and Heavy Ion Radiation Therapy, Shanghai, China.,Department of Radiation Oncology, Shanghai Proton and Heavy Ion Center, Shanghai, China
| | - Weixu Hu
- Shanghai Engineering Research Center of Proton and Heavy Ion Radiation Therapy, Shanghai, China.,Department of Radiation Oncology, Shanghai Proton and Heavy Ion Center, Shanghai, China
| | - Lin Kong
- Shanghai Engineering Research Center of Proton and Heavy Ion Radiation Therapy, Shanghai, China.,Department of Radiation Oncology, Shanghai Proton and Heavy Ion Center, Fudan University Cancer Center, Shanghai, China
| | - Jiade J Lu
- Shanghai Engineering Research Center of Proton and Heavy Ion Radiation Therapy, Shanghai, China.,Department of Radiation Oncology, Shanghai Proton and Heavy Ion Center, Shanghai, China
| |
Collapse
|
48
|
Wang R, Cai Y, Lee IK, Hu R, Purkayastha S, Pan I, Yi T, Tran TML, Lu S, Liu T, Chang K, Huang RY, Zhang PJ, Zhang Z, Xiao E, Wu J, Bai HX. Evaluation of a convolutional neural network for ovarian tumor differentiation based on magnetic resonance imaging. Eur Radiol 2020; 31:4960-4971. [PMID: 33052463 DOI: 10.1007/s00330-020-07266-x] [Citation(s) in RCA: 26] [Impact Index Per Article: 6.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/04/2020] [Revised: 07/19/2020] [Accepted: 09/08/2020] [Indexed: 10/23/2022]
Abstract
OBJECTIVES There currently lacks a noninvasive and accurate method to distinguish benign and malignant ovarian lesion prior to treatment. This study developed a deep learning algorithm that distinguishes benign from malignant ovarian lesion by applying a convolutional neural network on routine MR imaging. METHODS Five hundred forty-five lesions (379 benign and 166 malignant) from 451 patients from a single institution were divided into training, validation, and testing set in a 7:2:1 ratio. Model performance was compared with four junior and three senior radiologists on the test set. RESULTS Compared with junior radiologists averaged, the final ensemble model combining MR imaging and clinical variables had a higher test accuracy (0.87 vs 0.64, p < 0.001) and specificity (0.92 vs 0.64, p < 0.001) with comparable sensitivity (0.75 vs 0.63, p = 0.407). Against the senior radiologists averaged, the final ensemble model also had a higher test accuracy (0.87 vs 0.74, p = 0.033) and specificity (0.92 vs 0.70, p < 0.001) with comparable sensitivity (0.75 vs 0.83, p = 0.557). Assisted by the model's probabilities, the junior radiologists achieved a higher average test accuracy (0.77 vs 0.64, Δ = 0.13, p < 0.001) and specificity (0.81 vs 0.64, Δ = 0.17, p < 0.001) with unchanged sensitivity (0.69 vs 0.63, Δ = 0.06, p = 0.302). With the AI probabilities, the junior radiologists had higher specificity (0.81 vs 0.70, Δ = 0.11, p = 0.005) but similar accuracy (0.77 vs 0.74, Δ = 0.03, p = 0.409) and sensitivity (0.69 vs 0.83, Δ = -0.146, p = 0.097) when compared with the senior radiologists. CONCLUSIONS These results demonstrate that artificial intelligence based on deep learning can assist radiologists in assessing the nature of ovarian lesions and improve their performance. KEY POINTS • Artificial Intelligence based on deep learning can assess the nature of ovarian lesions on routine MRI with higher accuracy and specificity than radiologists. • Assisted by the deep learning model's probabilities, junior radiologists achieved better performance that matched those of senior radiologists.
Collapse
Affiliation(s)
- Robin Wang
- Department of Radiology, the Second Xiangya Hospital, Central South University, Changsha, China.,Perelman School of Medicine at the University of Pennsylvania, Philadelphia, PA, USA
| | - Yeyu Cai
- Department of Radiology, the Second Xiangya Hospital, Central South University, Changsha, China
| | - Iris K Lee
- Perelman School of Medicine at the University of Pennsylvania, Philadelphia, PA, USA.,Department of Bioengineering, University of Pennsylvania, Philadelphia, PA, USA
| | - Rong Hu
- School of Computer Science and Engineering, Central South University, Changsha, China
| | - Subhanik Purkayastha
- Department of Diagnostic Imaging, Rhode Island Hospital and Alpert Medical School of Brown University, Providence, RI, USA
| | - Ian Pan
- Warren Alpert Medical School at Brown University, Providence, RI, USA
| | - Thomas Yi
- Warren Alpert Medical School at Brown University, Providence, RI, USA
| | - Thi My Linh Tran
- Warren Alpert Medical School at Brown University, Providence, RI, USA
| | - Shaolei Lu
- Department of Pathology, Rhode Island Hospital and Alpert Medical School of Brown University, Providence, RI, USA
| | - Tao Liu
- Department of Biostatistics, Center for Statistical Sciences, Brown University School of Public Health, Providence, RI, USA
| | - Ken Chang
- Department of Radiology, Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital, Boston, MA, USA
| | - Raymond Y Huang
- Department of Radiology, Brigham and Women's Hospital, Boston, MA, USA
| | - Paul J Zhang
- Department of Pathology and Laboratory Medicine, Hospital of the University of Pennsylvania, Philadelphia, PA, USA
| | - Zishu Zhang
- Perelman School of Medicine at the University of Pennsylvania, Philadelphia, PA, USA
| | - Enhua Xiao
- Department of Radiology, the Second Xiangya Hospital, Central South University, Changsha, China
| | - Jing Wu
- Department of Radiology, the Second Xiangya Hospital, Central South University, Changsha, China.
| | - Harrison X Bai
- Department of Diagnostic Imaging, Rhode Island Hospital and Alpert Medical School of Brown University, Providence, RI, USA.
| |
Collapse
|
49
|
Le NQK, Do DT, Chiu FY, Yapp EKY, Yeh HY, Chen CY. XGBoost Improves Classification of MGMT Promoter Methylation Status in IDH1 Wildtype Glioblastoma. J Pers Med 2020; 10:jpm10030128. [PMID: 32942564 PMCID: PMC7563334 DOI: 10.3390/jpm10030128] [Citation(s) in RCA: 57] [Impact Index Per Article: 14.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/22/2020] [Revised: 09/03/2020] [Accepted: 09/09/2020] [Indexed: 02/07/2023] Open
Abstract
Approximately 96% of patients with glioblastomas (GBM) have IDH1 wildtype GBMs, characterized by extremely poor prognosis, partly due to resistance to standard temozolomide treatment. O6-Methylguanine-DNA methyltransferase (MGMT) promoter methylation status is a crucial prognostic biomarker for alkylating chemotherapy resistance in patients with GBM. However, MGMT methylation status identification methods, where the tumor tissue is often undersampled, are time consuming and expensive. Currently, presurgical noninvasive imaging methods are used to identify biomarkers to predict MGMT methylation status. We evaluated a novel radiomics-based eXtreme Gradient Boosting (XGBoost) model to identify MGMT promoter methylation status in patients with IDH1 wildtype GBM. This retrospective study enrolled 53 patients with pathologically proven GBM and tested MGMT methylation and IDH1 status. Radiomics features were extracted from multimodality MRI and tested by F-score analysis to identify important features to improve our model. We identified nine radiomics features that reached an area under the curve of 0.896, which outperformed other classifiers reported previously. These features could be important biomarkers for identifying MGMT methylation status in IDH1 wildtype GBM. The combination of radiomics feature extraction and F-core feature selection significantly improved the performance of the XGBoost model, which may have implications for patient stratification and therapeutic strategy in GBM.
Collapse
Affiliation(s)
- Nguyen Quoc Khanh Le
- Professional Master Program in Artificial Intelligence in Medicine, College of Medicine, Taipei Medical University, Taipei City 106, Taiwan
- Research Center for Artificial Intelligence in Medicine, Taipei Medical University, Taipei City 106, Taiwan;
- Correspondence: (N.Q.K.L.); (C.-Y.C.); Tel.: +886-266-382-736 (ext. 1992) (N.Q.K.L.); Fax: +886-2-2732-1956 (N.Q.K.L.)
| | - Duyen Thi Do
- Faculty of Applied Sciences, Ton Duc Thang University, Ho Chi Minh City 70000, Vietnam;
| | - Fang-Ying Chiu
- Research Center for Artificial Intelligence in Medicine, Taipei Medical University, Taipei City 106, Taiwan;
| | - Edward Kien Yee Yapp
- Singapore Institute of Manufacturing Technology, 2 Fusionopolis Way, #08-04, Innovis, Singapore 138634, Singapore;
| | - Hui-Yuan Yeh
- Medical Humanities Research Cluster, School of Humanities, Nanyang Technological University, 48 Nanyang Ave, Singapore 639798, Singapore;
| | - Cheng-Yu Chen
- Professional Master Program in Artificial Intelligence in Medicine, College of Medicine, Taipei Medical University, Taipei City 106, Taiwan
- Research Center for Artificial Intelligence in Medicine, Taipei Medical University, Taipei City 106, Taiwan;
- Department of Radiology, School of Medicine, College of Medicine, Taipei Medical University, Taipei 11031, Taiwan
- Department of Medical Imaging, Taipei Medical University Hospital, Taipei 11031, Taiwan
- Correspondence: (N.Q.K.L.); (C.-Y.C.); Tel.: +886-266-382-736 (ext. 1992) (N.Q.K.L.); Fax: +886-2-2732-1956 (N.Q.K.L.)
| |
Collapse
|
50
|
Grimm J, Kiessling F, Pichler BJ. Quo Vadis, Molecular Imaging? J Nucl Med 2020; 61:1428-1434. [PMID: 32859706 DOI: 10.2967/jnumed.120.241984] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/27/2020] [Accepted: 08/07/2020] [Indexed: 01/16/2023] Open
Abstract
The important insights yielded by molecular imaging (MI) into relevant biologic signatures at an organ-specific and systemic level are not achievable with conventional imaging methods and thus provide an essential link between preclinical and clinical research. New diagnostic probes and imaging methods revealing comprehensive functional and molecular information are being provided by MI research, several of which have found their way into clinical application. However, there are also reservations about the impact of MI and its added value over conventional, often less expensive, diagnostic imaging methods. This perspective discusses seminal research directions for the MI field that have the potential to result in added value to the patient. Emphasis is placed on MI without probes, MI based on radiotracers and small molecules, MI nano- and microsystems, and MI in context with comprehensive diagnostics. Furthermore, besides technical innovations and probes, emerging clinical indications are highlighted.
Collapse
Affiliation(s)
- Jan Grimm
- Molecular Pharmacology Program and Department of Radiology, Memorial Sloan Kettering Cancer Center, and Pharmacology Program and Department of Radiology, Weil Cornell Medical College, New York, New York
| | - Fabian Kiessling
- Center for Biohybrid Medical Systems, Institute for Experimental Molecular Imaging, University Hospital Aachen, RWTH Aachen University, Aachen, Germany, and Fraunhofer Institute for Digital Medicine, Bremen, Germany; and
| | - Bernd J Pichler
- Werner Siemens Imaging Center, Department of Preclinical Imaging and Radiopharmacy, Eberhard Karls University, Tuebingen, Germany, and Cluster of Excellence iFIT (EXC 2180) "Image-Guided and Functionally Instructed Tumor Therapies," University of Tübingen, Tübingen, Germany
| |
Collapse
|