Machine Learning-Based Radiomics for Molecular Subtyping of Gliomas

MR-Based Radiomics Predicts CDK6 Expression and Prognostic Value in High-grade Glioma

RATIONALE AND OBJECTIVES

This study aims to assess the prognostic value of Cyclin-dependent kinases 6 (CDK6) expression levels and establish a machine learning-based radiomics model for predicting the expression levels of CDK6 in high-grade gliomas (HGG).

MATERIALS AND METHODS

Clinical parameters and genomic data were extracted from 310 HGG patients in the Cancer Genome Atlas (TCGA) database and 27 patients in the Repository of Molecular Brain Neoplasia Data (REMBRANDT) database. Univariate and multivariate Cox regression, as well as Kaplan-Meier analysis, were performed for prognosis analysis. The correlation between immune cell Infiltration with CDK6 was assessed using spearman correlation analysis. Radiomic features were extracted from contrast-enhanced magnetic resonance imaging (CE-MRI) in the Cancer Imaging Archive (TCIA) database (n = 82) and REMBRANDT database (n = 27). Logistic regression (LR) and support vector machine (SVM) were employed to establish the radiomics model for predicting CDK6 expression. Receiver operating characteristic curve (ROC), calibration curve, and decision curve analysis (DCA) were utilized to assess the predictive performance of the radiomics model. Generate radiomic scores (RS) based on the LR model. An RS-based nomogram was constructed to predict the prognosis of HGG.

RESULTS

CDK6 was significantly overexpressed in HGG tissues and was related to lower overall survival. A significant elevation in infiltrating M0 macrophages was observed in the CDK6 high group (P < 0.001). The LR radiomics model for the prediction of CDK6 expression levels (AUC=0.810 in the training cohort, AUC = 0.784 after cross-validation, AUC=0.750 in the testing cohort) was established utilizing three radiomic features. The predictive efficiencies of the RS-based nomogram, as measured by AUC, were 0.769 for 1-year, 0.815 for 3-year, and 0.780 for 5-year, respectively.

CONCLUSION

The expression level of CDK6 can impact the prognosis of patients with HGG. The expression level of HGG can be noninvasively prognosticated utilizing a radiomics model.

Identification of schizophrenia by applying interpretable radiomics modeling with structural magnetic resonance imaging of the cerebellum

AIMS

The cerebellum is involved in higher-order mental processing as well as sensorimotor functions. Although structural abnormalities in the cerebellum have been demonstrated in schizophrenia, neuroimaging techniques are not yet applicable to identify them given the lack of biomarkers. We aimed to develop a robust diagnostic model for schizophrenia using radiomic features from T1-weighted magnetic resonance imaging (T1-MRI) of the cerebellum.

METHODS

A total of 336 participants (174 schizophrenia; 162 healthy controls [HCs]) were allocated to training (122 schizophrenia; 115 HCs) and test (52 schizophrenia; 47 HCs) cohorts. We obtained 2568 radiomic features from T1-MRI of the cerebellar subregions. After feature selection, a light gradient boosting machine classifier was trained. The discrimination and calibration of the model were evaluated. SHapley Additive exPlanations (SHAP) was applied to determine model interpretability.

RESULTS

We identified 17 radiomic features to differentiate participants with schizophrenia from HCs. In the test cohort, the radiomics model had an area under the curve, accuracy, sensitivity, and specificity of 0.89 (95% confidence interval: 0.82-0.95), 78.8%, 88.5%, and 75.4%, respectively. The model explanation by SHAP suggested that the second-order size zone non-uniformity feature from the right lobule IX and first-order energy feature from the right lobules V and VI were highly associated with the risk of schizophrenia.

CONCLUSION

The radiomics model focused on the cerebellum demonstrates robustness in diagnosing schizophrenia. Our results suggest that microcircuit disruption in the posterior cerebellum is a disease-defining feature of schizophrenia, and radiomics modeling has potential for supporting biomarker-based decision-making in clinical practice.

MRI radiomics predicts the efficacy of EGFR-TKI in EGFR-mutant non-small-cell lung cancer with brain metastasis

AIM

To develop and validate models based on magnetic resonance imaging (MRI) radiomics for predicting the efficacy of epidermal growth factor receptor tyrosine kinase inhibitor (EGFR-TKI) in EGFR-mutant non-small-cell lung cancer (NSCLC) patients with brain metastases.

MATERIALS AND METHODS

117 EGFR-mutant NSCLC patients with brain metastases who received EGFR-TKI treatment were included in this study from January 1, 2014 to December 31, 2021. Patients were randomly divided into training and validation cohorts in a ratio of 2:1. Radiomics features extracted from brain MRI were screened by least absolute shrinkage and selection operator (LASSO) algorithm. Logistic regression analysis and Cox proportional hazard regression analysis were used to screen clinical risk factors. Clinical (C), radiomics (R), and combined (C + R) nomograms were constructed in models predicting short-term efficacy and intracranial progression-free survival (iPFS), respectively. Calibration curves, Harrell's concordance index (C-index), and decision curve analysis (DCA) were used to evaluate the performance of models.

RESULTS

Overall response rate (ORR) was 57.3% and median iPFS was 12.67 months. The C + R nomograms were more effective. In the short-term efficacy model, the C-indexes of C + R nomograms in training cohort and validation cohort were 0.860 (0.820-0.901, 95%CI) and 0.843 (0.783-0.904, 95%CI). In iPFS model, the C-indexes of C + R nomograms in training cohort and validation cohort were 0.837 (0.751-0.923, 95%CI) and 0.850 (0.763-0.937, 95%CI).

CONCLUSION

The C + R nomograms were more effective in predicting EGFR-TKI efficacy of EGFR-mutant NSCLC patients with brain metastases than single clinical or radiomics nomograms.

Accurate and rapid molecular subgrouping of high-grade glioma via deep learning-assisted label-free fiber-optic Raman spectroscopy

Molecular genetics is highly related with prognosis of high-grade glioma. Accordingly, the latest WHO guideline recommends that molecular subgroups of the genes, including IDH, 1p/19q, MGMT, TERT, EGFR, Chromosome 7/10, CDKN2A/B, need to be detected to better classify glioma and guide surgery and treatment. Unfortunately, there is no preoperative or intraoperative technology available for accurate and comprehensive molecular subgrouping of glioma. Here, we develop a deep learning-assisted fiber-optic Raman diagnostic platform for accurate and rapid molecular subgrouping of high-grade glioma. Specifically, a total of 2,354 fingerprint Raman spectra was obtained from 743 tissue sites (astrocytoma: 151; oligodendroglioma: 150; glioblastoma (GBM): 442) of 44 high-grade glioma patients. The convolutional neural networks (ResNet) model was then established and optimized for molecular subgrouping. The mean area under receiver operating characteristic curves (AUC) for identifying the molecular subgroups of high-grade glioma reached 0.904, with mean sensitivity of 83.3%, mean specificity of 85.0%, mean accuracy of 83.3%, and mean time expense of 10.6 s. The diagnosis performance using ResNet model was shown to be superior to PCA-SVM and UMAP models, suggesting that high dimensional information from Raman spectra would be helpful. In addition, for the molecular subgroups of GBM, the mean AUC reached 0.932, with mean sensitivity of 87.8%, mean specificity of 83.6%, and mean accuracy of 84.1%. Furthermore, according to saliency maps, the specific Raman features corresponding to tumor-associated biomolecules (e.g. nucleic acid, tyrosine, tryptophan, cholesteryl ester, fatty acid, and collagen) were found to contribute to the accurate molecular subgrouping. Collectively, this study opens up new opportunities for accurate and rapid molecular subgrouping of high-grade glioma, which would assist optimal surgical resection and instant post-operative decision-making.

Imaging Genomics of Glioma Revisited: Analytic Methods to Understand Spatial and Temporal Heterogeneity

An improved understanding of the cellular and molecular biologic processes responsible for brain tumor development, growth, and resistance to therapy is fundamental to improving clinical outcomes. Imaging genomics is the study of the relationships between microscopic, genetic, and molecular biologic features and macroscopic imaging features. Imaging genomics is beginning to shift clinical paradigms for diagnosing and treating brain tumors. This article provides an overview of imaging genomics in gliomas, in which imaging data including hallmarks such as IDH-mutation, MGMT methylation, and EGFR-mutation status can provide critical insights into the pretreatment and posttreatment stages. This article will accomplish the following: 1) review the methods used in imaging genomics, including visual analysis, quantitative analysis, and radiomics analysis; 2) recommend suitable analytic methods for imaging genomics according to biologic characteristics; 3) discuss the clinical applicability of imaging genomics; and 4) introduce subregional tumor habitat analysis with the goal of guiding future radiogenetics research endeavors toward translation into critically needed clinical applications.

Deep learning-based workflow for automatic extraction of atria and epicardial adipose tissue on cardiac computed tomography in atrial fibrillation

BACKGROUND

Preoperative estimation of the volume of the left atrium (LA) and epicardial adipose tissue (EAT) on computed tomography (CT) images is associated with an increased risk of atrial fibrillation (AF) recurrence. We aimed to design a deep learning-based workflow to provide reliable automatic segmentation of the atria, pericardium, and EAT for future applications in the management of AF.

METHODS

This study enrolled 157 patients with AF who underwent first-time catheter ablation between January 2015 and December 2017 at Taipei Veterans General Hospital. Three-dimensional (3D) U-Net models of the LA, right atrium (RA), and pericardium were used to develop a pipeline for total, LA-EAT, and RA-EAT automatic segmentation. We defined fat within the pericardium as tissue with attenuation between -190 and -30 HU and quantified the total EAT. Regions between the dilated endocardial boundaries and endocardial walls of the LA or RA within the pericardium were used to detect voxels attributed to fat, thus estimating LA-EAT and RA-EAT.

RESULTS

The LA, RA, and pericardium segmentation models achieved Dice coefficients of 0.960 ± 0.010, 0.945 ± 0.013, and 0.967 ± 0.006, respectively. The 3D segmentation models correlated well with the ground truth for the LA, RA, and pericardium ( r = 0.99 and p < 0.001 for all). The Dice coefficients of our proposed method for EAT, LA-EAT, and RA-EAT were 0.870 ± 0.027, 0.846 ± 0.057, and 0.841 ± 0.071, respectively.

CONCLUSION

Our proposed workflow for automatic LA, RA, and EAT segmentation using 3D U-Nets on CT images is reliable in patients with AF.

Sub-region based radiomics analysis for prediction of isocitrate dehydrogenase and telomerase reverse transcriptase promoter mutations in diffuse gliomas

AIM

To enhance the prediction of mutation status of isocitrate dehydrogenase (IDH) and telomerase reverse transcriptase (TERT) promoter, which are crucial for glioma prognostication and therapeutic decision-making, via sub-regional radiomics analysis based on multiparametric magnetic resonance imaging (MRI).

MATERIALS AND METHODS

A retrospective study was conducted on 401 participants with adult-type diffuse gliomas. Employing the K-means algorithm, tumours were clustered into two to four subregions. Sub-regional radiomics features were extracted and selected using the Mann-Whitney U-test, Pearson correlation analysis, and least absolute shrinkage and selection operator, forming the basis for predictive models. The performance of model combinations of different sub-regional features and classifiers (including logistic regression, support vector machines, K-nearest neighbour, light gradient boosting machine, and multilayer perceptron) was evaluated using an external test set.

RESULTS

The models demonstrated high predictive performance, with area under the receiver operating characteristic curve (AUC) values ranging from 0.918 to 0.994 in the training set for IDH mutation prediction and from 0.758 to 0.939 for TERT promoter mutation prediction. In the external test sets, the two-cluster radiomics features and the logistic regression model yielded the highest prediction for IDH mutation, resulting in an AUC of 0.905. Additionally, the most effective predictive performance with an AUC of 0.803 was achieved using the four-cluster radiomics features and the support vector machine model, specifically for TERT promoter mutation prediction.

CONCLUSION

The present study underscores the potential of sub-regional radiomics analysis in predicting IDH and TERT promoter mutations in glioma patients. These models have the capacity to refine preoperative glioma diagnosis and contribute to personalised therapeutic interventions for patients.

Impact of signal intensity normalization of MRI on the generalizability of radiomic-based prediction of molecular glioma subtypes

OBJECTIVES

Radiomic features have demonstrated encouraging results for non-invasive detection of molecular biomarkers, but the lack of guidelines for pre-processing MRI-data has led to poor generalizability. Here, we assessed the influence of different MRI-intensity normalization techniques on the performance of radiomics-based models for predicting molecular glioma subtypes.

METHODS

Preoperative MRI-data from n = 615 patients with newly diagnosed glioma and known isocitrate dehydrogenase (IDH) and 1p/19q status were pre-processed using four different methods: no normalization (naive), N4 bias field correction (N4), N4 followed by either WhiteStripe (N4/WS), or z-score normalization (N4/z-score). A total of 377 Image-Biomarker-Standardisation-Initiative-compliant radiomic features were extracted from each normalized data, and 9 different machine-learning algorithms were trained for multiclass prediction of molecular glioma subtypes (IDH-mutant 1p/19q codeleted vs. IDH-mutant 1p/19q non-codeleted vs. IDH wild type). External testing was performed in public glioma datasets from UCSF (n = 410) and TCGA (n = 160).

RESULTS

Support vector machine yielded the best performance with macro-average AUCs of 0.84 (naive), 0.84 (N4), 0.87 (N4/WS), and 0.87 (N4/z-score) in the internal test set. Both N4/WS and z-score outperformed the other approaches in the external UCSF and TCGA test sets with macro-average AUCs ranging from 0.85 to 0.87, replicating the performance of the internal test set, in contrast to macro-average AUCs ranging from 0.19 to 0.45 for naive and 0.26 to 0.52 for N4 alone.

CONCLUSION

Intensity normalization of MRI data is essential for the generalizability of radiomic-based machine-learning models. Specifically, both N4/WS and N4/z-score approaches allow to preserve the high model performance, yielding generalizable performance when applying the developed radiomic-based machine-learning model in an external heterogeneous, multi-institutional setting.

CLINICAL RELEVANCE STATEMENT

Intensity normalization such as N4/WS or N4/z-score can be used to develop reliable radiomics-based machine learning models from heterogeneous multicentre MRI datasets and provide non-invasive prediction of glioma subtypes.

KEY POINTS

• MRI-intensity normalization increases the stability of radiomics-based models and leads to better generalizability. • Intensity normalization did not appear relevant when the developed model was applied to homogeneous data from the same institution. • Radiomic-based machine learning algorithms are a promising approach for simultaneous classification of IDH and 1p/19q status of glioma.

MRI-based Machine Learning Radiomics Can Predict CSF1R Expression Level and Prognosis in High-grade Gliomas

The purpose of this study is to predict the mRNA expression of CSF1R in HGG non-invasively using MRI (magnetic resonance imaging) omics technology and to evaluate the correlation between the established radiomics model and prognosis. We investigated the predictive value of CSF1R in the Cancer Genome Atlas (TCGA) and The Cancer Imaging Archive (TCIA) database. The Support vector machine (SVM) and the Logistic regression (LR) algorithms were used to create a radiomics_score (Rad_score), respectively. The effectiveness and performance of the radiomics model was assessed in the training (n = 89) and tenfold cross-validation sets. We further analyzed the correlation between Rad_score and macrophage-related genes using Spearman correlation analysis. A radiomics nomogram combining the clinical factors and Rad_score was constructed to validate the radiomic signatures for individualized survival estimation and risk stratification. The results showed that CSF1R expression was markedly elevated in HGG tissues, which was related to worse prognosis. CSF1R expression was closely related to the abundance of infiltrating immune cells, such as macrophages. We identified nine features for establishing a radiomics model. The radiomics model predicting CSF1R achieved high AUC in training (0.768 in SVM and 0.792 in LR) and tenfold cross-validation sets (0.706 in SVM and 0.717 in LR). Rad_score was highly associated with tumor-related macrophage genes. A radiomics nomogram combining the Rad_score and clinical factors was constructed and revealed satisfactory performance. MRI-based Rad_score is a novel way to predict CSF1R expression and prognosis in high-grade glioma patients. The radiomics nomogram could optimize individualized survival estimation for HGG patients.

Accuracy of Radiomics in Predicting IDH Mutation Status in Diffuse Gliomas: A Bivariate Meta-Analysis

Purpose To perform a systematic review and meta-analysis assessing the predictive accuracy of radiomics in the noninvasive determination of isocitrate dehydrogenase (IDH) status in grade 4 and lower-grade diffuse gliomas. Materials and Methods A systematic search was performed in the PubMed, Scopus, Embase, Web of Science, and Cochrane Library databases for relevant articles published between January 1, 2010, and July 7, 2021. Pooled sensitivity and specificity across studies were estimated. Risk of bias was evaluated using Quality Assessment of Diagnostic Accuracy Studies-2, and methods were evaluated using the radiomics quality score (RQS). Additional subgroup analyses were performed according to tumor grade, RQS, and number of sequences used (PROSPERO ID: CRD42021268958). Results Twenty-six studies that included 3280 patients were included for analysis. The pooled sensitivity and specificity of radiomics for the detection of IDH mutation were 79% (95% CI: 76, 83) and 80% (95% CI: 76, 83), respectively. Low RQS scores were found overall for the included works. Subgroup analyses showed lower false-positive rates in very low RQS studies (RQS < 6) (meta-regression, z = -1.9; P = .02) compared with adequate RQS studies. No substantial differences were found in pooled sensitivity and specificity for the pure grade 4 gliomas group compared with the all-grade gliomas group (81% and 86% vs 79% and 79%, respectively) and for studies using single versus multiple sequences (80% and 77% vs 79% and 82%, respectively). Conclusion The pooled data showed that radiomics achieved good accuracy performance in distinguishing IDH mutation status in patients with grade 4 and lower-grade diffuse gliomas. The overall methodologic quality (RQS) was low and introduced potential bias. Keywords: Neuro-Oncology, Radiomics, Integration, Application Domain, Glioblastoma, IDH Mutation, Radiomics Quality Scoring Supplemental material is available for this article. Published under a CC BY 4.0 license.

Magnetic resonance radiomics-derived sphericity correlates with seizure in brain arteriovenous malformations

OBJECTIVES

Angioarchitectural analysis of brain arteriovenous malformations (BAVMs) is qualitative and subject to interpretation. This study quantified the morphology of and signal changes in the nidal and perinidal areas by using MR radiomics and compared the performance of MR radiomics and angioarchitectural analysis in detecting epileptic BAVMs.

MATERIALS AND METHODS

From 2010 to 2020, a total of 111 patients with supratentorial BAVMs were retrospectively included and grouped in accordance with the initial presentation of seizure. Patients' angiograms and MR imaging results were analyzed to determine the corresponding angioarchitecture. The BAVM nidus was contoured on time-of-flight MR angiography images. The perinidal brain parenchyma was contoured on T2-weighted images, followed by radiomic analysis. Logistic regression analysis was performed to determine the independent risk factors for seizure. ROC curve analysis, decision curve analysis (DCA), and calibration curve were performed to compare the performance of angioarchitecture-based and radiomics-based models in diagnosing epileptic BAVMs.

RESULTS

In multivariate analyses, low sphericity (OR: 2012.07, p = .04) and angiogenesis (OR: 5.30, p = .01) were independently associated with a high risk of seizure after adjustment for age, sex, temporal location, and nidal volume. The AUC for the angioarchitecture-based, MR radiomics-based, and combined models was 0.672, 0.817, and 0.794, respectively. DCA confirmed the clinical utility of the MR radiomics-based and combined models.

CONCLUSIONS

Low nidal sphericity and angiogenesis were associated with high seizure risk in patients with BAVMs. MR radiomics-derived tools may be used for noninvasive and objective measurement for evaluating the risk of seizure due to BAVM.

CLINICAL RELEVANCE STATEMENT

Low nidal sphericity was associated with high seizure risk in patients with brain arteriovenous malformation and MR radiomics may be used as a noninvasive and objective measurement method for evaluating seizure risk in patients with brain arteriovenous malformation.

KEY POINTS

• Low nidal sphericity was associated with high seizure risk in patients with brain arteriovenous malformation. • The performance of MR radiomics in detecting epileptic brain arteriovenous malformations was more satisfactory than that of angioarchitectural analysis. • MR radiomics may be used as a noninvasive and objective measurement method for evaluating seizure risk in patients with brain arteriovenous malformation.

Image-localized biopsy mapping of brain tumor heterogeneity: A single-center study protocol

Brain cancers pose a novel set of difficulties due to the limited accessibility of human brain tumor tissue. For this reason, clinical decision-making relies heavily on MR imaging interpretation, yet the mapping between MRI features and underlying biology remains ambiguous. Standard (clinical) tissue sampling fails to capture the full heterogeneity of the disease. Biopsies are required to obtain a pathological diagnosis and are predominantly taken from the tumor core, which often has different traits to the surrounding invasive tumor that typically leads to recurrent disease. One approach to solving this issue is to characterize the spatial heterogeneity of molecular, genetic, and cellular features of glioma through the intraoperative collection of multiple image-localized biopsy samples paired with multi-parametric MRIs. We have adopted this approach and are currently actively enrolling patients for our 'Image-Based Mapping of Brain Tumors' study. Patients are eligible for this research study (IRB #16-002424) if they are 18 years or older and undergoing surgical intervention for a brain lesion. Once identified, candidate patients receive dynamic susceptibility contrast (DSC) perfusion MRI and diffusion tensor imaging (DTI), in addition to standard sequences (T1, T1Gd, T2, T2-FLAIR) at their presurgical scan. During surgery, sample anatomical locations are tracked using neuronavigation. The collected specimens from this research study are used to capture the intra-tumoral heterogeneity across brain tumors including quantification of genetic aberrations through whole-exome and RNA sequencing as well as other tissue analysis techniques. To date, these data (made available through a public portal) have been used to generate, test, and validate predictive regional maps of the spatial distribution of tumor cell density and/or treatment-related key genetic marker status to identify biopsy and/or treatment targets based on insight from the entire tumor makeup. This type of methodology, when delivered within clinically feasible time frames, has the potential to further inform medical decision-making by improving surgical intervention, radiation, and targeted drug therapy for patients with glioma.

Rapid intraoperative multi-molecular diagnosis of glioma with ultrasound radio frequency signals and deep learning

BACKGROUND

Molecular diagnosis is crucial for biomarker-assisted glioma resection and management. However, some limitations of current molecular diagnostic techniques prevent their widespread use intraoperatively. With the unique advantages of ultrasound, this study developed a rapid intraoperative molecular diagnostic method based on ultrasound radio-frequency signals.

METHODS

We built a brain tumor ultrasound bank with 169 cases enrolled since July 2020, of which 43483 RF signal patches from 67 cases with a pathological diagnosis of glioma were a retrospective cohort for model training and validation. IDH1 and TERT promoter (TERTp) mutations and 1p/19q co-deletion were detected by next-generation sequencing. We designed a spatial-temporal integration model (STIM) to diagnose the three molecular biomarkers, thus establishing a rapid intraoperative molecular diagnostic system for glioma, and further analysed its consistency with the fifth edition of the WHO Classification of Tumors of the Central Nervous System (WHO CNS5). We tested STIM in 16-case prospective cohorts, which contained a total of 10384 RF signal patches. Two other RF-based classical models were used for comparison. Further, we included 20 cases additional prospective data for robustness test (ClinicalTrials.govNCT05656053).

FINDINGS

In the retrospective cohort, STIM achieved a mean accuracy and AUC of 0.9190 and 0.9650 (95% CI, 0.94-0.99) respectively for the three molecular biomarkers, with a total time of 3 s and a 96% match to WHO CNS5. In the prospective cohort, the diagnostic accuracy of STIM is 0.85 ± 0.04 (mean ± SD) for IDH1, 0.84 ± 0.05 for TERTp, and 0.88 ± 0.04 for 1p/19q. The AUC is 0.89 ± 0.02 (95% CI, 0.84-0.94) for IDH1, 0.80 ± 0.04 (95% CI, 0.71-0.89) for TERTp, and 0.85 ± 0.06 (95% CI, 0.73-0.98) for 1p/19q. Compared to the second best available method based on RF signal, the diagnostic accuracy of STIM is improved by 16.70% and the AUC is improved by 19.23% on average.

INTERPRETATION

STIM is a rapid, cost-effective, and easy-to-manipulate AI method to perform real-time intraoperative molecular diagnosis. In the future, it may help neurosurgeons designate personalized surgical plans and predict survival outcomes.

FUNDING

A full list of funding bodies that contributed to this study can be found in the Acknowledgements section.

Tumor radiogenomics in gliomas with Bayesian layered variable selection

We propose a statistical framework to analyze radiological magnetic resonance imaging (MRI) and genomic data to identify the underlying radiogenomic associations in lower grade gliomas (LGG). We devise a novel imaging phenotype by dividing the tumor region into concentric spherical layers that mimics the tumor evolution process. MRI data within each layer is represented by voxel-intensity-based probability density functions which capture the complete information about tumor heterogeneity. Under a Riemannian-geometric framework these densities are mapped to a vector of principal component scores which act as imaging phenotypes. Subsequently, we build Bayesian variable selection models for each layer with the imaging phenotypes as the response and the genomic markers as predictors. Our novel hierarchical prior formulation incorporates the interior-to-exterior structure of the layers, and the correlation between the genomic markers. We employ a computationally-efficient Expectation-Maximization-based strategy for estimation. Simulation studies demonstrate the superior performance of our approach compared to other approaches. With a focus on the cancer driver genes in LGG, we discuss some biologically relevant findings. Genes implicated with survival and oncogenesis are identified as being associated with the spherical layers, which could potentially serve as early-stage diagnostic markers for disease monitoring, prior to routine invasive approaches. We provide a R package that can be used to deploy our framework to identify radiogenomic associations.

Glioma Tumor Grading Using Radiomics on Conventional MRI: A Comparative Study of WHO 2021 and WHO 2016 Classification of Central Nervous Tumors

BACKGROUND

Glioma grading transformed in World Health Organization (WHO) 2021 CNS tumor classification, integrating molecular markers. However, the impact of this change on radiomics-based machine learning (ML) classifiers remains unexplored.

PURPOSE

To assess the performance of ML in classifying glioma tumor grades based on various WHO criteria.

STUDY TYPE

Retrospective.

SUBJECTS

A neuropathologist regraded gliomas of 237 patients into WHO 2016 and 2021 from 2007 criteria.

FIELD STRENGTH/SEQUENCE

Multicentric 0.5 to 3 Tesla; pre- and post-contrast T1-weighted, T2-weighted, and fluid-attenuated inversion recovery.

ASSESSMENT

Radiomic features were selected using random forest-recursive feature elimination. The synthetic minority over-sampling technique (SMOTE) was implemented for data augmentation. Stratified 10-fold cross-validation with and without SMOTE was used to evaluate 11 classifiers for 3-grade (2, 3, and 4; WHO 2016 and 2021) and 2-grade (low and high grade; WHO 2007 and 2021) classification. Additionally, we developed the models on data randomly divided into training and test sets (mixed-data analysis), or data divided based on the centers (independent-data analysis).

STATISTICAL TESTS

We assessed ML classifiers using sensitivity, specificity, accuracy, and the area under the receiver operating characteristic curve (AUC). Top performances were compared with a t-test and categorical data with the chi-square test using a significance level of P < 0.05.

RESULTS

In the mixed-data analysis, Stacking Classifier without SMOTE achieved the highest accuracy (0.86) and AUC (0.92) in 3-grade WHO 2021 grouping. The results of WHO 2021 were significantly better than WHO 2016 (P-value<0.0001). In the 2-grade analysis, ML achieved 1.00 in all metrics. In the independent-data analysis, ML classifiers showed strong discrimination between grade 2 and 4, despite lower performance metrics than the mixed analysis.

DATA CONCLUSION

ML algorithms performed better in glioma tumor grading based on WHO 2021 criteria. Nonetheless, the clinical use of ML classifiers needs further investigation.

LEVEL OF EVIDENCE

3 TECHNICAL EFFICACY: Stage 2.

Investigating the value of radiomics stemming from DSC quantitative biomarkers in IDH mutation prediction in gliomas

Objective

This study aims to assess the value of biomarker based radiomics to predict IDH mutation in gliomas. The patient cohort consists of 160 patients histopathologicaly proven of primary glioma (WHO grades 2-4) from 3 different centers.

Methods

To quantify the DSC perfusion signal two different mathematical modeling methods were used (Gamma fitting, leakage correction algorithms) considering the assumptions about the compartments contributing in the blood flow between the extra- and intra vascular space.

Results

The Mean slope of increase (MSI) and the K1 parameter of the bidirectional exchange model exhibited the highest performance with (ACC 74.3% AUROC 74.2%) and (ACC 75% AUROC 70.5%) respectively.

Conclusion

The proposed framework on DSC-MRI radiogenomics in gliomas has the potential of becoming a reliable diagnostic support tool exploiting the mathematical modeling of the DSC signal to characterize IDH mutation status through a more reproducible and standardized signal analysis scheme for facilitating clinical translation.

Machine Learning Approaches to Differentiate Sellar-Suprasellar Cystic Lesions on Magnetic Resonance Imaging

Cystic lesions are common lesions of the sellar region with various pathological types, including pituitary apoplexy, Rathke's cleft cyst, cystic craniopharyngioma, etc. Suggested surgical approaches are not unique when dealing with different cystic lesions. However, cystic lesions with different pathological types were hard to differentiate on MRI with the naked eye by doctors. This study aimed to distinguish different pathological types of cystic lesions in the sellar region using preoperative magnetic resonance imaging (MRI). Radiomics and deep learning approaches were used to extract features from gadolinium-enhanced MRIs of 399 patients enrolled at Peking Union Medical College Hospital over the past 15 years. Paired imaging differentiations were performed on four subtypes, including pituitary apoplexy, cystic pituitary adenoma (cysticA), Rathke's cleft cyst, and cystic craniopharyngioma. Results showed that the model achieved an average AUC value of 0.7685. The model based on a support vector machine could distinguish cystic craniopharyngioma from Rathke's cleft cyst with the highest AUC value of 0.8584. However, distinguishing cystic apoplexy from pituitary apoplexy was difficult and almost unclassifiable with any algorithms on any feature set, with the AUC value being only 0.6641. Finally, the proposed methods achieved an average Accuracy of 0.7532, which outperformed the traditional clinical knowledge-based method by about 8%. Therefore, in this study, we first fill the gap in the existing literature and provide a non-invasive method for accurately differentiating between these lesions, which could improve preoperative diagnosis accuracy and help to make surgery plans in clinical work.

Deep wavelet scattering orthogonal fusion network for glioma IDH mutation status prediction

Accurately predicting the isocitrate dehydrogenase (IDH) mutation status of gliomas is greatly significant for formulating appropriate treatment plans and evaluating the prognoses of gliomas. Although existing studies can accurately predict the IDH mutation status of gliomas based on multimodal magnetic resonance (MR) images and machine learning methods, most of these methods cannot fully explore multimodal information and effectively predict IDH status for datasets acquired from multiple centers. To address this issue, a novel wavelet scattering (WS)-based orthogonal fusion network (WSOFNet) was proposed in this work to predict the IDH mutation status of gliomas from multiple centers. First, transformation-invariant features were extracted from multimodal MR images with a WS network, and then the multimodal WS features were used instead of the original images as the inputs of WSOFNet and were fully fused through an adaptive multimodal feature fusion module (AMF2M) and an orthogonal projection module (OPM). Finally, the fused features were input into a fully connected classifier to predict IDH mutation status. In addition, to achieve improved prediction accuracy, four auxiliary losses were also used in the feature extraction modules. The comparison results showed that the prediction area under the curve (AUC) of WSOFNet on a single-center dataset was 0.9966 and that on a multicenter dataset was approximately 0.9655, which was at least 3.9% higher than that of state-of-the-art methods. Moreover, the ablation experimental results also proved that the adaptive multimodal feature fusion strategy based on orthogonal projection could effectively improve the prediction performance of the model, especially for an external validation dataset.

Artificial Intelligence Applications in Glioma With 1p/19q Co-Deletion: A Systematic Review

As an important genomic marker for oligodendrogliomas, early determination of 1p/19q co-deletion status is critical for guiding therapy and predicting prognosis in patients with glioma. The purpose of this study is to systematically review the literature concerning the magnetic resonance imaging (MRI) with artificial intelligence (AI) methods for predicting 1p/19q co-deletion status in glioma. PubMed, Scopus, Embase, and IEEE Xplore were searched in accordance with the Preferred Reporting Items for systematic reviews and meta-analyses guidelines. Methodological quality of studies was assessed according to the Quality Assessment of Diagnostic Accuracy Studies-2. Finally, 28 studies were included in the quantitative analysis. Diagnostic test accuracy reached an area under the ROC curve of 0.71-0.98 were reported in 24 studies. The remaining four studies with no available AUC provided an accuracy of 0.75-0. 89. The included studies varied widely in terms of imaging sequences, input features, and modeling methods. The current review highlighted that integrating MRI with AI technology is a potential tool for determination 1p/19q status pre-operatively and noninvasively, which can possibly help clinical decision-making. However, the reliability and feasibility of this approach still need to be further validated and improved in a real clinical setting. EVIDENCE LEVEL: 2. TECHNICAL EFFICACY: 2.

Evaluating the Potential of Delta Radiomics for Assessing Tyrosine Kinase Inhibitor Treatment Response in Non-Small Cell Lung Cancer Patients

Our study aimed to harness the power of CT scans, observed over time, in predicting how lung adenocarcinoma patients might respond to a treatment known as EGFR-TKI. Analyzing scans from 322 advanced stage lung cancer patients, we identified distinct image-based patterns. By integrating these patterns with comprehensive clinical information, such as gene mutations and treatment regimens, our predictive capabilities were significantly enhanced. Interestingly, the precision of these predictions, particularly related to radiomics features, diminished when data from various centers were combined, suggesting that the approach requires standardization across facilities. This novel method offers a potential pathway to anticipate disease progression in lung adenocarcinoma patients treated with EGFR-TKI, laying the groundwork for more personalized treatments. To further validate this approach, extensive studies involving a larger cohort are pivotal.

Frontiers of Cranial Base Surgery: Integrating Technique, Technology, and Teamwork for the Future of Neurosurgery

The landscape of cranial base surgery has undergone monumental transformations over the past several decades. This article serves as a comprehensive survey, detailing both the historical and current techniques and technologies that have propelled this field into an era of unprecedented capabilities and sophistication. In the prologue, we traverse the historical evolution from rudimentary interventions to the state-of-the-art neurosurgical methodologies that define today's practice. Subsequent sections delve into the anatomical complexities of the anterior, middle, and posterior cranial fossa, shedding light on the intricacies that dictate surgical approaches. In a section dedicated to advanced techniques and modalities, we explore cutting-edge evolutions in minimally invasive procedures, pituitary surgery, and cranial base reconstruction. Here, we highlight the seamless integration of endocrinology, biomaterial science, and engineering into neurosurgical craftsmanship. The article emphasizes the paradigm shift towards "Functionally" Guided Surgery facilitated by intraoperative neuromonitoring. We explore its historical origins, current technologies, and its invaluable role in tailoring surgical interventions across diverse pathologies. Additionally, the digital era's contributions to cranial base surgery are examined. This includes breakthroughs in endoscopic technology, robotics, augmented reality, and the potential of machine learning and AI-assisted diagnostic and surgical planning. The discussion extends to radiosurgery and radiotherapy, focusing on the harmonization of precision and efficacy through advanced modalities such as Gamma Knife and CyberKnife. The article also evaluates newer protocols that optimize tumor control while preserving neural structures. In acknowledging the holistic nature of cranial base surgery, we advocate for an interdisciplinary approach. The ecosystem of this surgical field is presented as an amalgamation of various medical disciplines, including neurology, radiology, oncology, and rehabilitation, and is further enriched by insights from patient narratives and quality-of-life metrics. The epilogue contemplates future challenges and opportunities, pinpointing potential breakthroughs in stem cell research, regenerative medicine, and genomic tailoring. Ultimately, the article reaffirms the ethos of continuous learning, global collaboration, and patient-first principles, projecting an optimistic trajectory for the field of cranial base surgery in the coming decade.

Personalized radiomics signature to screen for KIT-11 mutation genotypes among patients with gastrointestinal stromal tumors: a retrospective multicenter study

OBJECTIVES

Gastrointestinal stromal tumors (GISTs) carrying different KIT exon 11 (KIT-11) mutations exhibit varying prognoses and responses to Imatinib. Herein, we aimed to determine whether computed tomography (CT) radiomics can accurately stratify KIT-11 mutation genotypes to benefit Imatinib therapy and GISTs monitoring.

METHODS

Overall, 1143 GISTs from 3 independent centers were separated into a training cohort (TC) or validation cohort (VC). In addition, the KIT-11 mutation genotype was classified into 4 categories: no KIT-11 mutation (K11-NM), point mutations or duplications (K11-PM/D), KIT-11 557/558 deletions (K11-557/558D), and KIT-11 deletion without codons 557/558 involvement (K11-D). Subsequently, radiomic signatures (RS) were generated based on the arterial phase of contrast CT, which were then developed as KIT-11 mutation predictors using 1408 quantitative image features and LASSO regression analysis, with further evaluation of its predictive capability.

RESULTS

The TC AUCs for K11-NM, K11-PM/D, K11-557/558D, and K11-D ranged from 0.848 (95% CI 0.812-0.884), 0.759 (95% CI 0.722-0.797), 0.956 (95% CI 0.938-0.974), and 0.876 (95% CI 0.844-0.908), whereas the VC AUCs ranged from 0.723 (95% CI 0.660-0.786), 0.688 (95% CI 0.643-0.732), 0.870 (95% CI 0.824-0.918), and 0.830 (95% CI 0.780-0.878). Macro-weighted AUCs for the KIT-11 mutant genotype ranged from 0.838 (95% CI 0.820-0.855) in the TC to 0.758 (95% CI 0.758-0.784) in VC. TC had an overall accuracy of 0.694 (95%CI 0.660-0.729) for RS-based predictions of the KIT-11 mutant genotype, whereas VC had an accuracy of 0.637 (95%CI 0.595-0.679).

CONCLUSIONS

CT radiomics signature exhibited good predictive performance in estimating the KIT-11 mutation genotype, especially in prediction of K11-557/558D genotype. RS-based classification of K11-NM, K11-557/558D, and K11-D patients may be an indication for choice of Imatinib therapy.

Improving Noninvasive Classification of Molecular Subtypes of Adult Gliomas With Diffusion-Weighted MR Imaging: An Externally Validated Machine Learning Algorithm

BACKGROUND

Genetic testing for molecular markers of gliomas sometimes is unavailable because of time-consuming and expensive, even limited tumor specimens or nonsurgery cases.

PURPOSE

To train a three-class radiomic model classifying three molecular subtypes including isocitrate dehydrogenase (IDH) mutations and 1p/19q-noncodeleted (IDHmut-noncodel), IDH wild-type (IDHwt), IDH-mutant and 1p/19q-codeleted (IDHmut-codel) of adult gliomas and investigate whether radiomic features from diffusion-weighted imaging (DWI) could bring additive value.

STUDY TYPE

Retrospective.

POPULATION

A total of 755 patients including 111 IDHmut-noncodel, 571 IDHwt, and 73 IDHmut-codel cases were divided into training (n = 480) and internal validation set (n = 275); 139 patients including 21 IDHmut-noncodel, 104 IDHwt, and 14 IDHmut-codel cases were utilized as external validation set.

FIELD STRENGTH/SEQUENCE

A 1.5 T or 3.0 T/multiparametric MRI, including T1-weighted (T1), T1-weighted gadolinium contrast-enhanced (T1c), T2-weighted (T2), fluid attenuated inversion recovery (FLAIR), and DWI.

ASSESSMENT

The performance of multiparametric radiomic model (random-forest model) using 22 selected features from T1, T2, FLAIR, T1c images and apparent diffusion coefficient (ADC) maps, and conventional radiomic model using 20 selected features from T1, T2, FLAIR, and T1c images was assessed in internal and external validation sets by comparing probability values and actual incidence.

STATISTICAL TESTS

Mann-Whitney U test, Chi-Squared test, Wilcoxon test, receiver operating curve (ROC), and area under the curve (AUC); DeLong analysis. P < 0.05 was statistically significant.

RESULTS

The multiparametric radiomic model achieved AUC values for IDHmut-noncodel, IDHwt, and IDHmut-codel of 0.8181, 0.8524, and 0.8502 in internal validation set and 0.7571, 0.7779, and 0.7491 in external validation set, respectively. Multiparametric radiomic model showed significantly better diagnostic performance after DeLong analysis, especially in classifying IDHwt and IDHmut-noncodel subtypes.

DATA CONCLUSION

Radiomic features from DWI could bring additive value and improve the performance of conventional MRI-based radiomic model for classifying the molecular subtypes especially IDHmut-noncodel and IDHwt of adult gliomas.

LEVEL OF EVIDENCE: 3

TECHNICAL EFFICACY

Stage 2.

Systematic Literature Review of Machine Learning Algorithms Using Pretherapy Radiologic Imaging for Glioma Molecular Subtype Prediction

BACKGROUND

The molecular profile of gliomas is a prognostic indicator for survival, driving clinical decision-making for treatment. Pathology-based molecular diagnosis is challenging because of the invasiveness of the procedure, exclusion from neoadjuvant therapy options, and the heterogeneous nature of the tumor.

PURPOSE

We performed a systematic review of algorithms that predict molecular subtypes of gliomas from MR Imaging.

DATA SOURCES

Data sources were Ovid Embase, Ovid MEDLINE, Cochrane Central Register of Controlled Trials, Web of Science.

STUDY SELECTION

Per the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines, 12,318 abstracts were screened and 1323 underwent full-text review, with 85 articles meeting the inclusion criteria.

DATA ANALYSIS

We compared prediction results from different machine learning approaches for predicting molecular subtypes of gliomas. Bias analysis was conducted for each study, following the Prediction model Risk Of Bias Assessment Tool (PROBAST) guidelines.

DATA SYNTHESIS

Isocitrate dehydrogenase mutation status was reported with an area under the curve and accuracy of 0.88 and 85% in internal validation and 0.86 and 87% in limited external validation data sets, respectively. For the prediction of O6-methylguanine-DNA methyltransferase promoter methylation, the area under the curve and accuracy in internal validation data sets were 0.79 and 77%, and in limited external validation, 0.89 and 83%, respectively. PROBAST scoring demonstrated high bias in all articles.

LIMITATIONS

The low number of external validation and studies with incomplete data resulted in unequal data analysis. Comparing the best prediction pipelines of each study may introduce bias.

CONCLUSIONS

While the high area under the curve and accuracy for the prediction of molecular subtypes of gliomas are reported in internal and external validation data sets, limited use of external validation and the increased risk of bias in all articles may present obstacles for clinical translation of these techniques.

Research on application of radiomics in glioma: a bibliometric and visual analysis

Background

With the continuous development of medical imaging informatics technology, radiomics has become a new and evolving field in medical applications. Radiomics aims to be an aid to support clinical decision making by extracting quantitative features from medical images and has a very wide range of applications. The purpose of this study was to perform a bibliometric and visual analysis of scientific results and research trends in the research application of radiomics in glioma.

Methods

We searched the Web of Science Core Collection (WOScc) for publications related to glioma radiomics. A bibliometric and visual analysis of online publications in this field related to countries/regions, authors, journals, references and keywords was performed using CiteSpace and R software.

Results

A total of 587 relevant literature published from 2012 to September 2022 were retrieved in WOScc, and finally a total of 484 publications were obtained according to the filtering criteria, including 393 (81.20%) articles and 91 (18.80%) reviews. The number of relevant publications increases year by year. The highest number of publications was from the USA (171 articles, 35.33%) and China (170 articles, 35.12%). The research institution with the highest number of publications was Chinese Acad Sci (24), followed by Univ Penn (22) and Fudan Univ (21). WANG Y (27) had the most publications, followed by LI Y (22), and WANG J (20). Among the 555 co-cited authors, LOUIS DN (207) and KICKINGEREDER P (207) were the most cited authors. FRONTIERS IN ONCOLOGY (42) was the most published journal and NEURO-ONCOLOGY (412) was the most co-cited journal. The most frequent keywords in all publications included glioblastoma (187), survival (136), classification (131), magnetic resonance imaging (113), machine learning (100), tumor (82), and feature (79), central nervous system (66), IDH (57), and radiomics (55). Cluster analysis was performed on the basis of keyword co-occurrence, and a total of 16 clusters were formed, indicating that these directions are the current hotspots of radiomics research applications in glioma and may be the future directions of continuous development.

Conclusion

In the past decade, radiomics has received much attention in the medical field and has been widely used in clinical research applications. Cooperation and communication between countries/regions need to be enhanced in future research to promote the development of radiomics in the field of medicine. In addition, the application of radiomics has improved the accuracy of pre-treatment diagnosis, efficacy prediction and prognosis assessment of glioma and helped to promote the development into precision medicine, the future still faces many challenges.

Radiomic features from multiparametric magnetic resonance imaging predict molecular subgroups of pediatric low-grade gliomas

BACKGROUND

We aimed to develop machine learning models for prediction of molecular subgroups (low-risk group and intermediate/high-risk group) and molecular marker (KIAA1549-BRAF fusion) of pediatric low-grade gliomas (PLGGs) based on radiomic features extracted from multiparametric MRI.

METHODS

61 patients with PLGGs were included in this retrospective study, which were divided into a training set and an internal validation set at a ratio of 2:1 based on the molecular subgroups or the molecular marker. The patients were classified into low-risk and intermediate/high-risk groups, BRAF fusion positive and negative groups, respectively. We extracted 5929 radiomic features from multiparametric MRI. Thereafter, we removed redundant features, trained random forest models on the training set for predicting the molecular subgroups or the molecular marker, and validated their performance on the internal validation set. The performance of the prediction model was verified by 3-fold cross-validation.

RESULTS

We constructed the classification model differentiating low-risk PLGGs from intermediate/high-risk PLGGs using 4 relevant features, with an AUC of 0.833 and an accuracy of 76.2% in the internal validation set. In the prediction model for predicting KIAA1549-BRAF fusion using 4 relevant features, an AUC of 0.818 and an accuracy of 81.0% were achieved in the internal validation set.

CONCLUSIONS

The current study demonstrates that MRI radiomics is able to predict molecular subgroups of PLGGs and KIAA1549-BRAF fusion with satisfying sensitivity.

TRIAL REGISTRATION

This study was retrospectively registered at clinicaltrials.gov (NCT04217018).

Universal multi-factor feature selection method for radiomics-based brain tumor classification

Brain tumor mortality is high, and accurate classification before treatment can improve patient prognosis. Radiomics, which extracts numerous features from medical images, has been widely applied in brain tumor classification studies. Feature selection (FS) is a critical step in radiomics because it reduces redundant information and enhances classification performance. However, the lack of universal FS methods limits the development of radiomics-based brain tumor classification studies. To address this issue, we summarize the characteristics of the FS methods used in related studies and propose a universal method based on three selection factors called triple-factor cascaded selection (TFCS). Particularly, these factors correspond to the correlation between features and task labels, interdependence among features, and role of features in the model. The TFCS method divides FS into two steps. First, it utilizes mutual information to select features that are strongly correlated with the task and contain less redundant information. Recursive feature elimination is then employed to obtain the subset with the best classification performance. To validate the universality of the TFCS, we conducted experiments on seven datasets containing 13 brain tumor classification tasks and evaluated the overall performance using five types of indicators. Results: TFCS exhibited excellent overall performance for all tasks. Compared to the 13 related methods, it takes less time, has moderate parsimony, the best classification performance, adaptability, and stability, and shows better universality. Our study demonstrates that the reasonable utilization of multiple factors can enhance FS performance and provide new insights for future method design.

Brain tumor detection and screening using artificial intelligence techniques: Current trends and future perspectives

A brain tumor is an abnormal mass of tissue located inside the skull. In addition to putting pressure on the healthy parts of the brain, it can lead to significant health problems. Depending on the region of the brain tumor, it can cause a wide range of health issues. As malignant brain tumors grow rapidly, the mortality rate of individuals with this cancer can increase substantially with each passing week. Hence it is vital to detect these tumors early so that preventive measures can be taken at the initial stages. Computer-aided diagnostic (CAD) systems, in coordination with artificial intelligence (AI) techniques, have a vital role in the early detection of this disorder. In this review, we studied 124 research articles published from 2000 to 2022. Here, the challenges faced by CAD systems based on different modalities are highlighted along with the current requirements of this domain and future prospects in this area of research.

Deep-learning and conventional radiomics to predict IDH genotyping status based on magnetic resonance imaging data in adult diffuse glioma

Objectives

In adult diffuse glioma, preoperative detection of isocitrate dehydrogenase (IDH) status helps clinicians develop surgical strategies and evaluate patient prognosis. Here, we aim to identify an optimal machine-learning model for prediction of IDH genotyping by combining deep-learning (DL) signatures and conventional radiomics (CR) features as model predictors.

Methods

In this study, a total of 486 patients with adult diffuse gliomas were retrospectively collected from our medical center (n=268) and the public database (TCGA, n=218). All included patients were randomly divided into the training and validation sets by using nested 10-fold cross-validation. A total of 6,736 CR features were extracted from four MRI modalities in each patient, namely T1WI, T1CE, T2WI, and FLAIR. The LASSO algorithm was performed for CR feature selection. In each MRI modality, we applied a CNN+LSTM-based neural network to extract DL features and integrate these features into a DL signature after the fully connected layer with sigmoid activation. Eight classic machine-learning models were analyzed and compared in terms of their prediction performance and stability in IDH genotyping by combining the LASSO-selected CR features and integrated DL signatures as model predictors. In the validation sets, the prediction performance was evaluated by using accuracy and the area under the curve (AUC) of the receiver operating characteristics, while the model stability was analyzed by using the relative standard deviation of the AUC (RSDAUC). Subgroup analyses of DL signatures and CR features were also individually conducted to explore their independent prediction values.

Results

Logistic regression (LR) achieved favorable prediction performance (AUC: 0.920 ± 0.043, accuracy: 0.843 ± 0.044), whereas support vector machine with the linear kernel (l-SVM) displayed low prediction performance (AUC: 0.812 ± 0.052, accuracy: 0.821 ± 0.050). With regard to stability, LR also showed high robustness against data perturbation (RSDAUC: 4.7%). Subgroup analyses showed that DL signatures outperformed CR features (DL, AUC: 0.915 ± 0.054, accuracy: 0.835 ± 0.061, RSDAUC: 5.9%; CR, AUC: 0.830 ± 0.066, accuracy: 0.771 ± 0.051, RSDAUC: 8.0%), while DL and DL+CR achieved similar prediction results.

Conclusion

In IDH genotyping, LR is a promising machine-learning classification model. Compared with CR features, DL signatures exhibit markedly superior prediction values and discriminative capability.

Quantifying the Growth of Glioblastoma Tumors Using Multimodal MRI Brain Images

Predicting the eventual volume of tumor cells, that might proliferate from a given tumor, can help in cancer early detection and medical procedure planning to prevent their migration to other organs. In this work, a new statistical framework is proposed using Bayesian techniques for detecting the eventual volume of cells expected to proliferate from a glioblastoma (GBM) tumor. Specifically, the tumor region was first extracted using a parallel image segmentation algorithm. Once the tumor region was determined, we were interested in the number of cells that could proliferate from this tumor until its survival time. For this, we constructed the posterior distribution of the tumor cell numbers based on the proposed likelihood function and a certain prior volume. Furthermore, we extended the detection model and conducted a Bayesian regression analysis by incorporating radiomic features to discover those non-tumor cells that remained undetected. The main focus of the study was to develop a time-independent prediction model that could reliably predict the ultimate volume a malignant tumor of the fourth-grade severity could attain and which could also determine if the incorporation of the radiomic properties of the tumor enhanced the chances of no malignant cells remaining undetected.

A computer-aided diagnosis system for brain tumors based on artificial intelligence algorithms

The choice of treatment and prognosis evaluation depend on the accurate early diagnosis of brain tumors. Many brain tumors go undiagnosed or are overlooked by clinicians as a result of the challenges associated with manually evaluating magnetic resonance imaging (MRI) images in clinical practice. In this study, we built a computer-aided diagnosis (CAD) system for glioma detection, grading, segmentation, and knowledge discovery based on artificial intelligence algorithms. Neuroimages are specifically represented using a type of visual feature known as the histogram of gradients (HOG). Then, through a two-level classification framework, the HOG features are employed to distinguish between healthy controls and patients, or between different glioma grades. This CAD system also offers tumor visualization using a semi-automatic segmentation tool for better patient management and treatment monitoring. Finally, a knowledge base is created to offer additional advice for the diagnosis of brain tumors. Based on our proposed two-level classification framework, we train models for glioma detection and grading, achieving area under curve (AUC) of 0.921 and 0.806, respectively. Different from other systems, we integrate these diagnostic tools with a web-based interface, which provides the flexibility for system deployment.

Prediction of IDH mutation status of glioma based on terahertz spectral data

Gliomas are the most common type of primary tumor in the central nervous system in adults. Isocitrate dehydrogenase (IDH) mutation status is an important molecular biomarker for adult diffuse gliomas. In this study, we were aiming to predict IDH mutation status based on terahertz time-domain spectroscopy technology. Ninety-two frozen sections of glioma tissue from nine patients were included, and terahertz spectroscopy data were obtained. Through Least Absolute Shrinkage and Selection Operator (LASSO), Principal component analysis (PCA), and Random forest (RF) algorithms, a predictive model for predicting IDH mutation status in gliomas was established based on the terahertz spectroscopy dataset with an AUC of 0.844. These results indicate that gliomas with different IDH mutation status have different terahertz spectral features, and the use of terahertz spectroscopy can establish a predictive model of IDH mutation status, providing a new way for glioma research.

Deep Learning-Assisted Quantitative Susceptibility Mapping as a Tool for Grading and Molecular Subtyping of Gliomas

This study aimed to explore the value of deep learning (DL)-assisted quantitative susceptibility mapping (QSM) in glioma grading and molecular subtyping. Forty-two patients with gliomas, who underwent preoperative T2 fluid-attenuated inversion recovery (T2 FLAIR), contrast-enhanced T1-weighted imaging (T1WI + C), and QSM scanning at 3.0T magnetic resonance imaging (MRI) were included in this study. Histopathology and immunohistochemistry staining were used to determine glioma grades, and isocitrate dehydrogenase (IDH) 1 and alpha thalassemia/mental retardation syndrome X-linked gene (ATRX) subtypes. Tumor segmentation was performed manually using Insight Toolkit-SNAP program (www.itksnap.org). An inception convolutional neural network (CNN) with a subsequent linear layer was employed as the training encoder to capture multi-scale features from MRI slices. Fivefold cross-validation was utilized as the training strategy (seven samples for each fold), and the ratio of sample size of the training, validation, and test dataset was 4:1:1. The performance was evaluated by the accuracy and area under the curve (AUC). With the inception CNN, single modal of QSM showed better performance in differentiating glioblastomas (GBM) and other grade gliomas (OGG, grade II-III), and predicting IDH1 mutation and ATRX loss (accuracy: 0.80, 0.77, 0.60) than either T2 FLAIR (0.69, 0.57, 0.54) or T1WI + C (0.74, 0.57, 0.46). When combining three modalities, compared with any single modality, the best AUC/accuracy/F1-scores were reached in grading gliomas (OGG and GBM: 0.91/0.89/0.87, low-grade and high-grade gliomas: 0.83/0.86/0.81), predicting IDH1 mutation (0.88/0.89/0.85), and predicting ATRX loss (0.78/0.71/0.67). As a supplement to conventional MRI, DL-assisted QSM is a promising molecular imaging method to evaluate glioma grades, IDH1 mutation, and ATRX loss.

Supplementary Information

The online version contains supplementary material available at 10.1007/s43657-022-00087-6.

Artificial intelligence-assisted selection and efficacy prediction of antineoplastic strategies for precision cancer therapy

The rapid development of artificial intelligence (AI) technologies in the context of the vast amount of collectable data obtained from high-throughput sequencing has led to an unprecedented understanding of cancer and accelerated the advent of a new era of clinical oncology with a tone of precision treatment and personalized medicine. However, the gains achieved by a variety of AI models in clinical oncology practice are far from what one would expect, and in particular, there are still many uncertainties in the selection of clinical treatment options that pose significant challenges to the application of AI in clinical oncology. In this review, we summarize emerging approaches, relevant datasets and open-source software of AI and show how to integrate them to address problems from clinical oncology and cancer research. We focus on the principles and procedures for identifying different antitumor strategies with the assistance of AI, including targeted cancer therapy, conventional cancer therapy, and cancer immunotherapy. In addition, we also highlight the current challenges and directions of AI in clinical oncology translation. Overall, we hope this article will provide researchers and clinicians with a deeper understanding of the role and implications of AI in precision cancer therapy, and help AI move more quickly into accepted cancer guidelines.

QuantImage v2: a comprehensive and integrated physician-centered cloud platform for radiomics and machine learning research

BACKGROUND

Radiomics, the field of image-based computational medical biomarker research, has experienced rapid growth over the past decade due to its potential to revolutionize the development of personalized decision support models. However, despite its research momentum and important advances toward methodological standardization, the translation of radiomics prediction models into clinical practice only progresses slowly. The lack of physicians leading the development of radiomics models and insufficient integration of radiomics tools in the clinical workflow contributes to this slow uptake.

METHODS

We propose a physician-centered vision of radiomics research and derive minimal functional requirements for radiomics research software to support this vision. Free-to-access radiomics tools and frameworks were reviewed to identify best practices and reveal the shortcomings of existing software solutions to optimally support physician-driven radiomics research in a clinical environment.

RESULTS

Support for user-friendly development and evaluation of radiomics prediction models via machine learning was found to be missing in most tools. QuantImage v2 (QI2) was designed and implemented to address these shortcomings. QI2 relies on well-established existing tools and open-source libraries to realize and concretely demonstrate the potential of a one-stop tool for physician-driven radiomics research. It provides web-based access to cohort management, feature extraction, and visualization and supports "no-code" development and evaluation of machine learning models against patient-specific outcome data.

CONCLUSIONS

QI2 fills a gap in the radiomics software landscape by enabling "no-code" radiomics research, including model validation, in a clinical environment. Further information about QI2, a public instance of the system, and its source code is available at https://medgift.github.io/quantimage-v2-info/ . Key points As domain experts, physicians play a key role in the development of radiomics models. Existing software solutions do not support physician-driven research optimally. QuantImage v2 implements a physician-centered vision for radiomics research. QuantImage v2 is a web-based, "no-code" radiomics research platform.

Predicting survival after radiosurgery in patients with lung cancer brain metastases using deep learning of radiomics and EGFR status

The early prediction of overall survival (OS) in patients with lung cancer brain metastases (BMs) after Gamma Knife radiosurgery (GKRS) can facilitate patient management and outcome improvement. However, the disease progression is influenced by multiple factors, such as patient characteristics and treatment strategies, and hence satisfactory performance of OS prediction remains challenging. Accordingly, we proposed a deep learning approach based on comprehensive predictors, including clinical, imaging, and genetic information, to accomplish reliable and personalized OS prediction in patients with BMs after receiving GKRS. Overall 1793 radiomic features extracted from pre-GKRS magnetic resonance images (MRI), clinical information, and epidermal growth factor receptor (EGFR) mutation status were retrospectively collected from 237 BM patients who underwent GKRS. DeepSurv, a multi-layer perceptron model, with 4 different aggregation methods of radiomics was applied to predict personalized survival curves and survival status at 3, 6, 12, and 24 months. The model combining clinical features, EGFR status, and radiomics from the largest BM showed the best prediction performance with concordance index of 0.75 and achieved areas under the curve of 0.82, 0.80, 0.84, and 0.92 for predicting survival status at 3, 6, 12, and 24 months, respectively. The DeepSurv model showed a significant improvement (p < 0.001) in concordance index compared to the validated lung cancer BM prognostic molecular markers. Furthermore, the model provided a novel estimate of the risk-of-death period for patients. The personalized survival curves generated by the DeepSurv model effectively predicted the risk-of-death period which could facilitate personalized management of patients with lung cancer BMs.

Radiomic features from dynamic susceptibility contrast perfusion-weighted imaging improve the three-class prediction of molecular subtypes in patients with adult diffuse gliomas

OBJECTIVES

To investigate whether radiomic features extracted from dynamic susceptibility contrast perfusion-weighted imaging (DSC-PWI) can improve the prediction of the molecular subtypes of adult diffuse gliomas, and to further develop and validate a multimodal radiomic model by integrating radiomic features from conventional and perfusion MRI.

METHODS

We extracted 1197 radiomic features from each sequence of conventional MRI and DSC-PWI, respectively. The Boruta algorithm was used for feature selection and combination, and a three-class random forest method was applied to construct the models. We also constructed a combined model by integrating radiomic features and clinical metrics. The models' diagnostic performance for discriminating the molecular subtypes (IDH wild type [IDHwt], IDH mutant and 1p/19q-noncodeleted [IDHmut-noncodel], and IDH mutant and 1p/19q-codeleted [IDHmut-codel]) was compared using AUCs in the validation set.

RESULTS

We included 272 patients (training set, n = 166; validation set, n = 106) with grade II-IV gliomas (mean age, 48.7 years; range, 19-77 years). The proportions of the molecular subtypes were 66.2% IDHwt, 15.1% IDHmut-noncodel, and 18.8% IDHmut-codel. Nineteen radiomic features (13 from conventional MRI and 6 from DSC-PWI) were selected to build the multimodal radiomic model. In the validation set, the multimodal radiomic model showed better performance than the conventional radiomic model did in predicting the IDHwt and IDHmut-codel subtypes, which was comparable to the conventional radiomic model in predicting the IDHmut-noncodel subtype. The multimodal radiomic model yielded similar performance as the combined model in predicting the three molecular subtypes.

CONCLUSIONS

Adding DSC-PWI to conventional MRI can improve molecular subtype prediction in patients with diffuse gliomas.

KEY POINTS

• The multimodal radiomic model outperformed conventional MRI when predicting both the IDH wild type and IDH mutant and 1p/19q-codeleted subtypes of gliomas. • The multimodal radiomic model showed comparable performance to the combined model in the prediction of the three molecular subtypes. • Radiomic features from T1-weighted gadolinium contrast-enhanced and relative cerebral blood volume images played an important role in the prediction of molecular subtypes.

Shape and texture analyses based on conventional MRI for the preoperative prediction of the aggressiveness of pituitary adenomas

OBJECTIVES

Pituitary adenomas can exhibit aggressive behavior, characterized by rapid growth, resistance to conventional treatment, and early recurrence. This study aims to evaluate the clinical value of shape-related features combined with textural features based on conventional MRI in evaluating the aggressiveness of pituitary adenomas and develop the best diagnostic model.

METHODS

Two hundred forty-six pituitary adenoma patients (84 aggressive, 162 non-aggressive) who underwent preoperative MRI were retrospectively reviewed. The patients were divided into training (n = 193) and testing (n = 53) sets. Clinical information, shape-related, and textural features extracted from the tumor volume on contrast-enhanced T1-weighted images (CE-T1WI), were compared between aggressive and non-aggressive groups. Variables with significant differences were enrolled into Pearson's correlation analysis to weaken multicollinearity. Logistic regression models based on the selected features were constructed to predict tumor aggressiveness under fivefold cross-validation.

RESULTS

Sixty-five imaging features, including five shape-related and sixty textural features, were extracted from volumetric CE-T1WI. Forty-seven features were significantly different between aggressive and non-aggressive groups (all p values < 0.05). After feature selection, four features (SHAPE_Sphericity, SHAPE_Compacity, DISCRETIZED_Q3, and DISCRETIZED_Kurtosis) were put into logistic regression analysis. Based on the combination of these features and Knosp grade, the model yielded an area under the curve value of 0.935, with a sensitivity of 94.4% and a specificity of 82.9%, to discriminate between aggressive and non-aggressive pituitary adenomas in the testing set.

CONCLUSION

The radiomic model based on tumor shape and textural features study from CE-T1WI might potentially assist in the preoperative aggressiveness diagnosis of pituitary adenomas.

KEY POINTS

• Pituitary adenomas with aggressive behavior exhibit rapid growth, resistance to conventional treatment, and early recurrence despite gross resection and may require multiline treatments. • Shape-related features and texture features based on CE-T1WI were significantly correlated with the Ki-67 labeling index, mitotic count, and p53 expression, and the proposed model achieved a favorable prediction of the aggressiveness of PAs with an AUC value of 0.935. • The prediction model might provide valuable guidance for individualized treatment in patients with PAs.

Magnetic Resonance Imaging of Primary Adult Brain Tumors: State of the Art and Future Perspectives

MRI is undoubtedly the cornerstone of brain tumor imaging, playing a key role in all phases of patient management, starting from diagnosis, through therapy planning, to treatment response and/or recurrence assessment. Currently, neuroimaging can describe morphologic and non-morphologic (functional, hemodynamic, metabolic, cellular, microstructural, and sometimes even genetic) characteristics of brain tumors, greatly contributing to diagnosis and follow-up. Knowing the technical aspects, strength and limits of each MR technique is crucial to correctly interpret MR brain studies and to address clinicians to the best treatment strategy. This article aimed to provide an overview of neuroimaging in the assessment of adult primary brain tumors. We started from the basilar role of conventional/morphological MR sequences, then analyzed, one by one, the non-morphological techniques, and finally highlighted future perspectives, such as radiomics and artificial intelligence.

A radiomics-based deep learning approach to predict progression free-survival after tyrosine kinase inhibitor therapy in non-small cell lung cancer

BACKGROUND

The epidermal growth factor receptor (EGFR) tyrosine kinase inhibitors (TKIs) are a first-line therapy for non-small cell lung cancer (NSCLC) with EGFR mutations. Approximately half of the patients with EGFR-mutated NSCLC are treated with EGFR-TKIs and develop disease progression within 1 year. Therefore, the early prediction of tumor progression in patients who receive EGFR-TKIs can facilitate patient management and development of treatment strategies. We proposed a deep learning approach based on both quantitative computed tomography (CT) characteristics and clinical data to predict progression-free survival (PFS) in patients with advanced NSCLC after EGFR-TKI treatment.

METHODS

A total of 593 radiomic features were extracted from pretreatment chest CT images. The DeepSurv models for the progression risk stratification of EGFR-TKI treatment were proposed based on CT radiomic and clinical features from 270 stage IIIB-IV EGFR-mutant NSCLC patients. Time-dependent PFS predictions at 3, 12, 18, and 24 months and estimated personalized PFS curves were calculated using the DeepSurv models.

RESULTS

The model combining clinical and radiomic features demonstrated better prediction performance than the clinical model. The model achieving areas under the curve of 0.76, 0.77, 0.76, and 0.86 can predict PFS at 3, 12, 18, and 24 months, respectively. The personalized PFS curves showed significant differences (p < 0.003) between groups with good (PFS > median) and poor (PFS < median) tumor control.

CONCLUSIONS

The DeepSurv models provided reliable multi-time-point PFS predictions for EGFR-TKI treatment. The personalized PFS curves can help make accurate and individualized predictions of tumor progression. The proposed deep learning approach holds promise for improving the pre-TKI personalized management of patients with EGFR-mutated NSCLC.

Radiomics-Based Machine Learning to Predict Recurrence in Glioma Patients Using Magnetic Resonance Imaging

OBJECTIVE

Recurrence is a major factor in the poor prognosis of patients with glioma. The aim of this study was to predict glioma recurrence using machine learning based on radiomic features.

METHODS

We recruited 77 glioma patients, consisting of 57 newly diagnosed patients and 20 patients with recurrence. After extracting the radiomic features from T2-weighted images, the data set was randomly divided into training (58 patients) and testing (19 patients) cohorts. An automated machine learning method (the Tree-based Pipeline Optimization Tool) was applied to generate 10 independent recurrence prediction models. The final model was determined based on the area under the curve (AUC) and average specificity. Moreover, an independent validation set of 20 patients with glioma was used to verify the model performance.

RESULTS

Recurrence in glioma patients was successfully predicting by machine learning using radiomic features. Among the 10 recurrence prediction models, the best model achieved an accuracy of 0.81, an AUC value of 0.85, and a specificity of 0.69 in the testing cohort, but an accuracy of 0.75 and an AUC value of 0.87 in the independent validation set.

CONCLUSIONS

Our algorithm that is generated by machine learning exhibits promising power and may predict recurrence noninvasively, thereby offering potential value for the early development of interventions to delay or prevent recurrence in glioma patients.

Radiomics analysis of amide proton transfer-weighted and structural MR images for treatment response assessment in malignant gliomas

The purpose of this study was to evaluate the value of amide proton transfer-weighted (APTw) MRI radiomic features for the differentiation of tumor recurrence from treatment effect in malignant gliomas. Eighty-six patients who had suspected tumor recurrence after completion of chemoradiation or radiotherapy, and who had APTw-MRI data acquired at 3 T, were retrospectively analyzed. Using a fluid-attenuated inversion recovery (FLAIR) image-based mask, radiomics analysis was applied to the processed APTw and structural MR images. A chi-square automatic interaction detector decision tree was used for classification analysis. Models with and without APTw features were built using the same strategy. Tenfold cross-validation was applied to obtain the overall classification performance of each model. Sixty patients were confirmed as having tumor recurrence, and the remainder were confirmed as having treatment effect, at median time points of 190 and 171 days after therapy, respectively. There were 525 radiomic features extracted from each of the processed APTw and structural MR images. Based on these, the APTw-based model yielded the highest accuracy (86.0%) for the differentiation of tumor recurrence from treatment effect, compared with 74.4%, 76.7%, 83.7%, and 76.7% for T1 w, T2 w, FLAIR, and Gd-T1 w, respectively. Model classification accuracy was 82.6% when using the combined structural MR images (T1 w, T2 w, FLAIR, Gd-T1 w), and increased to 89.5% when using these structural plus APTw images. The corresponding sensitivity and specificity were 85.0% and 76.9% for the combination of structural MR images, and 85.0% and 100% after adding APTw image features. Adding APTw-based radiomic features increased MRI accuracy in the assessment of the treatment response in post-treatment malignant gliomas.

Machine learning based survival prediction in Glioma using large-scale registry data

Gliomas are the most common central nervous system tumors exhibiting poor clinical outcomes. The ability to estimate prognosis is crucial for both patients and providers in order to select the most appropriate treatment. Machine learning (ML) allows for sophisticated approaches to survival prediction using real world clinical parameters needed to achieve superior predictive accuracy. We employed Cox Proportional hazards (CPH) model, Support Vector Machine (SVM) model, Random Forest (RF) model in a large glioma dataset (3462 patients, diagnosed 2000-2018) to explore the most optimal approach to survival prediction. Features employed were age, sex, surgical resection status, tumor histology and tumor site, administration of radiation therapy (RT) and chemotherapy status. Concordance index (c-index) was employed to assess the accuracy of survival time prediction. All three models performed well with prediction accuracy (CI 0.767, 0.771, 0.57 for CPH, SVM, RF models respectively) with the best performance achieved when incorporating RT and chemotherapy administration status which emerged as key predictive features. Within the subset of glioblastoma patients, similar prediction accuracy was achieved. These findings should prompt stricter clinician oversight over registry data accuracy through quality assurance as we move towards meaningful predictive ability using ML approaches in glioma.

Predicting IDH subtype of grade 4 astrocytoma and glioblastoma from tumor radiomic patterns extracted from multiparametric magnetic resonance images using a machine learning approach

Background and purpose

Semantic imaging features have been used for molecular subclassification of high-grade gliomas. Radiomics-based prediction of molecular subgroups has the potential to strategize and individualize therapy. Using MRI texture features, we propose to distinguish between IDH wild type and IDH mutant type high grade gliomas.

Methods

Between 2013 and 2020, 100 patients were retrospectively analyzed for the radiomics study. Immunohistochemistry of the pathological specimen was used to initially identify patients for the IDH mutant/wild phenotype and was then confirmed by Sanger’s sequencing. Image texture analysis was performed on contrast-enhanced T1 (T1C) and T2 weighted (T2W) MR images. Manual segmentation was performed on MR image slices followed by single-slice multiple sampling image augmentation. Both whole tumor multislice segmentation and single-slice multiple sampling approaches were used to arrive at the best model. Radiomic features were extracted, which included first-order features, second-order (GLCM—Grey level co-occurrence matrix), and shape features. Feature enrichment was done using LASSO (Least Absolute Shrinkage and Selection Operator) regression, followed by radiomic classification using Support Vector Machine (SVM) and a 10-fold cross-validation strategy for model development. The area under the Receiver Operator Characteristic (ROC) curve and predictive accuracy were used as diagnostic metrics to evaluate the model to classify IDH mutant and wild-type subgroups.

Results

Multislice analysis resulted in a better model compared to the single-slice multiple-sampling approach. A total of 164 MR-based texture features were extracted, out of which LASSO regression identified 14 distinctive GLCM features for the endpoint, which were used for further model development. The best model was achieved by using combined T1C and T2W MR images using a Quadratic Support Vector Machine Classifier and a 10-fold internal cross-validation approach, which demonstrated a predictive accuracy of 89% with an AUC of 0.89 for each IDH mutant and IDH wild subgroup.

Conclusion

A machine learning classifier of radiomic features extracted from multiparametric MRI images (T1C and T2w) provides important diagnostic information for the non-invasive prediction of the IDH mutant or wild-type phenotype of high-grade gliomas and may have potential use in either escalating or de-escalating adjuvant therapy for gliomas or for using targeted agents in the future.

Artificial intelligence in multi-parametric magnetic resonance imaging: A review

Multi-parametric magnetic resonance imaging (mpMRI) is an indispensable tool in the clinical workflow for the diagnosis and treatment planning of various diseases. Machine learning-based artificial intelligence (AI) methods, especially those adopting the deep learning technique, have been extensively employed to perform mpMRI image classification, segmentation, registration, detection, reconstruction, and super-resolution. The current availability of increasing computational power and fast-improving AI algorithms have empowered numerous computer-based systems for applying mpMRI to disease diagnosis, imaging-guided radiotherapy, patient risk and overall survival time prediction, and the development of advanced quantitative imaging technology for magnetic resonance fingerprinting. However, the wide application of these developed systems in the clinic is still limited by a number of factors, including robustness, reliability, and interpretability. This survey aims to provide an overview for new researchers in the field as well as radiologists with the hope that they can understand the general concepts, main application scenarios, and remaining challenges of AI in mpMRI. This article is protected by copyright. All rights reserved.

Swin Transformer Improves the IDH Mutation Status Prediction of Gliomas Free of MRI-Based Tumor Segmentation

Background: Deep learning (DL) could predict isocitrate dehydrogenase (IDH) mutation status from MRIs. Yet, previous work focused on CNNs with refined tumor segmentation. To bridge the gap, this study aimed to evaluate the feasibility of developing a Transformer-based network to predict the IDH mutation status free of refined tumor segmentation. Methods: A total of 493 glioma patients were recruited from two independent institutions for model development (TCIA; N = 259) and external test (AHXZ; N = 234). IDH mutation status was predicted directly from T2 images with a Swin Transformer and conventional ResNet. Furthermore, to investigate the necessity of refined tumor segmentation, seven strategies for the model input image were explored: (i) whole tumor slice; (ii-iii) tumor mask and/or not edema; (iv-vii) tumor bounding box of 0.8, 1.0, 1.2, 1.5 times. Performance comparison was made among the networks of different architectures along with different image input strategies, using area under the curve (AUC) and accuracy (ACC). Finally, to further boost the performance, a hybrid model was built by incorporating the images with clinical features. Results: With the seven proposed input strategies, seven Swin Transformer models and seven ResNet models were built, respectively. Based on the seven Swin Transformer models, an averaged AUC of 0.965 (internal test) and 0.842 (external test) were achieved, outperforming 0.922 and 0.805 resulting from the seven ResNet models, respectively. When a bounding box of 1.0 times was used, Swin Transformer (AUC = 0.868, ACC = 80.7%), achieved the best results against the one that used tumor segmentation (Tumor + Edema, AUC = 0.862, ACC = 78.5%). The hybrid model that integrated age and location features into images yielded improved performance (AUC = 0.878, Accuracy = 82.0%) over the model that used images only. Conclusions: Swin Transformer outperforms the CNN-based ResNet in IDH prediction. Using bounding box input images benefits the DL networks in IDH prediction and makes the IDH prediction free of refined glioma segmentation feasible.

Radiomics-Based Deep Learning Prediction of Overall Survival in Non-Small-Cell Lung Cancer Using Contrast-Enhanced Computed Tomography

Simple Summary

The five-year survival rate of non-small-cell lung cancer (NSCLC), which accounts for 85% of all lung cancer cases, is only 10–20%. A reliable prediction model of overall survival (OS) that integrates imaging and clinical data is required. Overall, 492 patients with NSCLC from two hospitals were enrolled in this study. The compensation method was applied to reduce the variation of imaging features among different hospitals. We constructed a deep learning prediction model, DeepSurv, based on computed tomography radiomics and key clinical features to generate a personalized survival curve for each patient. The results of DeepSurv showed a good performance in discriminating high and low risk of survival. Furthermore, the generated personalized survival curves could be intuitively applied for individual OS prediction in clinical practice. We concluded that the proposed prediction model could benefit physicians, patients, and caregivers in managing NSCLC and facilitate personalized medicine.

Abstract

Patient outcomes of non-small-cell lung cancer (NSCLC) vary because of tumor heterogeneity and treatment strategies. This study aimed to construct a deep learning model combining both radiomic and clinical features to predict the overall survival of patients with NSCLC. To improve the reliability of the proposed model, radiomic analysis complying with the Image Biomarker Standardization Initiative and the compensation approach to integrate multicenter datasets were performed on contrast-enhanced computed tomography (CECT) images. Pretreatment CECT images and the clinical data of 492 patients with NSCLC from two hospitals were collected. The deep neural network architecture, DeepSurv, with the input of radiomic and clinical features was employed. The performance of survival prediction model was assessed using the C-index and area under the curve (AUC) 8, 12, and 24 months after diagnosis. The performance of survival prediction that combined eight radiomic features and five clinical features outperformed that solely based on radiomic or clinical features. The C-index values of the combined model achieved 0.74, 0.75, and 0.75, respectively, and AUC values of 0.76, 0.74, and 0.73, respectively, 8, 12, and 24 months after diagnosis. In conclusion, combining the traits of pretreatment CECT images, lesion characteristics, and treatment strategies could effectively predict the survival of patients with NSCLC using a deep learning model.

Applications of Artificial Intelligence Based on Medical Imaging in Glioma: Current State and Future Challenges

Glioma is one of the most fatal primary brain tumors, and it is well-known for its difficulty in diagnosis and management. Medical imaging techniques such as magnetic resonance imaging (MRI), positron emission tomography (PET), and spectral imaging can efficiently aid physicians in diagnosing, treating, and evaluating patients with gliomas. With the increasing clinical records and digital images, the application of artificial intelligence (AI) based on medical imaging has reduced the burden on physicians treating gliomas even further. This review will classify AI technologies and procedures used in medical imaging analysis. Additionally, we will discuss the applications of AI in glioma, including tumor segmentation and classification, prediction of genetic markers, and prediction of treatment response and prognosis, using MRI, PET, and spectral imaging. Despite the benefits of AI in clinical applications, several issues such as data management, incomprehension, safety, clinical efficacy evaluation, and ethical or legal considerations, remain to be solved. In the future, doctors and researchers should collaborate to solve these issues, with a particular emphasis on interdisciplinary teamwork.

A multimodal domain adaptive segmentation framework for IDH genotype prediction

PURPOSE

The gene mutation status of isocitrate dehydrogenase (IDH) in gliomas leads to a different prognosis. It is challenging to perform automated tumor segmentation and genotype prediction directly using label-deprived multimodal magnetic resonance (MR) images. We propose a novel framework that employs a domain adaptive mechanism to address this issue.

METHODS

Multimodal domain adaptive segmentation (MDAS) framework was proposed to solve the gap issue in cross dataset model transfer. Image translation was used to adaptively align the multimodal data from two domains at the image level, and segmentation consistency loss was proposed to retain more pathological information through semantic constraints. The data distribution between the labeled public dataset and label-free target dataset was learned to achieve better unsupervised segmentation results on the target dataset. Then, the segmented tumor foci were used as a mask to extract the radiomics and deep features. And the subsequent prediction of IDH gene mutation status was conducted by training a random forest classifier. The prediction model does not need any expert segmented labels.

RESULTS

We implemented our method on the public BraTS 2019 dataset and 110 astrocytoma cases of grade II-IV brain tumors from our hospital. We obtained a Dice score of 77.41% for unsupervised tumor segmentation, a genotype prediction accuracy (ACC) of 0.7639 and an area under curve (AUC) of 0.8600. Experimental results demonstrate that our domain adaptive approach outperforms the methods utilizing direct transfer learning. The model using hybrid features gives better results than the model using radiomics or deep features alone.

CONCLUSIONS

Domain adaptation enables the segmentation network to achieve better performance, and the extraction of mixed features at multiple levels on the segmented region of interest ensures effective prediction of the IDH gene mutation status.