Residual Convolutional Neural Network for the Determination of IDH Status in Low- and High-Grade Gliomas from MR Imaging

Diffusion-weighted MRI precisely predicts telomerase reverse transcriptase promoter mutation status in World Health Organization grade IV gliomas using a residual convolutional neural network

OBJECTIVES

Telomerase reverse transcriptase promoter (pTERT) mutation status plays a key role in making decisions and predicting prognoses for patients with World Health Organization (WHO) grade IV glioma. This study was conducted to assess the value of diffusion-weighted imaging (DWI) for predicting pTERT mutation status in WHO grade IV glioma.

METHODS

MRI data and molecular information were obtained for 266 patients with WHO grade IV glioma at the hospital and divided into training and validation sets. The ratio of training to validation set was approximately 10:3. We trained the same residual convolutional neural network (ResNet) for each MR modality, including structural MRIs (T1-weighted, T2-weighted, and contrast-enhanced T1-weighted) and DWI*, to compare the predictive capacities between DWI and conventional structural MRI. We also explored the effects of different regions of interest on pTERT mutation status prediction outcomes.

RESULTS

Structural MRI modalities poorly predicted the pTERT mutation status (accuracy = 51%-54%; area under the curve [AUC]=0.545-0.571), whereas DWI combined with its apparent diffusive coefficient maps yielded the best predictive performance (accuracy = 85.2%, AUC = 0.934). Including the radiological and clinical characteristics did not further improve the performance for predicting pTERT mutation status. The entire tumour volume yielded the best prediction performance.

CONCLUSIONS

DWI technology shows promising potential for predicting pTERT mutations in WHO grade IV glioma and should be included in the MRI protocol for WHO grade IV glioma in clinical practice.

ADVANCES IN KNOWLEDGE

This is the first large-scale model study to validate the predictive value of DWI for pTERT in WHO grade IV glioma.

Artificial Intelligence for Response Assessment in Neuro Oncology (AI-RANO), part 1: review of current advancements

The development, application, and benchmarking of artificial intelligence (AI) tools to improve diagnosis, prognostication, and therapy in neuro-oncology are increasing at a rapid pace. This Policy Review provides an overview and critical assessment of the work to date in this field, focusing on diagnostic AI models of key genomic markers, predictive AI models of response before and after therapy, and differentiation of true disease progression from treatment-related changes, which is a considerable challenge based on current clinical care in neuro-oncology. Furthermore, promising future directions, including the use of AI for automated response assessment in neuro-oncology, are discussed.

-New frontiers in domain-inspired radiomics and radiogenomics: increasing role of molecular diagnostics in CNS tumor classification and grading following WHO CNS-5 updates

Gliomas and Glioblastomas represent a significant portion of central nervous system (CNS) tumors associated with high mortality rates and variable prognosis. In 2021, the World Health Organization (WHO) updated its Glioma classification criteria, most notably incorporating molecular markers including CDKN2A/B homozygous deletion, TERT promoter mutation, EGFR amplification, + 7/-10 chromosome copy number changes, and others into the grading and classification of adult and pediatric Gliomas. The inclusion of these markers and the corresponding introduction of new Glioma subtypes has allowed for more specific tailoring of clinical interventions and has inspired a new wave of Radiogenomic studies seeking to leverage medical imaging information to explore the diagnostic and prognostic implications of these new biomarkers. Radiomics, deep learning, and combined approaches have enabled the development of powerful computational tools for MRI analysis correlating imaging characteristics with various molecular biomarkers integrated into the updated WHO CNS-5 guidelines. Recent studies have leveraged these methods to accurately classify Gliomas in accordance with these updated molecular-based criteria based solely on non-invasive MRI, demonstrating the great promise of Radiogenomic tools. In this review, we explore the relative benefits and drawbacks of these computational frameworks and highlight the technical and clinical innovations presented by recent studies in the landscape of fast evolving molecular-based Glioma subtyping. Furthermore, the potential benefits and challenges of incorporating these tools into routine radiological workflows, aiming to enhance patient care and optimize clinical outcomes in the evolving field of CNS tumor management, have been highlighted.

Medical image foundation models in assisting diagnosis of brain tumors: a pilot study

OBJECTIVES

To build self-supervised foundation models for multicontrast MRI of the whole brain and evaluate their efficacy in assisting diagnosis of brain tumors.

METHODS

In this retrospective study, foundation models were developed using 57,621 enhanced head MRI scans through self-supervised learning with a pretext task of cross-contrast context restoration with two different content dropout schemes. Downstream classifiers were constructed based on the pretrained foundation models and fine-tuned for brain tumor detection, discrimination, and molecular status prediction. Metrics including accuracy, sensitivity, specificity, and area under the ROC curve (AUC) were used to evaluate the performance. Convolutional neural networks trained exclusively on downstream task data were employed for comparative analysis.

RESULTS

The pretrained foundation models demonstrated their ability to extract effective representations from multicontrast whole-brain volumes. The best classifiers, endowed with pretrained weights, showed remarkable performance with accuracies of 94.9, 92.3, and 80.4%, and corresponding AUC values of 0.981, 0.972, and 0.852 on independent test datasets in brain tumor detection, discrimination, and molecular status prediction, respectively. The classifiers with pretrained weights outperformed the convolutional classifiers trained from scratch by approximately 10% in terms of accuracy and AUC across all tasks. The saliency regions in the correctly predicted cases are mainly clustered around the tumors. Classifiers derived from the two dropout schemes differed significantly only in the detection of brain tumors.

CONCLUSIONS

Foundation models obtained from self-supervised learning have demonstrated encouraging potential for scalability and interpretability in downstream brain tumor-related tasks and hold promise for extension to neurological diseases with diffusely distributed lesions.

CLINICAL RELEVANCE STATEMENT

The application of our proposed method to the prediction of key molecular status in gliomas is expected to improve treatment planning and patient outcomes. Additionally, the foundation model we developed could serve as a cornerstone for advancing AI applications in the diagnosis of brain-related diseases.

PTPN7 mediates macrophage-polarization and determines immunotherapy in gliomas: A single-cell sequencing analysis

BACKGROUND

Protein tyrosine phosphatase non-receptor type 7 (PTPN7) is a signaling molecule that regulates a multitude of cellular processes, spanning cell proliferation, cellular differentiation, the mitotic cycle, and oncogenic metamorphosis. However, the characteristic of PTPN7 in the glioma microenvironment has yet to be elucidated.

METHODS

The prognostic value, genomic features, immune characteristics, chemotherapy prediction, and immunotherapy prediction of PTPN7 were systematically explored at the bulk sequencing level. The cell evolution trajectory, cell communication pattern, and cell metabolic activity related to PTPN7 were systematically explored at the single-cell sequencing level. HMC3 and M0 cells were cocultured with U251 and T98G cells, and flow cytometry was carried out to investigate the polarization of HMC3 and M0. Transwell assay and CCK-8 assay were performed to explore the migration and proliferation activity of U251 and T98G.

RESULTS

The expression level of PTPN7 is significantly elevated in glioma and indicates malignant features. PTPN7 expression predicts worse prognosis of glioma patients. PTPN7 is associated with genome alteration and immune infiltration. Besides, PTPN7 plays a crucial role in modulating metabolic and immunogenic processes, particularly by influencing the activity of microglia and macrophages through multiple signaling pathways involved in cellular communication. Specifically, PTPN7 actively mediates inflammation-resolving-polarization of macrophages and microglia and protects glioma from immune attack. PTPN7 could also predict the response of immunotherapy.

CONCLUSIONS

PTPN7 is critically involved in inflammation-resolving-polarization mediated by macrophage and microglia and promotes the immune escape of glioma cells.

Preoperative CT-based radiomics and deep learning model for predicting risk stratification of gastric gastrointestinal stromal tumors

BACKGROUND

Gastrointestinal stromal tumors (GISTs) are clinically heterogeneous with various malignant potential in different individuals. It is crucial to explore a reliable method for preoperative risk stratification of gastric GISTs noninvasively.

PURPOSE

To establish and evaluate a machine learning model using the combination of computed tomography (CT) morphology, radiomics, and deep learning features to predict the risk stratification of primary gastric GISTs preoperatively.

METHODS

The 193 gastric GISTs lesions were randomly divided into training set, validation set, and test set in a ratio of 6:2:2. The qualitative and quantitative CT morphological features were assessed by two radiologists. The tumors were segmented manually, and then radiomic features were extracted using PyRadiomics and the deep learning features were extracted using pre-trained Resnet50 from arterial phase and venous phase CT images, respectively. Pearson correlation analysis and recursive feature elimination were used for feature selection. Support vector machines were employed to build a classifier for predicting the risk stratification of GISTs. This study compared the performance of models using different pre-trained convolutional neural networks (CNNs) to extract deep features for classification, as well as the performance of modeling features from single-phase and dual-phase images. The arterial phase, venous phase and dual-phase machine learning models were built, respectively, and the morphological features were added to the dual-phase machine learning model to construct a combined model. Receiver operating characteristic (ROC) curves were used to evaluate the efficacy of each model. The clinical application value of the combined model was determined through the decision curve analysis (DCA) and the net reclassification index (NRI) was analyzed.

RESULTS

The area under the curve (AUC) of the dual-phase machine learning model was 0.876, which was higher than that of the arterial phase model or venous phase model (0.813, 0.838, respectively). The combined model had best predictive performance than the above models with an AUC of 0.941 (95% CI: 0.887-0.974) (p = 0.012, Delong test). DCA demonstrated that the combined model had good clinical application value with an NRI of 0.575 (95% CI: 0.357-0.891).

CONCLUSION

In this study, we established a combined model that incorporated dual-phase morphology, radiomics, and deep learning characteristics, which can be used to predict the preoperative risk stratification of gastric GISTs.

Resource requirements to accelerate clinical applications of next-generation sequencing and radiomics: workshop commentary and review

The National Institutes of Health-US Food and Drug Administration Joint Leadership Council Next-Generation Sequencing and Radiomics Working Group was formed by the National Institutes of Health-Food and Drug Administration Joint Leadership Council to promote the development and validation of innovative next-generation sequencing tests, radiomic tools, and associated data analysis and interpretation enhanced by artificial intelligence and machine learning technologies. A 2-day workshop was held on September 29-30, 2021, to convene members of the scientific community to discuss how to overcome the "ground truth" gap that has frequently been acknowledged as 1 of the limiting factors impeding high-quality research, development, validation, and regulatory science in these fields. This report provides a summary of the resource gaps identified by the working group and attendees, highlights existing resources and the ways they can potentially be employed to accelerate growth in these fields, and presents opportunities to support next-generation sequencing and radiomic tool development and validation using technologies such as artificial intelligence and machine learning.

Leveraging State-of-the-Art AI Algorithms in Personalized Oncology: From Transcriptomics to Treatment

BACKGROUND

Continuous breakthroughs in computational algorithms have positioned AI-based models as some of the most sophisticated technologies in the healthcare system. AI shows dynamic contributions in advancing various medical fields involving data interpretation and monitoring, imaging screening and diagnosis, and treatment response and survival prediction. Despite advances in clinical oncology, more effort must be employed to tailor therapeutic plans based on each patient's unique transcriptomic profile within the precision/personalized oncology frame. Furthermore, the standard analysis method is not compatible with the comprehensive deciphering of significant data streams, thus precluding the prediction of accurate treatment options.

METHODOLOGY

We proposed a novel approach that includes obtaining different tumour tissues and preparing RNA samples for comprehensive transcriptomic interpretation using specifically trained, programmed, and optimized AI-based models for extracting large data volumes, refining, and analyzing them. Next, the transcriptomic results will be scanned against an expansive drug library to predict the response of each target to the tested drugs. The obtained target-drug combination/s will be then validated using in vitro and in vivo experimental models. Finally, the best treatment combination option/s will be introduced to the patient. We also provided a comprehensive review discussing AI models' recent innovations and implementations to aid in molecular diagnosis and treatment planning.

RESULTS

The expected transcriptomic analysis generated by the AI-based algorithms will provide an inclusive genomic profile for each patient, containing statistical and bioinformatics analyses, identification of the dysregulated pathways, detection of the targeted genes, and recognition of molecular biomarkers. Subjecting these results to the prediction and pairing AI-based processes will result in statistical graphs presenting each target's likely response rate to various treatment options. Different in vitro and in vivo investigations will further validate the selection of the target drug/s pairs.

CONCLUSIONS

Leveraging AI models will provide more rigorous manipulation of large-scale datasets on specific cancer care paths. Such a strategy would shape treatment according to each patient's demand, thus fortifying the avenue of personalized/precision medicine. Undoubtedly, this will assist in improving the oncology domain and alleviate the burden of clinicians in the coming decade.

Integrated diagnosis of glioma based on magnetic resonance images with incomplete ground truth labels

BACKGROUND

Since the 2016 WHO guidelines, glioma diagnosis has entered an era of integrated diagnosis, combining tissue pathology and molecular pathology. The WHO has focused on promoting the application of molecular diagnosis in the classification of central nervous system tumors. Genetic information such as IDH1 and 1p/19q are important molecular markers, and pathological grading is also a key clinical indicator. However, obtaining genetic pathology labels is more costly than conventional MRI images, resulting in a large number of missing labels in realistic modeling.

METHOD

We propose a training strategy based on label encoding and a corresponding loss function to enable the model to effectively utilize data with missing labels. Additionally, we integrate a graph model with genes and pathology-related clinical prior knowledge into the ResNet backbone to further improve the efficacy of diagnosis. Ten-fold cross-validation experiments were conducted on a large dataset of 1072 patients.

RESULTS

The classification area under the curve (AUC) values are 0.93, 0.91, and 0.90 for IDH1, 1p/19q status, and grade (LGG/HGG), respectively. When the label miss rate reached 59.3 %, the method improved the AUC by 0.09, 0.10, and 0.04 for IDH1, 1p/19q, and pathological grade, respectively, compared to the same backbone without the missing label strategy.

CONCLUSIONS

Our method effectively utilizes data with missing labels and integrates clinical prior knowledge, resulting in improved diagnostic performance for glioma genetic and pathological markers, even with high rates of missing labels.

MR-Based Radiomics Predicts CDK6 Expression and Prognostic Value in High-grade Glioma

RATIONALE AND OBJECTIVES

This study aims to assess the prognostic value of Cyclin-dependent kinases 6 (CDK6) expression levels and establish a machine learning-based radiomics model for predicting the expression levels of CDK6 in high-grade gliomas (HGG).

MATERIALS AND METHODS

Clinical parameters and genomic data were extracted from 310 HGG patients in the Cancer Genome Atlas (TCGA) database and 27 patients in the Repository of Molecular Brain Neoplasia Data (REMBRANDT) database. Univariate and multivariate Cox regression, as well as Kaplan-Meier analysis, were performed for prognosis analysis. The correlation between immune cell Infiltration with CDK6 was assessed using spearman correlation analysis. Radiomic features were extracted from contrast-enhanced magnetic resonance imaging (CE-MRI) in the Cancer Imaging Archive (TCIA) database (n = 82) and REMBRANDT database (n = 27). Logistic regression (LR) and support vector machine (SVM) were employed to establish the radiomics model for predicting CDK6 expression. Receiver operating characteristic curve (ROC), calibration curve, and decision curve analysis (DCA) were utilized to assess the predictive performance of the radiomics model. Generate radiomic scores (RS) based on the LR model. An RS-based nomogram was constructed to predict the prognosis of HGG.

RESULTS

CDK6 was significantly overexpressed in HGG tissues and was related to lower overall survival. A significant elevation in infiltrating M0 macrophages was observed in the CDK6 high group (P < 0.001). The LR radiomics model for the prediction of CDK6 expression levels (AUC=0.810 in the training cohort, AUC = 0.784 after cross-validation, AUC=0.750 in the testing cohort) was established utilizing three radiomic features. The predictive efficiencies of the RS-based nomogram, as measured by AUC, were 0.769 for 1-year, 0.815 for 3-year, and 0.780 for 5-year, respectively.

CONCLUSION

The expression level of CDK6 can impact the prognosis of patients with HGG. The expression level of HGG can be noninvasively prognosticated utilizing a radiomics model.

Patient-Specific, Mechanistic Models of Tumor Growth Incorporating Artificial Intelligence and Big Data

Despite the remarkable advances in cancer diagnosis, treatment, and management over the past decade, malignant tumors remain a major public health problem. Further progress in combating cancer may be enabled by personalizing the delivery of therapies according to the predicted response for each individual patient. The design of personalized therapies requires the integration of patient-specific information with an appropriate mathematical model of tumor response. A fundamental barrier to realizing this paradigm is the current lack of a rigorous yet practical mathematical theory of tumor initiation, development, invasion, and response to therapy. We begin this review with an overview of different approaches to modeling tumor growth and treatment, including mechanistic as well as data-driven models based on big data and artificial intelligence. We then present illustrative examples of mathematical models manifesting their utility and discuss the limitations of stand-alone mechanistic and data-driven models. We then discuss the potential of mechanistic models for not only predicting but also optimizing response to therapy on a patient-specific basis. We describe current efforts and future possibilities to integrate mechanistic and data-driven models. We conclude by proposing five fundamental challenges that must be addressed to fully realize personalized care for cancer patients driven by computational models.

Generative AI in glioma: Ensuring diversity in training image phenotypes to improve diagnostic performance for IDH mutation prediction

BACKGROUND

This study evaluated whether generative artificial intelligence (AI)-based augmentation (GAA) can provide diverse and realistic imaging phenotypes and improve deep learning-based classification of isocitrate dehydrogenase (IDH) type in glioma compared with neuroradiologists.

METHODS

For model development, 565 patients (346 IDH-wildtype, 219 IDH-mutant) with paired contrast-enhanced T1 and FLAIR MRI scans were collected from tertiary hospitals and The Cancer Imaging Archive. Performance was tested on internal (119, 78 IDH-wildtype, 41 IDH-mutant [IDH1 and 2]) and external test sets (108, 72 IDH-wildtype, 36 IDH-mutant). GAA was developed using a score-based diffusion model and ResNet50 classifier. The optimal GAA was selected in comparison with the null model. Two neuroradiologists (R1, R2) assessed realism, diversity of imaging phenotypes, and predicted IDH mutation. The performance of a classifier trained with optimal GAA was compared with that of neuroradiologists using the area under the receiver operating characteristics curve (AUC). The effect of tumor size and contrast enhancement on GAA performance was tested.

RESULTS

Generated images demonstrated realism (Turing's test: 47.5-50.5%) and diversity indicating IDH type. Optimal GAA was achieved with augmentation with 110 000 generated slices (AUC: 0.938). The classifier trained with optimal GAA demonstrated significantly higher AUC values than neuroradiologists in both the internal (R1, P = .003; R2, P < .001) and external test sets (R1, P < .01; R2, P < .001). GAA with large-sized tumors or predominant enhancement showed comparable performance to optimal GAA (internal test: AUC 0.956 and 0.922; external test: 0.810 and 0.749).

CONCLUSIONS

The application of generative AI with realistic and diverse images provided better diagnostic performance than neuroradiologists for predicting IDH type in glioma.

Noninvasive Isocitrate Dehydrogenase 1 Status Prediction in Grade II/III Glioma Based on Magnetic Resonance Images: A Transfer Learning Strategy

OBJECTIVE

The aim of this study was to evaluate transfer learning combined with various convolutional neural networks (TL-CNNs) in predicting isocitrate dehydrogenase 1 ( IDH1 ) status of grade II/III gliomas.

METHODS

Grade II/III glioma patients diagnosed at the Tangdu Hospital (August 2009 to May 2017) were retrospectively enrolled, including 54 patients with IDH1 mutant and 56 patients with wild-type IDH1 . Convolutional neural networks, AlexNet, GoogLeNet, ResNet, and VGGNet were fine-tuned with T2-weighted imaging (T2WI), fluid attenuation inversion recovery (FLAIR), and contrast-enhanced T1-weighted imaging (T1CE) images. The single-modal networks were integrated with averaged sigmoid probabilities, logistic regression, and support vector machine. FLAIR-T1CE-fusion (FC-fusion), T2WI-T1CE-fusion (TC-fusion), and FLAIR-T2WI-T1CE-fusion (FTC-fusion) were used for fine-tuning TL-CNNs.

RESULTS

IDH1 -mutant prediction accuracies using AlexNet, GoogLeNet, ResNet, and VGGNet achieved 70.0% (AUC = 0.660), 65.0% (AUC = 0.600), 70.0% (AUC = 0.700), and 80.0% (AUC = 0.730) for T2WI images, 70.0% (AUC = 0.660), 70.0% (AUC = 0.620), 70.0% (AUC = 0.710), and 80.0% (AUC = 0.720) for FLAIR images, and 73.7% (AUC = 0.744), 73.7% (AUC = 0.656), 73.7% (AUC = 0.633), and 73.7% (AUC = 0.700) for T1CE images, respectively. The highest AUC (0.800) was achieved using VGGNet and FC-fusion images.

CONCLUSIONS

TL-CNNs (especially VGGNet) had a potential predictive value for IDH1 -mutant status of grade II/III gliomas.

TGIF2 is a potential biomarker for diagnosis and prognosis of glioma

Background

TGFB-induced factor homeobox 2 (TGIF2), a member of the Three-Amino-acid-Loop-Extension (TALE) superfamily, has been implicated in various malignant tumors. However, its prognostic significance in glioma, impact on tumor immune infiltration, and underlying mechanisms in glioma development remain elusive.

Methods

The expression of TGIF2 in various human normal tissues, normal brain tissues, and gliomas was investigated using HPA, TCGA, GTEx, and GEO databases. The study employed several approaches, including Kaplan-Meier analysis, ROC analysis, logistic regression, Cox regression, GO analysis, KEGG analysis, and GSEA, to explore the relationship between TGIF2 expression and clinicopathologic features, prognostic value, and potential biological functions in glioma patients. The impact of TGIF2 on tumor immune infiltration was assessed through Estimate, ssGSEA, and Spearman analysis. Genes coexpressed with TGIF2 were identified, and the protein-protein interaction (PPI) network of these coexpressed genes were constructed using the STRING database and Cytoscape software. Hub genes were identified using CytoHubba plugin, and their clinical predictive value was explored. Furthermore, in vitro experiments were performed by knocking down and knocking out TGIF2 using siRNA and CRISPR/Cas9 gene editing, and the role of TGIF2 in glioma cell invasion and migration was analyzed using transwell assay, scratch wound-healing assay, RT-qPCR, and Western blot.

Results

TGIF2 mRNA was found to be upregulated in 21 cancers, including glioma. High expression of TGIF2 was associated with malignant phenotypes and poor prognosis in glioma patients, indicating its potential as an independent prognostic factor. Furthermore, elevated TGIF2 expression positively correlated with cell cycle regulation, DNA synthesis and repair, extracellular matrix (ECM) components, immune response, and several signaling pathways that promote tumor progression. TGIF2 showed correlations with Th2 cells, macrophages, and various immunoregulatory genes. The hub genes coexpressed with TGIF2 demonstrated significant predictive value. Additionally, in vitro experiments revealed that knockdown and knockout of TGIF2 inhibited glioma cell invasion, migration and suppressed the epithelial-mesenchymal transition (EMT) phenotype.

Conclusion

TGIF2 emerges as a potential biomarker for glioma, possibly linked to tumor immune infiltration and EMT.

A subregion-based RadioFusionOmics model discriminates between grade 4 astrocytoma and glioblastoma on multisequence MRI

PURPOSE

To explore a subregion-based RadioFusionOmics (RFO) model for discrimination between adult-type grade 4 astrocytoma and glioblastoma according to the 2021 WHO CNS5 classification.

METHODS

329 patients (40 grade 4 astrocytomas and 289 glioblastomas) with histologic diagnosis was retrospectively collected from our local institution and The Cancer Imaging Archive (TCIA). The volumes of interests (VOIs) were obtained from four multiparametric MRI sequences (T1WI, T1WI + C, T2WI, T2-FLAIR) using (1) manual segmentation of the non-enhanced tumor (nET), enhanced tumor (ET), and peritumoral edema (pTE), and (2) K-means clustering of four habitats (H1: high T1WI + C, high T2-FLAIR; (2) H2: high T1WI + C, low T2-FLAIR; (3) H3: low T1WI + C, high T2-FLAIR; and (4) H4: low T1WI + C, low T2-FLAIR). The optimal VOI and best MRI sequence combination were determined. The performance of the RFO model was evaluated using the area under the precision-recall curve (AUPRC) and the best signatures were identified.

RESULTS

The two best VOIs were manual VOI3 (putative peritumoral edema) and clustering H34 (low T1WI + C, high T2-FLAIR (H3) combined with low T1WI + C and low T2-FLAIR (H4)). Features fused from four MRI sequences ([Formula: see text]) outperformed those from either a single sequence or other sequence combinations. The RFO model that was trained using fused features [Formula: see text] achieved the AUPRC of 0.972 (VOI3) and 0.976 (H34) in the primary cohort (p = 0.905), and 0.971 (VOI3) and 0.974 (H34) in the testing cohort (p = 0.402).

CONCLUSION

The performance of subregions defined by clustering was comparable to that of subregions that were manually defined. Fusion of features from the edematous subregions of multiple MRI sequences by the RFO model resulted in differentiation between grade 4 astrocytoma and glioblastoma.

Brain Tumor Imaging without Gadolinium-based Contrast Agents: Feasible or Fantasy?

Gadolinium-based contrast agents (GBCAs) form the cornerstone of current primary brain tumor MRI protocols at all stages of the patient journey. Though an imperfect measure of tumor grade, GBCAs are repeatedly used for diagnosis and monitoring. In practice, however, radiologists will encounter situations where GBCA injection is not needed or of doubtful benefit. Reducing GBCA administration could improve the patient burden of (repeated) imaging (especially in vulnerable patient groups, such as children), minimize risks of putative side effects, and benefit costs, logistics, and the environmental footprint. On the basis of the current literature, imaging strategies to reduce GBCA exposure for pediatric and adult patients with primary brain tumors will be reviewed. Early postoperative MRI and fixed-interval imaging of gliomas are examples of GBCA exposure with uncertain survival benefits. Half-dose GBCAs for gliomas and T2-weighted imaging alone for meningiomas are among options to reduce GBCA use. While most imaging guidelines recommend using GBCAs at all stages of diagnosis and treatment, non-contrast-enhanced sequences, such as the arterial spin labeling, have shown a great potential. Artificial intelligence methods to generate synthetic postcontrast images from decreased-dose or non-GBCA scans have shown promise to replace GBCA-dependent approaches. This review is focused on pediatric and adult gliomas and meningiomas. Special attention is paid to the quality and real-life applicability of the reviewed literature.

A Fully Automated Deep-Learning Model for Predicting the Molecular Subtypes of Posterior Fossa Ependymomas Using T2-Weighted Images

PURPOSE

We aimed to develop and validate a deep learning (DL) model to automatically segment posterior fossa ependymoma (PF-EPN) and predict its molecular subtypes [Group A (PFA) and Group B (PFB)] from preoperative MR images.

EXPERIMENTAL DESIGN

We retrospectively identified 227 PF-EPNs (development and internal test sets) with available preoperative T2-weighted (T2w) MR images and molecular status to develop and test a 3D nnU-Net (referred to as T2-nnU-Net) for tumor segmentation and molecular subtype prediction. The network was externally tested using an external independent set [n = 40; subset-1 (n = 31) and subset-2 (n =9)] and prospectively enrolled cases [prospective validation set (n = 27)]. The Dice similarity coefficient was used to evaluate the segmentation performance. Receiver operating characteristic analysis for molecular subtype prediction was performed.

RESULTS

For tumor segmentation, the T2-nnU-Net achieved a Dice score of 0.94 ± 0.02 in the internal test set. For molecular subtype prediction, the T2-nnU-Net achieved an AUC of 0.93 and accuracy of 0.89 in the internal test set, an AUC of 0.99 and accuracy of 0.93 in the external test set. In the prospective validation set, the model achieved an AUC of 0.93 and an accuracy of 0.89. The predictive performance of T2-nnU-Net was superior or comparable to that of demographic and multiple radiologic features (AUCs ranging from 0.87 to 0.95).

CONCLUSIONS

A fully automated DL model was developed and validated to accurately segment PF-EPNs and predict molecular subtypes using only T2w MR images, which could help in clinical decision-making.

Convolutional Neural Networks for Glioma Segmentation and Prognosis: A Systematic Review

Deep learning (DL) is poised to redefine the way medical images are processed and analyzed. Convolutional neural networks (CNNs), a specific type of DL architecture, are exceptional for high-throughput processing, allowing for the effective extraction of relevant diagnostic patterns from large volumes of complex visual data. This technology has garnered substantial interest in the field of neuro-oncology as a promising tool to enhance medical imaging throughput and analysis. A multitude of methods harnessing MRI-based CNNs have been proposed for brain tumor segmentation, classification, and prognosis prediction. They are often applied to gliomas, the most common primary brain cancer, to classify subtypes with the goal of guiding therapy decisions. Additionally, the difficulty of repeating brain biopsies to evaluate treatment response in the setting of often confusing imaging findings provides a unique niche for CNNs to help distinguish the treatment response to gliomas. For example, glioblastoma, the most aggressive type of brain cancer, can grow due to poor treatment response, can appear to grow acutely due to treatment-related inflammation as the tumor dies (pseudo-progression), or falsely appear to be regrowing after treatment as a result of brain damage from radiation (radiation necrosis). CNNs are being applied to separate this diagnostic dilemma. This review provides a detailed synthesis of recent DL methods and applications for intratumor segmentation, glioma classification, and prognosis prediction. Furthermore, this review discusses the future direction of MRI-based CNN in the field of neuro-oncology and challenges in model interpretability, data availability, and computation efficiency.

Development and validation of a clinical prediction model for glioma grade using machine learning

BACKGROUND

Histopathological evaluation is currently the gold standard for grading gliomas; however, this technique is invasive.

OBJECTIVE

This study aimed to develop and validate a diagnostic prediction model for glioma by employing multiple machine learning algorithms to identify risk factors associated with high-grade glioma, facilitating the prediction of glioma grading.

METHODS

Data from 1114 eligible glioma patients were obtained from The Cancer Genome Atlas (TCGA) database, which was divided into a training set (n= 781) and a test set (n= 333). Fifty machine learning algorithms were employed, and the optimal algorithm was selected to construct a prediction model. The performance of the machine learning prediction model was compared to the clinical prediction model in terms of discrimination, calibration, and clinical validity to assess the performance of the prediction model.

RESULTS

The area under the curve (AUC) values of the machine learning prediction models (training set: 0.870 vs. 0.740, test set: 0.863 vs. 0.718) were significantly improved from the clinical prediction models. Furthermore, significant improvement in discrimination was observed for the Integrated Discrimination Improvement (IDI) (training set: 0.230, test set: 0.270) and Net Reclassification Index (NRI) (training set: 0.170, test set: 0.170) from the clinical prognostic model. Both models showed a high goodness of fit and an increased net benefit.

CONCLUSION

A strong prediction accuracy model can be developed using machine learning algorithms to screen for high-grade glioma risk predictors, which can serve as a non-invasive prediction tool for preoperative diagnostic grading of glioma.

Fractals, Pattern Recognition, Memetics, and AI: A Personal Journal in the Computational Neurosurgery

In this chapter, the personal journey of the author in many countries, including Italy, Germany, Austria, the United Kingdom, Switzerland, the United States, Canada, and Australia, is summarized, aimed to merge different translational fields (such as neurosurgery and the clinical neurosciences in general, biomedical engineering, mathematics, computer science, and cognitive sciences) and lay the foundations of a new field defined computational neurosurgery, with fractals, pattern recognition, memetics, and artificial intelligence as the common key words of the journey.

Diagnostic and Therapeutic Issues in Glioma Using Imaging Data: The Challenge of Numerical Twinning

Glial tumors represent the leading etiology of primary brain tumors. Their particularities lie in (i) their location in a highly functional organ that is difficult to access surgically, including for biopsy, and (ii) their rapid, anisotropic mode of extension, notably via the fiber bundles of the white matter, which further limits the possibilities of resection. The use of mathematical tools enables the development of numerical models representative of the oncotype, genotype, evolution, and therapeutic response of lesions. The significant development of digital technologies linked to high-resolution NMR exploration, coupled with the possibilities offered by AI, means that we can envisage the creation of digital twins of tumors and their host organs, thus reducing the use of physical sampling.

Artificial intelligence in neuro-oncology

Artificial intelligence (AI) describes the application of computer algorithms to the solution of problems that have traditionally required human intelligence. Although formal work in AI has been slowly advancing for almost 70 years, developments in the last decade, and particularly in the last year, have led to an explosion of AI applications in multiple fields. Neuro-oncology has not escaped this trend. Given the expected integration of AI-based methods to neuro-oncology practice over the coming years, we set to provide an overview of existing technologies as they are applied to the neuropathology and neuroradiology of brain tumors. We highlight current benefits and limitations of these technologies and offer recommendations on how to appraise novel AI-tools as they undergo consideration for integration into clinical workflows.

Artificial intelligence in neuroimaging of brain tumors: reality or still promise?

PURPOSE OF REVIEW

To provide an updated overview of artificial intelligence (AI) applications in neuro-oncologic imaging and discuss current barriers to wider clinical adoption.

RECENT FINDINGS

A wide variety of AI applications in neuro-oncologic imaging have been developed and researched, spanning tasks from pretreatment brain tumor classification and segmentation, preoperative planning, radiogenomics, prognostication and survival prediction, posttreatment surveillance, and differentiating between pseudoprogression and true disease progression. While earlier studies were largely based on data from a single institution, more recent studies have demonstrated that the performance of these algorithms are also effective on external data from other institutions. Nevertheless, most of these algorithms have yet to see widespread clinical adoption, given the lack of prospective studies demonstrating their efficacy and the logistical difficulties involved in clinical implementation.

SUMMARY

While there has been significant progress in AI and neuro-oncologic imaging, clinical utility remains to be demonstrated. The next wave of progress in this area will be driven by prospective studies measuring outcomes relevant to clinical practice and go beyond retrospective studies which primarily aim to demonstrate high performance.

Deep wavelet scattering orthogonal fusion network for glioma IDH mutation status prediction

Accurately predicting the isocitrate dehydrogenase (IDH) mutation status of gliomas is greatly significant for formulating appropriate treatment plans and evaluating the prognoses of gliomas. Although existing studies can accurately predict the IDH mutation status of gliomas based on multimodal magnetic resonance (MR) images and machine learning methods, most of these methods cannot fully explore multimodal information and effectively predict IDH status for datasets acquired from multiple centers. To address this issue, a novel wavelet scattering (WS)-based orthogonal fusion network (WSOFNet) was proposed in this work to predict the IDH mutation status of gliomas from multiple centers. First, transformation-invariant features were extracted from multimodal MR images with a WS network, and then the multimodal WS features were used instead of the original images as the inputs of WSOFNet and were fully fused through an adaptive multimodal feature fusion module (AMF2M) and an orthogonal projection module (OPM). Finally, the fused features were input into a fully connected classifier to predict IDH mutation status. In addition, to achieve improved prediction accuracy, four auxiliary losses were also used in the feature extraction modules. The comparison results showed that the prediction area under the curve (AUC) of WSOFNet on a single-center dataset was 0.9966 and that on a multicenter dataset was approximately 0.9655, which was at least 3.9% higher than that of state-of-the-art methods. Moreover, the ablation experimental results also proved that the adaptive multimodal feature fusion strategy based on orthogonal projection could effectively improve the prediction performance of the model, especially for an external validation dataset.

Multi-Modal Learning for Predicting the Genotype of Glioma

The isocitrate dehydrogenase (IDH) gene mutation is an essential biomarker for the diagnosis and prognosis of glioma. It is promising to better predict glioma genotype by integrating focal tumor image and geometric features with brain network features derived from MRI. Convolutional neural networks show reasonable performance in predicting IDH mutation, which, however, cannot learn from non-Euclidean data, e.g., geometric and network data. In this study, we propose a multi-modal learning framework using three separate encoders to extract features of focal tumor image, tumor geometrics and global brain networks. To mitigate the limited availability of diffusion MRI, we develop a self-supervised approach to generate brain networks from anatomical multi-sequence MRI. Moreover, to extract tumor-related features from the brain network, we design a hierarchical attention module for the brain network encoder. Further, we design a bi-level multi-modal contrastive loss to align the multi-modal features and tackle the domain gap at the focal tumor and global brain. Finally, we propose a weighted population graph to integrate the multi-modal features for genotype prediction. Experimental results on the testing set show that the proposed model outperforms the baseline deep learning models. The ablation experiments validate the performance of different components of the framework. The visualized interpretation corresponds to clinical knowledge with further validation. In conclusion, the proposed learning framework provides a novel approach for predicting the genotype of glioma.

Differentiation of lung and breast cancer brain metastases: Comparison of texture analysis and deep convolutional neural networks

PURPOSE

Metastases are the most common neoplasm in the adult brain. In order to initiate the treatment, an extensive diagnostic workup is usually required. Radiomics is a discipline aimed at transforming visual data in radiological images into reliable diagnostic information. We aimed to examine the capability of deep learning methods to classify the origin of metastatic lesions in brain MRIs and compare the deep Convolutional Neural Network (CNN) methods with image texture based features.

METHODS

One hundred forty three patients with 157 metastatic brain tumors were included in the study. The statistical and texture based image features were extracted from metastatic tumors after manual segmentation process. Three powerful pre-trained CNN architectures and the texture-based features on both 2D and 3D tumor images were used to differentiate lung and breast metastases. Ten-fold cross-validation was used for evaluation. Accuracy, precision, recall, and area under curve (AUC) metrics were calculated to analyze the diagnostic performance.

RESULTS

The texture-based image features on 3D volumes achieved better discrimination results than 2D image features. The overall performance of CNN architectures with 3D inputs was higher than the texture-based features. Xception architecture, with 3D volumes as input, yielded the highest accuracy (0.85) while the AUC value was 0.84. The AUC values of VGG19 and the InceptionV3 architectures were 0.82 and 0.81, respectively.

CONCLUSION

CNNs achieved superior diagnostic performance in differentiating brain metastases from lung and breast malignancies than texture-based image features. Differentiation using 3D volumes as input exhibited a higher success rate than 2D sagittal images.

Artificial intelligence in cancer diagnosis and therapy: Current status and future perspective

Artificial intelligence (AI) in healthcare plays a pivotal role in combating many fatal diseases, such as skin, breast, and lung cancer. AI is an advanced form of technology that uses mathematical-based algorithmic principles similar to those of the human mind for cognizing complex challenges of the healthcare unit. Cancer is a lethal disease with many etiologies, including numerous genetic and epigenetic mutations. Cancer being a multifactorial disease is difficult to be diagnosed at an early stage. Therefore, genetic variations and other leading factors could be identified in due time through AI and machine learning (ML). AI is the synergetic approach for mining the drug targets, their mechanism of action, and drug-organism interaction from massive raw data. This synergetic approach is also facing several challenges in data mining but computational algorithms from different scientific communities for multi-target drug discovery are highly helpful to overcome the bottlenecks in AI for drug-target discovery. AI and ML could be the epicenter in the medical world for the diagnosis, treatment, and evaluation of almost any disease in the near future. In this comprehensive review, we explore the immense potential of AI and ML when integrated with the biological sciences, specifically in the context of cancer research. Our goal is to illuminate the many ways in which AI and ML are being applied to the study of cancer, from diagnosis to individualized treatment. We highlight the prospective role of AI in supporting oncologists and other medical professionals in making informed decisions and improving patient outcomes by examining the intersection of AI and cancer control. Although AI-based medical therapies show great potential, many challenges must be overcome before they can be implemented in clinical practice. We critically assess the current hurdles and provide insights into the future directions of AI-driven approaches, aiming to pave the way for enhanced cancer interventions and improved patient care.

Radiomic features from multiparametric magnetic resonance imaging predict molecular subgroups of pediatric low-grade gliomas

BACKGROUND

We aimed to develop machine learning models for prediction of molecular subgroups (low-risk group and intermediate/high-risk group) and molecular marker (KIAA1549-BRAF fusion) of pediatric low-grade gliomas (PLGGs) based on radiomic features extracted from multiparametric MRI.

METHODS

61 patients with PLGGs were included in this retrospective study, which were divided into a training set and an internal validation set at a ratio of 2:1 based on the molecular subgroups or the molecular marker. The patients were classified into low-risk and intermediate/high-risk groups, BRAF fusion positive and negative groups, respectively. We extracted 5929 radiomic features from multiparametric MRI. Thereafter, we removed redundant features, trained random forest models on the training set for predicting the molecular subgroups or the molecular marker, and validated their performance on the internal validation set. The performance of the prediction model was verified by 3-fold cross-validation.

RESULTS

We constructed the classification model differentiating low-risk PLGGs from intermediate/high-risk PLGGs using 4 relevant features, with an AUC of 0.833 and an accuracy of 76.2% in the internal validation set. In the prediction model for predicting KIAA1549-BRAF fusion using 4 relevant features, an AUC of 0.818 and an accuracy of 81.0% were achieved in the internal validation set.

CONCLUSIONS

The current study demonstrates that MRI radiomics is able to predict molecular subgroups of PLGGs and KIAA1549-BRAF fusion with satisfying sensitivity.

TRIAL REGISTRATION

This study was retrospectively registered at clinicaltrials.gov (NCT04217018).

Association of partial T2-FLAIR mismatch sign and isocitrate dehydrogenase mutation in WHO grade 4 gliomas: results from the ReSPOND consortium

PURPOSE

While the T2-FLAIR mismatch sign is highly specific for isocitrate dehydrogenase (IDH)-mutant, 1p/19q-noncodeleted astrocytomas among lower-grade gliomas, its utility in WHO grade 4 gliomas is not well-studied. We derived the partial T2-FLAIR mismatch sign as an imaging biomarker for IDH mutation in WHO grade 4 gliomas.

METHODS

Preoperative MRI scans of adult WHO grade 4 glioma patients (n = 2165) from the multi-institutional ReSPOND (Radiomics Signatures for PrecisiON Diagnostics) consortium were analyzed. Diagnostic performance of the partial T2-FLAIR mismatch sign was evaluated. Subset analyses were performed to assess associations of imaging markers with overall survival (OS).

RESULTS

One hundred twenty-one (5.6%) of 2165 grade 4 gliomas were IDH-mutant. Partial T2-FLAIR mismatch was present in 40 (1.8%) cases, 32 of which were IDH-mutant, yielding 26.4% sensitivity, 99.6% specificity, 80.0% positive predictive value, and 95.8% negative predictive value. Multivariate logistic regression demonstrated IDH mutation was significantly associated with partial T2-FLAIR mismatch (odds ratio [OR] 5.715, 95% CI [1.896, 17.221], p = 0.002), younger age (OR 0.911 [0.895, 0.927], p < 0.001), tumor centered in frontal lobe (OR 3.842, [2.361, 6.251], p < 0.001), absence of multicentricity (OR 0.173, [0.049, 0.612], p = 0.007), and presence of cystic (OR 6.596, [3.023, 14.391], p < 0.001) or non-enhancing solid components (OR 6.069, [3.371, 10.928], p < 0.001). Multivariate Cox analysis demonstrated cystic components (p = 0.024) and non-enhancing solid components (p = 0.003) were associated with longer OS, while older age (p < 0.001), frontal lobe center (p = 0.008), multifocality (p < 0.001), and multicentricity (p < 0.001) were associated with shorter OS.

CONCLUSION

Partial T2-FLAIR mismatch sign is highly specific for IDH mutation in WHO grade 4 gliomas.

Deep Learning for Noninvasive Assessment of H3 K27M Mutation Status in Diffuse Midline Gliomas Using MR Imaging

BACKGROUND

Determination of H3 K27M mutation in diffuse midline glioma (DMG) is key for prognostic assessment and stratifying patient subgroups for clinical trials. MRI can noninvasively depict morphological and metabolic characteristics of H3 K27M mutant DMG.

PURPOSE

This study aimed to develop a deep learning (DL) approach to noninvasively predict H3 K27M mutation in DMG using T2-weighted images.

STUDY TYPE

Retrospective and prospective.

POPULATION

For diffuse midline brain gliomas, 341 patients from Center-1 (27 ± 19 years, 184 males), 42 patients from Center-2 (33 ± 19 years, 27 males) and 35 patients (37 ± 18 years, 24 males). For diffuse spinal cord gliomas, 133 patients from Center-1 (30 ± 15 years, 80 males).

FIELD STRENGTH/SEQUENCE

5T and 3T, T2-weighted turbo spin echo imaging.

ASSESSMENT

Conventional radiological features were independently reviewed by two neuroradiologists. H3 K27M status was determined by histopathological examination. The Dice coefficient was used to evaluate segmentation performance. Classification performance was evaluated using accuracy, sensitivity, specificity, and area under the curve.

STATISTICAL TESTS

Pearson's Chi-squared test, Fisher's exact test, two-sample Student's t-test and Mann-Whitney U test. A two-sided P value <0.05 was considered statistically significant.

RESULTS

In the testing cohort, Dice coefficients of tumor segmentation using DL were 0.87 for diffuse midline brain and 0.81 for spinal cord gliomas. In the internal prospective testing dataset, the predictive accuracies, sensitivities, and specificities of H3 K27M mutation status were 92.1%, 98.2%, 82.9% in diffuse midline brain gliomas and 85.4%, 88.9%, 82.6% in spinal cord gliomas. Furthermore, this study showed that the performance generalizes to external institutions, with predictive accuracies of 85.7%-90.5%, sensitivities of 90.9%-96.0%, and specificities of 82.4%-83.3%.

DATA CONCLUSION

In this study, an automatic DL framework was developed and validated for accurately predicting H3 K27M mutation using T2-weighted images, which could contribute to the noninvasive determination of H3 K27M status for clinical decision-making.

EVIDENCE LEVEL

2 Technical Efficacy: Stage 2.

Radiogenomics: a key component of precision cancer medicine

Radiogenomics, focusing on the relationship between genomics and imaging phenotypes, has been widely applied to address tumour heterogeneity and predict immune responsiveness and progression. It is an inevitable consequence of current trends in precision medicine, as radiogenomics costs less than traditional genetic sequencing and provides access to whole-tumour information rather than limited biopsy specimens. By providing voxel-by-voxel genetic information, radiogenomics can allow tailored therapy targeting a complete, heterogeneous tumour or set of tumours. In addition to quantifying lesion characteristics, radiogenomics can also be used to distinguish benign from malignant entities, as well as patient characteristics, to better stratify patients according to disease risk, thereby enabling more precise imaging and screening. Here, we have characterised the radiogenomic application in precision medicine using a multi-omic approach. we outline the main applications of radiogenomics in diagnosis, treatment planning and evaluations in the field of oncology with the aim of developing quantitative and personalised medicine. Finally, we discuss the challenges in the field of radiogenomics and the scope and clinical applicability of these methods.

Deep-learning and conventional radiomics to predict IDH genotyping status based on magnetic resonance imaging data in adult diffuse glioma

Objectives

In adult diffuse glioma, preoperative detection of isocitrate dehydrogenase (IDH) status helps clinicians develop surgical strategies and evaluate patient prognosis. Here, we aim to identify an optimal machine-learning model for prediction of IDH genotyping by combining deep-learning (DL) signatures and conventional radiomics (CR) features as model predictors.

Methods

In this study, a total of 486 patients with adult diffuse gliomas were retrospectively collected from our medical center (n=268) and the public database (TCGA, n=218). All included patients were randomly divided into the training and validation sets by using nested 10-fold cross-validation. A total of 6,736 CR features were extracted from four MRI modalities in each patient, namely T1WI, T1CE, T2WI, and FLAIR. The LASSO algorithm was performed for CR feature selection. In each MRI modality, we applied a CNN+LSTM-based neural network to extract DL features and integrate these features into a DL signature after the fully connected layer with sigmoid activation. Eight classic machine-learning models were analyzed and compared in terms of their prediction performance and stability in IDH genotyping by combining the LASSO-selected CR features and integrated DL signatures as model predictors. In the validation sets, the prediction performance was evaluated by using accuracy and the area under the curve (AUC) of the receiver operating characteristics, while the model stability was analyzed by using the relative standard deviation of the AUC (RSDAUC). Subgroup analyses of DL signatures and CR features were also individually conducted to explore their independent prediction values.

Results

Logistic regression (LR) achieved favorable prediction performance (AUC: 0.920 ± 0.043, accuracy: 0.843 ± 0.044), whereas support vector machine with the linear kernel (l-SVM) displayed low prediction performance (AUC: 0.812 ± 0.052, accuracy: 0.821 ± 0.050). With regard to stability, LR also showed high robustness against data perturbation (RSDAUC: 4.7%). Subgroup analyses showed that DL signatures outperformed CR features (DL, AUC: 0.915 ± 0.054, accuracy: 0.835 ± 0.061, RSDAUC: 5.9%; CR, AUC: 0.830 ± 0.066, accuracy: 0.771 ± 0.051, RSDAUC: 8.0%), while DL and DL+CR achieved similar prediction results.

Conclusion

In IDH genotyping, LR is a promising machine-learning classification model. Compared with CR features, DL signatures exhibit markedly superior prediction values and discriminative capability.

Advances in artificial intelligence, robotics, augmented and virtual reality in neurosurgery

Neurosurgical practitioners undergo extensive and prolonged training to acquire diverse technical proficiencies, while neurosurgical procedures necessitate a substantial amount of pre-, post-, and intraoperative clinical data acquisition, making decisions, attention, and convalescence. The past decade witnessed an appreciable escalation in the significance of artificial intelligence (AI) in neurosurgery. AI holds significant potential in neurosurgery as it supplements the abilities of neurosurgeons to offer optimal interventional and non-interventional care to patients by improving prognostic and diagnostic outcomes in clinical therapy and assisting neurosurgeons in making decisions while surgical interventions to enhance patient outcomes. Other technologies including augmented reality, robotics, and virtual reality can assist and promote neurosurgical methods as well. Moreover, they play a significant role in generating, processing, as well as storing experimental and clinical data. Also, the usage of these technologies in neurosurgery is able to curtail the number of costs linked with surgical care and extend high-quality health care to a wider populace. This narrative review aims to integrate the results of articles that elucidate the role of the aforementioned technologies in neurosurgery.

MRI-based deep learning techniques for the prediction of isocitrate dehydrogenase and 1p/19q status in grade 2-4 adult gliomas

Molecular biomarkers are becoming increasingly important in the classification of intracranial gliomas. While tissue sampling remains the gold standard, there is growing interest in the use of deep learning (DL) techniques to predict these markers. This narrative review with a systematic approach identifies and synthesises the current published data on DL techniques using conventional MRI sequences for predicting isocitrate dehydrogenase (IDH) and 1p/19q-codeletion status in World Health Organisation grade 2-4 gliomas. Three databases were searched for relevant studies. In all, 13 studies met the inclusion criteria after exclusions. Key results, limitations and discrepancies between studies were synthesised. High accuracy has been reported in some studies, but the existing literature has several limitations, including generally small cohort sizes, a paucity of studies with independent testing cohorts and a lack of studies assessing IDH and 1p/19q together. While DL shows promise as a non-invasive means of predicting glioma genotype, addressing these limitations in future research will be important for facilitating clinical translation.

Predicting glioblastoma molecular subtypes and prognosis with a multimodal model integrating convolutional neural network, radiomics, and semantics

OBJECTIVE

The aim of this study was to build a convolutional neural network (CNN)-based prediction model of glioblastoma (GBM) molecular subtype diagnosis and prognosis with multimodal features.

METHODS

In total, 222 GBM patients were included in the training set from Sun Yat-sen University Cancer Center (SYSUCC) and 107 GBM patients were included in the validation set from SYSUCC, Xuanwu Hospital Capital Medical University, and the First Hospital of Jilin University. The multimodal model was trained with MR images (pre- and postcontrast T1-weighted images and T2-weighted images), corresponding MRI impression, and clinical patient information. First, the original images were segmented using the Multimodal Brain Tumor Image Segmentation Benchmark toolkit. Convolutional features were extracted using 3D residual deep neural network (ResNet50) and convolutional 3D (C3D). Radiomic features were extracted using pyradiomics. Report texts were converted to word embedding using word2vec. These three types of features were then integrated to train neural networks. Accuracy, precision, recall, and F1-score were used to evaluate the model performance.

RESULTS

The C3D-based model yielded the highest accuracy of 91.11% in the prediction of IDH1 mutation status. Importantly, the addition of semantics improved precision by 11.21% and recall in MGMT promoter methylation status prediction by 14.28%. The areas under the receiver operating characteristic curves of the C3D-based model in the IDH1, ATRX, MGMT, and 1-year prognosis groups were 0.976, 0.953, 0.955, and 0.976, respectively. In external validation, the C3D-based model showed significant improvement in accuracy in the IDH1, ATRX, MGMT, and 1-year prognosis groups, which were 88.30%, 76.67%, 85.71%, and 85.71%, respectively (compared with 3D ResNet50: 83.51%, 66.67%, 82.14%, and 70.79%, respectively).

CONCLUSIONS

The authors propose a novel multimodal model integrating C3D, radiomics, and semantics, which had a great performance in predicting IDH1, ATRX, and MGMT molecular subtypes and the 1-year prognosis of GBM.

Magnetoencephalography-based approaches to epilepsy classification

Epilepsy is a chronic central nervous system disorder characterized by recurrent seizures. Not only does epilepsy severely affect the daily life of the patient, but the risk of premature death in patients with epilepsy is three times higher than that of the normal population. Magnetoencephalography (MEG) is a non-invasive, high temporal and spatial resolution electrophysiological data that provides a valid basis for epilepsy diagnosis, and used in clinical practice to locate epileptic foci in patients with epilepsy. It has been shown that MEG helps to identify MRI-negative epilepsy, contributes to clinical decision-making in recurrent seizures after previous epilepsy surgery, that interictal MEG can provide additional localization information than scalp EEG, and complete excision of the stimulation area defined by the MEG has prognostic significance for postoperative seizure control. However, due to the complexity of the MEG signal, it is often difficult to identify subtle but critical changes in MEG through visual inspection, opening up an important area of research for biomedical engineers to investigate and implement intelligent algorithms for epilepsy recognition. At the same time, the use of manual markers requires significant time and labor costs, necessitating the development and use of computer-aided diagnosis (CAD) systems that use classifiers to automatically identify abnormal activity. In this review, we discuss in detail the results of applying various different feature extraction methods on MEG signals with different classifiers for epilepsy detection, subtype determination, and laterality classification. Finally, we also briefly look at the prospects of using MEG for epilepsy-assisted localization (spike detection, high-frequency oscillation detection) due to the unique advantages of MEG for functional area localization in epilepsy, and discuss the limitation of current research status and suggestions for future research. Overall, it is hoped that our review will facilitate the reader to quickly gain a general understanding of the problem of MEG-based epilepsy classification and provide ideas and directions for subsequent research.

Multiple therapeutic approaches of glioblastoma multiforme: From terminal to therapy

Glioblastoma multiforme (GBM) is an aggressive brain cancer showing poor prognosis. Currently, treatment methods of GBM are limited with adverse outcomes and low survival rate. Thus, advancements in the treatment of GBM are of utmost importance, which can be achieved in recent decades. However, despite aggressive initial treatment, most patients develop recurrent diseases, and the overall survival rate of patients is impossible to achieve. Currently, researchers across the globe target signaling events along with tumor microenvironment (TME) through different drug molecules to inhibit the progression of GBM, but clinically they failed to demonstrate much success. Herein, we discuss the therapeutic targets and signaling cascades along with the role of the organoids model in GBM research. Moreover, we systematically review the traditional and emerging therapeutic strategies in GBM. In addition, we discuss the implications of nanotechnologies, AI, and combinatorial approach to enhance GBM therapeutics.

Multi-task Model for Glioma Segmentation and Isocitrate Dehydrogenase Status Prediction Using Global and Local Features

According to the 2021 World Health Organization IDH status prediction scheme for gliomas, isocitrate dehydrogenase (IDH) is a particularly important basis for glioma diagnosis. In general, 3D multimodal brain MRI is an effective diagnostic tool. However, only using brain MRI data is difficult for experienced doctors to predict the IDH status. Surgery is necessary to be performed for confirming the IDH. Previous studies have shown that brain MRI images of glioma areas contain a lot of useful information for diagnosis. These studies usually need to mark the glioma area in advance to complete the prediction of IDH status, which takes a long time and has high computational cost. The tumor segmentation task model can automatically segment and locate the tumor region, which is exactly the information needed for the IDH prediction task. In this study, we proposed a multi-task deep learning model using 3D multimodal brain MRI images to achieve glioma segmentation and IDH status prediction simultaneously, which improved the accuracy of both tasks effectively. Firstly, we used a segmentation model to segment the tumor region. Also, the whole MRI image and the segmented glioma region features as the global and local features were used to predict IDH status. The effectiveness of the proposed method was validated via a public glioma dataset from the BraTS2020. Our experimental results show that our proposed method outperformed state-of-the-art methods with a prediction accuracy of 88.5% and average dice of 79.8%. The improvements in prediction and segmentation are 3% and 1% compared with the state-of-the-art method, respectively.

Comparison of MRI Sequences to Predict ATRX Status Using Radiomics-Based Machine Learning

ATRX is an important molecular marker according to the 2021 WHO classification of adult-type diffuse glioma. We aim to predict the ATRX mutation status non-invasively using radiomics-based machine learning models on MRI and to determine which MRI sequence is best suited for this purpose. In this retrospective study, we used MRI images of patients with histologically confirmed glioma, including the sequences T1w without and with the administration of contrast agent, T2w, and the FLAIR. Radiomics features were extracted from the corresponding MRI images by hand-delineated regions of interest. Data partitioning into training data and independent test data was repeated 100 times to avoid random effects. Feature preselection and subsequent model development were performed using Lasso regression. The T2w sequence was found to be the most suitable and the FLAIR sequence the least suitable for predicting ATRX mutations using radiomics-based machine learning models. For the T2w sequence, our seven-feature model developed with Lasso regression achieved a mean AUC of 0.831, a mean accuracy of 0.746, a mean sensitivity of 0.772, and a mean specificity of 0.697. In conclusion, for the prediction of ATRX mutation using radiomics-based machine learning models, the T2w sequence is the most suitable among the commonly used MRI sequences.

Convolutional neural network to predict IDH mutation status in glioma from chemical exchange saturation transfer imaging at 7 Tesla

Background and goal

Noninvasive prediction of isocitrate dehydrogenase (IDH) mutation status in glioma guides surgical strategies and individualized management. We explored the capability on preoperatively identifying IDH status of combining a convolutional neural network (CNN) and a novel imaging modality, ultra-high field 7.0 Tesla (T) chemical exchange saturation transfer (CEST) imaging.

Method

We enrolled 84 glioma patients of different tumor grades in this retrospective study. Amide proton transfer CEST and structural Magnetic Resonance (MR) imaging at 7T were performed preoperatively, and the tumor regions are manually segmented, leading to the "annotation" maps that offers the location and shape information of the tumors. The tumor region slices in CEST and T1 images were further cropped out as samples and combined with the annotation maps, which were inputted to a 2D CNN model for generating IDH predictions. Further comparison analysis to radiomics-based prediction methods was performed to demonstrate the crucial role of CNN for predicting IDH based on CEST and T1 images.

Results

A fivefold cross-validation was performed on the 84 patients and 4090 slices. We observed a model based on only CEST achieved accuracy of 74.01% ± 1.15%, and the area under the curve (AUC) of 0.8022 ± 0.0147. When using T1 image only, the prediction performances dropped to accuracy of 72.52% ± 1.12% and AUC of 0.7904 ± 0.0214, which indicates no superiority of CEST over T1. However, when we combined CEST and T1 together with the annotation maps, the performances of the CNN model were further boosted to accuracy of 82.94% ± 1.23% and AUC of 0.8868 ± 0.0055, suggesting the importance of a joint analysis of CEST and T1. Finally, using the same inputs, the CNN-based predictions achieved significantly improved performances above those from radiomics-based predictions (logistic regression and support vector machine) by 10% to 20% in all metrics.

Conclusion

7T CEST and structural MRI jointly offer improved sensitivity and specificity of preoperative non-invasive imaging for the diagnosis of IDH mutation status. As the first study of CNN model on imaging acquired at ultra-high field MR, our results could demonstrate the potential of combining ultra-high-field CEST and CNN for facilitating decision-making in clinical practice. However, due to the limited cases and B1 inhomogeneities, the accuracy of this model will be improved in our further study.

Smart brain tumor diagnosis system utilizing deep convolutional neural networks

The early diagnosis of cancer is crucial to provide prompt and adequate management of the diseases. Imaging tests, in particular magnetic resonance imaging (MRI), are the first preferred method for diagnosis. However, these tests have some limitations which can cause a delay in detection and diagnosis. The use of computer-aided intelligent systems can assist physicians in diagnosis. In this study, we established a Convolutional Neural Network (CNN)-based brain tumor diagnosis system using EfficientNetv2s architecture, which was improved with the Ranger optimization and extensive pre-processing. We also compared the proposed model with state-of-the-art deep learning architectures such as ResNet18, ResNet200d, and InceptionV4 in discriminating brain tumors based on their spatial features. We achieved the best micro-average results with 99.85% test accuracy, 99.89% Area under the Curve (AUC), 98.16% precision, 98.17% recall, and 98.21% f1-score. Furthermore, the experimental results of the improved model were compared to various CNN-based architectures using key performance metrics and were shown to have a strong impact on tumor categorization. The proposed system has been experimentally evaluated with different optimizers and compared with recent CNN architectures, on both augmented and original data. The results demonstrated a convincing performance in tumor detection and diagnosis.

Easy-to-use machine learning system for the prediction of IDH mutation and 1p/19q codeletion using MRI images of adult-type diffuse gliomas

Adult-type diffuse gliomas are divided into Astrocytoma, IDH-mutant, Oligodendroglioma, IDH-mutant and 1p/19q-codeleted and Glioblastoma, IDH-wildtype based on the IDH mutation, and 1p/19q codeletion status. To determine the treatment strategy for these tumors, pre-operative prediction of IDH mutation and 1p/19q codeletion status might be effective. Computer-aided diagnosis (CADx) systems using machine learning have been noted as innovative diagnostic methods. However, it is difficult to promote the clinical application of machine learning systems at each institute because the support of various specialists is essential. In this study, we established an easy-to-use computer-aided diagnosis system using Microsoft Azure Machine Learning Studio (MAMLS) to predict these statuses. We constructed an analysis model using 258 adult-type diffuse glioma cases from The Cancer Genome Atlas (TCGA) cohort. Using MRI T2-weighted images, the overall accuracy, sensitivity, and specificity for the prediction of IDH mutation and 1p/19q codeletion were 86.9%, 80.9%, and 92.0%, and 94.7%, 94.1%, and 95.1%, respectively. We also constructed an reliable analysis model for the prediction of IDH mutation and 1p/19q codeletion using an independent Nagoya cohort including 202 cases. These analysis models were established within 30 min. This easy-to-use CADx system might be useful for the clinical application of CADx in various institutes.

Emerging role of artificial intelligence in diagnosis, classification and clinical management of glioma

Glioma represents a dominant primary intracranial malignancy in the central nervous system. Artificial intelligence that mainly includes machine learning, and deep learning computational approaches, presents a unique opportunity to enhance clinical management of glioma through improving tumor segmentation, diagnosis, differentiation, grading, treatment, prediction of clinical outcomes (prognosis, and recurrence), molecular features, clinical classification, characterization of the tumor microenvironment, and drug discovery. A growing body of recent studies apply artificial intelligence-based models to disparate data sources of glioma, covering imaging modalities, digital pathology, high-throughput multi-omics data (especially emerging single-cell RNA sequencing and spatial transcriptome), etc. While these early findings are promising, future studies are required to normalize artificial intelligence-based models to improve the generalizability and interpretability of the results. Despite prominent issues, targeted clinical application of artificial intelligence approaches in glioma will facilitate the development of precision medicine of this field. If these challenges can be overcome, artificial intelligence has the potential to profoundly change the way patients with or at risk of glioma are provided with more rational care.

Predicting gene mutation status via artificial intelligence technologies based on multimodal integration (MMI) to advance precision oncology

Personalized treatment strategies for cancer frequently rely on the detection of genetic alterations which are determined by molecular biology assays. Historically, these processes typically required single-gene sequencing, next-generation sequencing, or visual inspection of histopathology slides by experienced pathologists in a clinical context. In the past decade, advances in artificial intelligence (AI) technologies have demonstrated remarkable potential in assisting physicians with accurate diagnosis of oncology image-recognition tasks. Meanwhile, AI techniques make it possible to integrate multimodal data such as radiology, histology, and genomics, providing critical guidance for the stratification of patients in the context of precision therapy. Given that the mutation detection is unaffordable and time-consuming for a considerable number of patients, predicting gene mutations based on routine clinical radiological scans or whole-slide images of tissue with AI-based methods has become a hot issue in actual clinical practice. In this review, we synthesized the general framework of multimodal integration (MMI) for molecular intelligent diagnostics beyond standard techniques. Then we summarized the emerging applications of AI in the prediction of mutational and molecular profiles of common cancers (lung, brain, breast, and other tumor types) pertaining to radiology and histology imaging. Furthermore, we concluded that there truly exist multiple challenges of AI techniques in the way of its real-world application in the medical field, including data curation, feature fusion, model interpretability, and practice regulations. Despite these challenges, we still prospect the clinical implementation of AI as a highly potential decision-support tool to aid oncologists in future cancer treatment management.

Imaging of Brain Tumors

OBJECTIVE

This article focuses on neuroimaging as an essential tool for diagnosing brain tumors and monitoring response to treatment.

LATEST DEVELOPMENTS

Neuroimaging is useful at all stages of brain tumor care. Technologic advances have improved the clinical diagnostic capability of neuroimaging as a vital complement to history, examination, and pathologic assessment. Presurgical evaluations are enriched by novel imaging techniques, through improved differential diagnosis and better surgical planning using functional MRI (fMRI) and diffusion tensor imaging. The common clinical challenge of differentiating tumor progression from treatment-related inflammatory change is aided by novel uses of perfusion imaging, susceptibility-weighted imaging (SWI), spectroscopy, and new positron emission tomography (PET) tracers.

ESSENTIAL POINTS

Using the most up-to-date imaging techniques will facilitate high-quality clinical practice in the care of patients with brain tumors.

Non-invasive classification of IDH mutation status of gliomas from multi-modal MRI using a 3D convolutional neural network

Glioma is the most common form of brain tumor with a high degree of heterogeneity in imaging characteristics, treatment-response, and survival rate. An important factor causing this heterogeneity is the mutation of isocitrate dehydrogenase (IDH) enzyme. The current clinical gold-standard for identifying IDH mutation status involves invasive procedures that involve risk, may fail to capture intra-tumoral spatial heterogeneity or can be inaccessible in low-resource settings. In this study, we propose a deep learning-based method to non-invasively and pre-operatively determine IDH status of high- and low-grade gliomas by leveraging their phenotypical characteristics from volumetric MRI scans. For this purpose, we propose a 3D Mask R-CNN-based approach to simultaneously detect and segment glioma as well as classify its IDH status - thus obviating the requirement of any separate tumor segmentation step. The network can operate on routinely acquired MRI sequences and is agnostic to glioma grade. It was trained on patient-cases from publicly available datasets (n = 223) and tested on two hold-out datasets acquired from The Cancer Genome Atlas (TCGA; n = 62) and Washington University School of Medicine (WUSM; n = 261). The model achieved areas under the receiver operating characteristic of 0.83 and 0.87, and areas under the precision-recall curves of 0.78 and 0.79, on the TCGA and WUSM sets, respectively. The model can be used to perform a pre-operative 'virtual biopsy' of gliomas, thus facilitating treatment planning, potentially leading to better overall survival.

Combining Multi-Shell Diffusion with Conventional MRI Improves Molecular Diagnosis of Diffuse Gliomas with Deep Learning

The WHO classification since 2016 confirms the importance of integrating molecular diagnosis for prognosis and treatment decisions of adult-type diffuse gliomas. This motivates the development of non-invasive diagnostic methods, in particular MRI, to predict molecular subtypes of gliomas before surgery. At present, this development has been focused on deep-learning (DL)-based predictive models, mainly with conventional MRI (cMRI), despite recent studies suggesting multi-shell diffusion MRI (dMRI) offers complementary information to cMRI for molecular subtyping. The aim of this work is to evaluate the potential benefit of combining cMRI and multi-shell dMRI in DL-based models. A model implemented with deep residual neural networks was chosen as an illustrative example. Using a dataset of 146 patients with gliomas (from grade 2 to 4), the model was trained and evaluated, with nested cross-validation, on pre-operative cMRI, multi-shell dMRI, and a combination of the two for the following classification tasks: (i) IDH-mutation; (ii) 1p/19q-codeletion; and (iii) three molecular subtypes according to WHO 2021. The results from a subset of 100 patients with lower grades gliomas (2 and 3 according to WHO 2016) demonstrated that combining cMRI and multi-shell dMRI enabled the best performance in predicting IDH mutation and 1p/19q codeletion, achieving an accuracy of 75 ± 9% in predicting the IDH-mutation status, higher than using cMRI and multi-shell dMRI separately (both 70 ± 7%). Similar findings were observed for predicting the 1p/19q-codeletion status, with the accuracy from combining cMRI and multi-shell dMRI (72 ± 4%) higher than from each modality used alone (cMRI: 65 ± 6%; multi-shell dMRI: 66 ± 9%). These findings remain when we considered all 146 patients for predicting the IDH status (combined: 81 ± 5% accuracy; cMRI: 74 ± 5%; multi-shell dMRI: 73 ± 6%) and for the diagnosis of the three molecular subtypes according to WHO 2021 (combined: 60 ± 5%; cMRI: 57 ± 8%; multi-shell dMRI: 56 ± 7%). Together, these findings suggest that combining cMRI and multi-shell dMRI can offer higher accuracy than using each modality alone for predicting the IDH and 1p/19q status and in diagnosing the three molecular subtypes with DL-based models.

Artificial Intelligence Assisted Computational Tomographic Detection of Lung Nodules for Prognostic Cancer Examination: A Large-Scale Clinical Trial

Low-dose computed tomography (LDCT) has emerged as a standard method for detecting early-stage lung cancer. However, the tedious computer tomography (CT) slide reading, patient-by-patient check, and lack of standard criteria to determine the vague but possible nodule leads to variable outcomes of CT slide interpretation. To determine the artificial intelligence (AI)-assisted CT examination, AI algorithm-assisted CT screening was embedded in the hospital picture archiving and communication system, and a 200 person-scaled clinical trial was conducted at two medical centers. With AI algorithm-assisted CT screening, the sensitivity of detecting nodules sized 4−5 mm, 6~10 mm, 11~20 mm, and >20 mm increased by 41%, 11.2%, 10.3%, and 18.7%, respectively. Remarkably, the overall sensitivity of detecting varied nodules increased by 20.7% from 67.7% to 88.4%. Furthermore, the sensitivity increased by 18.5% from 72.5% to 91% for detecting ground glass nodules (GGN), which is challenging for radiologists and physicians. The free-response operating characteristic (FROC) AI score was ≥0.4, and the AI algorithm standalone CT screening sensitivity reached >95% with an area under the localization receiver operating characteristic curve (LROC-AUC) of >0.88. Our study demonstrates that AI algorithm-embedded CT screening significantly ameliorates tedious LDCT practices for doctors.