Glioblastoma multiforme prognosis: MRI missing modality generation, segmentation and radiogenomic survival prediction

Modality redundancy for MRI-based glioblastoma segmentation

PURPOSE

Automated glioblastoma segmentation from magnetic resonance imaging is generally performed on a four-modality input, including T1, contrast T1, T2 and FLAIR. We hypothesize that information redundancy is present within these image combinations, which can possibly reduce a model's performance. Moreover, for clinical applications, the risk of encountering missing data rises as the number of required input modalities increases. Therefore, this study aimed to explore the relevance and influence of the different modalities used for MRI-based glioblastoma segmentation.

METHODS

After the training of multiple segmentation models based on nnU-Net and SwinUNETR architectures, differing only in their amount and combinations of input modalities, each model was evaluated with regard to segmentation accuracy and epistemic uncertainty.

RESULTS

Results show that T1CE-based segmentation (for enhanced tumor and tumor core) and T1CE-FLAIR-based segmentation (for whole tumor and overall segmentation) can reach segmentation accuracies comparable to the full-input version. Notably, the highest segmentation accuracy for nnU-Net was found for a three-input configuration of T1CE-FLAIR-T1, suggesting the confounding effect of redundant input modalities. The SwinUNETR architecture appears to suffer less from this, where said three-input and the full-input model yielded statistically equal results.

CONCLUSION

The T1CE-FLAIR-based model can therefore be considered as a minimal-input alternative to the full-input configuration. Addition of modalities beyond this does not statistically improve and can even deteriorate accuracy, but does lower the segmentation uncertainty.

Prediction of prognosis in glioblastoma with radiomics features extracted by synthetic MRI images using cycle-consistent GAN

To propose a style transfer model for multi-contrast magnetic resonance imaging (MRI) images with a cycle-consistent generative adversarial network (CycleGAN) and evaluate the image quality and prognosis prediction performance for glioblastoma (GBM) patients from the extracted radiomics features. Style transfer models of T1 weighted MRI image (T1w) to T2 weighted MRI image (T2w) and T2w to T1w with CycleGAN were constructed using the BraTS dataset. The style transfer model was validated with the Cancer Genome Atlas Glioblastoma Multiforme (TCGA-GBM) dataset. Moreover, imaging features were extracted from real and synthesized images. These features were transformed to rad-scores by the least absolute shrinkage and selection operator (LASSO)-Cox regression. The prognosis performance was estimated by the Kaplan-Meier method. For the accuracy of the image quality of the real and synthesized MRI images, the MI, RMSE, PSNR, and SSIM were 0.991 ± 2.10 × 10 - 4 , 2.79 ± 0.16, 40.16 ± 0.38, and 0.995 ± 2.11 × 10 - 4 , for T2w, and .992 ± 2.63 × 10 - 4 , 2.49 ± 6.89 × 10 - 2 , 40.51 ± 0.22, and 0.993 ± 3.40 × 10 - 4 for T1w, respectively. The survival time had a significant difference between good and poor prognosis groups for both real and synthesized T2w (p < 0.05). However, the survival time had no significant difference between good and poor prognosis groups for both real and synthesized T1w. On the other hand, there was no significant difference between the real and synthesized T2w in both good and poor prognoses. The results of T1w were similar in the point that there was no significant difference between the real and synthesized T1w. It was found that the synthesized image could be used for prognosis prediction. The proposed prognostic model using CycleGAN could reduce the cost and time of image scanning, leading to a promotion to build the patient's outcome prediction with multi-contrast images.

Ultrasmall iron oxide nanoparticles with MRgFUS for enhanced magnetic resonance imaging of orthotopic glioblastoma

Ultrasmall iron oxide nanoparticles (USIO NPs) are expected to become the next generation T1 contrast agents; however, their diagnostic and therapeutic potential for primary brain tumors (such as glioblastoma multiforme, GBM) is yet to be explored. At present, the main challenge is the effective hindering of biological barriers, including the blood-brain barrier (BBB) and the blood-brain tumor barrier (BBTB). Herein, we aimed to investigate whether the USIO NPs, in combination with MR-guided focused ultrasound (MRgFUS), could intensify MR imaging of GBM. In this study, we presented zwitterionic USIO NPs for enhanced MR imaging of both xenografted and orthotopic GBM mouse models. We first synthesized citric-stabilized USIO NPs with a size of 3.19 ± 0.76 nm, modified with ethylenediamine, and decorated with 1,3-propanesultone (1,3-PS) to form USIO NPs-1,3-PS. The obtained USIO NPs-1,3-PS exhibited good cytocompatibility and cellular uptake efficiency. MRgFUS, in combination with microbubbles, provided a non-invasive and safe technique for BBB opening, which, in turn, promoted the delivery of USIO NPs-1,3-PS in orthotopic GBM. This developed USIO NP nanoplatform may improve the precision imaging of solid tumors and therapeutic efficacy in the central nervous system.

The application value of deep learning in the background of precision medicine in glioblastoma

Introduction: Glioblastoma is a highly malignant central nervous system tumor, World Health Organization Ⅳ, glioblastoma is the most common primary malignancy, due to its own specificity and complexity, different patients often benefit from the current conventional treatment regimen because of different molecular subtypes, in the context of precision medicine, the application of deep learning to identify the salient features of tumors on brain imaging, prognostic predictive assessment combined with clinical data to maximize the benefits of each patient from the treatment regimen is a non-invasive and feasible regimen. Methods: We conducted a comprehensive review of the existing literature on the role of deep learning in glioblastomas, covering molecular classification and diagnosis, prognosis assessment. Results: Data based on a variety of magnetic resonance imaging sequences, genetic information, and clinical combinations enable noninvasive predictive tumor diagnosis of glioblastoma and assess overall survival and treatment response accuracy. For images, standardized image acquisition and data extraction techniques can be effectively translated into learning models for clinical practice. However, it must be recognized that interventions in the treatment of glioblastoma using deep learning are still in their infancy, and the robustness of the model is challenged, as the current total number of glioblastoma samples is insufficient for large-scale experimental methods, which is directly related to the difficulty of application of the model. Conclusion: Compared to radiomics and shallow machine learning, deep learning can be a more robust, non-invasive, and effective approach, providing more valuable information as clinicians develop personalized medical protocols for glioblastoma patients.

A review on brain tumor segmentation based on deep learning methods with federated learning techniques

Brain tumors have become a severe medical complication in recent years due to their high fatality rate. Radiologists segment the tumor manually, which is time-consuming, error-prone, and expensive. In recent years, automated segmentation based on deep learning has demonstrated promising results in solving computer vision problems such as image classification and segmentation. Brain tumor segmentation has recently become a prevalent task in medical imaging to determine the tumor location, size, and shape using automated methods. Many researchers have worked on various machine and deep learning approaches to determine the most optimal solution using the convolutional methodology. In this review paper, we discuss the most effective segmentation techniques based on the datasets that are widely used and publicly available. We also proposed a survey of federated learning methodologies to enhance global segmentation performance and ensure privacy. A comprehensive literature review is suggested after studying more than 100 papers to generalize the most recent techniques in segmentation and multi-modality information. Finally, we concentrated on unsolved problems in brain tumor segmentation and a client-based federated model training strategy. Based on this review, future researchers will understand the optimal solution path to solve these issues.

Deep Learning Techniques with Genomic Data in Cancer Prognosis: A Comprehensive Review of the 2021-2023 Literature

Deep learning has brought about a significant transformation in machine learning, leading to an array of novel methodologies and consequently broadening its influence. The application of deep learning in various sectors, especially biomedical data analysis, has initiated a period filled with noteworthy scientific developments. This trend has majorly influenced cancer prognosis, where the interpretation of genomic data for survival analysis has become a central research focus. The capacity of deep learning to decode intricate patterns embedded within high-dimensional genomic data has provoked a paradigm shift in our understanding of cancer survival. Given the swift progression in this field, there is an urgent need for a comprehensive review that focuses on the most influential studies from 2021 to 2023. This review, through its careful selection and thorough exploration of dominant trends and methodologies, strives to fulfill this need. The paper aims to enhance our existing understanding of applications of deep learning in cancer survival analysis, while also highlighting promising directions for future research. This paper undertakes aims to enrich our existing grasp of the application of deep learning in cancer survival analysis, while concurrently shedding light on promising directions for future research in this vibrant and rapidly proliferating field.

ETISTP: An Enhanced Model for Brain Tumor Identification and Survival Time Prediction

Technology-assisted diagnosis is increasingly important in healthcare systems. Brain tumors are a leading cause of death worldwide, and treatment plans rely heavily on accurate survival predictions. Gliomas, a type of brain tumor, have particularly high mortality rates and can be further classified as low- or high-grade, making survival prediction challenging. Existing literature provides several survival prediction models that use different parameters, such as patient age, gross total resection status, tumor size, or tumor grade. However, accuracy is often lacking in these models. The use of tumor volume instead of size may improve the accuracy of survival prediction. In response to this need, we propose a novel model, the enhanced brain tumor identification and survival time prediction (ETISTP), which computes tumor volume, classifies it into low- or high-grade glioma, and predicts survival time with greater accuracy. The ETISTP model integrates four parameters: patient age, survival days, gross total resection (GTR) status, and tumor volume. Notably, ETISTP is the first model to employ tumor volume for prediction. Furthermore, our model minimizes the computation time by allowing for parallel execution of tumor volume computation and classification. The simulation results demonstrate that ETISTP outperforms prominent survival prediction models.

A literature survey of MR-based brain tumor segmentation with missing modalities

Multimodal MR brain tumor segmentation is one of the hottest issues in the community of medical image processing. However, acquiring the complete set of MR modalities is not always possible in clinical practice, due to the acquisition protocols, image corruption, scanner availability, scanning cost or allergies to certain contrast materials. The missing information can cause some restraints to brain tumor diagnosis, monitoring, treatment planning and prognosis. Thus, it is highly desirable to develop brain tumor segmentation methods to address the missing modalities problem. Based on the recent advancements, in this review, we provide a detailed analysis of the missing modality issue in MR-based brain tumor segmentation. First, we briefly introduce the biomedical background concerning brain tumor, MR imaging techniques, and the current challenges in brain tumor segmentation. Then, we provide a taxonomy of the state-of-the-art methods with five categories, namely, image synthesis-based method, latent feature space-based model, multi-source correlation-based method, knowledge distillation-based method, and domain adaptation-based method. In addition, the principles, architectures, benefits and limitations are elaborated in each method. Following that, the corresponding datasets and widely used evaluation metrics are described. Finally, we analyze the current challenges and provide a prospect for future development trends. This review aims to provide readers with a thorough knowledge of the recent contributions in the field of brain tumor segmentation with missing modalities and suggest potential future directions.

Radiogenomics study to predict the nuclear grade of renal clear cell carcinoma

Purpose

To develop models based on radiomics and genomics for predicting the histopathologic nuclear grade with localized clear cell renal cell carcinoma (ccRCC) and to assess whether macro-radiomics models can predict the microscopic pathological changes.

Method

In this multi-institutional retrospective study, a computerized tomography (CT) radiomic model for nuclear grade prediction was developed. Utilizing a genomics analysis cohort, nuclear grade-associated gene modules were identified, and a gene model was constructed based on top 30 hub mRNA to predict the nuclear grade. Using a radiogenomic development cohort, biological pathways were enriched by hub genes and a radiogenomic map was created.

Results

The four-features-based SVM model predicted nuclear grade with an area under the curve (AUC) score of 0.94 in validation sets, while a five-gene-based model predicted nuclear grade with an AUC of 0.73 in the genomics analysis cohort. A total of five gene modules were identified to be associated with the nuclear grade. Radiomic features were only associated with 271 out of 603 genes in five gene modules and eight top 30 hub genes. Differences existed in the enrichment pathway between associated and un-associated with radiomic features, which were associated with two genes of five-gene signatures in the mRNA model.

Conclusion

The CT radiomics models exhibited higher predictive performance than mRNA models. The association between radiomic features and mRNA related to nuclear grade is not universal.

Synthetic MRI improves radiomics-based glioblastoma survival prediction

Glioblastoma is an aggressive and fast-growing brain tumor with poor prognosis. Predicting the expected survival of patients with glioblastoma is a key task for efficient treatment and surgery planning. Survival predictions could be enhanced by means of a radiomic system. However, these systems demand high numbers of multicontrast images, the acquisitions of which are time consuming, giving rise to patient discomfort and low healthcare system efficiency. Synthetic MRI could favor deployment of radiomic systems in the clinic by allowing practitioners not only to reduce acquisition time, but also to retrospectively complete databases or to replace artifacted images. In this work we analyze the replacement of an actually acquired MR weighted image by a synthesized version to predict survival of glioblastoma patients with a radiomic system. Each synthesized version was realistically generated from two acquired images with a deep learning synthetic MRI approach based on a convolutional neural network. Specifically, two weighted images were considered for the replacement one at a time, a T2w and a FLAIR, which were synthesized from the pairs T1w and FLAIR, and T1w and T2w, respectively. Furthermore, a radiomic system for survival prediction, which can classify patients into two groups (survival >480 days and ≤ 480 days), was built. Results show that the radiomic system fed with the synthesized image achieves similar performance compared with using the acquired one, and better performance than a model that does not include this image. Hence, our results confirm that synthetic MRI does add to glioblastoma survival prediction within a radiomics-based approach.

A lightweight 3D UNet model for glioma grading

Objective. Glioma is one of the most fatal cancers in the world which has been divided into low grade glioma (LGG) and high grade glioma (HGG), and its image grading has become a hot topic of contemporary research. Magnetic resonance imaging (MRI) is a vital diagnostic tool for brain tumor detection, analysis, and surgical planning. Accurate and automatic glioma grading is crucial for speeding up diagnosis and treatment planning. Aiming at the problems of (1) large number of parameters, (2) complex calculation, and (3) poor speed of the current glioma grading algorithms based on deep learning, this paper proposes a lightweight 3D UNet deep learning framework, which can improve classification accuracy in comparison with the existing methods. Approach. To improve efficiency while maintaining accuracy, existing 3D UNet has been excluded, and depthwise separable convolution has been applied to 3D convolution to reduce the number of network parameters. The weight of parameters on the basis of space and channel compression & excitation module has been strengthened to improve the model in the feature map, reduce the weight of redundant parameters, and strengthen the performance of the model. Main results. A total of 560 patients with glioma were retrospectively reviewed. All patients underwent MRI before surgery. The experiments were carried out on T1w, T2w, fluid attenuated inversion recovery, and CET1w images. Additionally, a way of marking tumor area by cube bounding box is presented which has no significant difference in model performance with the manually drawn ground truth. Evaluated on test datasets using the proposed model has shown good results (with accuracy of 89.29%). Significance. This work serves to achieve LGG/HGG grading by simple, effective, and non-invasive diagnostic approaches to provide diagnostic suggestions for clinical usage, thereby facilitating hasten treatment decisions.

Artificial Intelligence for Survival Prediction in Brain Tumors on Neuroimaging

Survival prediction of patients affected by brain tumors provides essential information to guide surgical planning, adjuvant treatment selection, and patient counseling. Current reliance on clinical factors, such as Karnofsky Performance Status Scale, and simplistic radiological characteristics are, however, inadequate for survival prediction in tumors such as glioma that demonstrate molecular and clinical heterogeneity with variable survival outcomes. Advances in the domain of artificial intelligence have afforded powerful tools to capture a large number of hidden high-dimensional imaging features that reflect abundant information about tumor structure and physiology. Here, we provide an overview of current literature that apply computational analysis tools such as radiomics and machine learning methods to the pipeline of image preprocessing, tumor segmentation, feature extraction, and construction of classifiers to establish survival prediction models based on neuroimaging. We also discuss challenges relating to the development and evaluation of such models and explore ethical issues surrounding the future use of machine learning predictions.

Identifying risk factors of intracerebral hemorrhage stability using explainable attention model

Segmentation of intracerebral hemorrhage (ICH) helps improve the quality of diagnosis, draft the desired treatment methods, and clinically observe the variations with healthy patients. The clinical utilization of various ICH progression scoring systems has limitations due to the systems' modest predictive value. This paper proposes a single pipeline of a multi-task model for end-to-end hemorrhage segmentation and risk estimation. We introduce a 3D spatial attention unit and integrate it into the state-of-the-art segmentation architecture, UNet, to enhance the accuracy by bootstrapping the global spatial representation. We further extract the geometric features from the segmented hemorrhage volume and fuse them with clinical features such as CT angiography (CTA) spot, Glasgow Coma Scale (GCS), and age to predict the ICH stability. Several state-of-the-art machine learning techniques such as multilayer perceptron (MLP), support vector machine (SVM), gradient boosting, and random forests are applied to train stability estimation and to compare the performances. To align clinical intuition with model learning, we determine the shapely values (SHAP) and explain the most significant features for the ICH risk scoring system. A total of 79 patients are included, of which 20 are found in critical condition. Our proposed single pipeline model achieves a segmentation accuracy of 86.3%, stability prediction accuracy of 78.3%, and precision of 82.9%; the mean square error of exact expansion rate regression is observed to be 0.46. The SHAP analysis reveals that CTA spot sign, age, solidity, location, and length of the first axis of the ICH volume are the most critical characteristics that help define the stability of the stroke lesion. We also show that integrating significant geometric features with clinical features can improve the ICH progression scoring by predicting long-term outcomes. Graphical abstract Overview of our proposed method comprising of spatial attention and feature extraction mechanisms. The architecture is trained on the input CT images, and the first step output is the predicted segmentation of the hemorrhagic region. The output is fed into a geometric feature extractor and is fused with clinical features to estimate ICH stability using a multilayer perceptron (MLP).