Feature-Guided Deep Radiomics for Glioblastoma Patient Survival Prediction

Convolutional Neural Networks for Glioma Segmentation and Prognosis: A Systematic Review

Deep learning (DL) is poised to redefine the way medical images are processed and analyzed. Convolutional neural networks (CNNs), a specific type of DL architecture, are exceptional for high-throughput processing, allowing for the effective extraction of relevant diagnostic patterns from large volumes of complex visual data. This technology has garnered substantial interest in the field of neuro-oncology as a promising tool to enhance medical imaging throughput and analysis. A multitude of methods harnessing MRI-based CNNs have been proposed for brain tumor segmentation, classification, and prognosis prediction. They are often applied to gliomas, the most common primary brain cancer, to classify subtypes with the goal of guiding therapy decisions. Additionally, the difficulty of repeating brain biopsies to evaluate treatment response in the setting of often confusing imaging findings provides a unique niche for CNNs to help distinguish the treatment response to gliomas. For example, glioblastoma, the most aggressive type of brain cancer, can grow due to poor treatment response, can appear to grow acutely due to treatment-related inflammation as the tumor dies (pseudo-progression), or falsely appear to be regrowing after treatment as a result of brain damage from radiation (radiation necrosis). CNNs are being applied to separate this diagnostic dilemma. This review provides a detailed synthesis of recent DL methods and applications for intratumor segmentation, glioma classification, and prognosis prediction. Furthermore, this review discusses the future direction of MRI-based CNN in the field of neuro-oncology and challenges in model interpretability, data availability, and computation efficiency.

Clinical and Magnetic Resonance Imaging Radiomics-Based Survival Prediction in Glioblastoma Using Multiparametric Magnetic Resonance Imaging

INTRODUCTION

Survival prediction in glioblastoma remains challenging, and identification of robust imaging markers could help with this relevant clinical problem. We evaluated multiparametric magnetic resonance imaging-derived radiomics to assess prediction of overall survival (OS) and progression-free survival (PFS).

METHODOLOGY

A retrospective, institutional review board-approved study was performed. There were 93 eligible patients, of which 55 underwent gross tumor resection and chemoradiation (GTR-CR). Overall survival and PFS were assessed in the entire cohort and the GTR-CR cohort using multiple machine learning pipelines. A model based on multiple clinical variables was also developed. Survival prediction was assessed using the radiomics-only, clinical-only, and the radiomics and clinical combined models.

RESULTS

For all patients combined, the clinical feature-derived model outperformed the best radiomics model for both OS (C-index, 0.706 vs 0.597; P < 0.0001) and PFS prediction (C-index, 0.675 vs 0.588; P < 0.001). Within the GTR-CR cohort, the radiomics model showed nonstatistically improved performance over the clinical model for predicting OS (C-index, 0.638 vs 0.588; P = 0.4). However, the radiomics model outperformed the clinical feature model for predicting PFS in GTR-CR cohort (C-index, 0.641 vs 0.550; P = 0.004). Combined clinical and radiomics model did not yield superior prediction when compared with the best model in each case.

CONCLUSIONS

When considering all patients, regardless of therapy, the radiomics-derived prediction of OS and PFS is inferior to that from a model derived from clinical features alone. However, in patients with GTR-CR, radiomics-only model outperforms clinical feature-derived model for predicting PFS.

MR Intensity Normalization Methods Impact Sequence Specific Radiomics Prognostic Model Performance in Primary and Recurrent High-Grade Glioma

PURPOSE

This study investigates the impact of different intensity normalization (IN) methods on the overall survival (OS) radiomics models' performance of MR sequences in primary (pHGG) and recurrent high-grade glioma (rHGG).

METHODS

MR scans acquired before radiotherapy were retrieved from two independent cohorts (rHGG C1: 197, pHGG C2: 141) from multiple scanners (15, 14). The sequences are T1 weighted (w), contrast-enhanced T1w (T1wce), T2w, and T2w-FLAIR. Sequence-specific significant features (SF) associated with OS, extracted from the tumour volume, were derived after applying 15 different IN methods. Survival analyses were conducted using Cox proportional hazard (CPH) and Poisson regression (POI) models. A ranking score was assigned based on the 10-fold cross-validated (CV) concordance index (C-I), mean square error (MSE), and the Akaike information criterion (AICs), to evaluate the methods' performance.

RESULTS

Scatter plots of the 10-CV C-I and MSE against the AIC showed an impact on the survival predictions between the IN methods and MR sequences (C1/C2 C-I range: 0.62-0.71/0.61-0.72, MSE range: 0.20-0.42/0.13-0.22). White stripe showed stable results for T1wce (C1/C2 C-I: 0.71/0.65, MSE: 0.21/0.14). Combat (0.68/0.62, 0.22/0.15) and histogram matching (HM, 0.67/0.64, 0.22/0.15) showed consistent prediction results for T2w models. They were also the top-performing methods for T1w in C2 (Combat: 0.67, 0.13; HM: 0.67, 0.13); however, only HM achieved high predictions in C1 (0.66, 0.22). After eliminating IN impacted SF using Spearman's rank-order correlation coefficient, a mean decrease in the C-I and MSE of 0.05 and 0.03 was observed in all four sequences.

CONCLUSION

The IN method impacted the predictive power of survival models; thus, performance is sequence-dependent.

Multimodal Deep Learning-Based Prognostication in Glioma Patients: A Systematic Review

Malignant brain tumors pose a substantial burden on morbidity and mortality. As clinical data collection improves, along with the capacity to analyze it, novel predictive clinical tools may improve prognosis prediction. Deep learning (DL) holds promise for integrating clinical data of various modalities. A systematic review of the DL-based prognostication of gliomas was performed using the Embase (Elsevier), PubMed MEDLINE (National library of Medicine), and Scopus (Elsevier) databases, in accordance with PRISMA guidelines. All included studies focused on the prognostication of gliomas, and predicted overall survival (13 studies, 81%), overall survival as well as genotype (2 studies, 12.5%), and response to immunotherapy (1 study, 6.2%). Multimodal analyses were varied, with 6 studies (37.5%) combining MRI with clinical data; 6 studies (37.5%) integrating MRI with histologic, clinical, and biomarker data; 3 studies (18.8%) combining MRI with genomic data; and 1 study (6.2%) combining histologic imaging with clinical data. Studies that compared multimodal models to unimodal-only models demonstrated improved predictive performance. The risk of bias was mixed, most commonly due to inconsistent methodological reporting. Overall, the use of multimodal data in DL assessments of gliomas leads to a more accurate overall survival prediction. However, due to data limitations and a lack of transparency in model and code reporting, the full extent of multimodal DL as a resource for brain tumor patients has not yet been realized.

Predicting Rectal Cancer Response to Total Neoadjuvant Treatment Using an Artificial Intelligence Model Based on Magnetic Resonance Imaging and Clinical Data

PURPOSE

To develop a model for predicting response to total neoadjuvant treatment (TNT) for patients with locally advanced rectal cancer (LARC) based on baseline magnetic resonance imaging (MRI) and clinical data using artificial intelligence methods.

METHODS

Baseline MRI and clinical data were curated from patients with LARC and analyzed using logistic regression (LR) and deep learning (DL) methods to predict TNT response retrospectively. We defined two groups of response to TNT as pathological complete response (pCR) versus non-pCR (Group 1), and high sensitivity [tumor regression grade (TRG) 0 and TRG 1] versus moderate sensitivity (TRG 2 or patients with TRG 3 and a reduction in tumor volume of at least 20% compared to baseline) versus low sensitivity (TRG 3 and a reduction in tumor volume <20% compared to baseline) (Group 2). We extracted and selected clinical and radiomic features on baseline T2WI. Then we built LR models and DL models. Receiver operating characteristic (ROC) curves analysis was performed to assess predictive performance of models.

RESULTS

Eighty-nine patients were assigned to the training cohort, and 29 patients were assigned to the testing cohort. The area under receiver operating characteristics curve (AUC) of LR models, which were predictive of high sensitivity and pCR, were 0.853 and 0.866, respectively. Whereas the AUCs of DL models were 0.829 and 0.838, respectively. After 10 rounds of cross validation, the accuracy of the models in Group 1 is higher than in Group 2.

CONCLUSION

There was no significant difference between LR model and DL model. Artificial Intelligence-based radiomics biomarkers may have potential clinical implications for adaptive and personalized therapy.

Current Evidence, Limitations and Future Challenges of Survival Prediction for Glioblastoma Based on Advanced Noninvasive Methods: A Narrative Review

Background and Objectives: Survival estimation for patients diagnosed with Glioblastoma (GBM) is an important information to consider in patient management and communication. Despite some known risk factors, survival estimation remains a major challenge. Novel non-invasive technologies such as radiomics and artificial intelligence (AI) have been implemented to increase the accuracy of these predictions. In this article, we reviewed and discussed the most significant available research on survival estimation for GBM through advanced non-invasive methods. Materials and Methods: PubMed database was queried for articles reporting on survival prognosis for GBM through advanced image and data management methods. Articles including in their title or abstract the following terms were initially screened: ((glioma) AND (survival)) AND ((artificial intelligence) OR (radiomics)). Exclusively English full-text articles, reporting on humans, published as of 1 September 2022 were considered. Articles not reporting on overall survival, evaluating the effects of new therapies or including other tumors were excluded. Research with a radiomics-based methodology were evaluated using the radiomics quality score (RQS). Results: 382 articles were identified. After applying the inclusion criteria, 46 articles remained for further analysis. These articles were thoroughly assessed, summarized and discussed. The results of the RQS revealed some of the limitations of current radiomics investigation on this field. Limitations of analyzed studies included data availability, patient selection and heterogeneity of methodologies. Future challenges on this field are increasing data availability, improving the general understanding of how AI handles data and establishing solid correlations between image features and tumor's biology. Conclusions: Radiomics and AI methods of data processing offer a new paradigm of possibilities to tackle the question of survival prognosis in GBM.

An MRI-based joint model of radiomics and spatial distribution differentiates autoimmune encephalitis from low-grade diffuse astrocytoma

BACKGROUND

The differential diagnosis between autoimmune encephalitis and low-grade diffuse astrocytoma remains challenging. We aim to develop a quantitative model integrating radiomics and spatial distribution features derived from MRI for discriminating these two conditions.

METHODS

In our study, we included 188 patients with confirmed autoimmune encephalitis (n = 81) and WHO grade II diffuse astrocytoma (n = 107). Patients with autoimmune encephalitis (AE, n = 59) and WHO grade II diffuse astrocytoma (AS, n = 79) were divided into training and test sets, using stratified sampling according to MRI scanners. We further included an independent validation set (22 patients with AE and 28 patients with AS). Hyperintensity fluid-attenuated inversion recovery (FLAIR) lesions were segmented for each subject. Ten radiomics and eight spatial distribution features were selected via the least absolute shrinkage and selection operator (LASSO), and joint models were constructed by logistic regression for disease classification. Model performance was measured in the test set using the area under the receiver operating characteristic (ROC) curve (AUC). The discrimination performance of the joint model was compared with neuroradiologists.

RESULTS

The joint model achieved better performance (AUC 0.957/0.908, accuracy 0.914/0.840 for test and independent validation sets, respectively) than the radiomics and spatial distribution models. The joint model achieved lower performance than a senior neuroradiologist (AUC 0.917/0.875) but higher performance than a junior neuroradiologist (AUC 0.692/0.745) in the test and independent validation sets.

CONCLUSION

The joint model of radiomics and spatial distribution from a single FLAIR could effectively classify AE and AS, providing clinical decision support for the differential diagnosis between the two conditions.

Radiomic and Volumetric Measurements as Clinical Trial Endpoints—A Comprehensive Review

Simple Summary

The extraction of quantitative data from standard-of-care imaging modalities offers opportunities to improve the relevance and salience of imaging biomarkers used in drug development. This review aims to identify the challenges and opportunities for discovering new imaging-based biomarkers based on radiomic and volumetric assessment in the single-site solid tumor sites: breast cancer, rectal cancer, lung cancer and glioblastoma. Developing approaches to harmonize three essential areas: segmentation, validation and data sharing may expedite regulatory approval and adoption of novel cancer imaging biomarkers.

Abstract

Clinical trials for oncology drug development have long relied on surrogate outcome biomarkers that assess changes in tumor burden to accelerate drug registration (i.e., Response Evaluation Criteria in Solid Tumors version 1.1 (RECIST v1.1) criteria). Drug-induced reduction in tumor size represents an imperfect surrogate marker for drug activity and yet a radiologically determined objective response rate is a widely used endpoint for Phase 2 trials. With the addition of therapies targeting complex biological systems such as immune system and DNA damage repair pathways, incorporation of integrative response and outcome biomarkers may add more predictive value. We performed a review of the relevant literature in four representative tumor types (breast cancer, rectal cancer, lung cancer and glioblastoma) to assess the preparedness of volumetric and radiomics metrics as clinical trial endpoints. We identified three key areas—segmentation, validation and data sharing strategies—where concerted efforts are required to enable progress of volumetric- and radiomics-based clinical trial endpoints for wider clinical implementation.

Challenges in Glioblastoma Radiomics and the Path to Clinical Implementation

Radiomics is a field of medical imaging analysis that focuses on the extraction of many quantitative imaging features related to shape, intensity and texture. These features are incorporated into models designed to predict important clinical or biological endpoints for patients. Attention for radiomics research has recently grown dramatically due to the increased use of imaging and the availability of large, publicly available imaging datasets. Glioblastoma multiforme (GBM) patients stand to benefit from this emerging research field as radiomics has the potential to assess the biological heterogeneity of the tumour, which contributes significantly to the inefficacy of current standard of care therapy. Radiomics models still require further development before they are implemented clinically in GBM patient management. Challenges relating to the standardisation of the radiomics process and the validation of radiomic models impede the progress of research towards clinical implementation. In this manuscript, we review the current state of radiomics in GBM, and we highlight the barriers to clinical implementation and discuss future validation studies needed to advance radiomics models towards clinical application.

Beware the Black-Box of Medical Image Generation: an Uncertainty Analysis by the Learned Feature Space

Deep neural networks (DNNs) are the primary driving force for the current development of medical imaging analysis tools and often provide exciting performance on various tasks. However, such results are usually reported on the overall performance of DNNs, such as the Peak signal-to-noise ratio (PSNR) or mean square error (MSE) for imaging generation tasks. As a black-box, DNNs usually produce a relatively stable performance on the same task across multiple training trials, while the learned feature spaces could be significantly different. We believe additional insightful analysis, such as uncertainty analysis of the learned feature space, is equally important, if not more. Through this work, we evaluate the learned feature space of multiple U-Net architectures for image generation tasks using computational analysis and clustering analysis methods. We demonstrate that the learned feature spaces are easily separable between different training trials of the same architecture with the same hyperparameter setting, indicating the models using different criteria for the same tasks. This phenomenon naturally raises the question of which criteria are correct to use. Thus, our work suggests that assessments other than overall performance are needed before applying a DNN model to real-world practice.

Artificial Intelligence for Survival Prediction in Brain Tumors on Neuroimaging

Survival prediction of patients affected by brain tumors provides essential information to guide surgical planning, adjuvant treatment selection, and patient counseling. Current reliance on clinical factors, such as Karnofsky Performance Status Scale, and simplistic radiological characteristics are, however, inadequate for survival prediction in tumors such as glioma that demonstrate molecular and clinical heterogeneity with variable survival outcomes. Advances in the domain of artificial intelligence have afforded powerful tools to capture a large number of hidden high-dimensional imaging features that reflect abundant information about tumor structure and physiology. Here, we provide an overview of current literature that apply computational analysis tools such as radiomics and machine learning methods to the pipeline of image preprocessing, tumor segmentation, feature extraction, and construction of classifiers to establish survival prediction models based on neuroimaging. We also discuss challenges relating to the development and evaluation of such models and explore ethical issues surrounding the future use of machine learning predictions.

MS-ResNet: disease-specific survival prediction using longitudinal CT images and clinical data

PURPOSE

Medical imaging data of lung cancer in different stages contain a large amount of time information related to its evolution (emergence, development, or extinction). We try to explore the evolution process of lung images in time dimension to improve the prediction of lung cancer survival by using longitudinal CT images and clinical data jointly.

METHODS

In this paper, we propose an innovative multi-branch spatiotemporal residual network (MS-ResNet) for disease-specific survival (DSS) prediction by integrating the longitudinal computed tomography (CT) images at different times and clinical data. Specifically, we first extract the deep features from the multi-period CT images by an improved residual network. Then, the feature selection algorithm is used to select the most relevant feature subset from the clinical data. Finally, we integrate the deep features and feature subsets to take full advantage of the complementarity between the two types of data to generate the final prediction results.

RESULTS

The experimental results demonstrate that our MS-ResNet model is superior to other methods, achieving a promising 86.78% accuracy in the classification of short-survivor, med-survivor, and long-survivor.

CONCLUSION

In computer-aided prognostic analysis of cancer, the time dimension features of the course of disease and the integration of patient clinical data and CT data can effectively improve the prediction accuracy.

Computer-Aided Diagnosis of Spinal Tuberculosis From CT Images Based on Deep Learning With Multimodal Feature Fusion

Background

Spinal tuberculosis (TB) has the highest incidence in remote plateau areas, particularly in Tibet, China, due to inadequate local healthcare services, which not only facilitates the transmission of TB bacteria but also increases the burden on grassroots hospitals. Computer-aided diagnosis (CAD) is urgently required to improve the efficiency of clinical diagnosis of TB using computed tomography (CT) images. However, classical machine learning with handcrafted features generally has low accuracy, and deep learning with self-extracting features relies heavily on the size of medical datasets. Therefore, CAD, which effectively fuses multimodal features, is an alternative solution for spinal TB detection.

Methods

A new deep learning method is proposed that fuses four elaborate image features, specifically three handcrafted features and one convolutional neural network (CNN) feature. Spinal TB CT images were collected from 197 patients with spinal TB, from 2013 to 2020, in the People’s Hospital of Tibet Autonomous Region, China; 3,000 effective lumbar spine CT images were randomly screened to our dataset, from which two sets of 1,500 images each were classified as tuberculosis (positive) and health (negative). In addition, virtual data augmentation is proposed to enlarge the handcrafted features of the TB dataset. Essentially, the proposed multimodal feature fusion CNN consists of four main sections: matching network, backbone (ResNet-18/50, VGG-11/16, DenseNet-121/161), fallen network, and gated information fusion network. Detailed performance analyses were conducted based on the multimodal features, proposed augmentation, model stability, and model-focused heatmap.

Results

Experimental results showed that the proposed model with VGG-11 and virtual data augmentation exhibited optimal performance in terms of accuracy, specificity, sensitivity, and area under curve. In addition, an inverse relationship existed between the model size and test accuracy. The model-focused heatmap also shifted from the irrelevant region to the bone destruction caused by TB.

Conclusion

The proposed augmentation effectively simulated the real data distribution in the feature space. More importantly, all the evaluation metrics and analyses demonstrated that the proposed deep learning model exhibits efficient feature fusion for multimodal features. Our study provides a profound insight into the preliminary auxiliary diagnosis of spinal TB from CT images applicable to the Tibetan area.

State-of-the-art techniques using pre-operative brain MRI scans for survival prediction of glioblastoma multiforme patients and future research directions

Objective

Glioblastoma multiforme (GBM) is a grade IV brain tumour with very low life expectancy. Physicians and oncologists urgently require automated techniques in clinics for brain tumour segmentation (BTS) and survival prediction (SP) of GBM patients to perform precise surgery followed by chemotherapy treatment.

Methods

This study aims at examining the recent methodologies developed using automated learning and radiomics to automate the process of SP. Automated techniques use pre-operative raw magnetic resonance imaging (MRI) scans and clinical data related to GBM patients. All SP methods submitted for the multimodal brain tumour segmentation (BraTS) challenge are examined to extract the generic workflow for SP.

Results

The maximum accuracies achieved by 21 state-of-the-art different SP techniques reviewed in this study are 65.5 and 61.7% using the validation and testing subsets of the BraTS dataset, respectively. The comparisons based on segmentation architectures, SP models, training parameters and hardware configurations have been made.

Conclusion

The limited accuracies achieved in the literature led us to review the various automated methodologies and evaluation metrics to find out the research gaps and other findings related to the survival prognosis of GBM patients so that these accuracies can be improved in future. Finally, the paper provides the most promising future research directions to improve the performance of automated SP techniques and increase their clinical relevance.

Treatment Response and Prognosis Evaluation in High-Grade Glioma: An Imaging Review Based on MRI

In recent years, the development of advanced magnetic resonance imaging (MRI) technology and machine learning (ML) have created new tools for evaluating treatment response and prognosis of patients with high-grade gliomas (HGG); however, patient prognosis has not improved significantly. This is mainly due to the heterogeneity between and within HGG tumors, resulting in standard treatment methods not benefitting all patients. Moreover, the survival of patients with HGG is not only related to tumor cells, but also to noncancer cells in the tumor microenvironment (TME). Therefore, during preoperative diagnosis and follow-up treatment of patients with HGG, noninvasive imaging markers are needed to characterize intratumoral heterogeneity, and then to evaluate treatment response and predict prognosis, timeously adjust treatment strategies, and achieve individualized diagnosis and treatment. In this review, we summarize the research progress of conventional MRI, advanced MRI technology, and ML in evaluation of treatment response and prognosis of patients with HGG. We further discuss the significance of the TME in the prognosis of HGG patients, associate imaging features with the TME, indirectly reflecting the heterogeneity within the tumor, and shifting treatment strategies from tumor cells alone to systemic therapy of the TME, which may be a major development direction in the future. LEVEL OF EVIDENCE: 5 TECHNICAL EFFICACY STAGE: 4.

Predicting Short-Term Survival after Gross Total or Near Total Resection in Glioblastomas by Machine Learning-Based Radiomic Analysis of Preoperative MRI

Radiomics, in combination with artificial intelligence, has emerged as a powerful tool for the development of predictive models in neuro-oncology. Our study aims to find an answer to a clinically relevant question: is there a radiomic profile that can identify glioblastoma (GBM) patients with short-term survival after complete tumor resection? A retrospective study of GBM patients who underwent surgery was conducted in two institutions between January 2019 and January 2020, along with cases from public databases. Cases with gross total or near total tumor resection were included. Preoperative structural multiparametric magnetic resonance imaging (mpMRI) sequences were pre-processed, and a total of 15,720 radiomic features were extracted. After feature reduction, machine learning-based classifiers were used to predict early mortality (<6 months). Additionally, a survival analysis was performed using the random survival forest (RSF) algorithm. A total of 203 patients were enrolled in this study. In the classification task, the naive Bayes classifier obtained the best results in the test data set, with an area under the curve (AUC) of 0.769 and classification accuracy of 80%. The RSF model allowed the stratification of patients into low- and high-risk groups. In the test data set, this model obtained values of C-Index = 0.61, IBS = 0.123 and integrated AUC at six months of 0.761. In this study, we developed a reliable predictive model of short-term survival in GBM by applying open-source and user-friendly computational means. These new tools will assist clinicians in adapting our therapeutic approach considering individual patient characteristics.

The Role of Exosomal miRNAs in Glioma: Biological Function and Clinical Application

Gliomas are complex and heterogeneous central nervous system tumors with poor prognosis. Despite the increasing development of aggressive combination therapies, the prognosis of glioma is generally unsatisfactory. Exosomal microRNA (miRNA) has been successfully used in other diseases as a reliable biomarker and even therapeutic target. Recent studies show that exosomal miRNA plays an important role in glioma occurrence, development, invasion, metastasis, and treatment resistance. However, the association of exosomal miRNA between glioma has not been systemically characterized. This will provide a theoretical basis for us to further explore the relationship between exosomal miRNAs and glioma and also has a positive clinical significance in the innovative diagnosis and treatment of glioma.

An Automatic Deep Learning-Based Workflow for Glioblastoma Survival Prediction Using Preoperative Multimodal MR Images: A Feasibility Study

PURPOSE

Most radiomic studies use the features extracted from the manually drawn tumor contours for classification or survival prediction. However, large interobserver segmentation variations lead to inconsistent features and hence introduce more challenges in constructing robust prediction models. Here, we proposed an automatic workflow for glioblastoma (GBM) survival prediction based on multimodal magnetic resonance (MR) images.

METHODS AND MATERIALS

Two hundred eighty-five patients with glioma (210 GBM, 75 low-grade glioma) were included. One hundred sixty-three of the patients with GBM had overall survival data. Every patient had 4 preoperative MR images and manually drawn tumor contours. A 3-dimensional convolutional neural network, VGG-Seg, was trained and validated using 122 patients with glioma for automatic GBM segmentation. The trained VGG-Seg was applied to the remaining 163 patients with GBM to generate their autosegmented tumor contours. The handcrafted and deep learning (DL)-based radiomic features were extracted from the autosegmented contours using explicitly designed algorithms and a pretrained convolutional neural network, respectively. One hundred sixty-three patients with GBM were randomly split into training (n = 122) and testing (n = 41) sets for survival analysis. Cox regression models were trained to construct the handcrafted and DL-based signatures. The prognostic powers of the 2 signatures were evaluated and compared.

RESULTS

The VGG-Seg achieved a mean Dice coefficient of 0.86 across 163 patients with GBM for GBM segmentation. The handcrafted signature achieved a C-index of 0.64 (95% confidence interval, 0.55-0.73), whereas the DL-based signature achieved a C-index of 0.67 (95% confidence interval, 0.57-0.77). Unlike the handcrafted signature, the DL-based signature successfully stratified testing patients into 2 prognostically distinct groups.

CONCLUSIONS

The VGG-Seg generated accurate GBM contours from 4 MR images. The DL-based signature achieved a numerically higher C-index than the handcrafted signature and significant patient stratification. The proposed automatic workflow demonstrated the potential of improving patient stratification and survival prediction in patients with GBM.

A Comprehensive Review on Radiomics and Deep Learning for Nasopharyngeal Carcinoma Imaging

Nasopharyngeal carcinoma (NPC) is one of the most common malignant tumours of the head and neck, and improving the efficiency of its diagnosis and treatment strategies is an important goal. With the development of the combination of artificial intelligence (AI) technology and medical imaging in recent years, an increasing number of studies have been conducted on image analysis of NPC using AI tools, especially radiomics and artificial neural network methods. In this review, we present a comprehensive overview of NPC imaging research based on radiomics and deep learning. These studies depict a promising prospect for the diagnosis and treatment of NPC. The deficiencies of the current studies and the potential of radiomics and deep learning for NPC imaging are discussed. We conclude that future research should establish a large-scale labelled dataset of NPC images and that studies focused on screening for NPC using AI are necessary.

Machine-Learning Approach to Differentiation of Benign and Malignant Peripheral Nerve Sheath Tumors: A Multicenter Study

BACKGROUND

Clinicoradiologic differentiation between benign and malignant peripheral nerve sheath tumors (PNSTs) has important management implications.

OBJECTIVE

To develop and evaluate machine-learning approaches to differentiate benign from malignant PNSTs.

METHODS

We identified PNSTs treated at 3 institutions and extracted high-dimensional radiomics features from gadolinium-enhanced, T1-weighted magnetic resonance imaging (MRI) sequences. Training and test sets were selected randomly in a 70:30 ratio. A total of 900 image features were automatically extracted using the PyRadiomics package from Quantitative Imaging Feature Pipeline. Clinical data including age, sex, neurogenetic syndrome presence, spontaneous pain, and motor deficit were also incorporated. Features were selected using sparse regression analysis and retained features were further refined by gradient boost modeling to optimize the area under the curve (AUC) for diagnosis. We evaluated the performance of radiomics-based classifiers with and without clinical features and compared performance against human readers.

RESULTS

A total of 95 malignant and 171 benign PNSTs were included. The final classifier model included 21 imaging and clinical features. Sensitivity, specificity, and AUC of 0.676, 0.882, and 0.845, respectively, were achieved on the test set. Using imaging and clinical features, human experts collectively achieved sensitivity, specificity, and AUC of 0.786, 0.431, and 0.624, respectively. The AUC of the classifier was statistically better than expert humans (P = .002). Expert humans were not statistically better than the no-information rate, whereas the classifier was (P = .001).

CONCLUSION

Radiomics-based machine learning using routine MRI sequences and clinical features can aid in evaluation of PNSTs. Further improvement may be achieved by incorporating additional imaging sequences and clinical variables into future models.

Incorporating radiomics into clinical trials: expert consensus endorsed by the European Society of Radiology on considerations for data-driven compared to biologically driven quantitative biomarkers

Existing quantitative imaging biomarkers (QIBs) are associated with known biological tissue characteristics and follow a well-understood path of technical, biological and clinical validation before incorporation into clinical trials. In radiomics, novel data-driven processes extract numerous visually imperceptible statistical features from the imaging data with no a priori assumptions on their correlation with biological processes. The selection of relevant features (radiomic signature) and incorporation into clinical trials therefore requires additional considerations to ensure meaningful imaging endpoints. Also, the number of radiomic features tested means that power calculations would result in sample sizes impossible to achieve within clinical trials. This article examines how the process of standardising and validating data-driven imaging biomarkers differs from those based on biological associations. Radiomic signatures are best developed initially on datasets that represent diversity of acquisition protocols as well as diversity of disease and of normal findings, rather than within clinical trials with standardised and optimised protocols as this would risk the selection of radiomic features being linked to the imaging process rather than the pathology. Normalisation through discretisation and feature harmonisation are essential pre-processing steps. Biological correlation may be performed after the technical and clinical validity of a radiomic signature is established, but is not mandatory. Feature selection may be part of discovery within a radiomics-specific trial or represent exploratory endpoints within an established trial; a previously validated radiomic signature may even be used as a primary/secondary endpoint, particularly if associations are demonstrated with specific biological processes and pathways being targeted within clinical trials. KEY POINTS: • Data-driven processes like radiomics risk false discoveries due to high-dimensionality of the dataset compared to sample size, making adequate diversity of the data, cross-validation and external validation essential to mitigate the risks of spurious associations and overfitting. • Use of radiomic signatures within clinical trials requires multistep standardisation of image acquisition, image analysis and data mining processes. • Biological correlation may be established after clinical validation but is not mandatory.

A machine learning-based survival prediction model of high grade glioma by integration of clinical and dose-volume histogram parameters

PURPOSE

Glioma is the most common type of primary brain tumor in adults, and it causes significant morbidity and mortality, especially in high-grade glioma (HGG) patients. The accurate prognostic prediction of HGG is vital and helpful for clinicians when developing therapeutic strategies. Therefore, we propose a machine learning-based survival prediction model by analyzing clinical and dose-volume histogram (DVH) parameters, to improve the performance of the risk model in HGG patients.

METHODS

Eight clinical variables and 39 DVH parameters were extracted for each patient, who received radiotherapy for HGG with active follow-up. Ninety-five patients were randomly divided into training and testing cohorts, and we employed random survival forest (RSF), support vector machine (SVM), and Cox proportional hazards (CPHs) models to predict survival. Calibration plots, concordance indexes, and decision curve analyses were used to evaluate the calibration, discrimination, and clinical utility of these three models.

RESULTS

The RSF model showed the best performance among the three models, with concordance indexes of 0.824 and 0.847 in the training and testing sets, respectively, followed by the SVM (0.792/0.823) and CPH (0.821/0.811) models. Specifically, in the RSF model, we identified age, gross tumor volume (GTV), grade, Karnofsky performance status (KPS), isocitrate dehydrogenase (IDH), and D99 as important variables associated with survival. The AUCs of the testing set were 92.4%, 87.7%, and 84.0% for 1-, 2-, and 3-year survival, respectively. According to this model, HGG patients can be divided into high- and low-risk groups.

CONCLUSION

The machine learning-based RSF model integrating both clinical and DVH variables is an improved and useful tool for predicting the survival of HGG patients.

Survival prediction in glioblastoma on post-contrast magnetic resonance imaging using filtration based first-order texture analysis: Comparison of multiple machine learning models

OBJECTIVE

Magnetic resonance texture analysis (MRTA) is a relatively new technique that can be a valuable addition to clinical and imaging parameters in predicting prognosis. In the present study, we investigated the efficacy of MRTA for glioblastoma survival using T1 contrast-enhanced (CE) images for texture analysis.

METHODS

We evaluated the diagnostic performance of multiple machine learning models based on first-order histogram statistical parameters derived from T1-weighted CE images in the survival stratification of glioblastoma multiforme (GBM). Retrospective evaluation of 85 patients with GBM was performed. Thirty-six first-order texture parameters at six spatial scale filters (SSF) were extracted on the T1 CE axial images for the whole tumor using commercially available research software. Several machine learning classification models (in four broad categories: linear, penalized linear, non-linear, and ensemble classifiers) were evaluated to assess the survival prediction performance using optimal features. Principal component analysis was used prior to fitting the linear classifiers in order to reduce the dimensionality of the feature inputs. Fivefold cross-validation was used to partition the data iteratively into training and testing sets. The area under the receiver operating characteristic curve (AUC) was used to assess the diagnostic performance.

RESULTS

The neural network model was the highest performing model with the highest observed AUC (0.811) and cross-validated AUC (0.71). The most important variable was the age at diagnosis, with mean and mean of positive pixels (MPP) for SSF = 0 being the second and third most important, followed by skewness for SSF = 0 and SSF = 4.

CONCLUSIONS

First-order texture features, when combined with age at presentation, show good accuracy in predicting GBM survival.

A radiomics model of predicting tumor volume change of patients with stage III non-small cell lung cancer after radiotherapy

To predict the volume change of stage III NSCLC after radiotherapy with 60 Gy.This retrospective study included two independent cohorts, a train cohort of 192 patients, and a test cohort of 31 patients. We developed a radiomics model based on radiomics features and clinical variables. LIFEx package was used to extract radiomics texture features from CT images. The classification method was logistic regression analysis and feature selection was performed by correlation coefficients. Performance metrics of logistic regression include accuracy, precision, the receiver operating characteristic curves, and recall.The combination features of clinical variables and radiomics can predict the tumor volume change after radiotherapy with 88.7% accuracy (88.6% precision, 88.7% recall, and 88.7% ROC area).Radiomics features combined with medical knowledge have a great potential to predict accurately tumor volume change of stage III NSCLC after radiotherapy with 60 Gy.

Radiomics in breast cancer classification and prediction

Breast Cancer (BC) is the common form of cancer in women. Its diagnosis and screening are usually performed through different imaging modalities such as mammography, magnetic resonance imaging and ultrasound. However, mammography and ultrasound-imaging techniques have limited sensitivity and specificity both in identifying lesions and in differentiating malign from benign lesions, especially in presence of dense breast parenchyma. Due to the higher resolution of magnetic resonance images, MRI represents the method with the higher specificity and sensitivity among all the available tools, in both lesions' identification and diagnosis. However, especially for diagnosis, even MRI has limitations that are only partially solved if combined with mammography. Unfortunately, due to the limits of all these imaging tools, in order to have a certain diagnosis, patients often receive painful and costly bioptics procedures. In this context, several computational approaches have been developed to increase sensitivity, while maintaining the same specificity, in BC diagnosis and screening. Amongst these, radiomics has been increasingly gaining ground in oncology to improve cancer diagnosis, prognosis and treatment. Radiomics derives multiple quantitative features from single or multiple medical imaging modalities, highlighting image traits which are not visible to the naked eye and hence significantly augmenting the discriminatory and predictive potential of medical imaging. This review article aims to summarize the state of the art in radiomics-based BC research. The dominating evidence extracted from the literature points towards a high potential of radiomics in disentangling malignant from benign breast lesions, classifying BC types and grades and also in predicting treatment response and recurrence risk. In the era of personalized medicine, radiomics has the potential to improve diagnosis, prognosis, prediction, monitoring, image-based intervention, and assessment of therapeutic response in BC.

BraTS Toolkit: Translating BraTS Brain Tumor Segmentation Algorithms Into Clinical and Scientific Practice

Despite great advances in brain tumor segmentation and clear clinical need, translation of state-of-the-art computational methods into clinical routine and scientific practice remains a major challenge. Several factors impede successful implementations, including data standardization and preprocessing. However, these steps are pivotal for the deployment of state-of-the-art image segmentation algorithms. To overcome these issues, we present BraTS Toolkit. BraTS Toolkit is a holistic approach to brain tumor segmentation and consists of three components: First, the BraTS Preprocessor facilitates data standardization and preprocessing for researchers and clinicians alike. It covers the entire image analysis workflow prior to tumor segmentation, from image conversion and registration to brain extraction. Second, BraTS Segmentor enables orchestration of BraTS brain tumor segmentation algorithms for generation of fully-automated segmentations. Finally, Brats Fusionator can combine the resulting candidate segmentations into consensus segmentations using fusion methods such as majority voting and iterative SIMPLE fusion. The capabilities of our tools are illustrated with a practical example to enable easy translation to clinical and scientific practice.

Tumor Cell Invasion in Glioblastoma

Glioblastoma (GBM) is a particularly devastating tumor with a median survival of about 16 months. Recent research has revealed novel insights into the outstanding heterogeneity of this type of brain cancer. However, all GBM subtypes share the hallmark feature of aggressive invasion into the surrounding tissue. Invasive glioblastoma cells escape surgery and focal therapies and thus represent a major obstacle for curative therapy. This review aims to provide a comprehensive understanding of glioma invasion mechanisms with respect to tumor-cell-intrinsic properties as well as cues provided by the microenvironment. We discuss genetic programs that may influence the dissemination and plasticity of GBM cells as well as their different invasion patterns. We also review how tumor cells shape their microenvironment and how, vice versa, components of the extracellular matrix and factors from non-neoplastic cells influence tumor cell motility. We further discuss different research platforms for modeling invasion. Finally, we highlight the importance of accounting for the complex interplay between tumor cell invasion and treatment resistance in glioblastoma when considering new therapeutic approaches.