Prediction of Glioma Grade Using Intratumoral and Peritumoral Radiomic Features From Multiparametric MRI Images

Assessment of MGMT promoter methylation status in glioblastoma using deep learning features from multi-sequence MRI of intratumoral and peritumoral regions

OBJECTIVE

This study aims to evaluate the effectiveness of deep learning features derived from multi-sequence magnetic resonance imaging (MRI) in determining the O6-methylguanine-DNA methyltransferase (MGMT) promoter methylation status among glioblastoma patients.

METHODS

Clinical, pathological, and MRI data of 356 glioblastoma patients (251 methylated, 105 unmethylated) were retrospectively examined from the public dataset The Cancer Imaging Archive. Each patient underwent preoperative multi-sequence brain MRI scans, which included T1-weighted imaging (T1WI) and contrast-enhanced T1-weighted imaging (CE-T1WI). Regions of interest (ROIs) were delineated to identify the necrotic tumor core (NCR), enhancing tumor (ET), and peritumoral edema (PED). The ET and NCR regions were categorized as intratumoral ROIs, whereas the PED region was categorized as peritumoral ROIs. Predictive models were developed using the Transformer algorithm based on intratumoral, peritumoral, and combined MRI features. The area under the receiver operating characteristic curve (AUC) was employed to assess predictive performance.

RESULTS

The ROI-based models of intratumoral and peritumoral regions, utilizing deep learning algorithms on multi-sequence MRI, were capable of predicting MGMT promoter methylation status in glioblastoma patients. The combined model of intratumoral and peritumoral regions exhibited superior diagnostic performance relative to individual models, achieving an AUC of 0.923 (95% confidence interval [CI]: 0.890 - 0.948) in stratified cross-validation, with sensitivity and specificity of 86.45% and 87.62%, respectively.

CONCLUSION

The deep learning model based on MRI data can effectively distinguish between glioblastoma patients with and without MGMT promoter methylation.

Magnetic resonance imaging (MRI)-based intratumoral and peritumoral radiomics for prognosis prediction in glioma patients

AIM

The purpose of this study was to identify robust radiological features from intratumoral and peritumoral regions, evaluate MRI protocols, and machine learning methods for overall survival stratification of glioma patients, and explore the relationship between radiological features and the tumour microenvironment.

MATERIAL AND METHODS

A retrospective analysis was conducted on 163 glioma patients, divided into a training set (n=113) and a testing set (n=50). For each patient, 2135 features were extracted from clinical MRI. Feature selection was performed using the Minimum Redundancy Maximum Relevance method and the Random Forest (RF) algorithm. Prognostic factors were assessed using the Cox proportional hazards model. Four machine learning models (RF, Logistic Regression, Support Vector Machine, and XGBoost) were trained on clinical and radiological features from tumour and peritumoral regions. Model evaluations on the testing set used receiver operating characteristic curves.

RESULTS

Among the 163 patients, 96 had an overall survival (OS) of less than three years postsurgery, while 67 had an OS of more than three years. Univariate Cox regression in the validation set indicated that age (p=0.003) and tumour grade (p<0.001) were positively associated with the risk of death within three years postsurgery. The final predictive model incorporated 13 radiological and 7 clinical features. The RF model, combining intratumor and peritumor radiomics, achieved the best predictive performance (AUC = 0.91; ACC = 0.86), outperforming single-region models.

CONCLUSION

Combined intratumoral and peritumoral radiomics can improve survival prediction and have potential as a practical imaging biomarker to guide clinical decision-making.

Radiomic features on multiparametric MRI for differentiating pseudoprogression from recurrence in high-grade gliomas

BACKGROUND

Distinguishing between tumor recurrence and pseudoprogression (PsP) in high-grade glioma postoperatively is challenging. This study aims to enhance this differentiation using a combination of intratumoral and peritumoral radiomics.

PURPOSE

To assess the effectiveness of intratumoral and peritumoral radiomics in improving the differentiation between high-grade glioma recurrence and pseudoprogression after surgery.

MATERIAL AND METHODS

A total of 109 cases were randomly divided into training and validation sets, with 1316 features extracted from intratumoral and peritumoral volumes of interest (VOIs) on conventional magnetic resonance imaging (MRI) and apparent diffusion coefficient (ADC) maps. Feature selection was performed using the mRMR algorithm, resulting in intratumoral (100 features), peritumoral (100 features), and combined (200 features) subsets. Optimal features were then selected using PCC and RFE algorithms and modeled using LR, SVM, and LDA classifiers. Diagnostic performance was compared using area under the receiver operating characteristic curve (AUC), evaluated in the validation set. A nomogram was established using radscores from intratumoral, peritumoral, and combined models.

RESULTS

The combined model, utilizing 14 optimal features (8 peritumoral, 6 intratumoral) and LR as the best classifier, outperformed the single intratumoral and peritumoral models. In the training set, the AUC values for the combined model, intratumoral model, and peritumoral model were 0.938, 0.921, and 0.847, respectively; in the validation set, the AUC values were 0.841, 0.755, and 0.705. The nomogram model demonstrated AUCs of 0.960 (training set) and 0.850 (validation set).

CONCLUSION

The combination of intratumoral and peritumoral radiomics is effective in distinguishing high-grade glioma recurrence from pseudoprogression after surgery.

Integrated diagnosis of glioma based on magnetic resonance images with incomplete ground truth labels

BACKGROUND

Since the 2016 WHO guidelines, glioma diagnosis has entered an era of integrated diagnosis, combining tissue pathology and molecular pathology. The WHO has focused on promoting the application of molecular diagnosis in the classification of central nervous system tumors. Genetic information such as IDH1 and 1p/19q are important molecular markers, and pathological grading is also a key clinical indicator. However, obtaining genetic pathology labels is more costly than conventional MRI images, resulting in a large number of missing labels in realistic modeling.

METHOD

We propose a training strategy based on label encoding and a corresponding loss function to enable the model to effectively utilize data with missing labels. Additionally, we integrate a graph model with genes and pathology-related clinical prior knowledge into the ResNet backbone to further improve the efficacy of diagnosis. Ten-fold cross-validation experiments were conducted on a large dataset of 1072 patients.

RESULTS

The classification area under the curve (AUC) values are 0.93, 0.91, and 0.90 for IDH1, 1p/19q status, and grade (LGG/HGG), respectively. When the label miss rate reached 59.3 %, the method improved the AUC by 0.09, 0.10, and 0.04 for IDH1, 1p/19q, and pathological grade, respectively, compared to the same backbone without the missing label strategy.

CONCLUSIONS

Our method effectively utilizes data with missing labels and integrates clinical prior knowledge, resulting in improved diagnostic performance for glioma genetic and pathological markers, even with high rates of missing labels.

CFINet: Cross-Modality MRI Feature Interaction Network for Pseudoprogression Prediction of Glioblastoma

Pseudoprogression (PSP) is a related reaction of glioblastoma treatment, and misdiagnosis can lead to unnecessary intervention. Magnetic resonance imaging (MRI) provides cross-modality images for PSP prediction studies. However, how to effectively use the complementary information between the cross-modality MRI to improve PSP prediction is still a challenging task. To address this challenge, we propose a cross-modality feature interaction network for PSP prediction. Firstly, we propose a triple-branch multi-scale module to extract low-order feature representations and a skip-connection multi-scale module to extract high-order feature representations. Then, a cross-modality interaction module based on attention mechanism is designed to make the complementary information between cross-modality MRI fully interact. Finally, the high-order cross-modality interaction information is fed into a multi-layer perceptron to achieve the PSP prediction task. We evaluate the proposed network on a private dataset with 52 subjects from Hunan Cancer Hospital and validate it on a private dataset with 30 subjects from Xiangya Hospital. The accuracy of our proposed network on the datasets is 0.954 and 0.929, respectively, which is better than most typical convolutional neural network and interaction methods.

MRI-based intratumoral and peritumoral radiomics for preoperative prediction of glioma grade: a multicenter study

Background

Accurate preoperative prediction of glioma is crucial for developing individualized treatment decisions and assessing prognosis. In this study, we aimed to establish and evaluate the value of integrated models by incorporating the intratumoral and peritumoral features from conventional MRI and clinical characteristics in the prediction of glioma grade.

Methods

A total of 213 glioma patients from two centers were included in the retrospective analysis, among which, 132 patients were classified as the training cohort and internal validation set, and the remaining 81 patients were zoned as the independent external testing cohort. A total of 7728 features were extracted from MRI sequences and various volumes of interest (VOIs). After feature selection, 30 radiomic models depended on five sets of machine learning classifiers, different MRI sequences, and four different combinations of predictive feature sources, including features from the intratumoral region only, features from the peritumoral edema region only, features from the fusion area including intratumoral and peritumoral edema region (VOI-fusion), and features from the intratumoral region with the addition of features from peritumoral edema region (feature-fusion), were established to select the optimal model. A nomogram based on the clinical parameter and optimal radiomic model was constructed for predicting glioma grade in clinical practice.

Results

The intratumoral radiomic models based on contrast-enhanced T1-weighted and T2-flair sequences outperformed those based on a single MRI sequence. Moreover, the internal validation and independent external test underscored that the XGBoost machine learning classifier, incorporating features extracted from VOI-fusion, showed superior predictive efficiency in differentiating between low-grade gliomas (LGG) and high-grade gliomas (HGG), with an AUC of 0.805 in the external test. The radiomic models of VOI-fusion yielded higher prediction efficiency than those of feature-fusion. Additionally, the developed nomogram presented an optimal predictive efficacy with an AUC of 0.825 in the testing cohort.

Conclusion

This study systematically investigated the effect of intratumoral and peritumoral radiomics to predict glioma grading with conventional MRI. The optimal model was the XGBoost classifier coupled radiomic model based on VOI-fusion. The radiomic models that depended on VOI-fusion outperformed those that depended on feature-fusion, suggesting that peritumoral features should be rationally utilized in radiomic studies.

Graph-Based Fusion of Imaging, Genetic and Clinical Data for Degenerative Disease Diagnosis

Graph learning methods have achieved noteworthy performance in disease diagnosis due to their ability to represent unstructured information such as inter-subject relationships. While it has been shown that imaging, genetic and clinical data are crucial for degenerative disease diagnosis, existing methods rarely consider how best to use their relationships. How best to utilize information from imaging, genetic and clinical data remains a challenging problem. This study proposes a novel graph-based fusion (GBF) approach to meet this challenge. To extract effective imaging-genetic features, we propose an imaging-genetic fusion module which uses an attention mechanism to obtain modality-specific and joint representations within and between imaging and genetic data. Then, considering the effectiveness of clinical information for diagnosing degenerative diseases, we propose a multi-graph fusion module to further fuse imaging-genetic and clinical features, which adopts a learnable graph construction strategy and a graph ensemble method. Experimental results on two benchmarks for degenerative disease diagnosis (Alzheimers Disease Neuroimaging Initiative and Parkinson's Progression Markers Initiative) demonstrate its effectiveness compared to state-of-the-art graph-based methods. Our findings should help guide further development of graph-based models for dealing with imaging, genetic and clinical data.

Automated Collateral Scoring on CT Angiography of Patients with Acute Ischemic Stroke Using Hybrid CNN and Transformer Network

Collateral scoring plays an important role in diagnosis and treatment decisions of acute ischemic stroke (AIS). Most existing automated methods rely on vessel prominence and amount after vessel segmentation. The purpose of this study was to design a vessel-segmentation free method for automating collateral scoring on CT angiography (CTA). We first processed the original CTA via maximum intensity projection (MIP) and middle cerebral artery (MCA) region segmentation. The obtained MIP images were fed into our proposed hybrid CNN and Transformer model (MPViT) to automatically determine the collateral scores. We collected 154 CTA scans of patients with AIS for evaluation using five-folder cross validation. Results show that the proposed MPViT achieved an intraclass correlation coefficient of 0.767 (95% CI: 0.68-0.83) and a Kappa of 0.6184 (95% CI: 0.4954-0.7414) for three-point collateral score classification. For dichotomized classification (good vs. non-good and poor vs. non-poor), it also achieved great performance.

Automated Diagnosis of COVID-19 Using Deep Supervised Autoencoder With Multi-View Features From CT Images

Accurate and rapid diagnosis of coronavirus disease 2019 (COVID-19) from chest CT scans is of great importance and urgency during the worldwide outbreak. However, radiologists have to distinguish COVID-19 pneumonia from other pneumonia in a large number of CT scans, which is tedious and inefficient. Thus, it is urgently and clinically needed to develop an efficient and accurate diagnostic tool to help radiologists to fulfill the difficult task. In this study, we proposed a deep supervised autoencoder (DSAE) framework to automatically identify COVID-19 using multi-view features extracted from CT images. To fully explore features characterizing CT images from different frequency domains, DSAE was proposed to learn the latent representation by multi-task learning. The proposal was designed to both encode valuable information from different frequency features and construct a compact class structure for separability. To achieve this, we designed a multi-task loss function, which consists of a supervised loss and a reconstruction loss. Our proposed method was evaluated on a newly collected dataset of 787 subjects including COVID-19 pneumonia patients, other pneumonia patients, and normal subjects without abnormal CT findings. Extensive experimental results demonstrated that our proposed method achieved encouraging diagnostic performance and may have potential clinical application for the diagnosis of COVID-19.

A Survey of Radiomics in Precision Diagnosis and Treatment of Adult Gliomas

Glioma is the most common primary malignant tumor of the adult central nervous system (CNS), which mostly shows invasive growth. In most cases, surgery is often difficult to completely remove, and the recurrence rate and mortality of patients are high. With the continuous development of molecular genetics and the great progress of molecular biology technology, more and more molecular biomarkers have been proved to have important guiding significance in the individualized diagnosis, treatment, and prognosis evaluation of glioma. With the updates of the World Health Organization (WHO) classification of tumors of the CNS in 2021, the diagnosis and treatment of glioma has entered the era of precision medicine in the true sense. Due to its ability to non-invasively achieve accurate identification of glioma from other intracranial tumors, and to predict the grade, genotyping, treatment response, and prognosis of glioma, which provides a scientific basis for the clinical application of individualized diagnosis and treatment model of glioma, radiomics has become a research hotspot in the field of precision medicine. This paper reviewed the research related to radiomics of adult gliomas published in recent years and summarized the research proceedings of radiomics in differential diagnosis, preoperative grading and genotyping, treatment and efficacy evaluation, and survival prediction of adult gliomas.

A Fully Automated Multimodal MRI-Based Multi-Task Learning for Glioma Segmentation and IDH Genotyping

The accurate prediction of isocitrate dehydrogenase (IDH) mutation and glioma segmentation are important tasks for computer-aided diagnosis using preoperative multimodal magnetic resonance imaging (MRI). The two tasks are ongoing challenges due to the significant inter-tumor and intra-tumor heterogeneity. The existing methods to address them are mostly based on single-task approaches without considering the correlation between the two tasks. In addition, the acquisition of IDH genetic labels is expensive and costly, resulting in a limited number of IDH mutation data for modeling. To comprehensively address these problems, we propose a fully automated multimodal MRI-based multi-task learning framework for simultaneous glioma segmentation and IDH genotyping. Specifically, the task correlation and heterogeneity are tackled with a hybrid CNN-Transformer encoder that consists of a convolutional neural network and a transformer to extract the shared spatial and global information learned from a decoder for glioma segmentation and a multi-scale classifier for IDH genotyping. Then, a multi-task learning loss is designed to balance the two tasks by combining the segmentation and classification loss functions with uncertain weights. Finally, an uncertainty-aware pseudo-label selection is proposed to generate IDH pseudo-labels from larger unlabeled data for improving the accuracy of IDH genotyping by using semi-supervised learning. We evaluate our method on a multi-institutional public dataset. Experimental results show that our proposed multi-task network achieves promising performance and outperforms the single-task learning counterparts and other existing state-of-the-art methods. With the introduction of unlabeled data, the semi-supervised multi-task learning framework further improves the performance of glioma segmentation and IDH genotyping. The source codes of our framework are publicly available at https://github.com/miacsu/MTTU-Net.git.

A Semi-Unsupervised Segmentation Methodology Based on Texture Recognition for Radiomics: A Preliminary Study on Brain Tumours

Because of the intrinsic anatomic complexity of the brain structures, brain tumors have a high mortality and disability rate, and an early diagnosis is mandatory to contain damages. The commonly used biopsy is the diagnostic gold standard method, but it is invasive and, due to intratumoral heterogeneity, biopsies may lead to an incorrect result. Moreover, some tumors cannot be resectable if located in critical eloquent areas. On the other hand, medical imaging procedures can evaluate the entire tumor in a non-invasive and reproducible way. Radiomics is an emerging diagnosis technique based on quantitative medical image analyses, which makes use of data provided by non-invasive diagnosis techniques such as X-ray, computer-tomography (CT), magnetic resonance (MR), and proton emission tomography (PET). Radiomics techniques require the comprehensive analysis of huge numbers of medical images to extract a large and useful number of phenotypic features (usually called radiomics biomarkers). The goal is to explore and obtain the associations between features of tumors, diagnosis and patients’ prognoses to choose the best treatments and maximize the patient’s survival rate. Current radiomics techniques are not standardized in term of segmentation, feature extraction, and selection, moreover, the decision on suitable therapies still requires the supervision of an expert doctor. In this paper, we propose a semi-automatic methodology aimed to help the identification and segmentation of malignant tissues by using the combination of binary texture recognition, growing area algorithm, and machine learning techniques. In particular, the proposed method not only helps to better identify pathologic tissues but also permits to analyze in a fast way the huge amount of data, in Dicom format, provided by non-invasive diagnostic techniques. A preliminary experimental assessment has been conducted, considering a real MRI database of brain tumors. The method has been compared with the segmentation software’s tools “slicer 3D”. The obtained results are quite promising and demonstrate the potentialities of the proposed semi-unsupervised segmentation methodology.

Multimodal Disentangled Variational Autoencoder with Game Theoretic Interpretability for Glioma grading

Effective fusion of multimodal magnetic resonance imaging (MRI) is of great significance to boost the accuracy of glioma grading thanks to the complementary information provided by different imaging modalities. However, how to extract the common and distinctive information from MRI to achieve complementarity is still an open problem in information fusion research. In this study, we propose a deep neural network model termed as multimodal disentangled variational autoencoder (MMD-VAE) for glioma grading based on radiomics features extracted from preoperative multimodal MRI images. Specifically, the radiomics features are quantized and extracted from the region of interest for each modality. Then, the latent representations of variational autoencoder for these features are disentangled into common and distinctive representations to obtain the shared and complementary data among modalities. Afterward, cross-modality reconstruction loss and common-distinctive loss are designed to ensure the effectiveness of the disentangled representations. Finally, the disentangled common and distinctive representations are fused to predict the glioma grades, and SHapley Additive exPlanations (SHAP) is adopted to quantitatively interpret and analyze the contribution of the important features to grading. Experimental results on two benchmark datasets demonstrate that the proposed MMD-VAE model achieves encouraging predictive performance (AUC:0.9939) on a public dataset, and good generalization performance (AUC:0.9611) on a cross-institutional private dataset. These quantitative results and interpretations may help radiologists understand gliomas better and make better treatment decisions for improving clinical outcomes.

Improving Loanword Identification in Low-Resource Language with Data Augmentation and Multiple Feature Fusion

Loanword identification is studied in recent years to alleviate data sparseness in several natural language processing (NLP) tasks, such as machine translation, cross-lingual information retrieval, and so on. However, recent studies on this topic usually put efforts on high-resource languages (such as Chinese, English, and Russian); for low-resource languages, such as Uyghur and Mongolian, due to the limitation of resources and lack of annotated data, loanword identification on these languages tends to have lower performance. To overcome this problem, we first propose a lexical constraint-based data augmentation method to generate training data for low-resource language loanword identification; then, a loanword identification model based on a log-linear RNN is introduced to improve the performance of low-resource loanword identification by incorporating features such as word-level embeddings, character-level embeddings, pronunciation similarity, and part-of-speech (POS) into one model. Experimental results on loanword identification in Uyghur (in this study, we mainly focus on Arabic, Chinese, Russian, and Turkish loanwords in Uyghur) showed that our proposed method achieves best performance compared with several strong baseline systems.