An integrative non-invasive malignant brain tumors classification and Ki-67 labeling index prediction pipeline with radiomics approach

A novel metastatic tumor segmentation method with a new evaluation metric in clinic study

Background

Brain metastases are the most common brain malignancies. Automatic detection and segmentation of brain metastases provide significant assistance for radiologists in discovering the location of the lesion and making accurate clinical decisions on brain tumor type for precise treatment.

Objectives

However, due to the small size of the brain metastases, existing brain metastases segmentation produces unsatisfactory results and has not been evaluated on clinic datasets.

Methodology

In this work, we propose a new metastasis segmentation method DRAU-Net, which integrates a new attention mechanism multi-branch weighted attention module and DResConv module, making the extraction of tumor boundaries more complete. To enhance the evaluation of both the segmentation quality and the number of targets, we propose a novel medical image segmentation evaluation metric: multi-objective segmentation integrity metric, which effectively improves the evaluation results on multiple brain metastases with small size.

Results

Experimental results evaluated on the BraTS2023 dataset and collected clinical data show that the proposed method has achieved excellent performance with an average dice coefficient of 0.6858 and multi-objective segmentation integrity metric of 0.5582.

Conclusion

Compared with other methods, our proposed method achieved the best performance in the task of segmenting metastatic tumors.

MRI-based radiomics signatures for preoperative prediction of Ki-67 index in primary central nervous system lymphoma

PURPOSE

The aim of this study was to develop and validate radiomics signatures based on MRI for preoperative prediction of Ki-67 proliferative index (PI) expression in primary central nervous system lymphoma (PCNSL).

METHODS

A total of 341 patients with PCNSL were retrospectively analyzed, including 286 patients in one center as the training set and 55 patients in another two centers as the external validation set. Radiomics features were extracted and selected from preoperative contrast-enhanced T1-weighted images, fluid attenuation inversion recovery to build radiomics signatures according to the Ki-67 PI. The predictive performances of the radiomics model were evaluated using four classifiers including random forest, K-Nearest Neighbors, Neural Network and Decision Tree. A combined model was built by incorporating radiomics signature, clinical variables and MRI radiological characteristics using multivariate logistic regression analysis, and a nomogram was established to predict the expression of Ki-67 individually. The predictive performances of the models were evaluated using area under receiver operating characteristic curve (AUC) and decision curve analysis (DCA).

RESULTS

Radiomics signatures were independent predictors of the expression level of Ki-67 (OR: 2.523, P < 0.001). RF radiomics models had the highest accuracy (0.934 in the training set and 0.811 in the external validation set) and F1 Score (0.920 in the training set and 0.836 in the external validation set). The clinic-radiologic-radiomics nomogram showed better predictive performance with AUCs of 0.877(95 % CI: 0.837-0.918) in the training set and 0.866(95 % CI: 0.774-0.957) in the external validation set. The calibration curve and DCA demonstrated goodness-of-fit and improved benefits in clinical practice of the nomogram.

CONCLUSIONS

Nomograms integrating MRI-based radiomics and clinical-radiological characteristics could effectively predict Ki-67 PI in primary PCNSL.

MRI radiomics-based interpretable model and nomogram for preoperative prediction of Ki-67 expression status in primary central nervous system lymphoma

Objectives

To investigate the value of interpretable machine learning model and nomogram based on clinical factors, MRI imaging features, and radiomic features to predict Ki-67 expression in primary central nervous system lymphomas (PCNSL).

Materials and methods

MRI images and clinical information of 92 PCNSL patients were retrospectively collected, which were divided into 53 cases in the training set and 39 cases in the external validation set according to different medical centers. A 3D brain tumor segmentation model was trained based on nnU-NetV2, and two prediction models, interpretable Random Forest (RF) incorporating the SHapley Additive exPlanations (SHAP) method and nomogram based on multivariate logistic regression, were proposed for the task of Ki-67 expression status prediction.

Results

The mean dice Similarity Coefficient (DSC) score of the 3D segmentation model on the validation set was 0.85. On the Ki-67 expression prediction task, the AUC of the interpretable RF model on the validation set was 0.84 (95% CI:0.81, 0.86; p < 0.001), which was a 3% improvement compared to the AUC of the nomogram. The Delong test showed that the z statistic for the difference between the two models was 1.901, corresponding to a p value of 0.057. In addition, SHAP analysis showed that the Rad-Score made a significant contribution to the model decision.

Conclusion

In this study, we developed a 3D brain tumor segmentation model and used an interpretable machine learning model and nomogram for preoperative prediction of Ki-67 expression status in PCNSL patients, which improved the prediction of this medical task.

Clinical relevance statement

Ki-67 represents the degree of active cell proliferation and is an important prognostic parameter associated with clinical outcomes. Non-invasive and accurate prediction of Ki-67 expression level preoperatively plays an important role in targeting treatment selection and patient stratification management for PCNSL thereby improving prognosis.

SRTRP-Net: A multi-task learning network for segmentation and prediction of stereotactic radiosurgery treatment response in brain metastases

Before the Stereotactic Radiosurgery (SRS) treatment, it is of great clinical significance to avoid secondary genetic damage and guide the personalized treatment plans for patients with brain metastases (BM) by predicting the response to SRS treatment of brain metastatic lesions. Thus, we developed a multi-task learning model termed SRTRP-Net to provide prior knowledge of BM ROI and predict the SRS treatment response of the lesion. In dual-encoder tumor segmentation Network (DTS-Net), two parallel encoders encode the original and mirrored multi-modal MRI images. The differences in the dual-encoder features between foreground and background are enhanced by the symmetrical visual difference block (SVDB). In the bottom layer of the encoder, a transformer is used to extract local contextual features in the spatial and depth dimensions of low-resolution images. Then, the decoder of DTS-Net provides the prior knowledge for predicting the response to SRS treatment by performing BM segmentation. SRS response prediction network (SRP-Net) directly utilizes shared multi-modal MRI features weighted by the signed distance map (SDM) of the masks. The bidirectional multi-dimensional feature fusion module (BMDF) fuses the shared features and the clinical text information features to obtain comprehensive tumor information for characterizing tumors and predicting SRS treatment response. Experiments based on internal and external clinical datasets have shown that SRTRP-Net achieves comparable or better results. We believe that SRTRP-Net can help clinicians accurately develop personalized first-time treatment regimens for BM patients and improve their survival.

AI-based classification of three common malignant tumors in neuro-oncology: A multi-institutional comparison of machine learning and deep learning methods

PURPOSE

To determine if machine learning (ML) or deep learning (DL) pipelines perform better in AI-based three-class classification of glioblastoma (GBM), intracranial metastatic disease (IMD) and primary CNS lymphoma (PCNSL).

METHODOLOGY

Retrospective analysis included 502 cases for training (208 GBM, 67 PCNSL and 227 IMD), with external validation on 86 cases (27:27:32). Multiparametric MRI images (T1W, T2W, FLAIR, DWI and T1-CE) were co-registered, resampled, denoised and intensity normalized, followed by semiautomatic 3D segmentation of the enhancing tumor (ET) and peritumoral region (PTR). Model performance was assessed using several ML pipelines and 3D-convolutional neural networks (3D-CNN) using sequence specific masks, as well as combination of masks. All pipelines were trained and evaluated with 5-fold nested cross-validation on internal data followed by external validation using multi-class AUC.

RESULTS

Two ML models achieved similar performance on test set, one using T2-ET and T2-PTR masks (AUC: 0.885, 95% CI: [0.816, 0.935] and another using T1-CE-ET and FLAIR-PTR mask (AUC: 0.878, CI: [0.804, 0.930]). The best performing DL models achieved an AUC of 0.854, (CI [0.774, 0.914]) on external data using T1-CE-ET and T2-PTR masks, followed by model derived from T1-CE-ET, ADC-ET and FLAIR-PTR masks (AUC: 0.851, CI [0.772, 0.909]).

CONCLUSION

Both ML and DL derived pipelines achieved similar performance. T1-CE mask was used in three of the top four overall models. Additionally, all four models had some mask derived from PTR, either T2WI or FLAIR.

MRI-Based Radiomics Methods for Predicting Ki-67 Expression in Breast Cancer: A Systematic Review and Meta-analysis

RATIONALE AND OBJECTIVES

The purpose of this systematic review and meta-analysis was to assess the quality and diagnostic accuracy of MRI-based radiomics for predicting Ki-67 expression in breast cancer.

MATERIALS AND METHODS

A systematic literature search was performed to find relevant studies published in different databases, including PubMed, Web of Science, and Embase up until March 10, 2023. All papers were independently evaluated for eligibility by two reviewers. Studies that matched research questions and provided sufficient data for quantitative synthesis were included in the systematic review and meta-analysis, respectively. The quality of the articles was assessed using Quality Assessment of Diagnostic Accuracy Studies 2 (QUADAS-2) and Radiomics Quality Score (RQS) tools. The predictive value of MRI-based radiomics for Ki-67 antigen in patients with breast cancer was assessed using pooled sensitivity (SEN), specificity, and area under the curve (AUC). Meta-regression was performed to explore the cause of heterogeneity. Different covariates were used for subgroup analysis.

RESULTS

31 studies were included in the systematic review; among them, 21 reported sufficient data for meta-analysis. 20 training cohorts and five validation cohorts were pooled separately. The pooled sensitivity, specificity, and AUC of MRI-based radiomics for predicting Ki-67 expression in training cohorts were 0.80 [95% CI, 0.73-0.86], 0.82 [95% CI, 0.78-0.86], and 0.88 [95%CI, 0.85-0.91], respectively. The corresponding values for validation cohorts were 0.81 [95% CI, 0.72-0.87], 0.73 [95% CI, 0.62-0.82], and 0.84 [95%CI, 0.80-0.87], respectively. Based on QUADAS-2, some risks of bias were detected for reference standard and flow and timing domains. However, the quality of the included article was acceptable. The mean RQS score of the included articles was close to 6, corresponding to 16.6% of the maximum possible score. Significant heterogeneity was observed in pooled sensitivity and specificity of training cohorts (I2 > 75%). We found that using deep learning radiomic methods, magnetic field strength (3 T vs. 1.5 T), scanner manufacturer, region of interest structure (2D vs. 3D), route of tissue sampling, Ki-67 cut-off, logistic regression for model construction, and LASSO for feature reduction as well as PyRadiomics software for feature extraction had a great impact on heterogeneity according to our joint model analysis. Diagnostic performance in studies that used deep learning-based radiomics and multiple MRI sequences (e.g., DWI+DCE) was slightly higher. In addition, radiomic features derived from DWI sequences performed better than contrast-enhanced sequences in terms of specificity and sensitivity. No publication bias was found based on Deeks' funnel plot. Sensitivity analysis showed that eliminating every study one by one does not impact overall results.

CONCLUSION

This meta-analysis showed that MRI-based radiomics has a good diagnostic accuracy in differentiating breast cancer patients with high Ki-67 expression from low-expressing groups. However, the sensitivity and specificity of these methods still do not surpass 90%, restricting them from being used as a supplement to current pathological assessments (e.g., biopsy or surgery) to predict Ki-67 expression accurately.

Aided Diagnosis Model Based on Deep Learning for Glioblastoma, Solitary Brain Metastases, and Primary Central Nervous System Lymphoma with Multi-Modal MRI

(1) Background: Diagnosis of glioblastoma (GBM), solitary brain metastases (SBM), and primary central nervous system lymphoma (PCNSL) plays a decisive role in the development of personalized treatment plans. Constructing a deep learning classification network to diagnose GBM, SBM, and PCNSL with multi-modal MRI is important and necessary. (2) Subjects: GBM, SBM, and PCNSL were confirmed by histopathology with the multi-modal MRI examination (study from 1225 subjects, average age 53 years, 671 males), 3.0 T T2 fluid-attenuated inversion recovery (T2-Flair), and Contrast-enhanced T1-weighted imaging (CE-T1WI). (3) Methods: This paper introduces MFFC-Net, a classification model based on the fusion of multi-modal MRIs, for the classification of GBM, SBM, and PCNSL. The network architecture consists of parallel encoders using DenseBlocks to extract features from different modalities of MRI images. Subsequently, an L1-norm feature fusion module is applied to enhance the interrelationships among tumor tissues. Then, a spatial-channel self-attention weighting operation is performed after the feature fusion. Finally, the classification results are obtained using the full convolutional layer (FC) and Soft-max. (4) Results: The ACC of MFFC-Net based on feature fusion was 0.920, better than the radiomics model (ACC of 0.829). There was no significant difference in the ACC compared to the expert radiologist (0.920 vs. 0.924, p = 0.774). (5) Conclusions: Our MFFC-Net model could distinguish GBM, SBM, and PCNSL preoperatively based on multi-modal MRI, with a higher performance than the radiomics model and was comparable to radiologists.

Exploring the association of glioma tumor residuals from incongruent [18F]FET PET/MR imaging with tumor proliferation using a multiparametric MRI radiomics nomogram

PURPOSE

The study aimed to using multiparametric MRI radiomics to predict glioma tumor residuals (TRFET over MR) derived from incongruent [18F]fluoroethyl-L-tyrosine ([18F]FET) PET/MR imaging.

METHODS

One hundred ten patients with gliomas who underwent [18F]FET PET/MR scanning were retrospectively analyzed. The TRFET over MR was identified by the discrepancy-PET that the extent of resection (EOR) based on MRI subtracted the biological tumor volume on PET images. The MRI parameters and radiomics features were extracted based on EOR and selected by the least absolute shrinkage and selection operator to construct radiomics score (Rad-score). The correlation network analysis of all features was analyzed by Spearman's correlation tests. The methods for evaluating the clinical usefulness consisted of the receiver operating characteristic curve, the calibration curve, and decision curve analysis.

RESULTS

The Rad-score of the patients with the TRFET over MR was significantly higher than those with the non TRFET over MR (p < 0.001). The Rad-score was significantly correlated with the discrepancy-PET (r = 0.72, p < 0.001), Ki-67 level (r = 0.76, p < 0.001), and epidermal growth factor receptor (EGFR) of gliomas (r = 0.75, p < 0.001), respectively. Moreover, there was a difference of the correlation network analysis between the TRPET over MR group and non TRFET over MR group. The nomogram combing Rad-score and clinical features had the greatest performance in predicting TRFET over MR (AUC = 0.90/0.87, training/testing). There was a significant difference in prognosis (median OS, 17 m vs. 43 m) between patients with TRFET over MR and non TRFET over MR based on nomogram prediction (p < 0.001).

CONCLUSION

The nomogram based on MRI radiomics would predict gliomas tumor residuals caused by the absence of 18F-PET PET examination and adjust EOR to improve prognosis.

BTSC-TNAS: A neural architecture search-based transformer for brain tumor segmentation and classification

Glioblastoma (GBM), isolated brain metastasis (SBM), and primary central nervous system lymphoma (PCNSL) possess a high level of similarity in histomorphology and clinical manifestations on multimodal MRI. Such similarities have led to challenges in the clinical diagnosis of these three malignant tumors. However, many existing models solely focus on either the task of segmentation or classification, which limits the application of computer-aided diagnosis in clinical diagnosis and treatment. To solve this problem, we propose a multi-task learning transformer with neural architecture search (NAS) for brain tumor segmentation and classification (BTSC-TNAS). In the segmentation stage, we use a nested transformer U-shape network (NTU-NAS) with NAS to directly predict brain tumor masks from multi-modal MRI images. In the tumor classification stage, we use the multiscale features obtained from the encoder of NTU-NAS as the input features of the classification network (MSC-NET), which are integrated and corrected by the classification feature correction enhancement (CFCE) block to improve the accuracy of classification. The proposed BTSC-TNAS achieves an average Dice coefficient of 80.86% and 87.12% for the segmentation of tumor region and the maximum abnormal region in clinical data respectively. The model achieves a classification accuracy of 0.941. The experiments performed on the BraTS 2019 dataset show that the proposed BTSC-TNAS has excellent generalizability and can provide support for some challenging tasks in the diagnosis and treatment of brain tumors.