Breast Tumor Classification based on MRI-US Images by Disentangling Modality Features

Diagnostic performance of ultrasound-based artificial intelligence for predicting key molecular markers in breast cancer: A systematic review and meta-analysis

BACKGROUND

Breast cancer (BC) diagnosis and treatment rely heavily on molecular markers such as HER2, Ki67, PR, and ER. Currently, these markers are identified by invasive methods.

OBJECTIVE

This meta-analysis investigates the diagnostic accuracy of ultrasound-based radiomics as a novel approach to predicting these markers.

METHODS

A comprehensive search of PubMed, EMBASE, and Web of Science databases was conducted to identify studies evaluating ultrasound-based radiomics in BC. Inclusion criteria encompassed research on HER2, Ki67, PR, and ER as key molecular markers. Quality assessment using Quality Assessment of Diagnostic Accuracy Studies (QUADAS-2) and Radiomics Quality Score (RQS) was performed. The data extraction step was performed systematically.

RESULTS

Our meta-analysis quantifies the diagnostic accuracy of ultrasound-based radiomics with a sensitivity and specificity of 0.76 and 0.78 for predicting HER2, 0.80, and 0.76 for Ki67 biomarkers. Studies did not provide sufficient data for quantitative PR and ER prediction analysis. The overall quality of studies based on the RQS tool was moderate. The QUADAS-2 evaluation showed that the studies had an unclear risk of bias regarding the flow and timing domain.

CONCLUSION

Our analysis indicated that AI models have a promising accuracy for predicting key molecular biomarkers' status in BC patients. We performed the quantitative analysis for HER2 and Ki67 biomarkers which yielded a moderate to high accuracy. However, studies did not provide adequate data for meta-analysis of ER and PR prediction accuracy of developed models. The overall quality of the studies was acceptable. In future research, studies need to report the results thoroughly. Also, we suggest more prospective studies from different centers.

Cross-and-Diagonal Networks: An Indirect Self-Attention Mechanism for Image Classification

In recent years, computer vision has witnessed remarkable advancements in image classification, specifically in the domains of fully convolutional neural networks (FCNs) and self-attention mechanisms. Nevertheless, both approaches exhibit certain limitations. FCNs tend to prioritize local information, potentially overlooking crucial global contexts, whereas self-attention mechanisms are computationally intensive despite their adaptability. In order to surmount these challenges, this paper proposes cross-and-diagonal networks (CDNet), innovative network architecture that adeptly captures global information in images while preserving local details in a more computationally efficient manner. CDNet achieves this by establishing long-range relationships between pixels within an image, enabling the indirect acquisition of contextual information. This inventive indirect self-attention mechanism significantly enhances the network's capacity. In CDNet, a new attention mechanism named "cross and diagonal attention" is proposed. This mechanism adopts an indirect approach by integrating two distinct components, cross attention and diagonal attention. By computing attention in different directions, specifically vertical and diagonal, CDNet effectively establishes remote dependencies among pixels, resulting in improved performance in image classification tasks. Experimental results highlight several advantages of CDNet. Firstly, it introduces an indirect self-attention mechanism that can be effortlessly integrated as a module into any convolutional neural network (CNN). Additionally, the computational cost of the self-attention mechanism has been effectively reduced, resulting in improved overall computational efficiency. Lastly, CDNet attains state-of-the-art performance on three benchmark datasets for similar types of image classification networks. In essence, CDNet addresses the constraints of conventional approaches and provides an efficient and effective solution for capturing global context in image classification tasks.

HSA-net with a novel CAD pipeline boosts both clinical brain tumor MR image classification and segmentation

Brain tumors are among the most prevalent neoplasms in current medical studies. Accurately distinguishing and classifying brain tumor types accurately is crucial for patient treatment and survival in clinical practice. However, existing computer-aided diagnostic pipelines are inadequate for practical medical use due to tumor complexity. In this study, we curated a multi-centre brain tumor dataset that includes various clinical brain tumor data types, including segmentation and classification annotations, surpassing previous efforts. To enhance brain tumor segmentation accuracy, we propose a new segmentation method: HSA-Net. This method utilizes the Shared Weight Dilated Convolution module (SWDC) and Hybrid Dense Dilated Convolution module (HDense) to capture multi-scale information while minimizing parameter count. The Effective Multi-Dimensional Attention (EMA) and Important Feature Attention (IFA) modules effectively aggregate task-related information. We introduce a novel clinical brain tumor computer-aided diagnosis pipeline (CAD) that combines HSA-Net with pipeline modification. This approach not only improves segmentation accuracy but also utilizes the segmentation mask as an additional channel feature to enhance brain tumor classification results. Our experimental evaluation of 3327 real clinical data demonstrates the effectiveness of the proposed method, achieving an average Dice coefficient of 86.85 % for segmentation and a classification accuracy of 95.35 %. We also validated the effectiveness of our proposed method using the publicly available BraTS dataset.

MRI-Based Radiomics Methods for Predicting Ki-67 Expression in Breast Cancer: A Systematic Review and Meta-analysis

RATIONALE AND OBJECTIVES

The purpose of this systematic review and meta-analysis was to assess the quality and diagnostic accuracy of MRI-based radiomics for predicting Ki-67 expression in breast cancer.

MATERIALS AND METHODS

A systematic literature search was performed to find relevant studies published in different databases, including PubMed, Web of Science, and Embase up until March 10, 2023. All papers were independently evaluated for eligibility by two reviewers. Studies that matched research questions and provided sufficient data for quantitative synthesis were included in the systematic review and meta-analysis, respectively. The quality of the articles was assessed using Quality Assessment of Diagnostic Accuracy Studies 2 (QUADAS-2) and Radiomics Quality Score (RQS) tools. The predictive value of MRI-based radiomics for Ki-67 antigen in patients with breast cancer was assessed using pooled sensitivity (SEN), specificity, and area under the curve (AUC). Meta-regression was performed to explore the cause of heterogeneity. Different covariates were used for subgroup analysis.

RESULTS

31 studies were included in the systematic review; among them, 21 reported sufficient data for meta-analysis. 20 training cohorts and five validation cohorts were pooled separately. The pooled sensitivity, specificity, and AUC of MRI-based radiomics for predicting Ki-67 expression in training cohorts were 0.80 [95% CI, 0.73-0.86], 0.82 [95% CI, 0.78-0.86], and 0.88 [95%CI, 0.85-0.91], respectively. The corresponding values for validation cohorts were 0.81 [95% CI, 0.72-0.87], 0.73 [95% CI, 0.62-0.82], and 0.84 [95%CI, 0.80-0.87], respectively. Based on QUADAS-2, some risks of bias were detected for reference standard and flow and timing domains. However, the quality of the included article was acceptable. The mean RQS score of the included articles was close to 6, corresponding to 16.6% of the maximum possible score. Significant heterogeneity was observed in pooled sensitivity and specificity of training cohorts (I2 > 75%). We found that using deep learning radiomic methods, magnetic field strength (3 T vs. 1.5 T), scanner manufacturer, region of interest structure (2D vs. 3D), route of tissue sampling, Ki-67 cut-off, logistic regression for model construction, and LASSO for feature reduction as well as PyRadiomics software for feature extraction had a great impact on heterogeneity according to our joint model analysis. Diagnostic performance in studies that used deep learning-based radiomics and multiple MRI sequences (e.g., DWI+DCE) was slightly higher. In addition, radiomic features derived from DWI sequences performed better than contrast-enhanced sequences in terms of specificity and sensitivity. No publication bias was found based on Deeks' funnel plot. Sensitivity analysis showed that eliminating every study one by one does not impact overall results.

CONCLUSION

This meta-analysis showed that MRI-based radiomics has a good diagnostic accuracy in differentiating breast cancer patients with high Ki-67 expression from low-expressing groups. However, the sensitivity and specificity of these methods still do not surpass 90%, restricting them from being used as a supplement to current pathological assessments (e.g., biopsy or surgery) to predict Ki-67 expression accurately.

A Convolutional Neural Network Model for Distinguishing Hemangioblastomas From Other Cerebellar-and-Brainstem Tumors Using Contrast-Enhanced MRI

BACKGROUND

Hemangioblastoma (HB) is a highly vascularized tumor most commonly occurring in the posterior cranial fossa, requiring accurate preoperative diagnosis to avoid accidental intraoperative hemorrhage and even death.

PURPOSE

To accurately distinguish HBs from other cerebellar-and-brainstem tumors using a convolutional neural network model based on a contrast-enhanced brain MRI dataset.

STUDY TYPE

Retrospective.

POPULATION

Four hundred five patients (182 = HBs; 223 = other cerebellar-and brainstem tumors): 305 cases for model training, and 100 for evaluation.

FIELD STRENGTH/SEQUENCE

3 T/contrast-enhanced T1-weighted imaging (T1WI + C).

ASSESSMENT

A CNN-based 2D classification network was trained by using sliced data along the z-axis. To improve the performance of the network, we introduced demographic information, various data-augmentation methods and an auxiliary task to segment tumor region. Then, this method was compared with the evaluations performed by experienced and intermediate-level neuroradiologists, and the heatmap of deep feature, which indicates the contribution of each pixel to model prediction, was visualized by Grad-CAM for analyzing the misclassified cases.

STATISTICAL TESTS

The Pearson chi-square test and an independent t-test were used to test for distribution difference in age and sex. And the independent t-test was exploited to evaluate the performance between experts and our proposed method. P value <0.05 was considered significant.

RESULTS

The trained network showed a higher accuracy for identifying HBs (accuracy = 0.902 ± 0.031, F1 = 0.891 ± 0.035, AUC = 0.926 ± 0.040) than experienced (accuracy = 0.887 ± 0.013, F1 = 0.868 ± 0.011, AUC = 0.881 ± 0.008) and intermediate-level (accuracy = 0.827 ± 0.037, F1 = 0.768 ± 0.068, AUC = 0.810 ± 0.047) neuroradiologists. The recall values were 0.910 ± 0.050, 0.659 ± 0.084, and 0.828 ± 0.019 for the trained network, intermediate and experienced neuroradiologists, respectively. Additional ablation experiments verified the utility of the introduced demographic information, data augmentation, and the auxiliary-segmentation task.

DATA CONCLUSION

Our proposed method can successfully distinguish HBs from other cerebellar-and-brainstem tumors and showed diagnostic efficiency comparable to that of experienced neuroradiologists.

EVIDENCE LEVEL

3 TECHNICAL EFFICACY: Stage 2.

Molecular-subtype guided automatic invasive breast cancer grading using dynamic contrast-enhanced MRI

BACKGROUND AND OBJECTIVES

Histological grade and molecular subtype have presented valuable references in assigning personalized or precision medicine as the significant prognostic indicators representing biological behaviors of invasive breast cancer (IBC). To evaluate a two-stage deep learning framework for IBC grading that incorporates with molecular-subtype (MS) information using DCE-MRI.

METHODS

In Stage I, an innovative neural network called IOS2-DA is developed, which includes a dense atrous-spatial pyramid pooling block with a pooling layer (DA) and inception-octconved blocks with double kernel squeeze-and-excitations (IOS2). This method focuses on the imaging manifestation of IBC grades and performs preliminary prediction using a novel class F1-score loss function. In Stage II, a MS attention branch is introduced to fine-tune the integrated deep vectors from IOS2-DA via Kullback-Leibler divergence. The MS-guided information is weighted with preliminary results to obtain classification values, which are analyzed by ensemble learning for tumor grade prediction on three MRI post-contrast series. Objective assessment is quantitatively evaluated by receiver operating characteristic curve analysis. DeLong test is applied to measure statistical significance (P < 0.05).

RESULTS

The molecular-subtype guided IOS2-DA performs significantly better than the single IOS2-DA in terms of accuracy (0.927), precision (0.942), AUC (0.927, 95% CI: [0.908, 0.946]), and F1-score (0.930). The gradient-weighted class activation maps show that the feature representations extracted from IOS2-DA are consistent with tumor areas.

CONCLUSIONS

IOS2-DA elucidates its potential in non-invasive tumor grade prediction. With respect to the correlation between MS and histological grade, it exhibits remarkable clinical prospects in the application of relevant clinical biomarkers to enhance the diagnostic effectiveness of IBC grading. Therefore, DCE-MRI tends to be a feasible imaging modality for the thorough preoperative assessment of breast biological behavior and carcinoma prognosis.

Multi-modality radiomics nomogram based on DCE-MRI and ultrasound images for benign and malignant breast lesion classification

OBJECTIVE

To develop a multi-modality radiomics nomogram based on DCE-MRI, B-mode ultrasound (BMUS) and strain elastography (SE) images for classifying benign and malignant breast lesions.

MATERIAL AND METHODS

In this retrospective study, 345 breast lesions from 305 patients who underwent DCE-MRI, BMUS and SE examinations were randomly divided into training (n = 241) and testing (n = 104) datasets. Radiomics features were extracted from manually contoured images. The inter-class correlation coefficient (ICC), Mann-Whitney U test and the least absolute shrinkage and selection operator (LASSO) regression were applied for feature selection and radiomics signature building. Multivariable logistic regression was used to develop a radiomics nomogram incorporating radiomics signature and clinical factors. The performance of the radiomics nomogram was evaluated by its discrimination, calibration, and clinical usefulness and was compared with BI-RADS classification evaluated by a senior breast radiologist.

RESULTS

The All-Combination radiomics signature derived from the combination of DCE-MRI, BMUS and SE images showed better diagnostic performance than signatures derived from single modality alone, with area under the curves (AUCs) of 0.953 and 0.941 in training and testing datasets, respectively. The multi-modality radiomics nomogram incorporating the All-Combination radiomics signature and age showed excellent discrimination with the highest AUCs of 0.964 and 0.951 in two datasets, respectively, which outperformed all single modality radiomics signatures and BI-RADS classification. Furthermore, the specificity of radiomics nomogram was significantly higher than BI-RADS classification (both p < 0.04) with the same sensitivity in both datasets.

CONCLUSION

The proposed multi-modality radiomics nomogram based on DCE-MRI and ultrasound images has the potential to serve as a non-invasive tool for classifying benign and malignant breast lesions and reduce unnecessary biopsy.

Breast cancer diagnosis in an early stage using novel deep learning with hybrid optimization technique

Breast cancer is one of the primary causes of death that is occurred in females around the world. So, the recognition and categorization of initial phase breast cancer are necessary to help the patients to have suitable action. However, mammography images provide very low sensitivity and efficiency while detecting breast cancer. Moreover, Magnetic Resonance Imaging (MRI) provides high sensitivity than mammography for predicting breast cancer. In this research, a novel Back Propagation Boosting Recurrent Wienmed model (BPBRW) with Hybrid Krill Herd African Buffalo Optimization (HKH-ABO) mechanism is developed for detecting breast cancer in an earlier stage using breast MRI images. Initially, the MRI breast images are trained to the system, and an innovative Wienmed filter is established for preprocessing the MRI noisy image content. Moreover, the projected BPBRW with HKH-ABO mechanism categorizes the breast cancer tumor as benign and malignant. Additionally, this model is simulated using Python, and the performance of the current research work is evaluated with prevailing works. Hence, the comparative graph shows that the current research model produces improved accuracy of 99.6% with a 0.12% lower error rate.