Added value of deep learning-based computer-aided diagnosis and shear wave elastography to b-mode ultrasound for evaluation of breast masses detected by screening ultrasound

Artificial Intelligence for Breast Ultrasound: AJR Expert Panel Narrative Review

Breast ultrasound is used in a wide variety of clinical scenarios, including both diagnostic and screening applications. Limitations of ultrasound, however, include its low specificity and, for automated breast ultrasound screening, the time necessary to review whole-breast ultrasound images. As of this writing, four AI tools that are approved or cleared by the FDA address these limitations. Current tools, which are intended to provide decision support for lesion classification and/or detection, have been shown to increase specificity among nonspecialists and to decrease interpretation times. Potential future applications include triage of patients with palpable masses in low-resource settings, preoperative prediction of axillary lymph node metastasis, and preoperative prediction of neoadjuvant chemotherapy response. Challenges in the development and clinical deployment of AI for ultrasound include the limited availability of curated training datasets compared with mammography, the high variability in ultrasound image acquisition due to equipment- and operator-related factors (which may limit algorithm generalizability), and the lack of postimplementation evaluation studies. Furthermore, current AI tools for lesion classification were developed based on 2D data, but diagnostic accuracy could potentially be improved if multimodal ultrasound data were used, such as color Doppler, elastography, cine clips, and 3D imaging.

Machine learning-based discrimination of benign and malignant breast lesions on US: The contribution of shear-wave elastography

PURPOSE

To build and validate a combined radiomics and machine learning (ML) approach using B-mode US and SWE images to differentiate benign from malignant solid breast lesions (BLs) and compare its performance with that of an expert radiologist.

METHODS

Patients with at least one BI-RADS 2-6 BL who performed breast US integrated with SWE were retrospectively included. B-mode US and SWE images were manually segmented to extract radiomics features. A multi-step feature selection process was performed and a predictive model built using the Logistic Regression algorithm. The diagnostic accuracy was evaluated with the AUC and Matthews Correlation Coefficient (MCC) metrics. The performance of the ML classifier was compared to that of an expert radiologist.

RESULTS

427 Bls were included and divided into a training (286 BLs, of which 127 benign and 159 malignant) and a test set (141 BLs, of which 59 benign and 82 malignant). Of 1098 features extracted from B-mode US and SWE images, 13 were finally selected. The ML classifier showed an AUC of 0.768 and 0.746, and an MCC of 0.403 and 0.423 in the training and test sets, respectively. The performance was higher than that of the expert radiologist assessing only B-mode US images, but significantly lower when SWE images were also provided.

CONCLUSION

A ML approach based on B-mode US and SWE images may represent a potential tool in the characterization of BLs. SWE still gives its most relevant contribution in the clinical setting rather than included in a radiomics pipeline.

Diagnostic performance of deep learning in ultrasound diagnosis of breast cancer: a systematic review

Deep learning (DL) has been widely investigated in breast ultrasound (US) for distinguishing between benign and malignant breast masses. This systematic review of test diagnosis aims to examine the accuracy of DL, compared to human readers, for the diagnosis of breast cancer in the US under clinical settings. Our literature search included records from databases including PubMed, Embase, Scopus, and Cochrane Library. Test accuracy outcomes were synthesized to compare the diagnostic performance of DL and human readers as well as to evaluate the assistive role of DL to human readers. A total of 16 studies involving 9238 female participants were included. There were no prospective studies comparing the test accuracy of DL versus human readers in clinical workflows. Diagnostic test results varied across the included studies. In 14 studies employing standalone DL systems, DL showed significantly lower sensitivities in 5 studies with comparable specificities and outperformed human readers at higher specificities in another 4 studies; in the remaining studies, DL models and human readers showed equivalent test outcomes. In 12 studies that assessed assistive DL systems, no studies proved the assistive role of DL in the overall diagnostic performance of human readers. Current evidence is insufficient to conclude that DL outperforms human readers or enhances the accuracy of diagnostic breast US in a clinical setting. Standardization of study methodologies is required to improve the reproducibility and generalizability of DL research, which will aid in clinical translation and application.

Application and prospects of AI-based radiomics in ultrasound diagnosis

Artificial intelligence (AI)-based radiomics has attracted considerable research attention in the field of medical imaging, including ultrasound diagnosis. Ultrasound imaging has unique advantages such as high temporal resolution, low cost, and no radiation exposure. This renders it a preferred imaging modality for several clinical scenarios. This review includes a detailed introduction to imaging modalities, including Brightness-mode ultrasound, color Doppler flow imaging, ultrasound elastography, contrast-enhanced ultrasound, and multi-modal fusion analysis. It provides an overview of the current status and prospects of AI-based radiomics in ultrasound diagnosis, highlighting the application of AI-based radiomics to static ultrasound images, dynamic ultrasound videos, and multi-modal ultrasound fusion analysis.

The Role of a Deep Learning-Based Computer-Aided Diagnosis System and Elastography in Reducing Unnecessary Breast Lesion Biopsies

OBJECTIVES

Ultrasound examination has inter-observer and intra-observer variability and a high false-positive rate. The aim of this study was to evaluate the value of the combined use of a deep learning-based computer-aided diagnosis (CAD) system and ultrasound elastography with conventional ultrasound (US) in increasing specificity and reducing unnecessary breast lesions biopsies.

MATERIALS AND METHODS

Conventional US, CAD system, and strain elastography (SE) were retrospectively performed on 216 breast lesions before biopsy or surgery. The area under the receiver operating characteristic curve (AUC), sensitivity, specificity, and biopsy rate were compared between conventional US and the combination of conventional US, SE, and CAD system.

RESULTS

Of 216 lesions, 54 were malignant and 162 were benign. The addition of CAD system and SE to conventional US increased the AUC from 0.716 to 0.910 and specificity from 46.9% to 85.8% without a loss in sensitivity while 89.2% (66 of 74) of benign lesions in Breast Imaging Reporting and Data System (BI-RADS) category 4A lesions would avoid unnecessary biopsies.

CONCLUSION

The addition of CAD system and SE to conventional US improved specificity and AUC without loss of sensitivity, and reduced unnecessary biopsies.

Ultrasound for Breast Cancer Screening in Resource-Limited Settings: Current Practice and Future Directions

Breast cancer (BC) is the most prevalent cancer among women globally. Cancer screening can reduce mortality and improve women's health. In developed countries, mammography (MAM) has been primarily utilized for population-based BC screening for several decades. However, it is usually unavailable in low-resource settings due to the lack of equipment, personnel, and time necessary to conduct and interpret the examinations. Ultrasound (US) with high detection sensitivity for women of younger ages and with dense breasts has become a supplement to MAM for breast examination. Some guidelines suggest using US as the primary screening tool in certain settings where MAM is unavailable and infeasible, but global recommendations have not yet reached a unanimous consensus. With the development of smart devices and artificial intelligence (AI) in medical imaging, clinical applications and preclinical studies have shown the potential of US combined with AI in BC screening. Nevertheless, there are few comprehensive reviews focused on the role of US in screening BC in underserved conditions, especially in technological, economical, and global perspectives. This work presents the benefits, limitations, advances, and future directions of BC screening with technology-assisted and resource-appropriate strategies, which may be helpful to implement screening initiatives in resource-limited countries.

Convolutional neural network based on automatic segmentation of peritumoral shear-wave elastography images for predicting breast cancer

Objective

Our aim was to develop dual-modal CNN models based on combining conventional ultrasound (US) images and shear-wave elastography (SWE) of peritumoral region to improve prediction of breast cancer.

Method

We retrospectively collected US images and SWE data of 1271 ACR- BIRADS 4 breast lesions from 1116 female patients (mean age ± standard deviation, 45.40 ± 9.65 years). The lesions were divided into three subgroups based on the maximum diameter (MD): ≤15 mm; >15 mm and ≤25 mm; >25 mm. We recorded lesion stiffness (SWV1) and 5-point average stiffness of the peritumoral tissue (SWV5). The CNN models were built based on the segmentation of different widths of peritumoral tissue (0.5 mm, 1.0 mm, 1.5 mm, 2.0 mm) and internal SWE image of the lesions. All single-parameter CNN models, dual-modal CNN models, and quantitative SWE parameters in the training cohort (971 lesions) and the validation cohort (300 lesions) were assessed by receiver operating characteristic (ROC) curve.

Results

The US + 1.0 mm SWE model achieved the highest area under the ROC curve (AUC) in the subgroup of lesions with MD ≤15 mm in both the training (0.94) and the validation cohorts (0.91). In the subgroups with MD between15 and 25 mm and above 25 mm, the US + 2.0 mm SWE model achieved the highest AUCs in both the training cohort (0.96 and 0.95, respectively) and the validation cohort (0.93 and 0.91, respectively).

Conclusion

The dual-modal CNN models based on the combination of US and peritumoral region SWE images allow accurate prediction of breast cancer.

Artificial Intelligence for Breast US

US is a widely available, commonly used, and indispensable imaging modality for breast evaluation. It is often the primary imaging modality for the detection and diagnosis of breast cancer in low-resource settings. In addition, it is frequently employed as a supplemental screening tool via either whole breast handheld US or automated breast US among women with dense breasts. In recent years, a variety of artificial intelligence systems have been developed to assist radiologists with the detection and diagnosis of breast lesions on US. This article reviews the background and evidence supporting the use of artificial intelligence tools for breast US, describes implementation strategies and impact on clinical workflow, and discusses potential emerging roles and future directions.

Ultrasound Elastography: Basic Principles and Examples of Clinical Applications with Artificial Intelligence—A Review

Ultrasound elastography (USE) or elastosonography is an ultrasound-based, non-invasive imaging method for assessing tissue elasticity. The different types of elastosonography are distinguished according to the mechanisms used for estimating tissue elasticity and the type of information they provide. In strain imaging, mechanical stress is applied to the tissue, and the resulting differential strain between different tissues is used to provide a qualitative assessment of elasticity. In shear wave imaging, tissue elasticity is inferred through quantitative parameters, such as shear wave velocity or longitudinal elastic modulus. Shear waves can be produced using a vibrating mechanical device, as in transient elastography (TE), or an acoustic impulse, which can be highly focused, as in point-shear wave elastography (p-SWE), or directed to multiple zones in a two-dimensional area, as in 2D-SWE. A general understanding of the basic principles behind each technique is important for clinicians to improve data acquisition and interpretation. Major clinical applications include chronic liver disease, breast lesions, thyroid nodules, lymph node malignancies, and inflammatory bowel disease. The integration of artificial intelligence tools could potentially overcome some of the main limitations of elastosonography, such as operator dependence and low specificity, allowing for its effective integration into clinical workflow.

The added value of S-detect in the diagnostic accuracy of breast masses by senior and junior radiologist groups: a systematic review and meta-analysis

Background

S-detect is an emerging computer-aided diagnosis (CAD) technique that provides a reference for radiologists to identify breast cancer. Some studies have shown that US (ultrasound) + S-detect can improve the diagnostic accuracy of junior radiologists more than senior radiologists, but the results are inconsistent in various studies. Therefore, this meta-analysis aimed to assess the value of S-detect combined with the US outcomes from senior and junior radiologists for the diagnosis of breast cancer.

Methods

We searched the PubMed, Cochrane Library, Embase, Web of Science, and Wanfang databases, China Biology Medicine disc, China National Knowledge Infrastructure (CNKI), and VIP database for trials on the diagnostic accuracy of US + S-detect for the diagnosis of breast masses. The search time frame was from the date of establishment of the database to August 20, 2022. Two researchers independently screened the literature, extracted the information, and evaluated the quality of the included literature using the Quality Assessment of Diagnostic Accuracy Studies-2 (QUADAS-2) scale. StataSE 15.1 software was utilized to assess pooled metrics, including sensitivity, specificity, and the area under the curve (AUC).

Results

A total of 19 articles with 3,349 patients and 3,895 breast masses were included in this meta-analysis. Of these, seventeen articles evaluated the diagnostic performance of senior radiologists' US + S-detect for breast cancer, while twelve articles reported junior radiologists' diagnostic performance. The risk of bias was primarily attributed to patient selection, flow and timing. In the senior radiologist group, the pooled sensitivity and specificity of US + S-detect were 0.93 [95% confidence interval (CI): 0.89-0.95] and 0.86 (95% CI: 0.80-0.90), respectively, with an AUC of 0.96. As for the junior radiologist group, the pooled sensitivity and specificity of US + S-detect were 0.89 (95% CI: 0.83-0.93) and 0.79 (95% CI: 0.72-0.84), respectively, and the AUC was 0.91.

Conclusions

The results of this meta-analysis showed that the pooled sensitivity and the AUC of both the senior and junior radiologist groups were high, with good diagnostic efficacy and high clinical application. However, the results of this study are highly heterogeneous and need to be validated by collecting more high-quality studies and accumulating a larger sample size.

Evaluating different combination methods to analyse ultrasound and shear wave elastography images automatically through discriminative convolutional neural network in breast cancer imaging

Purpose

Ultrasound (US) and Shear Wave Elastography (SWE) imaging are non-invasive methods used for breast lesion characterization. While US and SWE images provide both morphological information, SWE visualizes in addition the elasticity of tissue. In this study a Discriminative Convolutional Neural Network (DCNN) model is applied to US and SWE images and their combination to classify the breast lesions into malignant or benign cases. Furthermore, it is identified whether analysing only the region of the elastogram or including the surrounding B-mode image gives a superior performance.

Methods

The dataset used in this study consists of 746 images obtained from 207 patients comprising 486 malignant and 260 benign breast lesions. From each image the US and SWE image was extracted, once including only the region of the elastogram and once including also the surrounding B-mode image. These four datasets were applied individually to a DCNN to determine their predictive capability. Each the best US and SWE dataset were used to examine different combination methods with DCNN. The results were compared to the manual assessment by an expert radiologist.

Results

The combination of US and SWE images with the surrounding B-mode image using two ensembled DCNN models achieved best results with an accuracy of 93.53 %, sensitivity of 94.42 %, specificity of 90.75 % and area under the curve (AUC) of 96.55 %.

Conclusion

This study showed that using the whole US and SWE images through DCNN was superior to methods, in which only the region of elastogram was used. Combining breast cancer US and SWE images with two ensembled DCNN models in parallel improved the results. The accuracy, sensitivity and AUC of the best combination method were significantly superior to the results of using a single dataset through DCNN and to the results of the expert radiologist.

Diagnostic accuracy of S-Detect to breast cancer on ultrasonography: A meta-analysis (PRISMA)

BACKGROUND

Computer-aided diagnosis (CAD) systems have shown great potential as an effective auxiliary diagnostic tool in breast imaging. Previous studies have shown that S-Detect technology has a high accuracy in the differential diagnosis of breast masses. However, the application of S-Detect in clinical practice remains controversial, and the results vary among different clinical trials. This meta-analysis aimed to determine the diagnostic accuracy of S-Detect for distinguishing between benign and malignant breast masses.

METHODS

We searched PubMed, Cochrane Library, and CBM databases from inception to April 1, 2021. Meta-analysis was conducted using STATA version 14.0 and Meta-Disc version 1.4 softwares. We calculated the summary statistics for sensitivity (Sen), specificity (Spe), positive, and negative likelihood ratio (LR+/LR-), diagnostic odds ratio(DOR), and summary receiver operating characteristic (SROC) curves. Cochran Q-statistic and I2 test were used to evaluate the potential heterogeneity between studies. Sensitivity analysis was performed to evaluate the influence of single studies on the overall estimate. We also performed meta-regression analyses to investigate potential sources of heterogeneity.

RESULTS

Eleven studies that met all the inclusion criteria were included in the meta-analysis. A total of 951 malignant and 1866 benign breast masses were assessed. All breast masses were histologically confirmed using S-Detect. The pooled Sen was 0.82 (95% confidence interval(CI) = 0.74-0.88); the pooled Spe was 0.83 (95%CI = 0.78-0.88). The pooled LR + was 4.91 (95%CI = 3.75-6.41); the pooled negative LR - was 0.21 (95%CI = 0.15-0.31). The pooled DOR of S-Detect in the diagnosis of breast nodules was 23.12 (95% CI = 14.53-36.77). The area under the SROC curve was 0.90 (SE = 0.0166). No evidence of publication bias was found (t = 0.54, P = .61).

CONCLUSIONS

Our meta-analysis indicates that S-Detect may have high diagnostic accuracy in distinguishing benign and malignant breast masses.