Deep learning in ultrasound elastography imaging: A review

Advances in the Application of Artificial Intelligence in the Ultrasound Diagnosis of Vulnerable Carotid Atherosclerotic Plaque

Vulnerable atherosclerotic plaque is a type of plaque that poses a significant risk of high mortality in patients with cardiovascular disease. Ultrasound has long been used for carotid atherosclerosis screening and plaque assessment due to its safety, low cost and non-invasive nature. However, conventional ultrasound techniques have limitations such as subjectivity, operator dependence, and low inter-observer agreement, leading to inconsistent and possibly inaccurate diagnoses. In recent years, a promising approach to address these limitations has emerged through the integration of artificial intelligence (AI) into ultrasound imaging. It was found that by training AI algorithms with large data sets of ultrasound images, the technology can learn to recognize specific characteristics and patterns associated with vulnerable plaques. This allows for a more objective and consistent assessment, leading to improved diagnostic accuracy. This article reviews the application of AI in the field of diagnostic ultrasound, with a particular focus on carotid vulnerable plaques, and discusses the limitations and prospects of AI-assisted ultrasound. This review also provides a deeper understanding of the role of AI in diagnostic ultrasound and promotes more research in the field.

Deep denoising approach to improve shear wave phase velocity map reconstruction in ultrasound elastography

BACKGROUND

Measurement noise often leads to inaccurate shear wave phase velocity estimation in ultrasound shear wave elastography. Filtering techniques are commonly used for denoising the shear wavefields. However, these filters are often not sufficient, especially in fatty tissues where the signal-to-noise ratio (SNR) can be very low.

PURPOSE

The purpose of this study is to develop a deep learning approach for denoising shear wavefields in ultrasound shear wave elastography. This may lead to improved reconstruction of shear wave phase velocity image maps.

METHODS

The study addresses noise by transforming particle velocity data into a time-frequency representation. A neural network with encoder and decoder convolutional blocks effectively decomposes the input and extracts the signal of interest, improving the SNR in high-noise scenarios. The network is trained on simulated phantoms with elasticity values ranging from 3  to 60 kPa. A total of 1 85 570 samples with 80%-20 % $\%$ split were used for training and validation. The approach is tested on experimental phantom and ex-vivo goat liver tissue data. Performance was compared with the traditional filtering methods such as bandpass, median, and wavelet filtering. Kruskal-Wallis one-way analysis of variance was performed to check statistical significance. Multiple comparisons were performed using the Mann-Whitney U test and Holm-Bonferroni adjustment ofp - values $p-{\rm values}$ .

RESULTS

The results are evaluated using SNR and the percentage of pixels that can be reconstructed in the phase velocity maps. The SNR levels in experimental data improved from -2 to 9.9 dB levels to 15.6 to 30.3 dB levels. Kruskal-Wallis one-way analysis showed statistical significance (p < 0.05 $p<0.05$ ). Multiple comparisons with p-value corrections also showed statistically significant improvement when compared to the bandpass and wavelet filtering scheme (p < 0.05 $p<0.05$ ). Smoother phase velocity maps were reconstructed after denoising. The coefficient of variation is less than5 % $5\%$ in CIRS phantom and less than18 % $18\%$ in ex-vivo goat liver tissue.

CONCLUSIONS

The proposed approach demonstrates improvement in shear wave phase velocity image map reconstruction and holds promise that deep learning methods can be effectively utilized to extract true shear wave signal from measured noisy data.

CNN-Based Cross-Modality Fusion for Enhanced Breast Cancer Detection Using Mammography and Ultrasound

Background/Objectives: Breast cancer is a leading cause of mortality among women in Taiwan and globally. Non-invasive imaging methods, such as mammography and ultrasound, are critical for early detection, yet standalone modalities have limitations in regard to their diagnostic accuracy. This study aims to enhance breast cancer detection through a cross-modality fusion approach combining mammography and ultrasound imaging, using advanced convolutional neural network (CNN) architectures. Materials and Methods: Breast images were sourced from public datasets, including the RSNA, the PAS, and Kaggle, and categorized into malignant and benign groups. Data augmentation techniques were used to address imbalances in the ultrasound dataset. Three models were developed: (1) pre-trained CNNs integrated with machine learning classifiers, (2) transfer learning-based CNNs, and (3) a custom-designed 17-layer CNN for direct classification. The performance of the models was evaluated using metrics such as accuracy and the Kappa score. Results: The custom 17-layer CNN outperformed the other models, achieving an accuracy of 0.964 and a Kappa score of 0.927. The transfer learning model achieved moderate performance (accuracy 0.846, Kappa 0.694), while the pre-trained CNNs with machine learning classifiers yielded the lowest results (accuracy 0.780, Kappa 0.559). Cross-modality fusion proved effective in leveraging the complementary strengths of mammography and ultrasound imaging. Conclusions: This study demonstrates the potential of cross-modality imaging and tailored CNN architectures to significantly improve diagnostic accuracy and reliability in breast cancer detection. The custom-designed model offers a practical solution for early detection, potentially reducing false positives and false negatives, and improving patient outcomes through timely and accurate diagnosis.

A convolutional attention model for predicting response to chemo-immunotherapy from ultrasound elastography in mouse tumor models

BACKGROUND

In the era of personalized cancer treatment, understanding the intrinsic heterogeneity of tumors is crucial. Despite some patients responding favorably to a particular treatment, others may not benefit, leading to the varied efficacy observed in standard therapies. This study focuses on the prediction of tumor response to chemo-immunotherapy, exploring the potential of tumor mechanics and medical imaging as predictive biomarkers. We have extensively studied "desmoplastic" tumors, characterized by a dense and very stiff stroma, which presents a substantial challenge for treatment. The increased stiffness of such tumors can be restored through pharmacological intervention with mechanotherapeutics.

METHODS

We developed a deep learning methodology based on shear wave elastography (SWE) images, which involved a convolutional neural network (CNN) model enhanced with attention modules. The model was developed and evaluated as a predictive biomarker in the setting of detecting responsive, stable, and non-responsive tumors to chemotherapy, immunotherapy, or the combination, following mechanotherapeutics administration. A dataset of 1365 SWE images was obtained from 630 tumors from our previous experiments and used to train and successfully evaluate our methodology. SWE in combination with deep learning models, has demonstrated promising results in disease diagnosis and tumor classification but their potential for predicting tumor response prior to therapy is not yet fully realized.

RESULTS

We present strong evidence that integrating SWE-derived biomarkers with automatic tumor segmentation algorithms enables accurate tumor detection and prediction of therapeutic outcomes.

CONCLUSIONS

This approach can enhance personalized cancer treatment by providing non-invasive, reliable predictions of therapeutic outcomes.

Ultrasound Viscoelastography by Acoustic Radiation Force: A State-of-the-Art Review

Ultrasound elastography (USE) is a promising tool for tissue characterization as several diseases result in alterations of tissue structure and composition, which manifest as changes in tissue mechanical properties. By imaging the tissue response to an applied mechanical excitation, USE mimics the manual palpation performed by clinicians to sense the tissue elasticity for diagnostic purposes. Next to elasticity, viscosity has recently been investigated as an additional, relevant, diagnostic biomarker. Moreover, since biological tissues are inherently viscoelastic, accounting for viscosity in the tissue characterization process enhances the accuracy of the elasticity estimation. Recently, methods exploiting different acquisition and processing techniques have been proposed to perform ultrasound viscoelastography. After introducing the physics describing viscoelasticity, a comprehensive overview of the currently available USE acquisition techniques is provided, followed by a structured review of the existing viscoelasticity estimators classified according to the employed processing technique. These estimators are further reviewed from a clinical usage perspective, and current outstanding challenges are discussed.

Exploring the Intersection of Geophysics and Diagnostic Imaging in the Health Sciences

To develop diagnostic imaging approaches, this paper emphasizes the transformational potential of merging geophysics with health sciences. Diagnostic imaging technology improvements have transformed the health sciences by enabling earlier and more precise disease identification, individualized therapy, and improved patient care. This review article examines the connection between geophysics and diagnostic imaging in the field of health sciences. Geophysics, which is typically used to explore Earth's subsurface, has provided new uses of its methodology in the medical field, providing innovative solutions to pressing medical problems. The article examines the different geophysical techniques like electrical imaging, seismic imaging, and geophysics and their corresponding imaging techniques used in health sciences like tomography, magnetic resonance imaging, ultrasound imaging, etc. The examination includes the description, similarities, differences, and challenges associated with these techniques and how modified geophysical techniques can be used in imaging methods in health sciences. Examining the progression of each method from geophysics to medical imaging and its contributions to illness diagnosis, treatment planning, and monitoring are highlighted. Also, the utilization of geophysical data analysis techniques like signal processing and inversion techniques in image processing in health sciences has been briefly explained, along with different mathematical and computational tools in geophysics and how they can be implemented for image processing in health sciences. The key findings include the development of machine learning and artificial intelligence in geophysics-driven medical imaging, demonstrating the revolutionary effects of data-driven methods on precision, speed, and predictive modeling.

Liver fibrosis classification from ultrasound using machine learning: a systematic literature review

PURPOSE

Liver biopsy was considered the gold standard for diagnosing liver fibrosis; however, with advancements in medical technology and increasing awareness of potential complications, the reliance on liver biopsy has diminished. Ultrasound is gaining popularity due to its wider availability and cost-effectiveness. This study examined the machine learning / deep learning (ML/DL) models for non-invasive liver fibrosis classification from ultrasound.

METHODS

Following the preferred reporting items for systematic reviews and meta-analyses (PRISMA) protocol, we searched five academic databases using the query. We defined population, intervention, comparison, outcomes, and study design (PICOS) framework for the inclusion. Furthermore, Joana Briggs Institute (JBI) checklist for analytical cross-sectional studies is used for quality assessment.

RESULTS

Among the 188 screened studies, 17 studies are selected. The methods are categorized as off-the-shelf (OTS), attention, generative, and ensemble classifiers. Most studies used OTS classifiers that combined pre-trained ML/DL methods with radiomics features to determine fibrosis staging. Although machine learning shows potential for fibrosis classification, there are limited external comparisons of interventions and prospective clinical trials, which limits their applicability.

CONCLUSION

With the recent success of ML/DL toward biomedical image analysis, automated solutions using ultrasound are developed for predicting liver diseases. However, their applicability is bounded by the limited and imbalanced retrospective studies having high heterogeneity. This challenge could be addressed by generating a standard protocol for study design by selecting appropriate population, interventions, outcomes, and comparison.

Artificial intelligence - based ultrasound elastography for disease evaluation - a narrative review

Ultrasound elastography (USE) provides complementary information of tissue stiffness and elasticity to conventional ultrasound imaging. It is noninvasive and free of radiation, and has become a valuable tool to improve diagnostic performance with conventional ultrasound imaging. However, the diagnostic accuracy will be reduced due to high operator-dependence and intra- and inter-observer variability in visual observations of radiologists. Artificial intelligence (AI) has great potential to perform automatic medical image analysis tasks to provide a more objective, accurate and intelligent diagnosis. More recently, the enhanced diagnostic performance of AI applied to USE have been demonstrated for various disease evaluations. This review provides an overview of the basic concepts of USE and AI techniques for clinical radiologists and then introduces the applications of AI in USE imaging that focus on the following anatomical sites: liver, breast, thyroid and other organs for lesion detection and segmentation, machine learning (ML) - assisted classification and prognosis prediction. In addition, the existing challenges and future trends of AI in USE are also discussed.