Ultrasound Scatterer Density Classification Using Convolutional Neural Networks and Patch Statistics

Ultrasound normalized cumulative residual entropy imaging: Theory, methodology, and application

BACKGROUND AND OBJECTIVE

Ultrasound information entropy imaging is an emerging quantitative ultrasound technique for characterizing local tissue scatterer concentrations and arrangements. However, the commonly used ultrasound Shannon entropy imaging based on histogram-derived discrete probability estimation suffers from the drawbacks of histogram settings dependence and unknown estimator performance. In this paper, we introduced the information-theoretic cumulative residual entropy (CRE) defined in a continuous distribution of cumulative distribution functions as a new entropy measure of ultrasound backscatter envelope uncertainty or complexity, and proposed ultrasound CRE imaging for tissue characterization.

METHODS

We theoretically analyzed the CRE for Rayleigh and Nakagami distributions and proposed a normalized CRE for characterizing scatterer distribution patterns. We proposed a method based on an empirical cumulative distribution function estimator and a trapezoidal numerical integration for estimating the normalized CRE from ultrasound backscatter envelope signals. We presented an ultrasound normalized CRE imaging scheme based on the normalized CRE estimator and the parallel computation technique. We also conducted theoretical analysis of the differential entropy which is an extension of the Shannon entropy to a continuous distribution, and introduced a method for ultrasound differential entropy estimation and imaging. Monte-Carlo simulation experiments were performed to evaluate the estimation accuracy of the normalized CRE and differential entropy estimators. Phantom simulation and clinical experiments were conducted to evaluate the performance of the proposed normalized CRE imaging in characterizing scatterer concentrations and hepatic steatosis (n = 204), respectively.

RESULTS

The theoretical normalized CRE for the Rayleigh distribution was π/4, corresponding to the case where there were ≥10 randomly distributed scatterers within the resolution cell of an ultrasound transducer. The theoretical normalized CRE for the Nakagami distribution decreased as the Nakagami parameter m increased, corresponding to that the ultrasound backscattered statistics varied from pre-Rayleigh to Rayleigh and to post-Rayleigh distributions. Monte-Carlo simulation experiments showed that the proposed normalized CRE and differential entropy estimators can produce a satisfying estimation accuracy even when the size of the test samples is small. Phantom simulation experiments showed that the proposed normalized CRE and differential entropy imaging can characterize scatterer concentrations. Clinical experiments showed that the proposed ultrasound normalized CRE imaging is capable to quantitatively characterize hepatic steatosis, outperforming ultrasound differential entropy imaging and being comparable to ultrasound Shannon entropy and Nakagami imaging.

CONCLUSION

This study sheds light on the theory and methodology of ultrasound normalized CRE. The proposed ultrasound normalized CRE can serve as a new, flexible quantitative ultrasound envelope statistics parameter. The proposed ultrasound normalized CRE imaging may find applications in quantified characterization of biological tissues. Our code will be made available publicly at https://github.com/zhouzhuhuang.

Multimodality quantitative ultrasound envelope statistics imaging based support vector machines for characterizing tissue scatterer distribution patterns: Methods and application in detecting microwave-induced thermal lesions

Ultrasound envelope statistics imaging, including ultrasound Nakagami imaging, homodyned-K imaging, and information entropy imaging, is an important group of quantitative ultrasound techniques for characterizing tissue scatterer distribution patterns, such as scatterer concentrations and arrangements. In this study, we proposed a machine learning approach to integrate the strength of multimodality quantitative ultrasound envelope statistics imaging techniques and applied it to detecting microwave ablation induced thermal lesions in porcine liver ex vivo. The quantitative ultrasound parameters included were homodyned-K α which is a scatterer clustering parameter related to the effective scatterer number per resolution cell, Nakagami m which is a shape parameter of the envelope probability density function, and Shannon entropy which is a measure of signal uncertainty or complexity. Specifically, the homodyned-K log10(α), Nakagami-m, and horizontally normalized Shannon entropy parameters were combined as input features to train a support vector machine (SVM) model to classify thermal lesions with higher scatterer concentrations from normal tissues with lower scatterer concentrations. Through heterogeneous phantom simulations based on Field II, the proposed SVM model showed a classification accuracy above 0.90; the area accuracy and Dice score of higher-scatterer-concentration zone identification exceeded 83% and 0.86, respectively, with the Hausdorff distance <26. Microwave ablation experiments of porcine liver ex vivo at 60-80 W, 1-3 min showed that the SVM model achieved a classification accuracy of 0.85; compared with single log10(α),m, or hNSE parametric imaging, the SVM model achieved the highest area accuracy (89.1%) and Dice score (0.77) as well as the smallest Hausdorff distance (46.38) of coagulation zone identification. We concluded that the proposed multimodality quantitative ultrasound envelope statistics imaging based SVM approach can enhance the capability to characterize tissue scatterer distribution patterns and has the potential to detect the thermal lesions induced by microwave ablation.

Machine-to-Machine Transfer Function in Deep Learning-Based Quantitative Ultrasound

A transfer function approach was recently demonstrated to mitigate data mismatches at the acquisition level for a single ultrasound scanner in deep learning (DL)-based quantitative ultrasound (QUS). As a natural progression, we further investigate the transfer function approach and introduce a machine-to-machine (M2M) transfer function, which possesses the ability to mitigate data mismatches at a machine level. This ability opens the door to unprecedented opportunities for reducing DL model development costs, enabling the combination of data from multiple sources or scanners, or facilitating the transfer of DL models between machines. We tested the proposed method utilizing a SonixOne machine and a Verasonics machine with an L9-4 array and an L11-5 array. We conducted two types of acquisitions to obtain calibration data: stable and free-hand, using two different calibration phantoms. Without the proposed method, the mean classification accuracy when applying a model on data acquired from one system to data acquired from another system was 50%, and the mean average area under the receiver operator characteristic (ROC) curve (AUC) was 0.405. With the proposed method, mean accuracy increased to 99%, and the AUC rose to the 0.999. Additional observations include the choice of the calibration phantom led to statistically significant changes in the performance of the proposed method. Moreover, robust implementation inspired by Wiener filtering provided an effective method for transferring the domain from one machine to another machine, and it can succeed using just a single calibration view. Lastly, the proposed method proved effective when a different transducer was used in the test machine.

Recent Advances in Attenuation Estimation

This chapter reviews some of the recent advances in the estimation of the local and the total attenuation, with an emphasis on reducing the bias and variance of the estimates. A special focus is put on describing the effect of power spectrum estimation on bias and variance, the introduction of regularization strategies, as well as on eliminating the need to use reference phantoms for compensating for system dependent effects.

Deep Estimation of Speckle Statistics Parametric Images

Quantitative Ultrasound (QUS) provides important information about the tissue properties. QUS parametric image can be formed by dividing the envelope data into small overlapping patches and computing different speckle statistics such as parameters of the Nakagami and Homodyned K-distributions (HK-distribution). The calculated QUS parametric images can be erroneous since only a few independent samples are available inside the patches. Another challenge is that the envelope samples inside the patch are assumed to come from the same distribution, an assumption that is often violated given that the tissue is usually not homogenous. In this paper, we propose a method based on Convolutional Neural Networks (CNN) to estimate QUS parametric images without patching. We construct a large dataset sampled from the HK-distribution, having regions with random shapes and QUS parameter values. We then use a well-known network to estimate QUS parameters in a multi-task learning fashion. Our results confirm that the proposed method is able to reduce errors and improve border definition in QUS parametric images.

Robust Scatterer Number Density Segmentation of Ultrasound Images

Quantitative ultrasound (QUS) aims to reveal information about the tissue microstructure using backscattered echo signals from clinical scanners. Among different QUS parameters, scatterer number density is an important property that can affect the estimation of other QUS parameters. Scatterer number density can be classified into high or low scatterer densities. If there are more than ten scatterers inside the resolution cell, the envelope data are considered as fully developed speckle (FDS) and, otherwise, as underdeveloped speckle (UDS). In conventional methods, the envelope data are divided into small overlapping windows (a strategy here we refer to as patching), and statistical parameters, such as SNR and skewness, are employed to classify each patch of envelope data. However, these parameters are system-dependent, meaning that their distribution can change by the imaging settings and patch size. Therefore, reference phantoms that have known scatterer number density are imaged with the same imaging settings to mitigate system dependency. In this article, we aim to segment regions of ultrasound data without any patching. A large dataset is generated, which has different shapes of scatterer number density and mean scatterer amplitude using a fast simulation method. We employ a convolutional neural network (CNN) for the segmentation task and investigate the effect of domain shift when the network is tested on different datasets with different imaging settings. Nakagami parametric image is employed for multitask learning to improve performance. Furthermore, inspired by the reference phantom methods in QUS, a domain adaptation stage is proposed, which requires only two frames of data from FDS and UDS classes. We evaluate our method for different experimental phantoms and in vivo data.

Quantitative ultrasound imaging of soft biological tissues: a primer for radiologists and medical physicists

Quantitative ultrasound (QUS) aims at quantifying interactions between ultrasound and biological tissues. QUS techniques extract fundamental physical properties of tissues based on interactions between ultrasound waves and tissue microstructure. These techniques provide quantitative information on sub-resolution properties that are not visible on grayscale (B-mode) imaging. Quantitative data may be represented either as a global measurement or as parametric maps overlaid on B-mode images. Recently, major ultrasound manufacturers have released speed of sound, attenuation, and backscatter packages for tissue characterization and imaging. Established and emerging clinical applications are currently limited and include liver fibrosis staging, liver steatosis grading, and breast cancer characterization. On the other hand, most biological tissues have been studied using experimental QUS methods, and quantitative datasets are available in the literature. This educational review addresses the general topic of biological soft tissue characterization using QUS, with a focus on disseminating technical concepts for clinicians and specialized QUS materials for medical physicists. Advanced but simplified technical descriptions are also provided in separate subsections identified as such. To understand QUS methods, this article reviews types of ultrasound waves, basic concepts of ultrasound wave propagation, ultrasound image formation, point spread function, constructive and destructive wave interferences, radiofrequency data processing, and a summary of different imaging modes. For each major QUS technique, topics include: concept, illustrations, clinical examples, pitfalls, and future directions.