Novel 3D ultrasound image-based biomarkers based on a feature selection from a 2D standardized vessel wall thickness map: a tool for sensitive assessment of therapies for carotid atherosclerosis

Development of a Three-Dimensional Carotid Ultrasound Image Segmentation Workflow for Improved Efficiency, Reproducibility and Accuracy in Measuring Vessel Wall and Plaque Volume and Thickness

Automated segmentation of carotid lumen-intima boundary (LIB) and media-adventitia boundary (MAB) by deep convolutional neural networks (CNN) from three-dimensional ultrasound (3DUS) images has made assessment and monitoring of carotid atherosclerosis more efficient than manual segmentation. However, training of CNN still requires manual segmentation of LIB and MAB. Therefore, there is a need to improve the efficiency of manual segmentation and develop strategies to improve segmentation accuracy by the CNN for serial monitoring of carotid atherosclerosis. One strategy to reduce segmentation time is to increase the interslice distance (ISD) between segmented axial slices of a 3DUS image while maintaining the segmentation reliability. We, for the first time, investigated the effect of ISD on the reproducibility of MAB and LIB segmentations. The intra-observer reproducibility of LIB and MAB segmentations at ISDs of 1 mm and 2 mm was not statistically significantly different, whereas the reproducibility at ISD = 3 mm was statistically lower. Therefore, we conclude that segmentation with an ISD of 2 mm provides sufficient reliability for CNN training. We further proposed training the CNN by the baseline images of the entire cohort of patients for automatic segmentation of the follow-up images acquired for the same cohort. We validated that segmentation with this time-based partitioning approach is more accurate than that produced by patient-based partitioning, especially at the carotid bifurcation. This study forms the basis for an efficient, reproducible, and accurate 3DUS workflow for serial monitoring of carotid atherosclerosis useful in risk stratification of cardiovascular events and in evaluating the efficacy of new treatments.

A Dual-Stream Centerline-Guided Network for Segmentation of the Common and Internal Carotid Arteries From 3D Ultrasound Images

Segmentation of the carotid section encompassing the common carotid artery (CCA), the bifurcation and the internal carotid artery (ICA) from three-dimensional ultrasound (3DUS) is required to measure the vessel wall volume (VWV) and localized vessel-wall-plus-plaque thickness (VWT), shown to be sensitive to treatment effect. We proposed an approach to combine a centerline extraction network (CHG-Net) and a dual-stream centerline-guided network (DSCG-Net) to segment the lumen-intima (LIB) and media-adventitia boundaries (MAB) from 3DUS images. Correct arterial location is essential for successful segmentation of the carotid section encompassing the bifurcation. We addressed this challenge by using the arterial centerline to enhance the localization accuracy of the segmentation network. The CHG-Net was developed to generate a heatmap indicating high probability regions for the centerline location, which was then integrated with the 3DUS image by the DSCG-Net to generate the MAB and LIB. The DSCG-Net includes a scale-based and a spatial attention mechanism to fuse multi-level features extracted by the encoder, and a centerline heatmap reconstruction side-branch connected to the end of the encoder to increase the generalization ability of the network. Experiments involving 224 3DUS volumes produce a Dice similarity coefficient (DSC) of 95.8±1.9% and 92.3±5.4% for CCA MAB and LIB, respectively, and 93.2±4.4% and 89.0±10.0% for ICA MAB and LIB, respectively. Our approach outperformed four state-of-the-art 3D CNN models, even after their performances were boosted by centerline guidance. The efficiency afforded by the framework would allow it to be incorporated into the clinical workflow for improved quantification of plaque change.

Quantification of Local Vessel Wall and Plaque Volume Change for Assessment of Effects of Therapies on Carotid Atherosclerosis Based on 3-D Ultrasound Imaging

We developed a new method to measure the voxel-based vessel-wall-plus-plaque volume (VWV). In addition to quantifying local thickness change as in the previously introduced vessel-wall-plus-plaque thickness (VWT) metric, voxel-based VWV further considers the circumferential change associated with vascular remodeling. Three-dimensional ultrasound images were acquired at baseline and 1 y afterward. The vessel wall region was divided into small voxels with the voxel-based VWV change (ΔVVol%) computed by taking the percentage volume difference between corresponding voxels in the baseline and follow-up images. A 3-D carotid atlas was developed to allow visualization of the local thickness and circumferential change patterns in the pomegranate versus the placebo groups. A new patient-based biomarker was obtained by computing the mean ΔVVol% over the entire 3-D map for each patient (ΔVVol%¯). ΔVVol%¯ detected a significant difference between patients randomized to pomegranate juice/extract and placebo groups (p = 0.0002). The number of patients required by ΔVVol%¯ to establish statistical significance was approximately a third of that required by the local VWT biomarker. The increased sensitivity afforded by the proposed biomarker improves the cost-effectiveness of clinical studies evaluating new anti-atherosclerotic treatments.

Three-dimensional ultrasound assessment of effects of therapies on carotid atherosclerosis using vessel wall thickness maps

We present a new method for assessing the effects of therapies on atherosclerosis, by measuring the weighted average of carotid vessel-wall-plus-plaque thickness change (ΔVWT¯_Weighted) in 120 patients randomized to pomegranate juice/extract versus placebo. Three-dimensional ultrasound images were acquired at baseline and one year after. Three-dimensional VWT maps were reconstructed and then projected onto a carotid template to obtain two-dimensional VWT maps. Anatomic correspondence on the two-dimensional VWT maps was optimized to reduce misalignment for the same subject and across subjects. A weight was computed at each point on the two-dimensional VWT map to highlight anatomic locations likely to exhibit plaque progression/regression, resulting in ΔVWT¯_Weighted for each subject. The weighted average of VWT-Change measured from the two-dimensional VWT maps with correspondence alignment (ΔVWT¯_Weighted,MDL) detected a significant difference between the pomegranate and placebo groups (P = 0.008). This method improves the cost-effectiveness of proof-of-concept studies involving new therapies for atherosclerosis.

Segmentation of common and internal carotid arteries from 3D ultrasound images based on adaptive triple loss

PURPOSE

Vessel wall volume (VWV) and localized vessel-wall-plus-plaque thickness (VWT) measured from three-dimensional (3D) ultrasound (US) carotid images are sensitive to anti-atherosclerotic effects of medical/dietary treatments. VWV and VWT measurements require the lumen-intima (LIB) and media-adventitia boundaries (MAB) at the common and internal carotid arteries (CCA and ICA). However, most existing segmentation techniques were capable of segmenting the CCA only. An approach capable of segmenting the MAB and LIB from the CCA and ICA was required to accelerate VWV and VWT quantification.

METHODS

Segmentation for CCA and ICA was performed independently using the proposed two-channel U-Net, which was driven by a novel loss function known as the adaptive triple Dice loss (ADTL) function. The training set was augmented by interpolating manual segmentation along the longitudinal direction, thereby taking continuity of the artery into account. A test-time augmentation (TTA) approach was applied, in which segmentation was performed three times based on the input axial images and its flipped versions; the final segmentation was generated by pixel-wise majority voting.

RESULTS

Experiments involving 224 3DUS volumes produce a Dice similarity coefficient (DSC) of 95.1% ± 4.1% and 91.6% ± 6.6% for the MAB and LIB, in the CCA, respectively, and 94.2% ± 3.3% and 89.0% ± 8.1% for the MAB and LIB, in the ICA, respectively. TTA and ATDL independently contributed to a statistically significant improvement to all boundaries except the LIB in ICA.

CONCLUSIONS

The proposed two-channel U-Net with ADTL and TTA can segment the CCA and ICA accurately and efficiently from the 3DUS volume. Our approach has the potential to accelerate the transition of 3DUS measurements of carotid atherosclerosis to clinical research.

Area-Preserving Mapping of 3D Carotid Ultrasound Images Using Density-Equalizing Reference Map

Atherosclerotic plaques are focal and tend to occur at arterial bends and bifurcations. To quantitatively monitor the local changes in the carotid vessel-wall-plus-plaque thickness (VWT) and compare the VWT distributions for different patients or for the same patients at different ultrasound scanning sessions, a mapping technique is required to adjust for the geometric variability of different carotid artery models. In this work, we propose a novel method called density-equalizing reference map (DERM) for mapping 3D carotid surfaces to a standardized 2D carotid template, with an emphasis on preserving the local geometry of the carotid surface by minimizing the local area distortion. The initial map was generated by a previously described arc-length scaling (ALS) mapping method, which projects a 3D carotid surface onto a 2D non-convex L-shaped domain. A smooth and area-preserving flattened map was subsequently constructed by deforming the ALS map using the proposed algorithm that combines the density-equalizing map and the reference map techniques. This combination allows, for the first time, one-to-one mapping from a 3D surface to a standardized non-convex planar domain in an area-preserving manner. Evaluations using 20 carotid surface models show that the proposed method reduced the area distortion of the flattening maps by over 80% as compared to the ALS mapping method. The proposed method is capable of improving the accuracy of area estimation for plaque regions without compromising inter-scan reproducibility.

Carotid plaque segmentation from three-dimensional ultrasound images by direct three-dimensional sparse field level-set optimization

Total plaque volume (TPV) measured from 3D carotid ultrasound has been shown to be able to predict cardiovascular events and is sensitive in detecting treatment effects. Manual plaque segmentation was performed in previous studies to quantify TPV, but is tedious, requires long training times and is prone to observer variability. This article introduces the first 3D direct volume-based level-set algorithm to segment plaques from 3D carotid ultrasound images. The plaque surfaces were first initialized based on the lumen and outer wall boundaries generated by a previously described semi-automatic algorithm and then deformed by a direct three-dimensional sparse field level-set algorithm, which enforced the longitudinal continuity of the segmented plaque surfaces. This is a marked advantage as compared to a previously proposed 2D slice-by-slice plaque segmentation method. In plaque boundary initialization, the previous technique performed a search on lines connecting corresponding point pairs of the outer wall and lumen boundaries. A limitation of this initialization strategy was that an inaccurate initial plaque boundary would be generated if the plaque was not enclosed entirely by the wall and lumen boundaries. A mechanism is proposed to extend the search range in order to capture the entire plaque if the outer wall boundary lies on a weak edge in the 3D ultrasound image. The proposed method was compared with the previously described 2D slice-by-slice plaque segmentation method in 26 three-dimensional carotid ultrasound images containing 27 plaques with volumes ranging from 12.5 to 450.0 mm³. The manually segmented plaque boundaries serve as the surrogate gold standard. Segmentation accuracy was quantified by volume-, area- and distance-based metrics, including absolute plaque volume difference (|ΔPV|), Dice similarity coefficient (DSC), mean and maximum absolute distance (MAD and MAXD). The proposed direct 3D plaque segmentation algorithm was associated with a significantly lower |ΔPV|, MAD and MAXD, and a significantly higher DSC compared to the previously described slice-by-slice algorithm (|ΔPV|:p=0.012, DSC: p=2.1×10^-4, MAD: p=1.3×10^-4, MAXD: p=5.2×10^-4). The proposed 3D volume-based algorithm required 72±22 s to segment a plaque, which is 40% lower than the 2D slice-by-slice algorithm (114±18 s). The proposed automatic plaque segmentation method generates accurate and reproducible boundaries efficiently and will allow for streamlining plaque quantification based on 3D ultrasound images.

Breast lesion classification based on supersonic shear-wave elastography and automated lesion segmentation from B-mode ultrasound images

Supersonic shear-wave elastography (SWE) has emerged as a useful imaging modality for breast lesion assessment. Regions of interest (ROIs) were required to be specified for extracting features that characterize malignancy of lesions. Although analyses have been performed in small rectangular ROIs identified manually by expert observers, the results were subject to observer variability and the analysis of small ROIs would potentially miss out important features available in other parts of the lesion. Recent investigations extracted features from the entire lesion segmented by B-mode ultrasound images either manually or semi-automatically, but lesion delineation using existing techniques is time-consuming and prone to variability as intensive user interactions are required. In addition, rich diagnostic features were available along the rim surrounding the lesion. The width of the rim analyzed was subjectively and empirically determined by expert observers in previous studies after intensive visual study on the images, which is time-consuming and susceptible to observer variability. This paper describes an analysis pipeline to segment and classify lesions efficiently. The lesion boundary was first initialized and then deformed based on energy fields generated by the dyadic wavelet transform. Features of the SWE images were extracted from inside and outside of a lesion for different widths of the surrounding rim. Then, feature selection was performed followed by the Support Vector Machine (SVM) classification. This strategy obviates the empirical and time-consuming selection of the surrounding rim width before the analysis. The pipeline was evaluated on 137 lesions. Feature selection was performed 20 times using different sets of 14 lesions (7 malignant, 7 benign). Leave-one-out SVM classification was performed in each of the 20 experiments with a mean sensitivity, specificity and accuracy of 95.1%, 94.6% and 94.8% respectively. The pipeline took an average of 20 s to process a lesion. The fact that this efficient pipeline generated classification accuracy superior to that of existing algorithms suggests that improved efficiency did not compromise classification accuracy. The ability to streamline the quantitative assessment of SWE images will potentially accelerate the adoption of the combined use of ultrasound and elastography in clinical practice.

Sensitive three-dimensional ultrasound assessment of carotid atherosclerosis by weighted average of local vessel wall and plaque thickness change

PURPOSE

Vitamin B deficiency has been identified as a risk factor for vascular events. However, the reduction of vascular events was not shown in large randomized controlled trials evaluating B-Vitamin therapy. There is an important requirement to develop sensitive biomarkers to be used as efficacy targets for B-Vitamin therapy as well as other dietary treatments and lifestyle regimes that are being developed. Carotid vessel-wall-plus-plaque thickness change (VWT-Change) measured from 3D ultrasound has been shown to be sensitive to atorvastatin therapies in previous studies. However, B-Vitamin treatment is expected to confer a smaller beneficial effect in carotid atherosclerosis than the strong dose of atorvastatin. This paper introduces a sensitive atherosclerosis biomarker based on the weighted mean VWT-Change measurement from 3D ultrasound with a purpose to detect statistically significant effect of B-Vitamin therapy.

METHODS

Of the 56 subjects analyzed in this study, 27 were randomized to receive a B-Vitamin tablet daily and 29 received a placebo tablet daily. Participants were scanned at baseline and 1.9 ± 0.8 yr later. The 3D VWT map at each scanning session was computed by matching the outer wall and lumen surfaces on a point-by-point basis. The 3D annual VWT-Change maps were obtained by first registering the 3D VWT maps obtained at the baseline and follow-up scanning sessions, and then taking the point-wise difference in VWT and dividing the result by the years elapsed from the baseline to the follow-up scanning session. The 3D VWT-Change maps constructed for all patients were mapped to a 2D carotid template to adjust for the anatomic variability of the arteries. A weight at each point of the carotid template was assigned based on the degree of correlation between the VWT-Change measurements exhibited at that point and the treatment received (i.e., B-Vitamin or placebo) quantified by mutual information. The weighted mean of VWT-Change for each patient, denoted by ΔVWT¯Weighted, was computed according to this weight. T-tests were performed to compare the sensitivity of ΔVWT¯Weighted with existing biomarkers in detecting treatment effects. These biomarkers included changes in intima-media thickness (IMT), total plaque area (TPA), vessel wall volume (VWV), unweighted average of VWT-Change (ΔVWT¯) and a previously described biomarker, denoted by ΔVWT¯S, that quantifies the mean VWT-Change specific to regions of interest identified by a feature selection algorithm.

RESULTS

Among the six biomarkers evaluated, the effect of B Vitamins was detected only by ΔVWT¯Weighted in this cohort (P=4.4×10-3). The sample sizes per treatment group required to detect an effect as large as exhibited in this study were 139, 178, 41 for ΔVWV, ΔVWT¯ and ΔVWT¯Weighted respectively.

CONCLUSION

The proposed weighted mean of VWT-Change is more sensitive than existing biomarkers in detecting treatment effects. This measurement tool will allow for many proof-of-principal studies to be performed for various novel treatments before a more costly study involving a larger population is held to validate the results.

Conformal mapping of carotid vessel wall and plaque thickness measured from 3D ultrasound images

Measurements of vessel-wall-plus-plaque thickness (VWT) from 3D carotid ultrasound have been shown to be sensitive to the effect of pharmaceutical interventions. Since the geometry of carotid arteries is highly subject-specific, quantitative comparison of the distributions of point-wise VWT measured for different patients or for the same patients at different ultrasound scanning sessions requires the development of a mapping strategy to adjust for the geometric variability of different carotid surface models. In this paper, we present an algorithm mapping each 3D carotid surface to a 2D carotid template with an emphasis on preserving the local geometry of the carotid surface by minimizing local angular distortion. The previously described arc-length scaling (AL) approach was applied to generate an initial 2D VWT map. Using results established in the quasi-conformal theory, a new map was computed to compensate for the angular distortion incurred in AL mapping. As the 2D carotid template lies on an L-shaped non-convex domain, one-to-one correspondence of the mapping operation was not guaranteed. To address this issue, an iterative Beltrami differential chopping and smoothing procedure was developed to enforce bijectivity. Evaluations performed in the 20 carotid surface models showed that the reduction in average angular distortion made by the proposed algorithm was highly significant (P = 2.06 × 10^-5). This study is the first study showing that a bijective conformal map to a non-convex domain can be obtained using the iterative Beltrami differential chopping and smoothing procedure. The improved consistency exhibited in the 2D VWT map generated by the proposed algorithm will allow for unbiased quantitative comparisons of VWT as well as local geometric and hemodynamic quantities in population studies.

Concise biomarker for spatial-temporal change in three-dimensional ultrasound measurement of carotid vessel wall and plaque thickness based on a graph-based random walk framework: Towards sensitive evaluation of response to therapy

Rapid progression in total plaque area and volume measured from ultrasound images has been shown to be associated with an elevated risk of cardiovascular events. Since atherosclerosis is focal and predominantly occurring at the bifurcation, biomarkers that are able to quantify the spatial distribution of vessel-wall-plus-plaque thickness (VWT) change may allow for more sensitive detection of treatment effect. The goal of this paper is to develop simple and sensitive biomarkers to quantify the responsiveness to therapies based on the spatial distribution of VWT-Change on the entire 2D carotid standardized map previously described. Point-wise VWT-Changes computed for each patient were reordered lexicographically to a high-dimensional data node in a graph. A graph-based random walk framework was applied with the novel Weighted Cosine (WCos) similarity function introduced, which was tailored for quantification of responsiveness to therapy. The converging probability of each data node to the VWT regression template in the random walk process served as a scalar descriptor for VWT responsiveness to treatment. The WCos-based biomarker was 14 times more sensitive than the mean VWT-Change in discriminating responsive and unresponsive subjects based on the p-values obtained in T-tests. The proposed framework was extended to quantify where VWT-Change occurred by including multiple VWT-Change distribution templates representing focal changes at different regions. Experimental results show that the framework was effective in classifying carotid arteries with focal VWT-Change at different locations and may facilitate future investigations to correlate risk of cardiovascular events with the location where focal VWT-Change occurs.