Lumen segmentation and motion estimation in B-mode and contrast-enhanced ultrasound images of the carotid artery in patients with atherosclerotic plaque

Lumen segmentation using a Mask R-CNN in carotid arteries with stenotic atherosclerotic plaque

In patients at high risk for ischemic stroke, clinical carotid ultrasound is often used to grade stenosis, determine plaque burden and assess stroke risk. Analysis currently requires a trained sonographer to manually identify vessel and plaque regions, which is time and labor intensive. We present a method for automatically determining bounding boxes and lumen segmentation using a Mask R-CNN network trained on sonographer assisted ground-truth carotid lumen segmentations. Automatic lumen segmentation also lays the groundwork for developing methods for accurate plaque segmentation, and wall thickness measurements in cases with no plaque. Different training schemes are used to identify the Mask R-CNN model with the highest accuracy. Utilizing a single-channel B-mode training input, our model produces a mean bounding box intersection over union (IoU) of 0.81 and a mean lumen segmentation IoU of 0.75. However, we encountered errors in prediction when the jugular vein is the most prominently visualized vessel in the B-mode image. This was due to the fact that our dataset has limited instances of B-mode images with both the jugular vein and carotid artery where the vein is dominantly visualized. Additional training datasets are anticipated to mitigate this issue.

FRDD-Net: Automated Carotid Plaque Ultrasound Images Segmentation Using Feature Remapping and Dense Decoding

Automated segmentation and evaluation of carotid plaques ultrasound images is of great significance for the diagnosis and early intervention of high-risk groups of cardiovascular and cerebrovascular diseases. However, it remains challenging to develop such solutions due to the relatively low quality of ultrasound images and heterogenous characteristics of carotid plaques. To address those problems, in this paper, we propose a novel deep convolutional neural network, FRDD-Net, with an encoder–decoder architecture to automatically segment carotid plaques. We propose the feature remapping modules (FRMs) and incorporate them into the encoding and decoding blocks to ameliorate the reliability of acquired features. We also propose a new dense decoding mechanism as part of the decoder, thus promoting the utilization efficiency of encoded features. Additionally, we construct a compound loss function to train our network to further enhance its robustness in the face of numerous cases. We train and test our network in multiple carotid plaque ultrasound datasets and our method yields the best performance compared to other state-of-the-art methods. Further ablation studies consistently show the advancement of our proposed architecture.

A Review on Joint Carotid Intima-Media Thickness and Plaque Area Measurement in Ultrasound for Cardiovascular/Stroke Risk Monitoring: Artificial Intelligence Framework

Cardiovascular diseases (CVDs) are the top ten leading causes of death worldwide. Atherosclerosis disease in the arteries is the main cause of the CVD, leading to myocardial infarction and stroke. The two primary image-based phenotypes used for monitoring the atherosclerosis burden is carotid intima-media thickness (cIMT) and plaque area (PA). Earlier segmentation and measurement methods were based on ad hoc conventional and semi-automated digital imaging solutions, which are unreliable, tedious, slow, and not robust. This study reviews the modern and automated methods such as artificial intelligence (AI)-based. Machine learning (ML) and deep learning (DL) can provide automated techniques in the detection and measurement of cIMT and PA from carotid vascular images. Both ML and DL techniques are examples of supervised learning, i.e., learn from "ground truth" images and transformation of test images that are not part of the training. This review summarizes (1) the evolution and impact of the fast-changing AI technology on cIMT/PA measurement, (2) the mathematical representations of ML/DL methods, and (3) segmentation approaches for cIMT/PA regions in carotid scans based for (a) region-of-interest detection and (b) lumen-intima and media-adventitia interface detection using ML/DL frameworks. AI-based methods for cIMT/PA segmentation have emerged for CVD/stroke risk monitoring and may expand to the recommended parameters for atherosclerosis assessment by carotid ultrasound.

Fully Automated Integrated Segmentation of Carotid Artery Ultrasound Images Using DBSCAN and Affinity Propagation

Purpose

B-mode ultrasound images are used in identifying the presence of fat deposit if any in carotid artery. The intima media, lumen, bifurcation boundary is detected by the echogenic characteristics embedded in the carotid artery.

Methods

A fully automatic self-learning based segmentation is proposed by extracting the edges by a modified affinity propagation, which are given as inputs to the Density Based Spatial Clustering of Applications with Noise (DBSCAN) for super pixel segmentation. The segmented results are analyzed with Gradient Vector Flow (GVF) snake model and Particle Swarm Optimization (PSO) clustering based segmentation using various performance measures.

Results

The proposed parameter free, fully automatic segmentation method combining Affinity propagation and DBSCAN are evaluated for a database of 361 images and gives reinforced results in the longitudinal B-mode ultrasound images. The proposed approach gives an improved accuracy of 12% increase when compared with the manual segmentation and 15% compared with segmentation by affinity propagation and DBSCAN when performed individually. The average Root Mean Square Error (RMSE) is 110 ± 44 µm.

Conclusion

Extracted edge points are used for clustering in a fully automated carotid artery segmentation approach.

Carotid artery ultrasound image analysis: A review of the literature

Stroke is one of the prominent causes of death in the recent days. The existence of susceptible plaque in the carotid artery can be used in ascertaining the possibilities of cardiovascular diseases and long-term disabilities. The imaging modality used for early screening of the disease is B-mode ultrasound image of the person in the artery area. The objective of this article is to give a widespread review of the imaging modes and methods used for studying the carotid artery for identifying stroke, atherosclerosis and related cardiovascular diseases. We encompass the review in methods used for artery wall tracking, intima-media, and lumen segmentation which will help in finding the extent of the disease. Due to the characteristics of the imaging modality used, the images have speckle noise which worsens the image quality. Adaptive homomorphic filtering with wavelet and contourlet transforms, Levy Shrink, gamma distribution were used for image denoising. Learning-based neural network approaches for denoising give better edge preservation. Domain knowledge-based segmentation approaches have proved to provide more accurate intima-media thickness measurements. There is a requirement of useful fully automatic segmentation approaches, 3D, 4D systems, and plaque motion analysis. Taking into consideration the image priors like geometry, imaging physics, intensity and temporal data, image analysis has to be performed. Encouragingly more research has focused on content-specific segmentation and classification techniques. With the evaluation of machine learning algorithms, classifying the image as with or without a fat deposit has gained better accuracy and sensitivity. Machine learning-based approaches like self-organizing map, k-nearest neighborhood and support vector machine achieve promising accuracy and sensitivity in classification. The literature reveals that there is more scope in identifying a patient-specific model in a fully automatic manner.

Evaluating the Efficacy of Atorvastatin on Patients with Carotid Plaque by an Innovative Ultrasonography

BACKGROUND

The present study aimed to explore the efficacy of atorvastatin on patients with carotid plaque, applying superb microvascular imaging (SMI), and contrast-enhanced ultrasound (CEUS) for evaluating carotid intraplaque neovascularization.

METHODS

A total of 82 patients (82 carotid plaques) who were randomized into treatment group and control group underwent conventional ultrasound, CEUS, and SMI examinations. Patients in treatment group received a dose of 20 mg atorvastatin per day for 6 months while those in control group received placebo instead. Lipid parameters were assessed and intraplaque neovascularization were evaluated by CEUS and SMI before and 6 months after atorvastatin treatment.

RESULTS

No significant differences were found between the 2 groups at the study entry. Patients with atorvastatin treatment received marked improvement in total cholesterol, triglyceride, and LDL-cholesterol compared with those in control group (P < .001). In treatment group, SMI-detected intraplaque neovascularization reduced from 69.23% to 48.72% while CEUS-detected ones reduced from 76.92% to 69.23%. By contrast, the percentage of intraplaque neovascularization in control group did not change too much either by SMI (65.12%, 67.44%) or CEUS (74.41%, 74.41%). The consistency between CEUS and SMI was above .75 at all assessments (P < .001).

CONCLUSIONS

Atorvastatin treatment works for patients with carotid plaque by reducing LDL-cholesterol and improving plaque regression. Second, the consistency between SMI and CEUS in visualizing intraplaque neovascularization is good. That indicates a high possibility to identify carotid plaque instability by a safer and cheaper ultrasonography without contrast agent.

Medical image segmentation based on level set and isoperimetric constraint

Level set based methods are being increasingly used in image segmentation. In these methods, various shape constraints can be incorporated into the energy functionals to obtain the desired shapes of the contours represented by their zero level sets of functions. Motivated by the isoperimetric inequality in differential geometry, we propose a segmentation method in which the isoperimetric constrain is integrated into a level set framework to penalize the ratio of its squared perimeter to its enclosed area of an active contour. The new model can ensure the compactness of segmenting objects and complete missing or/and blurred parts of their boundaries simultaneously. The isoperimetric shape constraint is free of explicit expressions of shapes and scale-invariant. As a result, the proposed method can handle various objects with different scales and does not need to estimate parameters of shapes. Our method can segment lesions with blurred or/and partially missing boundaries in ultrasound, Computed Tomography (CT) and Magnetic Resonance (MR) images efficiently. Quantitative evaluation also confirms that the proposed method can provide more accurate segmentation than two well-known level set methods. Therefore, our proposed method shows potential of accurate segmentation of lesions for applying in diagnoses and surgical planning.

A Review on Atherosclerotic Biology, Wall Stiffness, Physics of Elasticity, and Its Ultrasound-Based Measurement

Functional and structural changes in the common carotid artery are biomarkers for cardiovascular risk. Current methods for measuring functional changes include pulse wave velocity, compliance, distensibility, strain, stress, stiffness, and elasticity derived from arterial waveforms. The review is focused on the ultrasound-based carotid artery elasticity and stiffness measurements covering the physics of elasticity and linking it to biological evolution of arterial stiffness. The paper also presents evolution of plaque with a focus on the pathophysiologic cascade leading to arterial hardening. Using the concept of strain, and image-based elasticity, the paper then reviews the lumen diameter and carotid intima-media thickness measurements in combined temporal and spatial domains. Finally, the review presents the factors which influence the understanding of atherosclerotic disease formation and cardiovascular risk including arterial stiffness, tissue morphological characteristics, and image-based elasticity measurement.

Accurate lumen diameter measurement in curved vessels in carotid ultrasound: an iterative scale-space and spatial transformation approach

Monitoring of cerebrovascular diseases via carotid ultrasound has started to become a routine. The measurement of image-based lumen diameter (LD) or inter-adventitial diameter (IAD) is a promising approach for quantification of the degree of stenosis. The manual measurements of LD/IAD are not reliable, subjective and slow. The curvature associated with the vessels along with non-uniformity in the plaque growth poses further challenges. This study uses a novel and generalized approach for automated LD and IAD measurement based on a combination of spatial transformation and scale-space. In this iterative procedure, the scale-space is first used to get the lumen axis which is then used with spatial image transformation paradigm to get a transformed image. The scale-space is then reapplied to retrieve the lumen region and boundary in the transformed framework. Then, inverse transformation is applied to display the results in original image framework. Two hundred and two patients' left and right common carotid artery (404 carotid images) B-mode ultrasound images were retrospectively analyzed. The validation of our algorithm has done against the two manual expert tracings. The coefficient of correlation between the two manual tracings for LD was 0.98 (p < 0.0001) and 0.99 (p < 0.0001), respectively. The precision of merit between the manual expert tracings and the automated system was 97.7 and 98.7%, respectively. The experimental analysis demonstrated superior performance of the proposed method over conventional approaches. Several statistical tests demonstrated the stability and reliability of the automated system.

Two Automated Techniques for Carotid Lumen Diameter Measurement: Regional versus Boundary Approaches

The degree of stenosis in the carotid artery can be predicted using automated carotid lumen diameter (LD) measured from B-mode ultrasound images. Systolic velocity-based methods for measurement of LD are subjective. With the advancement of high resolution imaging, image-based methods have started to emerge. However, they require robust image analysis for accurate LD measurement. This paper presents two different algorithms for automated segmentation of the lumen borders in carotid ultrasound images. Both algorithms are modeled as a two stage process. Stage one consists of a global-based model using scale-space framework for the extraction of the region of interest. This stage is common to both algorithms. Stage two is modeled using a local-based strategy that extracts the lumen interfaces. At this stage, the algorithm-1 is modeled as a region-based strategy using a classification framework, whereas the algorithm-2 is modeled as a boundary-based approach that uses the level set framework. Two sets of databases (DB), Japan DB (JDB) (202 patients, 404 images) and Hong Kong DB (HKDB) (50 patients, 300 images) were used in this study. Two trained neuroradiologists performed manual LD tracings. The mean automated LD measured was 6.35 ± 0.95 mm for JDB and 6.20 ± 1.35 mm for HKDB. The precision-of-merit was: 97.4 % and 98.0 % w.r.t to two manual tracings for JDB and 99.7 % and 97.9 % w.r.t to two manual tracings for HKDB. Statistical tests such as ANOVA, Chi-Squared, T-test, and Mann-Whitney test were conducted to show the stability and reliability of the automated techniques.

Quantification of carotid plaque elasticity and intraplaque neovascularization using contrast-enhanced ultrasound and image registration-based elastography

It is valuable for evaluation of carotid plaque vulnerability to investigate the relation between intraplaque neovascularization (IPN) and plaque elasticity. The contrast-enhanced ultrasound (CEUS) has been used in IPN measurement, but it cannot assess plaque elasticity. The aim of this study was to develop an ultrasound elastography technique based on registration of CEUS sequential images and to use this technique for direct comparison between IPN and plaque elasticity. We employed a nonrigid image registration method using the free-form deformation model to register a pair of clinical CEUS images at systole and diastole. The 2D displacement field of the plaque was estimated and then utilized to calculate the axial and lateral strain distributions within the plaque, from which quantitative strain parameters were obtained. The IPN was measured semiquantitatively with visual assessment and quantitatively with the time-intensity curve analysis and the analysis of contrast agent spatial distributions. Histopathology with CD34 staining for quantification of microvessel density (MVD) was performed on plaques excised by carotid endarterectomy. Simulation experiments showed that the mean absolute error and the root mean squared error of the displacement estimation were 0.325±0.180 pixel (7.2%±3.8%) and 0.556±0.284 pixel (12.3%±6.1%), respectively, demonstrating high accuracy of the elastography technique. Thirty-eight plaques in 29 patients met the inclusion criteria for the elastography and image analysis, where ten plaques underwent endarterectomy. The 95th percentile (A95) and standard deviation (Asd) of the axial strains exhibited significant differences between the low and high grades of IPN visually assessed (p<0.01). A95 (R=0.579; p<0.001) and Asd (R=0.609; p<0.001) were correlated with the enhanced intensity of plaque, and also correlated with the MVD (R=0.793 and 0.817, respectively; p<0.01), suggesting that plaque became softer and more elastically heterogeneous as IPN increased. These findings provide direct and quantitative evidence for the associations between plaque strains and IPN and might be helpful for evaluation of carotid plaque vulnerability and for plaque risk stratification.