Automatic Segmentation of Intima Media Complex in Carotid Ultrasound Images Using Support Vector Machine

NAG-Net: Nested attention-guided learning for segmentation of carotid lumen-intima interface and media-adventitia interface

Cardiovascular diseases (CVD), as the leading cause of death in the world, poses a serious threat to human health. The segmentation of carotid Lumen-intima interface (LII) and Media-adventitia interface (MAI) is a prerequisite for measuring intima-media thickness (IMT), which is of great significance for early screening and prevention of CVD. Despite recent advances, existing methods still fail to incorporate task-related clinical domain knowledge and require complex post-processing steps to obtain fine contours of LII and MAI. In this paper, a nested attention-guided deep learning model (named NAG-Net) is proposed for accurate segmentation of LII and MAI. The NAG-Net consists of two nested sub-networks, the Intima-Media Region Segmentation Network (IMRSN) and the LII and MAI Segmentation Network (LII-MAISN). It innovatively incorporates task-related clinical domain knowledge through the visual attention map generated by IMRSN, enabling LII-MAISN to focus more on the clinician's visual focus region under the same task during segmentation. Moreover, the segmentation results can directly obtain fine contours of LII and MAI through simple refinement without complicated post-processing steps. To further improve the feature extraction ability of the model and reduce the impact of data scarcity, the strategy of transfer learning is also adopted to apply the pretrained weights of VGG-16. In addition, a channel attention-based encoder feature fusion block (EFFB-ATT) is specially designed to achieve efficient representation of useful features extracted by two parallel encoders in LII-MAISN. Extensive experimental results have demonstrated that our proposed NAG-Net outperformed other state-of-the-art methods and achieved the highest performance on all evaluation metrics.

Intelligent Segmentation of Intima-Media and Plaque Recognition in Carotid Artery Ultrasound Images

Ultrasound imaging has been established as an effective method for measuring the thickness of the intima-media, the thickening of which, along with carotid plaque, is an indicator of cerebrovascular diseases. Here, a 2-D V-Net model that can automatically segment the intima-media in carotid artery ultrasound images is proposed. Moreover, a plaque recognition algorithm that automatically identifies plaque-affected areas is described. Performance tests to determine the average accuracy of the intima-media segmentation yielded the following results (expressed as lumen-intima boundary/media-adventitia boundary): intersection over union (IOU) of 0.752/0.813, pixel accuracy of 0.813/0.885 and Dice loss of 0.858/0.897. Finally, average IOU of 0.785, pixel accuracy of 0.825 and Dice loss of 0.866 were obtained for plaque recognition. These results satisfy the threshold for clinical application and indicate that the proposed model can assist doctors in making more efficient and accurate diagnoses.

Encoder-Decoder Architecture for Ultrasound IMC Segmentation and cIMT Measurement

Cardiovascular diseases (CVDs) have shown a huge impact on the number of deaths in the world. Thus, common carotid artery (CCA) segmentation and intima-media thickness (IMT) measurements have been significantly implemented to perform early diagnosis of CVDs by analyzing IMT features. Using computer vision algorithms on CCA images is not widely used for this type of diagnosis, due to the complexity and the lack of dataset to do it. The advancement of deep learning techniques has made accurate early diagnosis from images possible. In this paper, a deep-learning-based approach is proposed to apply semantic segmentation for intima-media complex (IMC) and to calculate the cIMT measurement. In order to overcome the lack of large-scale datasets, an encoder-decoder-based model is proposed using multi-image inputs that can help achieve good learning for the model using different features. The obtained results were evaluated using different image segmentation metrics which demonstrate the effectiveness of the proposed architecture. In addition, IMT thickness is computed, and the experiment showed that the proposed model is robust and fully automated compared to the state-of-the-art work.

Fully Automatic Measurement of Intima-Media Thickness in Ultrasound Images of the Common Carotid Artery Based on Improved Otsu's Method and Adaptive Wind Driven Optimization

The intima media thickness (IMT) of the common carotid artery (CCA) can be used to predict the risk of atherosclerosis. Many image segmentation techniques have been used for IMT measurement. However, severe noise in the ultrasound image can lead to erroneous segmentation results. To improve the robustness to noise, a fully automatic method, based on an improved Otsu's method and an adaptive wind-driven optimization technique, is proposed for estimating the IMT (denoted as "improved Otsu-AWDO"). First, an advanced despeckling filter, i.e., " Nagare's filter" is used to address the speckle noise in the carotid ultrasound images. Next, an improved fuzzy contrast method (IFC) is used to enhance the region of the intima media complex (IMC) in the blurred filtered images. Then, a new method is used for automatic extraction of the region of interest (ROI). Finally, the lumen intima interface and media adventitia interface are segmented from the IMC using improved Otsu-AWDO. Then, 156 B-mode longitudinal carotid ultrasound images of six different datasets are used to evaluate the performance of the automatic measurements. The results indicate that the absolute error of proposed method is only 10.1 ± 9.6 (mean ± std in μm). Moreover, the proposed method has a correlation coefficient as high as 0.9922, and a bias as low as 0.0007. From comparison with previous methods, we can conclude that the proposed method has strong robustness and can provide accurate IMT estimations.

Segmentation of the Common Carotid Intima-Media Complex in Ultrasound Images Using 2-D Continuous Max-Flow and Stacked Sparse Auto-encoder

The intima-media thickness (IMT) of a common carotid artery in an ultrasound image is considered an important indicator of the onset of atherosclerosis. However, it is challenging to segment the intima-media complex (IMC) directly in ultrasound images. This study proposes a fully automatic method to segment the IMC on longitudinal B-mode ultrasound images. Our method consists of two stages: (i) extraction of the region of interest with a continuous max-flow algorithm and region-of-interest reconstruction using a stacked sparse auto-encoder model, and (ii) IMC segmentation using a trained random forest classifier. The proposed method has been tested on three databases from three different imaging centres, comprising a total of 228 ultrasound images of the common carotid artery. On the three databases, our method yields mean absolute errors of 0.028 ± 0.016 mm, 0.579 ± 0.288 pixel and 0.582 ± 0.341 pixel; polyline distance (PD) measures of 0.026 ± 0.017 mm, 0.657 ± 0.275 pixel and 0.731 ± 0:282 pixel; Hausdorff distance measures of 0.249 ± 0.101 mm, 4.760 ± 1.085 pixels and 5.825 ± 2.059 pixels; and correlation coefficients of 95.19%, 93.79%, and 98.96%, respectively. These results indicate that the proposed method performs well in segmentation of the IMC and measurement of the IMT.