Segmentation of the luminal border in intravascular ultrasound B-mode images using a probabilistic approach

Deep Learning-Based Lumen and Vessel Segmentation of Intravascular Ultrasound Images in Coronary Artery Disease

BACKGROUND AND OBJECTIVES

Intravascular ultrasound (IVUS) evaluation of coronary artery morphology is based on the lumen and vessel segmentation. This study aimed to develop an automatic segmentation algorithm and validate the performances for measuring quantitative IVUS parameters.

METHODS

A total of 1,063 patients were randomly assigned, with a ratio of 4:1 to the training and test sets. The independent data set of 111 IVUS pullbacks was obtained to assess the vessel-level performance. The lumen and external elastic membrane (EEM) boundaries were labeled manually in every IVUS frame with a 0.2-mm interval. The Efficient-UNet was utilized for the automatic segmentation of IVUS images.

RESULTS

At the frame-level, Efficient-UNet showed a high dice similarity coefficient (DSC, 0.93±0.05) and Jaccard index (JI, 0.87±0.08) for lumen segmentation, and demonstrated a high DSC (0.97±0.03) and JI (0.94±0.04) for EEM segmentation. At the vessel-level, there were close correlations between model-derived vs. experts-measured IVUS parameters; minimal lumen image area (r=0.92), EEM area (r=0.88), lumen volume (r=0.99) and plaque volume (r=0.95). The agreement between model-derived vs. expert-measured minimal lumen area was similarly excellent compared to the experts' agreement. The model-based lumen and EEM segmentation for a 20-mm lesion segment required 13.2 seconds, whereas manual segmentation with a 0.2-mm interval by an expert took 187.5 minutes on average.

CONCLUSIONS

The deep learning models can accurately and quickly delineate vascular geometry. The artificial intelligence-based methodology may support clinicians' decision-making by real-time application in the catheterization laboratory.

Accuracy of IVUS-Based Machine Learning Segmentation Assessment of Coronary Artery Dimensions and Balloon Sizing

Background

Accurate intravascular ultrasound (IVUS) measurements are important in IVUS-guided percutaneous coronary intervention optimization by choosing the appropriate device size and confirming stent expansion.

Objectives

The purpose of this study was to assess the accuracy of machine learning (ML) automatic segmentation of coronary artery vessel and lumen dimensions and balloon sizing.

Methods

Using expert analysis as the gold standard, ML segmentation of 60 MHz IVUS images was developed using 8,076 IVUS cross-sectional images from 234 patients, which were randomly split into training (83%) and validation (17%) data sets. The performance of ML segmentation was then evaluated using an independent test data set (437 images from 92 patients). The endpoints were the agreement rate between ML vs experts' measurements for appropriate balloon size selection, and lumen and acute stent areas. Appropriate balloon size was determined by rounding down from the mean vessel diameter or rounding up from the mean lumen diameter to the next balloon size. The difference of lumen area ≥0.5 mm2 was considered as clinically significant.

Results

ML model segmentation correlated well with experts' segmentation for training data set with a correlation coefficient of 0.992 and 0.993 for lumen and vessel areas, respectively. The agreement rate in lumen and acute stent areas was 85.5% and 97.0%, respectively. The agreement rate for appropriate balloon size selection was 70.6% by vessel diameter only and 92.4% by adding lumen diameter.

Conclusions

ML model IVUS segmentation measurements were well-correlated with those of experts and selected an appropriate balloon size in more than 90% of images.

Supervised segmentation for guiding peripheral revascularization with forward-viewing, robotically steered ultrasound guidewire

BACKGROUND

Approximately 500 000 patients present with critical limb ischemia (CLI) each year in the U.S., requiring revascularization to avoid amputation. While peripheral arteries can be revascularized via minimally invasive procedures, 25% of cases with chronic total occlusions are unsuccessful due to inability to route the guidewire beyond the proximal occlusion. Improvements to guidewire navigation would lead to limb salvage in a greater number of patients.

PURPOSE

Integrating ultrasound imaging into the guidewire could enable direct visualization of routes for guidewire advancement. In order to navigate a robotically-steerable guidewire with integrated imaging beyond a chronic occlusion proximal to the symptomatic lesion for revascularization, acquired ultrasound images must be segmented to visualize the path for guidewire advancement.

METHODS

The first approach for automated segmentation of viable paths through occlusions in peripheral arteries is demonstrated in simulations and experimentally-acquired data with a forward-viewing, robotically-steered guidewire imaging system. B-mode ultrasound images formed via synthetic aperture focusing (SAF) were segmented using a supervised approach (U-net architecture). A total of 2500 simulated images were used to train the classifier to distinguish the vessel wall and occlusion from viable paths for guidewire advancement. First, the size of the synthetic aperture resulting in the highest classification performance was determined in simulations (90 test images) and compared with traditional classifiers (global thresholding, local adaptive thresholding, and hierarchical classification). Next, classification performance as a function of the diameter of the remaining lumen (0.5 to 1.5 mm) in the partially-occluded artery was tested using both simulated (60 test images at each of 7 diameters) and experimental data sets. Experimental test data sets were acquired in four 3D-printed phantoms from human anatomy and six ex vivo porcine arteries. Accuracy of classifying the path through the artery was evaluated using microcomputed tomography of phantoms and ex vivo arteries as a ground truth for comparison.

RESULTS

An aperture size of 3.8 mm resulted in the best-performing classification based on sensitivity and Jaccard index, with a significant increase in Jaccard index (p < 0.05) as aperture diameter increased. In comparing the performance of the supervised classifier and traditional classification strategies with simulated test data, sensitivity and F1 score for U-net were 0.95 ± 0.02 and 0.96 ± 0.01, respectively, compared to 0.83 ± 0.03 and 0.41 ± 0.13 for the best-performing conventional approach, hierarchical classification. In simulated test images, sensitivity (p < 0.05) and Jaccard index both increased with increasing artery diameter (p < 0.05). Classification of images acquired in artery phantoms with remaining lumen diameters ≥ 0.75 mm resulted in accuracies > 90%, while mean accuracy decreased to 82% when artery diameter decreased to 0.5 mm. For testing in ex vivo arteries, average binary accuracy, F1 score, Jaccard index, and sensitivity each exceeded 0.9.

CONCLUSIONS

Segmentation of ultrasound images of partially-occluded peripheral arteries acquired with a forward-viewing, robotically-steered guidewire system was demonstrated for the first-time using representation learning. This could represent a fast, accurate approach for guiding peripheral revascularization.

CADNet: an advanced architecture for automatic detection of coronary artery calcification and shadow border in intravascular ultrasound (IVUS) images

Intravascular Ultrasound (IVUS) is a medical imaging modality widely used for the detection and treatment of coronary heart disease. The detection of vascular structures is extremely important for accurate treatment procedures. Manual detection of lumen and calcification is very time-consuming and requires technical experience. Ultrasound imaging suffers from the generation of artifacts which obstructs the clear delineation among structures. Considering, the need, to provide special attention to crucial areas, convolutional block attention modules (CBAM) is integrated into an encoder-decoder-based U-Net architecture along with Atrous Spatial Pyramid Pooling (ASPP) to detect vessel components: lumen, calcification and shadow borders. The attention modules prove effective in dealing with areas of special attention by assigning additional weights to crucial channels and preserving spatial features. The IVUS data of 12 patients undergoing the treatment is taken for this study. The novelty of the model design is such that it is able to detect the lumen area in the presence/absence of calcification and bifurcation artifacts too. Also, the model efficiently detects the calcification area even in case of severely complex lesions with shadows behind them. The main contribution of the work is that IVUS images of varying degrees of calcification till 360° are also considered in this work, which is usually neglected in previous studies. The experimental results of 1097 IVUS images of 12 patients resulted in meanIoU (0.7894 ± 0.011), Dice Coefficient (0.8763 ± 0.070), precision (0.8768 ± 0.069) and recall (0.8774 ± 0.071) of the proposed model CADNet which show the model's effectiveness relative to other state-of-the art methods.

A State-Of-The-Art Review on Coronary Artery Border Segmentation Algorithms for Intravascular Ultrasound (IVUS) Images

Intravascular Ultrasound images (IVUS) is a useful guide for medical practitioners to identify the vascular status of coronary arteries in human beings. IVUS is a unique intracoronary imaging modality that is used as an adjunct to angioplasty to view vessel structures using a catheter with high resolutions. Segmentation of IVUS images has always remained a challenging task due to various impediments, for example, similar tissue components, vessel structures, and artifacts imposed during the acquisition process. Many researchers have applied various techniques to develop standard methods of image interpretation, however, the ultimate goal is still elusive to most researchers. This challenge was presented at the MICCAI- Computing and Visualization for (Intra)Vascular Imaging (CVII) workshop in 2011. This paper presents a major review of recently reported work in the field, with a detailed analysis of various segmentation techniques applied in IVUS, and highlights the directions for future research. The findings recommend a reference database with a larger number of samples acquired at varied transducer frequencies with special consideration towards complex lesions, suitable validation metrics, and ground-truth definition as a standard against which to compare new and current algorithms.

Convolutional networks for the segmentation of intravascular ultrasound images: Evaluation on a multicenter dataset

BACKGROUND AND OBJECTIVE

The delineation of the lumen contour and external elastic lamina (EEL) in intravascular ultrasound (IVUS) images is crucial for the quantitative analysis of coronary atherosclerotic plaques. However, the presence of ultrasonic shadows and anatomical structures (such as bifurcations and calcified plaque) complicates the automatic delineation of the lumen contour and EEL. The purpose of this paper is to evaluate the IVUS segmentation performances of different convolutional networks and the impact factors on a large-scale multiple-center dataset.

METHODS

A total of 6516 cross-sectional images from 175 IVUS pullbacks acquired in different centers by different IVUS imaging catheters were screened from a corelab to evaluate the segmentation methods. The IVUS images included bifurcation, side branch ostia, and various image artifacts to reflect the general image characteristics in routine clinical acquisition. We compared three generic fully convolutional networks (FCNs) and two FCNs specifically designed for the segmentation of IVUS images and explored the factors impacting the segmentation performance, including the training images and the input of consecutive images to the models. The performance of the FCNs was evaluated by using the Dice similarity coefficient (DSC), the Jaccard index (JI), the Hausdorff distance (HD), linear regression and Bland-Altman analysis.

RESULTS

The 4-cascaded RefineNet and DeepLabv3+ outperformed U-net and IVUS-net in the segmentation of the lumen contour and EEL on IVUS images. DeepLabv3+ had the best segmentation performance, with DSCs of 0.927 and 0.944, JIs of 0.911 and 0.933, and HDs of 0.336 mm and 0.367 mm for delineation of the lumen and EEL, respectively. Excellent agreement between DeepLabv3+ and the manual delineation was found in the quantification of the coronary plaque area (r = 0.98).

CONCLUSIONS

The convolutional network architecture is effective in the automatic segmentation of IVUS images. It might contribute to the clinical application of quantitative IVUS analysis in real-world as well as the efficient assessment of coronary atherosclerosis.

Fully automated lumen and vessel contour segmentation in intravascular ultrasound datasets

Segmentation of lumen and vessel contours in intravascular ultrasound (IVUS) pullbacks is an arduous and time-consuming task, which demands adequately trained human resources. In the present study, we propose a machine learning approach to automatically extract lumen and vessel boundaries from IVUS datasets. The proposed approach relies on the concatenation of a deep neural network to deliver a preliminary segmentation, followed by a Gaussian process (GP) regressor to construct the final lumen and vessel contours. A multi-frame convolutional neural network (MFCNN) exploits adjacency information present in longitudinally neighboring IVUS frames, while the GP regression method filters high-dimensional noise, delivering a consistent representation of the contours. Overall, 160 IVUS pullbacks (63 patients) from the IBIS-4 study (Integrated Biomarkers and Imaging Study-4, Trial NCT00962416), were used in the present work. The MFCNN algorithm was trained with 100 IVUS pullbacks (8427 manually segmented frames), was validated with 30 IVUS pullbacks (2583 manually segmented frames) and was blindly tested with 30 IVUS pullbacks (2425 manually segmented frames). Image and contour metrics were used to characterize model performance by comparing ground truth (GT) and machine learning (ML) contours. Median values (interquartile range, IQR) of the Jaccard index for lumen and vessel were 0.913, [0.882,0.935] and 0.940, [0.917,0.957], respectively. Median values (IQR) of the Hausdorff distance for lumen and vessel were 0.196mm, [0.146,0.275]mm and 0.163mm, [0.122,0.234]mm, respectively. Also, the mean value of lumen area predictions, and limits of agreement were -0.19mm², [1.1,-1.5]mm², while the mean value and limits of agreement of plaque burden were 0.0022, [0.082,-0.078]. The results obtained with the model developed in this work allow us to conclude that the proposed machine learning approach delivers accurate segmentations in terms of image metrics, contour metrics and clinically relevant variables, enabling its use in clinical routine by mitigating the costs involved in the manual management of IVUS datasets.

Extraction of media adventitia and luminal intima borders by reconstructing intravascular ultrasound image sequences with vascular structural continuity

PURPOSE

Most published methods directly achieve vessel membrane border detection on cross-sectional intravascular ultrasound (IVUS) images. The vascular structural continuity that exists in entire IVUS image sequences has been overlooked. However, this continuity can have a helpful role in the delineation of vessel membrane contours. To achieve the vessel membrane segmentation more effectively through employing this continuity, a strategy, referred to as multiangle reconstruction, segmentation, and recovery (RSR), is proposed in this paper.

METHODS

Four main steps are contained in the multiangle-RSR: first, a combination of sampling and interpolation is employed to reconstruct long-axis-model IVUS frames, in which continuity information becomes available. Second, a clustering algorithm is conducted on long-axis-model IVUS frames to roughly extract the media-adventitia (MA) and lumen-intima (LI) boundaries. Third, the segmentation results of cross-sectional IVUS frames are recovered based on the rough results of long-axis-model IVUS frames, and an optimization process that combines downsampling, fitting and smoothing is designed to reduce the interference of bifurcation and side vessels.

RESULTS

Multiangle-RSR is tested on a public dataset, and the Hausdorff distance (HD), Jaccard measure (JM), and percentage of area difference (PAD) are utilized as quantitative evaluation metrics. Mean HDs of 0.34 and 0.29 mm are obtained for MA border detection and LI border detection, respectively, which decrease by 43.3% and 9.4%, respectively, compared with their counterparts in previously published approaches. Furthermore, the mean JM is 0.87 for both MA border detection and LI border detection. The mean PADs of the MA contour extraction and the LI contour extraction are 0.10 and 0.11, respectively.

CONCLUSION

The results indicate that the proposed strategy effectively introduces vascular structural continuity by reconstructing long-axis-model IVUS frames and achieves more precise extraction of MA and LI borders.

Improved real-time segmentation of Intravascular Ultrasound images using coordinate-aware fully convolutional networks

Segmentation of Intravascular Ultrasound (IVUS) images into Lumen and Media (interior and exterior) artery vessel walls is highly clinically relevant in the diagnosis and treatment of cardiovascular diseases such as atherosclerosis. When fused with position data, such segmentations also play a key role in reconstructing 3D representations of arteries. Automated segmentation in real-time is known to be a difficult image analysis problem, primarily due to artefacts commonly present in IVUS ultrasound images such as shadows, guide-wire effects, and side-branches. An additional challenge is the limited amount of expert labelled IVUS data, which limits the application of many well-performing deep learning models from other domains. To exploit the circular layered structure of the artery in B-Mode images, we propose a multi-class fully convolutional semantic segmentation network based on a minimal U-Net architecture augmented with learned translation dependence in the polar domain. The coordinate awareness in the multi-class segmentation allows the model to exploit relative spatial context about the interior and exterior vessel walls which are simply separable in polar coordinates. After training on 109 expert-labelled examples, our model significantly outperforms the state-of-the art in terms of mean Jaccard Measure (0.91 vs. 0.89) and Hausdorff distance (0.32 mm vs. 0.48 mm) on Media segmentation, and reaches equivalent performance on Lumen segmentation when evaluated on a standard publicly available dataset of 326 IVUS B-Mode images captured by 20 Mhz ultrasound probes. Using an order of magnitude fewer trainable parameters than the previous state-of-the-art, our model runs over 50 times faster and is able to execute in only 3 ms on a common GPU, achieving both leading accuracy and practical real-time performance.

Advanced deep learning methodology for accurate, real-time segmentation of high-resolution intravascular ultrasound images

AIMS

The aim of this study is to develop and validate a deep learning (DL) methodology capable of automated and accurate segmentation of intravascular ultrasound (IVUS) image sequences in real-time.

METHODS AND RESULTS

IVUS segmentation was performed by two experts who manually annotated the external elastic membrane (EEM) and lumen borders in the end-diastolic frames of 197 IVUS sequences portraying the native coronary arteries of 65 patients. The IVUS sequences of 177 randomly-selected vessels were used to train and optimise a novel DL model for the segmentation of IVUS images. Validation of the developed methodology was performed in 20 vessels using the estimations of two expert analysts as the reference standard. The mean difference for the EEM, lumen and plaque area between the DL-methodology and the analysts was ≤0.23mm² (standard deviation ≤0.85mm²), while the Hausdorff and mean distance differences for the EEM and lumen borders was ≤0.19 mm (standard deviation≤0.17 mm). The agreement between DL and experts was similar to experts' agreement (Williams Index ranges: 0.754-1.061) with similar results in frames portraying calcific plaques or side branches.

CONCLUSIONS

The developed DL-methodology appears accurate and capable of segmenting high-resolution real-world IVUS datasets. These features are expected to facilitate its broad adoption and enhance the applications of IVUS in clinical practice and research.

Automatic Lumen Border Detection in IVUS Images Using Deep Learning Model and Handcrafted Features

In the clinical analysis of Intravascular ultrasound (IVUS) images, the lumen size is an important indicator of coronary atherosclerosis, and is also the premise of coronary artery disease diagnosis and interventional treatment. In this study, a fully automatic method based on deep learning model and handcrafted features is presented for the detection of the lumen borders in IVUS images. First, 193 handcrafted features are extracted from the IVUS images. Then hybrid feature vectors are constructed by combining handcrafted features with 64 high-level features extracted from U-Net. In order to obtain the feature subsets with larger contribution, we employ the extended binary cuckoo search for feature selection. Finally, the selected 36-dimensional hybrid feature subset is used to classify the test images using dictionary learning based on kernel sparse coding. The proposed algorithm is tested on the publicly available dataset and evaluated using three indicators. Through ablation experiments, mean value of the experimental results (Jaccard: 0.88, Hausdorff distance: 0.36, Percentage of the area difference: 0.06) prove to be effective improving lumen border detection. Furthermore, compared with the recent methods used on the same dataset, the proposed method shows good performance and high accuracy.

Vessel membrane segmentation and calcification location in intravascular ultrasound images using a region detector and an effective selection strategy

BACKGROUND AND OBJECTIVE

Segmenting vessel membranes and locating the calcific region in intravascular ultrasound (IVUS) images aid physicians in the diagnosis of atherosclerosis. However, the manual extraction of the media adventitia (MA)/lumen border and calcification location are cumbersome due to the excessive number of IVUS frames. Moreover, most existing (semi-)automatic detection methods cannot achieve both vessel membrane extraction and calcification location simultaneously, and they are unable to detect vessel membranes in IVUS frames from different acquisition systems.

METHOD

A fully automatic approach is proposed based on extremal regions and a flexible selection strategy to extract vessel membranes in different IVUS frames and locate the calcific region in high-frequency ones. Three main steps are included in the algorithm. First, a region detector is employed to extract extremal regions from an IVUS image. Then, according to the selection strategy, a part of the extracted regions is selected. At the same time, the calcification is located according to its special acoustic properties. Next, approximate MA and lumen border segmentation is achieved based on the selected extremal regions and the located calcification in polar coordinates. Finally, the final segmentation results are obtained by smoothing the approximate values.

RESULT

To demonstrate the feasibility of the method, it was evaluated based on a standard public dataset. Furthermore, to quantitatively evaluate the segmentation performance, the Hausdorff distance (HD), Jaccard measure (JM) and percentage of area difference (PAD) were used. The results show that a mean HD of 1.13/1.21 mm, a mean JM of 0.83/0.77 and a mean PAD of 0.11/0.23 are achieved for MA/lumen border detection in 77 40-MHz IVUS images. For MA/lumen border extraction in 435 20-MHz IVUS frames, the average HD, JM and PAD values are 0.47/0.28 mm, 0.84/0.89 and 0.13/0.10, respectively. In addition, the approach successfully achieves calcification location in 40-MHz IVUS frames. In comparison with other published methods, the method proposed in this study is competitive.

CONCLUSION

According to these results, our strategy can extract MA/lumen borders in different IVUS frames and effectively locate calcification in high-frequency IVUS frames.

Lumen-intima and media-adventitia segmentation in IVUS images using supervised classifications of arterial layers and morphological structures

BACKGROUND

Intravascular ultrasound (IVUS) provides axial grey-scale images of blood vessels. The large number of images require automatic analysis, specifically to identify the lumen and outer vessel wall. However, the high amount of noise, the presence of artifacts and anatomical structures, such as bifurcations, calcifications and fibrotic plaques, usually hinder the proper automatic segmentation of the vessel wall.

METHODS

Lumen, media, adventitia and surrounding tissues are automatically detected using Support Vector Machines (SVMs). The classification performance of the SVMs vary according to the kind of structure present within each region of the image. Random Forest (RF) is used to detect different morphological structures and to modify the initial layer classification depending on the detected structure. The resulting classification maps are fed into a segmentation method based on deformable contours to detect lumen-intima (LI) and media-adventitia (MA) interfaces.

RESULTS

The modifications in the layer classifications according to the presence of structures proved to be effective improving LI and MA segmentations. The proposed method reaches a Jaccard Measure (JM) of 0.88 ± 0.08 for LI segmentation, compared with 0.88 ± 0.05 of a semiautomatic method. When looking at MA, our method reaches a JM of 0.84 ± 0.09, and outperforms previous automatic methods in terms of HD, with 0.51mm ± 0.30.

CONCLUSIONS

A simple modification to the arterial layer classification produces results that match and improve state-of-the-art fully-automatic segmentation methods for LI and MA in 20MHz IVUS images. For LI segmentation, the proposed automatic method performs accurately as semi-automatic methods. For MA segmentation, our method matched the quality of state-of-the-art automatic methods described in the literature. Furthermore, our implementation is modular and open-source, allowing for future extensions and improvements.

Robust segmentation of arterial walls in intravascular ultrasound images using Dual Path U-Net

A Fully Convolutional Network (FCN) based deep architecture called Dual Path U-Net (DPU-Net) is proposed for automatic segmentation of the lumen and media-adventitia in IntraVascular UltraSound (IVUS) frames, which is crucial for diagnosis of many cardiovascular diseases and also for facilitating 3D reconstructions of human arteries. One of the most prevalent problems in medical image analysis is the lack of training data. To overcome this limitation, we propose a twofold solution. First, we introduce a deep architecture that is able to learn using a small number of training images and still achieves a high degree of generalization ability. Second, we strengthen the proposed DPU-Net by having a real-time augmentor control the image augmentation process. Our real-time augmentor contains specially-designed operations that simulate three types of IVUS artifacts and integrate them into the training images. We exhaustively assessed our twofold contribution over Balocco's standard publicly available IVUS 20 MHz and 40 MHz B-mode dataset, which contain 109 training image, 326 test images and 19 training images, 59 test images, respectively. Models are trained from scratch with the training images provided and evaluated with two commonly used metrics in the IVUS segmentation literature, namely Jaccard Measure (JM) and Hausdorff Distance (HD). Experimental results show that DPU-Net achieves 0.87 JM, 0.82 mm HD and 0.86 JM, 1.07 mm HD over 40 MHz dataset for segmenting the lumen and the media, respectively. Also, DPU-Net achieves 0.90 JM, 0.25 mm HD and 0.92 JM, 0.30 mm HD over 20 MHz images for segmenting the lumen and the media, respectively. In addition, DPU-Net outperforms existing methods by 8-15% in terms of HD distance. DPU-Net also shows a strong generalization property for predicting images in the test sets that contain a significant amount of major artifacts such as bifurcations, shadows, and side branches that are not common in the training set. Furthermore, DPU-Net runs within 0.03 s to segment each frame with a single modern GPU (Nvidia GTX 1080). The proposed work leverages modern deep learning-based method for segmentation of lumen and the media vessel walls in both 20 MHz and 40 MHz IVUS B-mode images and achieves state-of-the-art results without any manual intervention. The code is available online at https://github.com/Kulbear/IVUS-Ultrasonic.

Detecting the Media-adventitia Border in Intravascular Ultrasound Images through a Classification-based Approach

The detection of the media-adventitia (MA) border in intravascular ultrasound (IVUS) images is essential for vessel assessment and disease diagnosis. However, it remains a challenging task, considering the existence of plaque, calcification, and various artifacts. In this article, an effective method based on classification is proposed to extract the MA border in IVUS images. First, a novel morphologic feature describing the relative position of each structure relative to the MA border, called RPES for short, is proposed. Then, the RPES feature and other features are employed in a multiclass extreme learning machine (ELM) to classify IVUS images into nine classes including the MA border and other structures. At last, a modified snake model is employed to effectively detect the MA border in the rectangular domain, in which a modified external force field is constructed on the basis of local border appearances and classification results. The proposed method is evaluated on a public dataset with 77 IVUS images by three indicators in eight situations, such as calcification and a guide wire artifact. With the proposed RPES feature, detection performances are improved by more than 39 percent, which shows an apparent advantage in comparative experiments. Furthermore, compared with two other existing methods used on the same dataset, the proposed method achieves 18 of the best indicators among 24, demonstrating its higher capability in detecting the MA border.

Optimal surface segmentation with convex priors in irregularly sampled space

Optimal surface segmentation is a state-of-the-art method used for segmentation of multiple globally optimal surfaces in volumetric datasets. The method is widely used in numerous medical image segmentation applications. However, nodes in the graph based optimal surface segmentation method typically encode uniformly distributed orthogonal voxels of the volume. Thus the segmentation cannot attain an accuracy greater than a single unit voxel, i.e. the distance between two adjoining nodes in graph space. Segmentation accuracy higher than a unit voxel is achievable by exploiting partial volume information in the voxels which shall result in non-equidistant spacing between adjoining graph nodes. This paper reports a generalized graph based multiple surface segmentation method with convex priors which can optimally segment the target surfaces in an irregularly sampled space. The proposed method allows non-equidistant spacing between the adjoining graph nodes to achieve subvoxel segmentation accuracy by utilizing the partial volume information in the voxels. The partial volume information in the voxels is exploited by computing a displacement field from the original volume data to identify the subvoxel-accurate centers within each voxel resulting in non-equidistant spacing between the adjoining graph nodes. The smoothness of each surface modeled as a convex constraint governs the connectivity and regularity of the surface. We employ an edge-based graph representation to incorporate the necessary constraints and the globally optimal solution is obtained by computing a minimum s-t cut. The proposed method was validated on 10 intravascular multi-frame ultrasound image datasets for subvoxel segmentation accuracy. In all cases, the approach yielded highly accurate results. Our approach can be readily extended to higher-dimensional segmentations.

Fractional-order Darwinian PSO-based feature selection for media-adventitia border detection in intravascular ultrasound images

Media-adventitia (MA) border delineates the outer appearance of arterial wall in intravascular ultrasound (IVUS) image. The detection of MA border is a challenging topic due to many difficulties such as complicated intravascular structures, intrinsic artifacts and image noises. We propose a classification-based MA border detection method with an embedded feature selection technique. The feature selection technique is based on Fractional-order Darwinian particle swarm optimization (FODPSO) algorithm. By employing feature selection, 293-dimension features including multi-scale features, gray-scale features and morphological feature are reducing to 37-dimension. The border detection method with feature selection is tested on a public dataset extracted from in-vivo pullbacks of human coronary arteries, which contains 77 IVUS images. Three indicators, Jaccard (JACC), Hausdorff Distance (HD) and Percentage of Area Difference (PAD), are measured for quantitative evaluation. Detection with 293-dimension features obtains JACC 0.79, HD 1.41 and PAD 0.16, while detection with 37-dimension features obtains JACC 0.83, HD 1.27 and PAD 0.12, indicating that the FODPSO-based feature selection method improves MA border detection by JACC 0.04, HD 0.14 and PAD 0.04. Furthermore, the proposed border detection method acquires better performances compared with two other automatic methods conducted on the same dataset available in literature.

A new nonparametric statistical approach to detect lumen and Media-Adventitia borders in intravascular ultrasound frames

Intravascular ultrasound (IVUS) imaging is widely known as a powerful interventional imaging modality for diagnosing atherosclerosis, and for treatment planning. In this regard, the detection of lumen and media-adventitia (MA) borders is considered to be a vital process. However, the manual detection of these two borders by the physician is cumbersome due to the large number of frames in a sequence. In addition, no approved universal automatic method has been presented so far due to the great diversity in the appearance of the coronary artery in the images acquired by different IVUS systems. To this end, the present study aimed to provide a new border search theory on the radial profile, based upon the nonparametric statistical approach, and to develop a generic and fully automatic three-step process for extracting the lumen and MA borders in IVUS frames based on the proposed theory. Thereafter, the proposed theory and three-step process were evaluated on synthetic images, as well as on a test set of standard publicly available images, respectively. The results showed that our three-step process could segment the borders with ≥0.82 and with ≥0.75 Jaccard measure (JM) to manual borders in IVUS frames acquired by the 20 MHz and 40 MHz probes, respectively. Based on the results, the lumen and MA borders can be extracted automatically, and the border extraction process can be implemented in parallel for a polar image due to the capability of the present proposed method to estimate the borders for each angle independently.

Thin Cap Fibroatheroma Detection in Virtual Histology Images Using Geometric and Texture Features

Atherosclerotic plaque rupture is the most common mechanism responsible for a majority of sudden coronary deaths. The precursor lesion of plaque rupture is thought to be a thin cap fibroatheroma (TCFA), or “vulnerable plaque”. Virtual Histology-Intravascular Ultrasound (VH-IVUS) images are clinically available for visualising colour-coded coronary artery tissue. However, it has limitations in terms of providing clinically relevant information for identifying vulnerable plaque. The aim of this research is to improve the identification of TCFA using VH-IVUS images. To more accurately segment VH-IVUS images, a semi-supervised model is developed by means of hybrid K-means with Particle Swarm Optimisation (PSO) and a minimum Euclidean distance algorithm (KMPSO-mED). Another novelty of the proposed method is fusion of different geometric and informative texture features to capture the varying heterogeneity of plaque components and compute a discriminative index for TCFA plaque, while the existing research on TCFA detection has only focused on the geometric features. Three commonly used statistical texture features are extracted from VH-IVUS images: Local Binary Patterns (LBP), Grey Level Co-occurrence Matrix (GLCM), and Modified Run Length (MRL). Geometric and texture features are concatenated in order to generate complex descriptors. Finally, Back Propagation Neural Network (BPNN), kNN (K-Nearest Neighbour), and Support Vector Machine (SVM) classifiers are applied to select the best classifier for classifying plaque into TCFA and Non-TCFA. The present study proposes a fast and accurate computer-aided method for plaque type classification. The proposed method is applied to 588 VH-IVUS images obtained from 10 patients. The results prove the superiority of the proposed method, with accuracy rates of 98.61% for TCFA plaque.

Anatomical Structure Segmentation in Ultrasound Volumes Using Cross Frame Belief Propagating Iterative Random Walks

Ultrasound (US) is widely used as a low-cost alternative to computed tomography or magnetic resonance and primarily for preliminary imaging. Since speckle intensity in US images is inherently stochastic, readers are often challenged in their ability to identify the pathological regions in a volume of a large number of images. This paper introduces a generalized approach for volumetric segmentation of structures in US images and volumes. We employ an iterative random walks (IRW) solver, a random forest learning model, and a gradient vector flow (GVF) based interframe belief propagation technique for achieving cross-frame volumetric segmentation. At the start, a weak estimate of the tissue structure is obtained using estimates of parameters of a statistical mechanics model of US tissue interaction. Ensemble learning of these parameters further using a random forest is used to initialize the segmentation pipeline. IRW is used for correcting the contour in various steps of the algorithm. Subsequently, a GVF-based interframe belief propagation is applied to adjacent frames based on the initialization of contour using information in the current frame to segment the complete volume by frame-wise processing. We have experimentally evaluated our approach using two different datasets. Intravascular ultrasound (IVUS) segmentation was evaluated using 10 pullbacks acquired at 20 MHz and thyroid US segmentation is evaluated on 16 volumes acquired at [Formula: see text] MHz. Our approach obtains a Jaccard score of [Formula: see text] for IVUS segmentation and [Formula: see text] for thyroid segmentation while processing each frame in [Formula: see text] for the IVUS and in [Formula: see text] for thyroid segmentation without the need of any computing accelerators such as GPUs.

Segmentation of arterial walls in intravascular ultrasound cross-sectional images using extremal region selection

Intravascular Ultrasound (IVUS) is an intra-operative imaging modality that facilitates observing and appraising the vessel wall structure of the human coronary arteries. Segmentation of arterial wall boundaries from the IVUS images is not only crucial for quantitative analysis of the vessel walls and plaque characteristics, but is also necessary for generating 3D reconstructed models of the artery. The aim of this study is twofold. Firstly, we investigate the feasibility of using a recently proposed region detector, namely Extremal Region of Extremum Level (EREL) to delineate the luminal and media-adventitia borders in IVUS frames acquired by 20 MHz probes. Secondly, we propose a region selection strategy to label two ERELs as lumen and media based on the stability of their textural information. We extensively evaluated our selection strategy on the test set of a standard publicly available dataset containing 326 IVUS B-mode images. We showed that in the best case, the average Hausdorff Distances (HD) between the extracted ERELs and the actual lumen and media were 0.22  mm and 0.45 mm, respectively. The results of our experiments revealed that our selection strategy was able to segment the lumen with ⩽0.3 mm HD to the gold standard even though the images contained major artifacts such as bifurcations, shadows, and side branches. Moreover, when there was no artifact, our proposed method was able to delineate media-adventitia boundaries with 0.31 mm HD to the gold standard. Furthermore, our proposed segmentation method runs in time that is linear in the number of pixels in each frame. Based on the results of this work, by using a 20 MHz IVUS probe with controlled pullback, not only can we now analyze the internal structure of human arteries more accurately, but also segment each frame during the pullback procedure because of the low run time of our proposed segmentation method.

Automatic segmentation of the lumen region in intravascular images of the coronary artery

Image assessment of the arterial system plays an important role in the diagnosis of cardiovascular diseases. The segmentation of the lumen and media-adventitia in intravascular (IVUS) images of the coronary artery is the first step towards the evaluation of the morphology of the vessel under analysis and the identification of possible atherosclerotic lesions. In this study, a fully automatic method for the segmentation of the lumen in IVUS images of the coronary artery is presented. The proposed method relies on the K-means algorithm and the mean roundness to identify the region corresponding to the potential lumen. An approach to identify and eliminate side branches on bifurcations is also proposed to delimit the area with the potential lumen regions. Additionally, an active contour model is applied to refine the contour of the lumen region. In order to evaluate the segmentation accuracy, the results of the proposed method were compared against manual delineations made by two experts in 326 IVUS images of the coronary artery. The average values of the Jaccard measure, Hausdorff distance, percentage of area difference and Dice coefficient were 0.88 ± 0.06, 0.29 ± 0.17  mm, 0.09 ± 0.07 and 0.94 ± 0.04, respectively, in 324 IVUS images successfully segmented. Additionally, a comparison with the studies found in the literature showed that the proposed method is slight better than the majority of the related methods that have been proposed. Hence, the new automatic segmentation method is shown to be effective in detecting the lumen in IVUS images without using complex solutions and user interaction.

Assessment of image features for vessel wall segmentation in intravascular ultrasound images

BACKGROUND

Intravascular ultrasound (IVUS) provides axial greyscale images, allowing the assessment of the vessel wall and the surrounding tissues. Several studies have described automatic segmentation of the luminal boundary and the media-adventitia interface by means of different image features.

PURPOSE

The aim of the present study is to evaluate the capability of some of the most relevant state-of-the-art image features for segmenting IVUS images. The study is focused on Volcano 20 MHz frames not containing plaque or containing fibrotic plaques, and, in principle, it could not be applied to frames containing shadows, calcified plaques, bifurcations and side vessels.

METHODS

Several image filters, textural descriptors, edge detectors, noise and spatial measures were taken into account. The assessment is based on classification techniques previously used for IVUS segmentation, assigning to each pixel a continuous likelihood value obtained using support vector machines (SVMs). To retrieve relevant features, sequential feature selection was performed guided by the area under the precision-recall curve (AUC-PR).

RESULTS

Subsets of relevant image features for lumen, plaque and surrounding tissues characterization were obtained, and SVMs trained with these features were able to accurately identify those regions. The experimental results were evaluated with respect to ground truth segmentations from a publicly available dataset, reaching values of AUC-PR up to 0.97 and Jaccard index close to 0.85.

CONCLUSION

Noise-reduction filters and Haralick's textural features denoted their relevance to identify lumen and background. Laws' textural features, local binary patterns, Gabor filters and edge detectors had less relevance in the selection process.

A novel ultrasound based approach for lesion segmentation and its applications in gynecological laparoscopic surgery

Laparoscopic ultrasound (LUS) has been widely utilized as a surgical aide in general, urological, and gynecological applications. Our study summarizes the clinical applications of laparoscopic ultrasonography in laparoscopic gynecologic surgery. Retrospective analyses were performed on 42 women subjects using laparoscopic surgery during laparoscopic extirpation and excision of gynecological tumors in our hospital from August 2011 to August 2013. Specifically, the Esaote 7.5 × 10 MHz laparoscopic transducer was used to detect small residual lesions, as well as to assess, locate and guide in removing the lesions during laparoscopic operations. The findings of LUS were compared with those of preoperative trans-vaginal ultrasound, postoperative, and pathohistological examinations. In addition, a novel method for lesion segmentation was proposed in order to facilitate the laparoscopic gynecologic surgery. In our experiment, laparoscopic operation was performed using a higher frequency and more close to pelvic organs via laparoscopic access. LUS facilitates the ability of gynaecologists to find small residual lesions under laparoscopic visualization and their accurate diagnosis. LUS also helps to locate residual lesions precisely and provides guidance for the removal of residual tumor and eliminate its recurrence effectively. Our experiment provides a safer and more valuable assistance for clinical applications in laparoscopic gynecological surgery that are superior to trans-abdominal ultrasound and trans-vaginal ultrasound.

Automated Framework for Detecting Lumen and Media-Adventitia Borders in Intravascular Ultrasound Images

An automated framework for detecting lumen and media-adventitia borders in intravascular ultrasound images was developed on the basis of an adaptive region-growing method and an unsupervised clustering method. To demonstrate the capability of the framework, linear regression, Bland-Altman analysis and distance analysis were used to quantitatively investigate the correlation, agreement and spatial distance, respectively, between our detected borders and manually traced borders in 337 intravascular ultrasound images in vivo acquired from six patients. The results of these investigations revealed good correlation (r = 0.99), good agreement (>96.82% of results within the 95% confidence interval) and small average distance errors (lumen border: 0.08 mm, media-adventitia border: 0.10 mm) between the borders generated by the automated framework and the manual tracing method. The proposed framework was found to be effective in detecting lumen and media-adventitia borders in intravascular ultrasound images, indicating its potential for use in routine studies of vascular disease.

Computerized segmentation of pulmonary nodules depicted in CT examinations using freehand sketches

PURPOSE

To aid a consistent segmentation of pulmonary nodules, the authors describe a novel computerized scheme that utilizes a freehand sketching technique and an improved break-and-repair strategy.

METHODS

This developed scheme consists of two primary parts. The first part is freehand sketch analysis, where the freehand sketching not only serves a natural way of specifying the location of a nodule, but also provides a mechanism for inferring adaptive information (e.g., the mass center, the density, and the size) in regard to the nodule. The second part is an improved break-and-repair strategy. The improvement avoids the time-consuming ray-triangle intersections using spherical bins and replaces the original global implicit surface reconstruction with a local implicit surface fitting and blending scheme. The performance of this scheme, including accuracy and consistence, was assessed using 50 CT examinations in the Lung Image Database Consortium (LIDC). For each of these examinations, a single nodule was selected under the aid of a publically available tool to assure these nodules were diverse in size, location, and density. Two radiologists were asked to use the developed tool to segment these nodules twice at different times (at least three months apart). A Hausdorff distance based method was used to assess the discrepancies (agreements) between the computerized results and the results by the four radiologists in the LIDC as well as the inter- and intrareader agreements in freehand sketching.

RESULTS

The maximum and mean discrepancies in boundary outlines between the computerized scheme and the radiologists were 2.73 ± 1.32 mm and 1.01 ± 0.47 mm, respectively. When the nodules were classified (binned) into different size ranges, the maximum errors ranged from 1.91 to 4.13 mm; but smaller nodules had larger percentage discrepancies in term of size. Under the aid of the developed scheme, the inter- and intrareader variability in averaged maximum discrepancy across all types of pulmonary nodules were consistently smaller than 0.15 ± 0.07 mm. The computational cost in time of segmenting a pulmonary nodule ranged from 0.4 to 2.3 s with an average of 1.1 s for a typical desktop computer.

CONCLUSIONS

The experiments showed that this scheme could achieve a reasonable performance in nodule segmentation and demonstrated the merits of incorporating freehand sketching into pulmonary nodule segmentation.

Standardized evaluation methodology and reference database for evaluating IVUS image segmentation

This paper describes an evaluation framework that allows a standardized and quantitative comparison of IVUS lumen and media segmentation algorithms. This framework has been introduced at the MICCAI 2011 Computing and Visualization for (Intra)Vascular Imaging (CVII) workshop, comparing the results of eight teams that participated. We describe the available data-base comprising of multi-center, multi-vendor and multi-frequency IVUS datasets, their acquisition, the creation of the reference standard and the evaluation measures. The approaches address segmentation of the lumen, the media, or both borders; semi- or fully-automatic operation; and 2-D vs. 3-D methodology. Three performance measures for quantitative analysis have been proposed. The results of the evaluation indicate that segmentation of the vessel lumen and media is possible with an accuracy that is comparable to manual annotation when semi-automatic methods are used, as well as encouraging results can be obtained also in case of fully-automatic segmentation. The analysis performed in this paper also highlights the challenges in IVUS segmentation that remains to be solved.