An Automated Method for Lumen and Media–Adventitia Border Detection in a Sequence of IVUS Frames

A State-Of-The-Art Review on Coronary Artery Border Segmentation Algorithms for Intravascular Ultrasound (IVUS) Images

Intravascular Ultrasound images (IVUS) is a useful guide for medical practitioners to identify the vascular status of coronary arteries in human beings. IVUS is a unique intracoronary imaging modality that is used as an adjunct to angioplasty to view vessel structures using a catheter with high resolutions. Segmentation of IVUS images has always remained a challenging task due to various impediments, for example, similar tissue components, vessel structures, and artifacts imposed during the acquisition process. Many researchers have applied various techniques to develop standard methods of image interpretation, however, the ultimate goal is still elusive to most researchers. This challenge was presented at the MICCAI- Computing and Visualization for (Intra)Vascular Imaging (CVII) workshop in 2011. This paper presents a major review of recently reported work in the field, with a detailed analysis of various segmentation techniques applied in IVUS, and highlights the directions for future research. The findings recommend a reference database with a larger number of samples acquired at varied transducer frequencies with special consideration towards complex lesions, suitable validation metrics, and ground-truth definition as a standard against which to compare new and current algorithms.

AwCPM-Net: A Collaborative Constraint GAN for 3D Coronary Artery Reconstruction in Intravascular Ultrasound Sequences

3D coronary artery reconstruction (3D-CAR) in intravascular ultrasound (IVUS) sequences allows quantitative analyses of vessel properties. Existing methods treat two main tasks of the 3D-CAR separately, including the cardiac phase retrieval (CPR) and the membrane border extraction (MBE). They ignore the CPR-MBE connection that could achieve mutual promotions to both tasks. In this paper, we pioneer to achieve one-step 3D-CAR via a collaborative constraint generative adversarial network (GAN) named the AwCPM-Net. The AwCPM-Net consists of a dual-task collaborative generator and a dual-task constraint discriminator. The generator combines a self-supervised CPR branch with a semi-supervised MBE branch via a warming-up connection. The discriminator promotes dual-branch predictions simultaneously. The CPR branch requires no annotations and outputs inter-frame deformation fields used for identifying cardiac phases. Deformation fields are additionally constrained by the MBE branch and the discriminator. The MBE branch predicts membrane boundaries for each frame. Two aspects assist the semi-supervised segmentation: annotation augmentation by deformation fields of the CPR branch; information exploitation on unlabeled images enabled by GAN design. Trained and tested on an IVUS dataset acquired from atherosclerosis patients, the AwCPM-Net is effective in both CPR and MBE tasks, superior to state-of-the-art IVUS CPR or MBE methods. Hence, the AwCPM-Net reconstructs reliable 3D artery anatomy in the IVUS modality.

Automatic Detection of Atherosclerotic Plaque and Calcification From Intravascular Ultrasound Images by Using Deep Convolutional Neural Networks

Atherosclerosis is the major cause of cardiovascular diseases (CVDs). Intravascular ultrasound (IVUS) is a common imaging modality for diagnosing CVDs. However, an efficient analyzer for IVUS image segmentation is required for assisting cardiologists. In this study, an end-to-end deep-learning convolutional neural network was developed for automatically detecting media-adventitia borders, luminal regions, and calcified plaque in IVUS images. A total of 713 grayscale IVUS images from 18 patients were used as training data for the proposed deep-learning model. The model is constructed using the three modified U-Nets and combined with the concept of cascaded networks to prevent errors in the detection of calcification owing to the interference of pixels outside the plaque regions. Three loss functions (Dice, Tversky, and focal loss) with various characteristics were tested to determine the best setting for the proposed model. The efficacy of the deep-learning model was evaluated by analyzing precision-recall curve. The average precision (AP), Dice score coefficient, precision, sensitivity, and specificity of the predicted and ground truth results were then compared. All training processes were validated using leave-one-subject-out cross-validation. The experimental results showed that the proposed deep-learning model exhibits high performance in segmenting the media-adventitia layers and luminal regions for all loss functions, with all tested metrics being higher than 0.90. For locating calcified tissues, the best result was obtained when the focal loss function was applied to the proposed model, with an AP of 0.73; however, the prediction efficacy was affected by the proportion of calcified tissues within the plaque region when the focal loss function was employed. Compared with commercial software, the proposed method exhibited high accuracy in segmenting IVUS images in some special cases, such as when shadow artifacts or side vessels surrounded the target vessel.

A Domain Enriched Deep Learning Approach to Classify Atherosclerosis using Intravascular Ultrasound Imaging

Intravascular ultrasound (IVUS) imaging is widely used for diagnostic imaging in interventional cardiology. The detection and quantification of atherosclerosis from acquired images is typically performed manually by medical experts or by virtual histology IVUS (VH-IVUS) software. VH-IVUS analyzes backscattered radio frequency (RF) signals to provide a color-coded tissue map, and is the method of choice for assessing atherosclerotic plaque in situ. However, a significant amount of tissue cannot be analyzed in reasonable time because the method can be applied just once per cardiac cycle. Furthermore, only hardware and software compatible with RF signal acquisition and processing may be used. We present an image-based tissue characterization method that can be applied to entire acquisition sequences post hoc for the assessment of diseased vessels. The pixel-based method utilizes domain knowledge of arterial pathology and physiology, and leverages technological advances of convolutional neural networks to segment diseased vessel walls into the same tissue classes as virtual histology using only grayscale IVUS images. The method was trained and tested on patches extracted from VH-IVUS images acquired from several patients, and achieved overall accuracy of 93.5% for all segmented tissue. Imposing physically-relevant spatial constraints driven by domain knowledge was key to achieving such strong performance. This enriched approach offers capabilities akin to VH-IVUS without the constraints of RF signals or limited once-per-cycle analysis, offering superior potential information acquisition speed, reduced hardware and software requirements, and more widespread applicability. Such an approach may well yield promise for future clinical and research applications.

Vessel membrane segmentation and calcification location in intravascular ultrasound images using a region detector and an effective selection strategy

BACKGROUND AND OBJECTIVE

Segmenting vessel membranes and locating the calcific region in intravascular ultrasound (IVUS) images aid physicians in the diagnosis of atherosclerosis. However, the manual extraction of the media adventitia (MA)/lumen border and calcification location are cumbersome due to the excessive number of IVUS frames. Moreover, most existing (semi-)automatic detection methods cannot achieve both vessel membrane extraction and calcification location simultaneously, and they are unable to detect vessel membranes in IVUS frames from different acquisition systems.

METHOD

A fully automatic approach is proposed based on extremal regions and a flexible selection strategy to extract vessel membranes in different IVUS frames and locate the calcific region in high-frequency ones. Three main steps are included in the algorithm. First, a region detector is employed to extract extremal regions from an IVUS image. Then, according to the selection strategy, a part of the extracted regions is selected. At the same time, the calcification is located according to its special acoustic properties. Next, approximate MA and lumen border segmentation is achieved based on the selected extremal regions and the located calcification in polar coordinates. Finally, the final segmentation results are obtained by smoothing the approximate values.

RESULT

To demonstrate the feasibility of the method, it was evaluated based on a standard public dataset. Furthermore, to quantitatively evaluate the segmentation performance, the Hausdorff distance (HD), Jaccard measure (JM) and percentage of area difference (PAD) were used. The results show that a mean HD of 1.13/1.21 mm, a mean JM of 0.83/0.77 and a mean PAD of 0.11/0.23 are achieved for MA/lumen border detection in 77 40-MHz IVUS images. For MA/lumen border extraction in 435 20-MHz IVUS frames, the average HD, JM and PAD values are 0.47/0.28 mm, 0.84/0.89 and 0.13/0.10, respectively. In addition, the approach successfully achieves calcification location in 40-MHz IVUS frames. In comparison with other published methods, the method proposed in this study is competitive.

CONCLUSION

According to these results, our strategy can extract MA/lumen borders in different IVUS frames and effectively locate calcification in high-frequency IVUS frames.

Robust segmentation of arterial walls in intravascular ultrasound images using Dual Path U-Net

A Fully Convolutional Network (FCN) based deep architecture called Dual Path U-Net (DPU-Net) is proposed for automatic segmentation of the lumen and media-adventitia in IntraVascular UltraSound (IVUS) frames, which is crucial for diagnosis of many cardiovascular diseases and also for facilitating 3D reconstructions of human arteries. One of the most prevalent problems in medical image analysis is the lack of training data. To overcome this limitation, we propose a twofold solution. First, we introduce a deep architecture that is able to learn using a small number of training images and still achieves a high degree of generalization ability. Second, we strengthen the proposed DPU-Net by having a real-time augmentor control the image augmentation process. Our real-time augmentor contains specially-designed operations that simulate three types of IVUS artifacts and integrate them into the training images. We exhaustively assessed our twofold contribution over Balocco's standard publicly available IVUS 20 MHz and 40 MHz B-mode dataset, which contain 109 training image, 326 test images and 19 training images, 59 test images, respectively. Models are trained from scratch with the training images provided and evaluated with two commonly used metrics in the IVUS segmentation literature, namely Jaccard Measure (JM) and Hausdorff Distance (HD). Experimental results show that DPU-Net achieves 0.87 JM, 0.82 mm HD and 0.86 JM, 1.07 mm HD over 40 MHz dataset for segmenting the lumen and the media, respectively. Also, DPU-Net achieves 0.90 JM, 0.25 mm HD and 0.92 JM, 0.30 mm HD over 20 MHz images for segmenting the lumen and the media, respectively. In addition, DPU-Net outperforms existing methods by 8-15% in terms of HD distance. DPU-Net also shows a strong generalization property for predicting images in the test sets that contain a significant amount of major artifacts such as bifurcations, shadows, and side branches that are not common in the training set. Furthermore, DPU-Net runs within 0.03 s to segment each frame with a single modern GPU (Nvidia GTX 1080). The proposed work leverages modern deep learning-based method for segmentation of lumen and the media vessel walls in both 20 MHz and 40 MHz IVUS B-mode images and achieves state-of-the-art results without any manual intervention. The code is available online at https://github.com/Kulbear/IVUS-Ultrasonic.

Development of an innovative technology to segment luminal borders of intravascular ultrasound image sequences in a fully automated manner

Although intravascular ultrasound (IVUS) is the commonest intravascular imaging modality, it still is inefficient for clinical use as it requires laborious manual analysis. This study demonstrates the feasibility of a near real-time fully automated technology for accurate identification, detection, and quantification of luminal borders in intravascular images. This technology uses a combination of the novel approaches of a self-tuning engine, dynamic and static masking systems, radar-wise scan, and contour correction cycle method. The performance of the computer algorithm developed based on this technology was tested on a sequence of IVUS and True Vessel Characterization (TVC) images obtained from the left anterior descending (LAD) artery of 6 patients with coronary artery disease. The accuracy of the algorithm was evaluated by comparing luminal borders traced manually with those detected automatically. The processing time of the developed algorithm was also tested on a Dell laptop with an Intel Core i7-8750H Processor (4.1 GHz with 6 cores, 9 MB Cache). Linear regression and Bland-Altman analyses indicated high correlation between manual and automatic tracings (Y = 0.80 × X+1.70, R² = 0.88 & 0.67 ± 1.31 (bias±SD)). Whereas analysis of 2000 IVUS images using one CPU core with a 30% load took 23.12 min, the same analysis using six CPU cores with 90% load took 1.0 min. The performance, accuracy, and speed of the presented state-of-the-art technology demonstrates its capacity for use in clinical settings.

Detecting the Media-adventitia Border in Intravascular Ultrasound Images through a Classification-based Approach

The detection of the media-adventitia (MA) border in intravascular ultrasound (IVUS) images is essential for vessel assessment and disease diagnosis. However, it remains a challenging task, considering the existence of plaque, calcification, and various artifacts. In this article, an effective method based on classification is proposed to extract the MA border in IVUS images. First, a novel morphologic feature describing the relative position of each structure relative to the MA border, called RPES for short, is proposed. Then, the RPES feature and other features are employed in a multiclass extreme learning machine (ELM) to classify IVUS images into nine classes including the MA border and other structures. At last, a modified snake model is employed to effectively detect the MA border in the rectangular domain, in which a modified external force field is constructed on the basis of local border appearances and classification results. The proposed method is evaluated on a public dataset with 77 IVUS images by three indicators in eight situations, such as calcification and a guide wire artifact. With the proposed RPES feature, detection performances are improved by more than 39 percent, which shows an apparent advantage in comparative experiments. Furthermore, compared with two other existing methods used on the same dataset, the proposed method achieves 18 of the best indicators among 24, demonstrating its higher capability in detecting the MA border.

Position Paper Computational Cardiology

Computational cardiology is the scientific field devoted to the development of methodologies that enhance our mechanistic understanding, diagnosis and treatment of cardiovascular disease. In this regard, the field embraces the extraordinary pace of discovery in imaging, computational modeling, and cardiovascular informatics at the intersection of atherogenesis and vascular biology. This paper highlights existing methods, practices, and computational models and proposes new strategies to support a multidisciplinary effort in this space. We focus on the means by that to leverage and coalesce these multiple disciplines to advance translational science and computational cardiology. Analyzing the scientific trends and understanding the current needs we present our perspective for the future of cardiovascular treatment.

Ultrasound Image Segmentation: A Deeply Supervised Network With Attention to Boundaries

OBJECTIVE

Segmentation of anatomical structures in ultrasound images requires vast radiological knowledge and experience. Moreover, the manual segmentation often results in subjective variations, therefore, an automatic segmentation is desirable. We aim to develop a fully convolutional neural network (FCNN) with attentional deep supervision for the automatic and accurate segmentation of the ultrasound images.

METHOD

FCNN/CNNs are used to infer high-level context using low-level image features. In this paper, a sub-problem specific deep supervision of the FCNN is performed. The attention of fine resolution layers is steered to learn object boundary definitions using auxiliary losses, whereas coarse resolution layers are trained to discriminate object regions from the background. Furthermore, a customized scheme for downweighting the auxiliary losses and a trainable fusion layer are introduced. This produces an accurate segmentation and helps in dealing with the broken boundaries, usually found in the ultrasound images.

RESULTS

The proposed network is first tested for blood vessel segmentation in liver images. It results in F1 score, mean intersection over union, and dice index of 0.83, 0.83, and 0.79, respectively. The best values observed among the existing approaches are produced by U-net as 0.74, 0.81, and 0.75, respectively. The proposed network also results in dice index value of 0.91 in the lumen segmentation experiments on MICCAI 2011 IVUS challenge dataset, which is near to the provided reference value of 0.93. Furthermore, the improvements similar to vessel segmentation experiments are also observed in the experiment performed to segment lesions.

CONCLUSION

Deep supervision of the network based on the input-output characteristics of the layers results in improvement in overall segmentation accuracy.

SIGNIFICANCE

Sub-problem specific deep supervision for ultrasound image segmentation is the main contribution of this paper. Currently the network is trained and tested for fixed size inputs. It requires image resizing and limits the performance in small size images.

Thin Cap Fibroatheroma Detection in Virtual Histology Images Using Geometric and Texture Features

Atherosclerotic plaque rupture is the most common mechanism responsible for a majority of sudden coronary deaths. The precursor lesion of plaque rupture is thought to be a thin cap fibroatheroma (TCFA), or “vulnerable plaque”. Virtual Histology-Intravascular Ultrasound (VH-IVUS) images are clinically available for visualising colour-coded coronary artery tissue. However, it has limitations in terms of providing clinically relevant information for identifying vulnerable plaque. The aim of this research is to improve the identification of TCFA using VH-IVUS images. To more accurately segment VH-IVUS images, a semi-supervised model is developed by means of hybrid K-means with Particle Swarm Optimisation (PSO) and a minimum Euclidean distance algorithm (KMPSO-mED). Another novelty of the proposed method is fusion of different geometric and informative texture features to capture the varying heterogeneity of plaque components and compute a discriminative index for TCFA plaque, while the existing research on TCFA detection has only focused on the geometric features. Three commonly used statistical texture features are extracted from VH-IVUS images: Local Binary Patterns (LBP), Grey Level Co-occurrence Matrix (GLCM), and Modified Run Length (MRL). Geometric and texture features are concatenated in order to generate complex descriptors. Finally, Back Propagation Neural Network (BPNN), kNN (K-Nearest Neighbour), and Support Vector Machine (SVM) classifiers are applied to select the best classifier for classifying plaque into TCFA and Non-TCFA. The present study proposes a fast and accurate computer-aided method for plaque type classification. The proposed method is applied to 588 VH-IVUS images obtained from 10 patients. The results prove the superiority of the proposed method, with accuracy rates of 98.61% for TCFA plaque.

Automated in vivo delineation of lumen wall using intravascular ultrasound imaging

This paper presents a novel methodology for automated detection and extraction of the lumen wall from Intravascular Ultrasound (IVUS) frames. IVUS is an in-vivo pull back imaging technique and provides a sequential frame of images for diagnosis of atherosclerotic heart disease. The detection and segmentation of lumen wall is necessary for predicting the arterial wall blockage. Lumen wall is recognized and segmented with the help of seed refinement and random walks algorithms, in tunica and lumen area. The proposed methodology was tested on 147 frames of 13 patients. Proposed method achieves significant performances for automated lumen wall detection and extraction as compared with existing literature.

Real-time in vitro intravascular reconstruction and navigation for endovascular aortic stent grafting

BACKGROUND

Trans-catheter endovascular stent grafting minimizes trauma and increases the benefitting patient population. However, the alignment between stent graft branches and vasculature branches remains time-consuming and challenging, and such techniques require a significant amount of contrast agent for imaging.

METHODS

A new framework for intravascular reconstruction based on sensor fusion between intravascular ultrasound (IVUS) imaging and electromagnetic (EM) tracking was proposed. A new image processing method was presented to realize fully automatic processing of IVUS imaging and 3D reconstruction in real time, as well as branch detection for alignment and deployment. Complementary navigation using CT data allows for efficient catheter advancement and assistant clinical judgement.

RESULTS

The reconstruction of an in vitro descending aorta phantom with branches was realized at 35 Hz, with cross-section radius average error of 0.64 mm.

CONCLUSION

The proposed method demonstrates significant potential for clinical applications, enables navigation for precise alignment and placement for stent grafting to reduce surgical time, and decreases hemorrhagic collisions and the use of contrast agent. Copyright © 2016 John Wiley & Sons, Ltd.

Computerized methodology for micro-CT and histological data inflation using an IVUS based translation map

A framework for the inflation of micro-CT and histology data using intravascular ultrasound (IVUS) images, is presented. The proposed methodology consists of three steps. In the first step the micro-CT/histological images are manually co-registered with IVUS by experts using fiducial points as landmarks. In the second step the lumen of both the micro-CT/histological images and IVUS images are automatically segmented. Finally, in the third step the micro-CT/histological images are inflated by applying a transformation method on each image. The transformation method is based on the IVUS and micro-CT/histological contour difference. In order to validate the proposed image inflation methodology, plaque areas in the inflated micro-CT and histological images are compared with the ones in the IVUS images. The proposed methodology for inflating micro-CT/histological images increases the sensitivity of plaque area matching between the inflated and the IVUS images (7% and 22% in histological and micro-CT images, respectively).

Error propagation in the characterization of atheromatic plaque types based on imaging

Imaging systems transmit and acquire signals and are subject to errors including: error sources, signal variations or possible calibration errors. These errors are included in all imaging systems for atherosclerosis and are propagated to methodologies implemented for the segmentation and characterization of atherosclerotic plaque. In this paper, we present a study for the propagation of imaging errors and image segmentation errors in plaque characterization methods applied to 2D vascular images. More specifically, the maximum error that can be propagated to the plaque characterization results is estimated, assuming worst-case scenarios. The proposed error propagation methodology is validated using methods applied to real datasets, obtained from intravascular imaging (IVUS) and optical coherence tomography (OCT) for coronary arteries, and magnetic resonance imaging (MRI) for carotid arteries. The plaque characterization methods have recently been presented in the literature and are able to detect the vessel borders, and characterize the atherosclerotic plaque types. Although, these methods have been extensively validated using as gold standard expert annotations, by applying the proposed error propagation methodology a more realistic validation is performed taking into account the effect of the border detection algorithms error and the image formation error into the final results. The Pearson's coefficient of the detected plaques has changed significantly when the method was applied to IVUS and OCT, while there was not any variation when the method was applied to MRI data.

Automated Framework for Detecting Lumen and Media-Adventitia Borders in Intravascular Ultrasound Images

An automated framework for detecting lumen and media-adventitia borders in intravascular ultrasound images was developed on the basis of an adaptive region-growing method and an unsupervised clustering method. To demonstrate the capability of the framework, linear regression, Bland-Altman analysis and distance analysis were used to quantitatively investigate the correlation, agreement and spatial distance, respectively, between our detected borders and manually traced borders in 337 intravascular ultrasound images in vivo acquired from six patients. The results of these investigations revealed good correlation (r = 0.99), good agreement (>96.82% of results within the 95% confidence interval) and small average distance errors (lumen border: 0.08 mm, media-adventitia border: 0.10 mm) between the borders generated by the automated framework and the manual tracing method. The proposed framework was found to be effective in detecting lumen and media-adventitia borders in intravascular ultrasound images, indicating its potential for use in routine studies of vascular disease.

Computer Vision Techniques for Transcatheter Intervention

Minimally invasive transcatheter technologies have demonstrated substantial promise for the diagnosis and the treatment of cardiovascular diseases. For example, transcatheter aortic valve implantation is an alternative to aortic valve replacement for the treatment of severe aortic stenosis, and transcatheter atrial fibrillation ablation is widely used for the treatment and the cure of atrial fibrillation. In addition, catheter-based intravascular ultrasound and optical coherence tomography imaging of coronary arteries provides important information about the coronary lumen, wall, and plaque characteristics. Qualitative and quantitative analysis of these cross-sectional image data will be beneficial to the evaluation and the treatment of coronary artery diseases such as atherosclerosis. In all the phases (preoperative, intraoperative, and postoperative) during the transcatheter intervention procedure, computer vision techniques (e.g., image segmentation and motion tracking) have been largely applied in the field to accomplish tasks like annulus measurement, valve selection, catheter placement control, and vessel centerline extraction. This provides beneficial guidance for the clinicians in surgical planning, disease diagnosis, and treatment assessment. In this paper, we present a systematical review on these state-of-the-art methods. We aim to give a comprehensive overview for researchers in the area of computer vision on the subject of transcatheter intervention. Research in medical computing is multi-disciplinary due to its nature, and hence, it is important to understand the application domain, clinical background, and imaging modality, so that methods and quantitative measurements derived from analyzing the imaging data are appropriate and meaningful. We thus provide an overview on the background information of the transcatheter intervention procedures, as well as a review of the computer vision techniques and methodologies applied in this area.

Currently available methodologies for the processing of intravascular ultrasound and optical coherence tomography images

Optical coherence tomography and intravascular ultrasound are the most widely used methodologies in clinical practice as they provide high resolution cross-sectional images that allow comprehensive visualization of the lumen and plaque morphology. Several methods have been developed in recent years to process the output of these imaging modalities, which allow fast, reliable and reproducible detection of the luminal borders and characterization of plaque composition. These methods have proven useful in the study of the atherosclerotic process as they have facilitated analysis of a vast amount of data. This review presents currently available intravascular ultrasound and optical coherence tomography processing methodologies for segmenting and characterizing the plaque area, highlighting their advantages and disadvantages, and discusses the future trends in intravascular imaging.

Methodology for micro-CT data inflation using intravascular ultrasound images

In this paper, a framework for the inflation of micro-CT data using intravascular ultrasound (IVUS) images, is presented. The proposed methodology consists of four steps. In the first step a centerline is extracted from the micro-CT images. In the second step the micro CT images are segmented automatically using the k-means algorithm. In the third step IVUS- micro-CT images are co-registered based on fiducial markers selected manually by the experts. Finally, the images are inflated by applying a transformation method on each image. The transformation method is based on the IVUS and micro-CT contour difference. The proposed methodology for inflating micro-CT images could increase the reliability of correct plaque labeling process as well to enhance the accuracy of the produced training dataset from the micro-CT images.

Automated detection framework of the calcified plaque with acoustic shadowing in IVUS images

Intravascular Ultrasound (IVUS) is one ultrasonic imaging technology to acquire vascular cross-sectional images for the visualization of the inner vessel structure. This technique has been widely used for the diagnosis and treatment of coronary artery diseases. The detection of the calcified plaque with acoustic shadowing in IVUS images plays a vital role in the quantitative analysis of atheromatous plaques. The conventional method of the calcium detection is manual drawing by the doctors. However, it is very time-consuming, and with high inter-observer and intra-observer variability between different doctors. Therefore, the computer-aided detection of the calcified plaque is highly desired. In this paper, an automated method is proposed to detect the calcified plaque with acoustic shadowing in IVUS images by the Rayleigh mixture model, the Markov random field, the graph searching method and the prior knowledge about the calcified plaque. The performance of our method was evaluated over 996 in-vivo IVUS images acquired from eight patients, and the detected calcified plaques are compared with manually detected calcified plaques by one cardiology doctor. The experimental results are quantitatively analyzed separately by three evaluation methods, the test of the sensitivity and specificity, the linear regression and the Bland-Altman analysis. The first method is used to evaluate the ability to distinguish between IVUS images with and without the calcified plaque, and the latter two methods can respectively measure the correlation and the agreement between our results and manual drawing results for locating the calcified plaque in the IVUS image. High sensitivity (94.68%) and specificity (95.82%), good correlation and agreement (>96.82% results fall within the 95% confidence interval in the Student t-test) demonstrate the effectiveness of the proposed method in the detection of the calcified plaque with acoustic shadowing in IVUS images.

Standardized evaluation methodology and reference database for evaluating IVUS image segmentation

This paper describes an evaluation framework that allows a standardized and quantitative comparison of IVUS lumen and media segmentation algorithms. This framework has been introduced at the MICCAI 2011 Computing and Visualization for (Intra)Vascular Imaging (CVII) workshop, comparing the results of eight teams that participated. We describe the available data-base comprising of multi-center, multi-vendor and multi-frequency IVUS datasets, their acquisition, the creation of the reference standard and the evaluation measures. The approaches address segmentation of the lumen, the media, or both borders; semi- or fully-automatic operation; and 2-D vs. 3-D methodology. Three performance measures for quantitative analysis have been proposed. The results of the evaluation indicate that segmentation of the vessel lumen and media is possible with an accuracy that is comparable to manual annotation when semi-automatic methods are used, as well as encouraging results can be obtained also in case of fully-automatic segmentation. The analysis performed in this paper also highlights the challenges in IVUS segmentation that remains to be solved.

A state-of-the-art review on segmentation algorithms in intravascular ultrasound (IVUS) images

Over the past two decades, intravascular ultrasound (IVUS) image segmentation has remained a challenge for researchers while the use of this imaging modality is rapidly growing in catheterization procedures and in research studies. IVUS provides cross-sectional grayscale images of the arterial wall and the extent of atherosclerotic plaques with high spatial resolution in real time. In this paper, we review recently developed image processing methods for the detection of media-adventitia and luminal borders in IVUS images acquired with different transducers operating at frequencies ranging from 20 to 45 MHz. We discuss methodological challenges, lack of diversity in reported datasets, and weaknesses of quantification metrics that make IVUS segmentation still an open problem despite all efforts. In conclusion, we call for a common reference database, validation metrics, and ground-truth definition with which new and existing algorithms could be benchmarked.

A novel semiautomated atherosclerotic plaque characterization method using grayscale intravascular ultrasound images: comparison with virtual histology

Intravascular ultrasound (IVUS) virtual histology (VH-IVUS) is a new technique, which provides automated plaque characterization in IVUS frames, using the ultrasound backscattered RF-signals. However, its computation can only be performed once per cardiac cycle (ECG-gated technique), which significantly decreases the number of characterized IVUS frames. Also atherosclerotic plaques in images that have been acquired by machines, which are not equipped with the VH software, cannot be characterized. To address these limitations, we have developed a plaque characterization technique that can be applied in grayscale IVUS images. Our semiautomated method is based on a three-step approach. In the first step, the plaque area [region of interest (ROI)] is detected semiautomatically. In the second step, a set of features is extracted for each pixel of the ROI and in the third step, a random forest classifier is used to classify these pixels into four classes: dense calcium, necrotic core, fibrotic tissue, and fibro-fatty tissue. In order to train and validate our method, we used 300 IVUS frames acquired from virtual histology examinations from ten patients. The overall accuracy of the proposed method was 85.65% suggesting that our approach is reliable and may be further investigated in the clinical and research arena.

Automatic segmentation of calcifications in intravascular ultrasound images using snakes and the contourlet transform

It is valuable to detect calcifications in intravascular ultrasound images for studies of coronary artery diseases. An image segmentation method based on snakes and the Contourlet transform is proposed to automatically and accurately detect calcifications. With the Contourlet transform, an original image is decomposed into low-pass bands and band-pass directional sub-bands. The 2-D Renyi's entropy is used to adaptively threshold the low-pass bands in a multiresolution hierarchy to determine regions-of-interest (ROIs). Then a mean intensity ratio, reflecting acoustic shadowing, is presented to classify calcifications from noncalcifications and obtain initial contours of calcifications. The anisotropic diffusion is used in bandpass directional sub-bands to suppress noise and preserve calcific edges. Finally, the contour deformation in the boundary vector field is used to obtain final contours of calcifications. The method was evaluated via 60 simulated images and 86 in vivo images. It outperformed a recently proposed method, the Santos Filho method, by 2.76% and 14.53%, in terms of the sensitivity and specificity of calcification detection, respectively. The area under the receiver operating characteristic curve increased by 0.041. The relative mean distance error, relative difference degree, relative arc difference, relative thickness difference and relative length difference were reduced by 5.73%, 19.79%, 11.62%, 12.06% and 20.51%, respectively. These results reveal that the proposed method can automatically and accurately detect calcifications and delineate their boundaries. (E-mail: yywang@fudan.edu.cn).

Image analysis techniques for automated IVUS contour detection

Intravascular ultrasound (IVUS) constitutes a valuable technique for the diagnosis of coronary atherosclerosis. The detection of lumen and media-adventitia borders in IVUS images represents a necessary step towards the reliable quantitative assessment of atherosclerosis. In this work, a fully automated technique for the detection of lumen and media-adventitia borders in IVUS images is presented. This comprises two different steps for contour initialization: one for each corresponding contour of interest and a procedure for the refinement of the detected contours. Intensity information, as well as the result of texture analysis, generated by means of a multilevel discrete wavelet frames decomposition, are used in two different techniques for contour initialization. For subsequently producing smooth contours, three techniques based on low-pass filtering and radial basis functions are introduced. The different combinations of the proposed methods are experimentally evaluated in large datasets of IVUS images derived from human coronary arteries. It is demonstrated that our proposed segmentation approaches can quickly and reliably perform automated segmentation of IVUS images.

Texture Analysis and Radial Basis Function Approximation for IVUS Image Segmentation

>Intravascular ultrasound (IVUS) has become in the last years an important tool in both clinical and research applications. The detection of lumen and media-adventitia borders in IVUS images represents a first necessary step in the utilization of the IVUS data for the 3D reconstruction of human coronary arteries and the reliable quantitative assessment of the atherosclerotic lesions. To serve this goal, a fully automated technique for the detection of lumen and media-adventitia boundaries has been developed. This comprises two different steps for contour initialization, one for each corresponding contour of interest, based on the results of texture analysis, and a procedure for approximating the initialization results with smooth continuous curves. A multilevel Discrete Wavelet Frames decomposition is used for texture analysis, whereas Radial Basis Function approximation is employed for producing smooth contours. The proposed method shows promising results compared to a previous approach for texture-based IVUS image analysis.

A novel active contour model for fully automated segmentation of intravascular ultrasound images: In vivo validation in human coronary arteries

The detection of lumen and media-adventitia borders in intravascular ultrasound (IVUS) images constitutes a necessary step for the quantitative assessment of atherosclerotic lesions. To date, most of the segmentation methods reported are either manual, or semi-automated, requiring user interaction at some extent, which increases the analysis time and detection errors. In this work, a fully automated approach for lumen and media-adventitia border detection is presented based on an active contour model, the initialization of which is performed via an analysis mechanism that takes advantage of the inherent morphologic characteristics of IVUS images. The in vivo validation of the proposed model in human coronary arteries revealed that it is a feasible approach, enabling accurate and rapid segmentation of multiple IVUS images.

Variable Background Active Contour Model for Computer-Aided Delineation of Nodules in Thyroid Ultrasound Images

This paper presents a computer-aided approach for nodule delineation in thyroid ultrasound (US) images. The developed algorithm is based on a novel active contour model, named variable background active contour (VBAC), and incorporates the advantages of the level set region-based active contour without edges (ACWE) model, offering noise robustness and the ability to delineate multiple nodules. Unlike the classic active contour models that are sensitive in the presence of intensity inhomogeneities, the proposed VBAC model considers information of variable background regions. VBAC has been evaluated on synthetic images, as well as on real thyroid US images. From the quantification of the results, two major impacts have been derived: 1) higher average accuracy in the delineation of hypoechoic thyroid nodules, which exceeds 91%; and 2) faster convergence when compared with the ACWE model.

Automatic segmentation and 3D reconstruction of intravascular ultrasound images for a fast preliminar evaluation of vessel pathologies

Intravascular ultrasound (IVUS) imaging is used along with X-ray coronary angiography to detect vessel pathologies. Manual analysis of IVUS images is slow and time-consuming and it is not feasible for clinical purposes. A semi-automated method is proposed to generate 3D reconstructions from IVUS video sequences, so that a fast diagnose can be easily done, quantifying plaque length and severity as well as plaque volume of the vessels under study. The methodology described in this work has four steps: a pre-processing of IVUS images, a segmentation of media-adventitia contour, a detection of intima and plaque and a 3D reconstruction of the vessel. Preprocessing is intended to remove noise from the images without blurring the edges. Segmentation of media-adventitia contour is achieved using active contours (snakes). In particular, we use the gradient vector flow (GVF) as external force for the snakes. The detection of lumen border is obtained taking into account gray-level information of the inner part of the previously detected contours. A knowledge-based approach is used to determine which level of gray corresponds statistically to the different regions of interest: intima, plaque and lumen. The catheter region is automatically discarded. An estimate of plaque type is also given. Finally, 3D reconstruction of all detected regions is made. The suitability of this methodology has been verified for the analysis and visualization of plaque length, stenosis severity, automatic detection of the most problematic regions, calculus of plaque volumes and a preliminary estimation of plaque type obtaining for automatic measures of lumen and vessel area an average error smaller than 1mm(2) (equivalent aproximately to 10% of the average measure), for calculus of plaque and lumen volume errors smaller than 0.5mm(3) (equivalent approximately to 20% of the average measure) and for plaque type estimates a mismatch of less than 8% in the analysed frames.

Desarrollo de software para la reconstrucción tridimensional y cuantificación automática de secuencias de ultrasonido intravascular. Experiencia inicial

INTRODUCTION AND OBJECTIVES

Quantification of intravascular ultrasound (IVUS) images is essential in ischemic heart disease and interventional cardiology. Manual analysis is very slow and expensive. We describe an automated computerized method of analysis that requires only minimal initial input from a specialist.

METHODS

This study was carried out by interventional cardiologists and biomedical engineers working in close collaboration. We developed software in which it was necessary only to identify the media-adventitia boundary in a few images taken from the whole sequence. A three-dimensional reconstruction was then generated from each sequence, from which measurements of areas and volumes could be derived automatically. In total, 2300 randomly selected images from video sequences of 11 patients were analyzed.

RESULTS

Results obtained using the proposed method differed only minimally from those obtained with the manual method: for vessel area measurements, the variability was 0.08 (0.07) (mean absolute error [standard deviation] normalized to the actual value; this corresponds to an error of 0.08 mm(2) per mm(2) of vessel area); for lumen area, 0.11 (0.11) (normalized), and for plaque volume, 0.5 (0.3) (normalized). Regions with severe lesions (<4 mm(2)) were correctly identified in more than 90% of cases. Specialist time needed for each reconstruction was 10 (8) minutes (vs 60 [10] minutes for manual analysis; P< .0001).

CONCLUSIONS

The computerized method used dramatically reduced the time and effort needed for IVUS sequence analysis, and the automated measurements obtained were very promising.

Statistical strategy for anisotropic adventitia modelling in IVUS

Vessel plaque assessment by analysis of intravascular ultrasound sequences is a useful tool for cardiac disease diagnosis and intervention. Manual detection of luminal (inner) and media-adventitia (external) vessel borders is the main activity of physicians in the process of lumen narrowing (plaque) quantification. Difficult definition of vessel border descriptors, as well as, shades, artifacts, and blurred signal response due to ultrasound physical properties trouble automated adventitia segmentation. In order to efficiently approach such a complex problem, we propose blending advanced anisotropic filtering operators and statistical classification techniques into a vessel border modelling strategy. Our systematic statistical analysis shows that the reported adventitia detection achieves an accuracy in the range of interobserver variability regardless of plaque nature, vessel geometry, and incomplete vessel borders.

A method for 3D reconstruction of coronary arteries using biplane angiography and intravascular ultrasound images

The aim of this study is to describe a new method for the three-dimensional reconstruction of coronary arteries and its quantitative validation. Our approach is based on the fusion of the data provided by intravascular ultrasound images (IVUS) and biplane angiographies. A specific segmentation algorithm is used for the detection of the regions of interest in intravascular ultrasound images. A new methodology is also introduced for the accurate extraction of the catheter path. In detail, a cubic B-spline is used for approximating the catheter path in each biplane projection. Each B-spline curve is swept along the normal direction of its X-ray angiographic plane forming a surface. The intersection of the two surfaces is a 3D curve, which represents the reconstructed path. The detected regions of interest in the IVUS images are placed perpendicularly onto the path and their relative axial twist is computed using the sequential triangulation algorithm. Then, an efficient algorithm is applied to estimate the absolute orientation of the first IVUS frame. In order to obtain 3D visualization the commercial package Geomagic Studio 4.0 is used. The performance of the proposed method is assessed using a validation methodology which addresses the separate validation of each step followed for obtaining the coronary reconstruction. The performance of the segmentation algorithm was examined in 80 IVUS images. The reliability of the path extraction method was studied in vitro using a metal wire model and in vivo in a dataset of 11 patients. The performance of the sequential triangulation algorithm was tested in two gutter models and in the coronary arteries (marked with metal clips) of six cadaveric sheep hearts. Finally, the accuracy in the estimation of the first IVUS frame absolute orientation was examined in the same set of cadaveric sheep hearts. The obtained results demonstrate that the proposed reconstruction method is reliable and capable of depicting the morphology of coronary arteries.

In vivovalidation of a novel semi-automated method for border detection in intravascular ultrasound images

The aim of this work was to evaluate a new semi-automated intravascular ultrasound (IVUS) border detection method. The method was used to identify the lumen and the external elastic membrane or the borders of stents in 80 IVUS images, randomly selected from 10 consecutive human coronary arteries. These semi-automated results were compared with observations of two experts. Several indices in each case were obtained in order fully to evaluate the method. The time required for identification of the borders was also recorded. The interobserver variability of the method ranged from 1.21% to 5.61%, the correlation coefficient from 0.98 to 0.99, the slope was close to unity (0.94-1.03), the y intercept close to zero and the Williams index value was close to unity (range 0.67-0.91). The time (mean+/-SD) required for the method to identify the borders of the different vessel layers for the whole IVUS sequence was 5.2+/-0.2 min. The results demonstrate that the method is reliable and capable of identifying rapidly and accurately the different vessel layers depicted in IVUS images.