A snake-based method for segmentation of intravascular ultrasound images and its in vivo validation

Deep Learning Paradigm and Its Bias for Coronary Artery Wall Segmentation in Intravascular Ultrasound Scans: A Closer Look

BACKGROUND AND MOTIVATION

Coronary artery disease (CAD) has the highest mortality rate; therefore, its diagnosis is vital. Intravascular ultrasound (IVUS) is a high-resolution imaging solution that can image coronary arteries, but the diagnosis software via wall segmentation and quantification has been evolving. In this study, a deep learning (DL) paradigm was explored along with its bias.

METHODS

Using a PRISMA model, 145 best UNet-based and non-UNet-based methods for wall segmentation were selected and analyzed for their characteristics and scientific and clinical validation. This study computed the coronary wall thickness by estimating the inner and outer borders of the coronary artery IVUS cross-sectional scans. Further, the review explored the bias in the DL system for the first time when it comes to wall segmentation in IVUS scans. Three bias methods, namely (i) ranking, (ii) radial, and (iii) regional area, were applied and compared using a Venn diagram. Finally, the study presented explainable AI (XAI) paradigms in the DL framework.

FINDINGS AND CONCLUSIONS

UNet provides a powerful paradigm for the segmentation of coronary walls in IVUS scans due to its ability to extract automated features at different scales in encoders, reconstruct the segmented image using decoders, and embed the variants in skip connections. Most of the research was hampered by a lack of motivation for XAI and pruned AI (PAI) models. None of the UNet models met the criteria for bias-free design. For clinical assessment and settings, it is necessary to move from a paper-to-practice approach.

HRU-Net: A Transfer Learning Method for Carotid Artery Plaque Segmentation in Ultrasound Images

Carotid artery stenotic plaque segmentation in ultrasound images is a crucial means for the analysis of plaque components and vulnerability. However, segmentation of severe stenotic plaques remains a challenging task because of the heterogeneities of inter-plaques and intra-plaques, and obscure boundaries of plaques. In this paper, we propose an automated HRU-Net transfer learning method for segmenting carotid plaques, using the limited images. The HRU-Net is based on the U-Net encoder−decoder paradigm, and cross-domain knowledge is transferred for plaque segmentation by fine-tuning the pretrained ResNet-50. Moreover, a cropped-blood-vessel image augmentation is customized for the plaque position constraint during training only. Moreover, hybrid atrous convolutions (HACs) are designed to derive diverse long-range dependences for refined plaque segmentation that are used on high-level semantic layers to exploit the implicit discrimination features. The experiments are performed on 115 images; Firstly, the 10-fold cross-validation, using 40 images with severe stenosis plaques, shows that the proposed method outperforms some of the state-of-the-art CNN-based methods on Dice, IoU, Acc, and modified Hausdorff distance (MHD) metrics; the improvements on metrics of Dice and MHD are statistically significant (p < 0.05). Furthermore, our HRU-Net transfer learning method shows fine generalization performance on 75 new images with varying degrees of plaque stenosis, and it may be used as an alternative for automatic noisy plaque segmentation in carotid ultrasound images clinically.

A Deep Learning-based Method to Extract Lumen and Media-Adventitia in Intravascular Ultrasound Images

Intravascular ultrasound (IVUS) imaging allows direct visualization of the coronary vessel wall and is suitable for assessing atherosclerosis and the degree of stenosis. Accurate segmentation and lumen and median-adventitia (MA) measurements from IVUS are essential for such a successful clinical evaluation. However, current automated segmentation by commercial software relies on manual corrections, which is time-consuming and user-dependent. We aim to develop a deep learning-based method using an encoder-decoder deep architecture to automatically and accurately extract both lumen and MA border. Inspired by the dual-path design of the state-of-the-art model IVUS-Net, our method named IVUS-U-Net++ achieved an extension of the U-Net++ model. More specifically, a feature pyramid network was added to the U-Net++ model, enabling the utilization of feature maps at different scales. Following the segmentation, the Pearson correlation and Bland-Altman analyses were performed to evaluate the correlations of 12 clinical parameters measured from our segmentation results and the ground truth. A dataset with 1746 IVUS images from 18 patients was used for training and testing. Our segmentation model at the patient level achieved a Jaccard measure (JM) of 0.9080 ± 0.0321 and a Hausdorff distance (HD) of 0.1484 ± 0.1584 mm for the lumen border; it achieved a JM of 0.9199 ± 0.0370 and an HD of 0.1781 ± 0.1906 mm for the MA border. The 12 clinical parameters measured from our segmentation results agreed well with those from the ground truth (all p-values are smaller than .01). Our proposed method shows great promise for its clinical use in IVUS segmentation.

Adoption of Snake Variable Model-Based Method in Segmentation and Quantitative Calculation of Cardiac Ultrasound Medical Images

This paper intends to explore the effect of the enhanced snake variable model in the segmentation of cardiac ultrasound images and its adoption in quantitative measurement of cardiac cavity. First, the basic principles of the traditional snake model and the gradient vector flow (GVF) snake model are explained. Then, an ellipsoid model is constructed to obtain the initial contour of the heart based on the three-dimensional volume of cardiac ultrasound image, and a discretized triangular mesh model is generated. Finally, the vortical gradient vector flow (VGVF) external force field is introduced and combined with the greedy algorithm to process the deformation of the initial ellipsoid contour of the heart. The segmentation effect is quantitatively evaluated regarding the area overlap rate (AOR) and the mean contour distance (MCD). The results show that the VGVF snake model can segment the deep recessed area of the "U-shaped map" in contrast to the traditional snake model and the GVF snake model. After being applied to ultrasonic image segmentation, the VGVF snake model obtains the segmentation result that is close to the doctor's manual segmentation result, and the average AOR and MCD are 97.4% and 3.2, respectively. The quantitative evaluation of the cardiac cavity is carried out based on the segmentation results, and the measurement of the volume change of the left ventricle within a cardiac cycle is realized. To sum up, VGVF snake model is superior to the traditional snake and GVF snake models in terms of ultrasonic image segmentation, which realizes the three-dimensional segmentation and quantitative calculation of the cardiac cavity.

Improved real-time segmentation of Intravascular Ultrasound images using coordinate-aware fully convolutional networks

Segmentation of Intravascular Ultrasound (IVUS) images into Lumen and Media (interior and exterior) artery vessel walls is highly clinically relevant in the diagnosis and treatment of cardiovascular diseases such as atherosclerosis. When fused with position data, such segmentations also play a key role in reconstructing 3D representations of arteries. Automated segmentation in real-time is known to be a difficult image analysis problem, primarily due to artefacts commonly present in IVUS ultrasound images such as shadows, guide-wire effects, and side-branches. An additional challenge is the limited amount of expert labelled IVUS data, which limits the application of many well-performing deep learning models from other domains. To exploit the circular layered structure of the artery in B-Mode images, we propose a multi-class fully convolutional semantic segmentation network based on a minimal U-Net architecture augmented with learned translation dependence in the polar domain. The coordinate awareness in the multi-class segmentation allows the model to exploit relative spatial context about the interior and exterior vessel walls which are simply separable in polar coordinates. After training on 109 expert-labelled examples, our model significantly outperforms the state-of-the art in terms of mean Jaccard Measure (0.91 vs. 0.89) and Hausdorff distance (0.32 mm vs. 0.48 mm) on Media segmentation, and reaches equivalent performance on Lumen segmentation when evaluated on a standard publicly available dataset of 326 IVUS B-Mode images captured by 20 Mhz ultrasound probes. Using an order of magnitude fewer trainable parameters than the previous state-of-the-art, our model runs over 50 times faster and is able to execute in only 3 ms on a common GPU, achieving both leading accuracy and practical real-time performance.

A new solution model for cardiac medical image segmentation

Background

Calculation methods have a critical role in the precise sorting of medical images. Particle swarm optimization (PSO) is a widely used approach in the clinical centers and for other medical applications as it can disentangle optimization errors in attached spaces. In this work, a new model for image segmentation is proposed through an improved optimization algorithm.

Methods

A novel multi-objective algorithm was configured, named “multi-objective mathematical programming” (MOMP), based on the normalized normal constraint method (NNCM). In this model, the proposed algorithm was applied to evaluate the robustness of the suggested model through including the synthetic images of objects with various concavities and Gaussian noise. This model segments the individuals’ heart and the left ventricle from data sets of sequentially evaluated tomography and magnetic resonance images. To objectively and quantifiably assess the presentation of the medical image segmentations based on regions outlined by experts and the graph cut method, a set of distance and resemblance metrics were implemented.

Results

The numerical results obtained in experimental test cases demonstrate the validity and superiority of the proposed model through better segmentation accuracy and stability.

Conclusions

The results indicated that the proposed MOMP method can outperform all traditional models in terms of segmentation accuracy and stability, and is thus appropriate for use in medical imaging.

Lumen-intima and media-adventitia segmentation in IVUS images using supervised classifications of arterial layers and morphological structures

BACKGROUND

Intravascular ultrasound (IVUS) provides axial grey-scale images of blood vessels. The large number of images require automatic analysis, specifically to identify the lumen and outer vessel wall. However, the high amount of noise, the presence of artifacts and anatomical structures, such as bifurcations, calcifications and fibrotic plaques, usually hinder the proper automatic segmentation of the vessel wall.

METHODS

Lumen, media, adventitia and surrounding tissues are automatically detected using Support Vector Machines (SVMs). The classification performance of the SVMs vary according to the kind of structure present within each region of the image. Random Forest (RF) is used to detect different morphological structures and to modify the initial layer classification depending on the detected structure. The resulting classification maps are fed into a segmentation method based on deformable contours to detect lumen-intima (LI) and media-adventitia (MA) interfaces.

RESULTS

The modifications in the layer classifications according to the presence of structures proved to be effective improving LI and MA segmentations. The proposed method reaches a Jaccard Measure (JM) of 0.88 ± 0.08 for LI segmentation, compared with 0.88 ± 0.05 of a semiautomatic method. When looking at MA, our method reaches a JM of 0.84 ± 0.09, and outperforms previous automatic methods in terms of HD, with 0.51mm ± 0.30.

CONCLUSIONS

A simple modification to the arterial layer classification produces results that match and improve state-of-the-art fully-automatic segmentation methods for LI and MA in 20MHz IVUS images. For LI segmentation, the proposed automatic method performs accurately as semi-automatic methods. For MA segmentation, our method matched the quality of state-of-the-art automatic methods described in the literature. Furthermore, our implementation is modular and open-source, allowing for future extensions and improvements.

Robust segmentation of arterial walls in intravascular ultrasound images using Dual Path U-Net

A Fully Convolutional Network (FCN) based deep architecture called Dual Path U-Net (DPU-Net) is proposed for automatic segmentation of the lumen and media-adventitia in IntraVascular UltraSound (IVUS) frames, which is crucial for diagnosis of many cardiovascular diseases and also for facilitating 3D reconstructions of human arteries. One of the most prevalent problems in medical image analysis is the lack of training data. To overcome this limitation, we propose a twofold solution. First, we introduce a deep architecture that is able to learn using a small number of training images and still achieves a high degree of generalization ability. Second, we strengthen the proposed DPU-Net by having a real-time augmentor control the image augmentation process. Our real-time augmentor contains specially-designed operations that simulate three types of IVUS artifacts and integrate them into the training images. We exhaustively assessed our twofold contribution over Balocco's standard publicly available IVUS 20 MHz and 40 MHz B-mode dataset, which contain 109 training image, 326 test images and 19 training images, 59 test images, respectively. Models are trained from scratch with the training images provided and evaluated with two commonly used metrics in the IVUS segmentation literature, namely Jaccard Measure (JM) and Hausdorff Distance (HD). Experimental results show that DPU-Net achieves 0.87 JM, 0.82 mm HD and 0.86 JM, 1.07 mm HD over 40 MHz dataset for segmenting the lumen and the media, respectively. Also, DPU-Net achieves 0.90 JM, 0.25 mm HD and 0.92 JM, 0.30 mm HD over 20 MHz images for segmenting the lumen and the media, respectively. In addition, DPU-Net outperforms existing methods by 8-15% in terms of HD distance. DPU-Net also shows a strong generalization property for predicting images in the test sets that contain a significant amount of major artifacts such as bifurcations, shadows, and side branches that are not common in the training set. Furthermore, DPU-Net runs within 0.03 s to segment each frame with a single modern GPU (Nvidia GTX 1080). The proposed work leverages modern deep learning-based method for segmentation of lumen and the media vessel walls in both 20 MHz and 40 MHz IVUS B-mode images and achieves state-of-the-art results without any manual intervention. The code is available online at https://github.com/Kulbear/IVUS-Ultrasonic.

Detecting the Media-adventitia Border in Intravascular Ultrasound Images through a Classification-based Approach

The detection of the media-adventitia (MA) border in intravascular ultrasound (IVUS) images is essential for vessel assessment and disease diagnosis. However, it remains a challenging task, considering the existence of plaque, calcification, and various artifacts. In this article, an effective method based on classification is proposed to extract the MA border in IVUS images. First, a novel morphologic feature describing the relative position of each structure relative to the MA border, called RPES for short, is proposed. Then, the RPES feature and other features are employed in a multiclass extreme learning machine (ELM) to classify IVUS images into nine classes including the MA border and other structures. At last, a modified snake model is employed to effectively detect the MA border in the rectangular domain, in which a modified external force field is constructed on the basis of local border appearances and classification results. The proposed method is evaluated on a public dataset with 77 IVUS images by three indicators in eight situations, such as calcification and a guide wire artifact. With the proposed RPES feature, detection performances are improved by more than 39 percent, which shows an apparent advantage in comparative experiments. Furthermore, compared with two other existing methods used on the same dataset, the proposed method achieves 18 of the best indicators among 24, demonstrating its higher capability in detecting the MA border.

Thin Cap Fibroatheroma Detection in Virtual Histology Images Using Geometric and Texture Features

Atherosclerotic plaque rupture is the most common mechanism responsible for a majority of sudden coronary deaths. The precursor lesion of plaque rupture is thought to be a thin cap fibroatheroma (TCFA), or “vulnerable plaque”. Virtual Histology-Intravascular Ultrasound (VH-IVUS) images are clinically available for visualising colour-coded coronary artery tissue. However, it has limitations in terms of providing clinically relevant information for identifying vulnerable plaque. The aim of this research is to improve the identification of TCFA using VH-IVUS images. To more accurately segment VH-IVUS images, a semi-supervised model is developed by means of hybrid K-means with Particle Swarm Optimisation (PSO) and a minimum Euclidean distance algorithm (KMPSO-mED). Another novelty of the proposed method is fusion of different geometric and informative texture features to capture the varying heterogeneity of plaque components and compute a discriminative index for TCFA plaque, while the existing research on TCFA detection has only focused on the geometric features. Three commonly used statistical texture features are extracted from VH-IVUS images: Local Binary Patterns (LBP), Grey Level Co-occurrence Matrix (GLCM), and Modified Run Length (MRL). Geometric and texture features are concatenated in order to generate complex descriptors. Finally, Back Propagation Neural Network (BPNN), kNN (K-Nearest Neighbour), and Support Vector Machine (SVM) classifiers are applied to select the best classifier for classifying plaque into TCFA and Non-TCFA. The present study proposes a fast and accurate computer-aided method for plaque type classification. The proposed method is applied to 588 VH-IVUS images obtained from 10 patients. The results prove the superiority of the proposed method, with accuracy rates of 98.61% for TCFA plaque.

Segmentation of arterial walls in intravascular ultrasound cross-sectional images using extremal region selection

Intravascular Ultrasound (IVUS) is an intra-operative imaging modality that facilitates observing and appraising the vessel wall structure of the human coronary arteries. Segmentation of arterial wall boundaries from the IVUS images is not only crucial for quantitative analysis of the vessel walls and plaque characteristics, but is also necessary for generating 3D reconstructed models of the artery. The aim of this study is twofold. Firstly, we investigate the feasibility of using a recently proposed region detector, namely Extremal Region of Extremum Level (EREL) to delineate the luminal and media-adventitia borders in IVUS frames acquired by 20 MHz probes. Secondly, we propose a region selection strategy to label two ERELs as lumen and media based on the stability of their textural information. We extensively evaluated our selection strategy on the test set of a standard publicly available dataset containing 326 IVUS B-mode images. We showed that in the best case, the average Hausdorff Distances (HD) between the extracted ERELs and the actual lumen and media were 0.22  mm and 0.45 mm, respectively. The results of our experiments revealed that our selection strategy was able to segment the lumen with ⩽0.3 mm HD to the gold standard even though the images contained major artifacts such as bifurcations, shadows, and side branches. Moreover, when there was no artifact, our proposed method was able to delineate media-adventitia boundaries with 0.31 mm HD to the gold standard. Furthermore, our proposed segmentation method runs in time that is linear in the number of pixels in each frame. Based on the results of this work, by using a 20 MHz IVUS probe with controlled pullback, not only can we now analyze the internal structure of human arteries more accurately, but also segment each frame during the pullback procedure because of the low run time of our proposed segmentation method.

Lumen and media-adventitia border detection in IVUS images using texture enhanced deformable model

Lumen and media-adventitia (MA) borders in intravascular ultrasound (IVUS) images are critical for assessing the dimensions of vascular structures and providing plaque information in the diagnosis and navigation of vascular interventions. However, manual delineation of the lumen and MA borders is an intricate and time-consuming process. In this paper, a texture-enhanced deformable model (TEDM) is proposed to accurately detect these borders by incorporating texture information with the morphological factors of deformable model. An ensemble support vector machine classifier is used to classify IVUS pixels presented by texture features into different tissue types. The image regionalization maps of different tissue types are further used for texture enhancement modules in the TEDM. The proposed TEDM method has been tested on 1500 images from 15 clinical IVUS datasets by comparing with the manual delineations. Evaluation results demonstrate that our method can accurately detect lumen and MA surfaces with small surface distance errors of 0.17 and 0.19 mm, respectively. Accurate segmentation results provide 2D measurements of MA/lumen areas and 3D vessel visualizations for vascular interventions.

Segmenting breast cancerous regions in thermal images using fuzzy active contours

Breast cancer is the main cause of death among young women in developing countries. The human body temperature carries critical medical information related to the overall body status. Abnormal rise in total and regional body temperature is a natural symptom in diagnosing many diseases. Thermal imaging (Thermography) utilizes infrared beams which are fast, non-invasive, and non-contact and the output created images by this technique are flexible and useful to monitor the temperature of the human body. In some clinical studies and biopsy tests, it is necessary for the clinician to know the extent of the cancerous area. In such cases, the thermal image is very useful. In the same line, to detect the cancerous tissue core, thermal imaging is beneficial. This paper presents a fully automated approach to detect the thermal edge and core of the cancerous area in thermography images. In order to evaluate the proposed method, 60 patients with an average age of 44/9 were chosen. These cases were suspected of breast tissue disease. These patients referred to Tehran Imam Khomeini Imaging Center. Clinical examinations such as ultrasound, biopsy, questionnaire, and eventually thermography were done precisely on these individuals. Finally, the proposed model is applied for segmenting the proved abnormal area in thermal images. The proposed model is based on a fuzzy active contour designed by fuzzy logic. The presented method can segment cancerous tissue areas from its borders in thermal images of the breast area. In order to evaluate the proposed algorithm, Hausdorff and mean distance between manual and automatic method were used. Estimation of distance was conducted to accurately separate the thermal core and edge. Hausdorff distance between the proposed and the manual method for thermal core and edge was 0.4719 ± 0.4389, 0.3171 ± 0.1056 mm respectively, and the average distance between the proposed and the manual method for core and thermal edge was 0.0845 ± 0.0619, 0.0710 ± 0.0381 mm respectively. Furthermore, the sensitivity in recognizing the thermal pattern in breast tissue masses is 85 % and its accuracy is 91.98 %.A thermal imaging system has been proposed that is able to recognize abnormal breast tissue masses. This system utilizes fuzzy active contours to extract the abnormal regions automatically.

Automated in vivo delineation of lumen wall using intravascular ultrasound imaging

This paper presents a novel methodology for automated detection and extraction of the lumen wall from Intravascular Ultrasound (IVUS) frames. IVUS is an in-vivo pull back imaging technique and provides a sequential frame of images for diagnosis of atherosclerotic heart disease. The detection and segmentation of lumen wall is necessary for predicting the arterial wall blockage. Lumen wall is recognized and segmented with the help of seed refinement and random walks algorithms, in tunica and lumen area. The proposed methodology was tested on 147 frames of 13 patients. Proposed method achieves significant performances for automated lumen wall detection and extraction as compared with existing literature.

A method of localization and segmentation of intervertebral discs in spine MRI based on Gabor filter bank

BACKGROUND

Spine magnetic resonance image (MRI) plays a very important role in the diagnosis of various spinal diseases, such as disc degeneration, scoliosis, and osteoporosis. Accurate localization and segmentation of the intervertebral disc (IVD) in spine MRI can help accelerate the diagnosis time and assist in the treatment by providing quantitative parameters. In this paper, a method based on Gabor filter bank is proposed for IVD localization and segmentation.

METHODS

First, the structural features of IVDs are extracted using a Gabor filter bank. Second, the Gabor features of spine are calculated and spinal curves are detected. Third, the Gabor feature images (GFI) of IVDs are calculated and adjusted according to the spinal curves. Fourth, the IVDs are localized by clustering analysis with GFI. Finally, an optimum grayscale-based algorithm with self-adaptive threshold, combined with the localization results and Gabor features of the spine, is performed for IVDs segmentation.

RESULTS

The proposed method is verified by an MRI dataset consisting of 278 IVDs from 37 patients. The accuracy of localization is 98.23 % and the dice similarity index for segmentation evaluation is 0.9237.

CONCLUSIONS

The proposed Gabor filter based method is effective for IVD localization and segmentation. It would be useful in computer-aided diagnosis of IVD diseases and computer-assisted spine surgery.

Assessment of image features for vessel wall segmentation in intravascular ultrasound images

BACKGROUND

Intravascular ultrasound (IVUS) provides axial greyscale images, allowing the assessment of the vessel wall and the surrounding tissues. Several studies have described automatic segmentation of the luminal boundary and the media-adventitia interface by means of different image features.

PURPOSE

The aim of the present study is to evaluate the capability of some of the most relevant state-of-the-art image features for segmenting IVUS images. The study is focused on Volcano 20 MHz frames not containing plaque or containing fibrotic plaques, and, in principle, it could not be applied to frames containing shadows, calcified plaques, bifurcations and side vessels.

METHODS

Several image filters, textural descriptors, edge detectors, noise and spatial measures were taken into account. The assessment is based on classification techniques previously used for IVUS segmentation, assigning to each pixel a continuous likelihood value obtained using support vector machines (SVMs). To retrieve relevant features, sequential feature selection was performed guided by the area under the precision-recall curve (AUC-PR).

RESULTS

Subsets of relevant image features for lumen, plaque and surrounding tissues characterization were obtained, and SVMs trained with these features were able to accurately identify those regions. The experimental results were evaluated with respect to ground truth segmentations from a publicly available dataset, reaching values of AUC-PR up to 0.97 and Jaccard index close to 0.85.

CONCLUSION

Noise-reduction filters and Haralick's textural features denoted their relevance to identify lumen and background. Laws' textural features, local binary patterns, Gabor filters and edge detectors had less relevance in the selection process.

Feature-based fuzzy connectedness segmentation of ultrasound images with an object completion step

Medical ultrasound (US) image segmentation and quantification can be challenging due to signal dropouts, missing boundaries, and presence of speckle, which gives images of similar objects quite different appearance. Typically, purely intensity-based methods do not lead to a good segmentation of the structures of interest. Prior work has shown that local phase and feature asymmetry, derived from the monogenic signal, extract structural information from US images. This paper proposes a new US segmentation approach based on the fuzzy connectedness framework. The approach uses local phase and feature asymmetry to define a novel affinity function, which drives the segmentation algorithm, incorporates a shape-based object completion step, and regularises the result by mean curvature flow. To appreciate the accuracy and robustness of the methodology across clinical data of varying appearance and quality, a novel entropy-based quantitative image quality assessment of the different regions of interest is introduced. The new method is applied to 81 US images of the fetal arm acquired at multiple gestational ages, as a means to define a new automated image-based biomarker of fetal nutrition. Quantitative and qualitative evaluation shows that the segmentation method is comparable to manual delineations and robust across image qualities that are typical of clinical practice.

Three-dimensional Reconstruction of Peripheral Nerve Internal Fascicular Groups

Peripheral nerves are important pathways for receiving afferent sensory impulses and sending out efferent motor instructions, as carried out by sensory nerve fibers and motor nerve fibers. It has remained a great challenge to functionally reconnect nerve internal fiber bundles (or fascicles) in nerve repair. One possible solution may be to establish a 3D nerve fascicle visualization system. This study described the key technology of 3D peripheral nerve fascicle reconstruction. Firstly, fixed nerve segments were embedded with position lines, cryostat-sectioned continuously, stained and imaged histologically. Position line cross-sections were identified using a trained support vector machine method, and the coordinates of their central pixels were obtained. Then, nerve section images were registered using the bilinear method, and edges of fascicles were extracted using an improved gradient vector flow snake method. Subsequently, fascicle types were identified automatically using the multi-directional gradient and second-order gradient method. Finally, a 3D virtual model of internal fascicles was obtained after section images were processed. This technique was successfully applied for 3D reconstruction for the median nerve of the hand-wrist and cubital fossa regions and the gastrocnemius nerve. This nerve internal fascicle 3D reconstruction technology would be helpful for aiding peripheral nerve repair and virtual surgery.

Automated Framework for Detecting Lumen and Media-Adventitia Borders in Intravascular Ultrasound Images

An automated framework for detecting lumen and media-adventitia borders in intravascular ultrasound images was developed on the basis of an adaptive region-growing method and an unsupervised clustering method. To demonstrate the capability of the framework, linear regression, Bland-Altman analysis and distance analysis were used to quantitatively investigate the correlation, agreement and spatial distance, respectively, between our detected borders and manually traced borders in 337 intravascular ultrasound images in vivo acquired from six patients. The results of these investigations revealed good correlation (r = 0.99), good agreement (>96.82% of results within the 95% confidence interval) and small average distance errors (lumen border: 0.08 mm, media-adventitia border: 0.10 mm) between the borders generated by the automated framework and the manual tracing method. The proposed framework was found to be effective in detecting lumen and media-adventitia borders in intravascular ultrasound images, indicating its potential for use in routine studies of vascular disease.

Brachial artery vasomotion and transducer pressure effect on measurements by active contour segmentation on ultrasound

PURPOSE

To use feed-forward active contours (snakes) to track and measure brachial artery vasomotion on ultrasound images recorded in both transverse and longitudinal views; and to compare the algorithm's performance in each view.

METHODS

Longitudinal and transverse view ultrasound image sequences of 45 brachial arteries were segmented by feed-forward active contour (FFAC). The segmented regions were used to measure vasomotion artery diameter, cross-sectional area, and distention both as peak-to-peak diameter and as area. ECG waveforms were also simultaneously extracted frame-by-frame by thresholding a running finite-difference image between consecutive images. The arterial and ECG waveforms were compared as they traced each phase of the cardiac cycle.

RESULTS

FFAC successfully segmented arteries in longitudinal and transverse views in all 45 cases. The automated analysis took significantly less time than manual tracing, but produced superior, well-behaved arterial waveforms. Automated arterial measurements also had lower interobserver variability as measured by correlation, difference in mean values, and coefficient of variation. Although FFAC successfully segmented both the longitudinal and transverse images, transverse measurements were less variable. The cross-sectional area computed from the longitudinal images was 27% lower than the area measured from transverse images, possibly due to the compression of the artery along the image depth by transducer pressure.

CONCLUSIONS

FFAC is a robust and sensitive vasomotion segmentation algorithm in both transverse and longitudinal views. Transverse imaging may offer advantages over longitudinal imaging: transverse measurements are more consistent, possibly because the method is less sensitive to variations in transducer pressure during imaging.

Multiple active contours guided by differential evolution for medical image segmentation

This paper presents a new image segmentation method based on multiple active contours guided by differential evolution, called MACDE. The segmentation method uses differential evolution over a polar coordinate system to increase the exploration and exploitation capabilities regarding the classical active contour model. To evaluate the performance of the proposed method, a set of synthetic images with complex objects, Gaussian noise, and deep concavities is introduced. Subsequently, MACDE is applied on datasets of sequential computed tomography and magnetic resonance images which contain the human heart and the human left ventricle, respectively. Finally, to obtain a quantitative and qualitative evaluation of the medical image segmentations compared to regions outlined by experts, a set of distance and similarity metrics has been adopted. According to the experimental results, MACDE outperforms the classical active contour model and the interactive Tseng method in terms of efficiency and robustness for obtaining the optimal control points and attains a high accuracy segmentation.

Interactive contour delineation and refinement in treatment planning of image-guided radiation therapy

The accurate contour delineation of the target and/or organs at risk (OAR) is essential in treatment planning for image-guided radiation therapy (IGRT). Although many automatic contour delineation approaches have been proposed, few of them can fulfill the necessities of applications in terms of accuracy and efficiency. Moreover, clinicians would like to analyze the characteristics of regions of interests (ROI) and adjust contours manually during IGRT. Interactive tool for contour delineation is necessary in such cases. In this work, a novel approach of curve fitting for interactive contour delineation is proposed. It allows users to quickly improve contours by a simple mouse click. Initially, a region which contains interesting object is selected in the image, then the program can automatically select important control points from the region boundary, and the method of Hermite cubic curves is used to fit the control points. Hence, the optimized curve can be revised by moving its control points interactively. Meanwhile, several curve fitting methods are presented for the comparison. Finally, in order to improve the accuracy of contour delineation, the process of the curve refinement based on the maximum gradient magnitude is proposed. All the points on the curve are revised automatically towards the positions with maximum gradient magnitude. Experimental results show that Hermite cubic curves and the curve refinement based on the maximum gradient magnitude possess superior performance on the proposed platform in terms of accuracy, robustness, and time calculation. Experimental results of real medical images demonstrate the efficiency, accuracy, and robustness of the proposed process in clinical applications.

Interactive medical image segmentation using snake and multiscale curve editing

Image segmentation is typically applied to locate objects and boundaries, and it is an essential process that supports medical diagnosis, surgical planning, and treatments in medical applications. Generally, this process is done by clinicians manually, which may be accurate but tedious and very time consuming. To facilitate the process, numerous interactive segmentation methods have been proposed that allow the user to intervene in the process of segmentation by incorporating prior knowledge, validating results and correcting errors. The accurate segmentation results can potentially be obtained by such user-interactive process. In this work, we propose a novel framework of interactive medical image segmentation for clinical applications, which combines digital curves and the active contour model to obtain promising results. It allows clinicians to quickly revise or improve contours by simple mouse actions. Meanwhile, the snake model becomes feasible and practical in clinical applications. Experimental results demonstrate the effectiveness of the proposed method for medical images in clinical applications.

Unsupervised cardiac image segmentation via multiswarm active contours with a shape prior

This paper presents a new unsupervised image segmentation method based on particle swarm optimization and scaled active contours with shape prior. The proposed method uses particle swarm optimization over a polar coordinate system to perform the segmentation task, increasing the searching capability on medical images with respect to different interactive segmentation techniques. This method is used to segment the human heart and ventricular areas from datasets of computed tomography and magnetic resonance images, where the shape prior is acquired by cardiologists, and it is utilized as the initial active contour. Moreover, to assess the performance of the cardiac medical image segmentations obtained by the proposed method and by the interactive techniques regarding the regions delineated by experts, a set of validation metrics has been adopted. The experimental results are promising and suggest that the proposed method is capable of segmenting human heart and ventricular areas accurately, which can significantly help cardiologists in clinical decision support.

Standardized evaluation methodology and reference database for evaluating IVUS image segmentation

This paper describes an evaluation framework that allows a standardized and quantitative comparison of IVUS lumen and media segmentation algorithms. This framework has been introduced at the MICCAI 2011 Computing and Visualization for (Intra)Vascular Imaging (CVII) workshop, comparing the results of eight teams that participated. We describe the available data-base comprising of multi-center, multi-vendor and multi-frequency IVUS datasets, their acquisition, the creation of the reference standard and the evaluation measures. The approaches address segmentation of the lumen, the media, or both borders; semi- or fully-automatic operation; and 2-D vs. 3-D methodology. Three performance measures for quantitative analysis have been proposed. The results of the evaluation indicate that segmentation of the vessel lumen and media is possible with an accuracy that is comparable to manual annotation when semi-automatic methods are used, as well as encouraging results can be obtained also in case of fully-automatic segmentation. The analysis performed in this paper also highlights the challenges in IVUS segmentation that remains to be solved.

Multiple active contours driven by particle swarm optimization for cardiac medical image segmentation

This paper presents a novel image segmentation method based on multiple active contours driven by particle swarm optimization (MACPSO). The proposed method uses particle swarm optimization over a polar coordinate system to increase the energy-minimizing capability with respect to the traditional active contour model. In the first stage, to evaluate the robustness of the proposed method, a set of synthetic images containing objects with several concavities and Gaussian noise is presented. Subsequently, MACPSO is used to segment the human heart and the human left ventricle from datasets of sequential computed tomography and magnetic resonance images, respectively. Finally, to assess the performance of the medical image segmentations with respect to regions outlined by experts and by the graph cut method objectively and quantifiably, a set of distance and similarity metrics has been adopted. The experimental results demonstrate that MACPSO outperforms the traditional active contour model in terms of segmentation accuracy and stability.

Automated segmentation of transcranial sonographic images in the diagnostics of Parkinson's disease

Images captured during routine clinical transcranial sonography (TCS) examination are of a low resolution, so can be confusing for diagnostic evaluations. Manual segmentation of brain structures (areas of the midbrain and substantia nigra (SN)) that are of special interest cause inter-observer and intra-observer variability, thus restricting the reliability of Parkinson disease (PD) diagnostics. This paper presents a new technique for automated segmentation applicable to low resolution sonographic images, and particularly to brain structures related to PD. The segmentation was performed by a modified shape-based active contour (AC) segmentation algorithm. In order to suppress the speckle noise and to improve the AC segmentation, a pre-processing technique based on the averaging of adjusted spatially varying TCS images is proposed. The latter technique was tested on clinical TCS images. The results of the automated segmentation were compared with the manual markings. Two experts on the 40TCS images performed these markings. The comparison showed that an automated method is effective when segmentation of the midbrain is performed (averaged overlap between regions obtained automatically and outlined manually was 73.10±7.45%). The results of the segmentation of the SN area showed that a sufficiently correct contour of this area could also be obtained, but the accuracy of the segmentation is related to the image quality. It should be emphasised that the main difficulty in evaluating the accuracy of automated segmentation of the SN was the indefinite "gold standard" (variation between the measurements of two experts with different experience was found). And, therefore, the diagnostic reliability of the proposed technique was inconclusive.

A robust graph-based segmentation method for breast tumors in ultrasound images

OBJECTIVES

This paper introduces a new graph-based method for segmenting breast tumors in US images.

BACKGROUND AND MOTIVATION

Segmentation for breast tumors in ultrasound (US) images is crucial for computer-aided diagnosis system, but it has always been a difficult task due to the defects inherent in the US images, such as speckles and low contrast.

METHODS

The proposed segmentation algorithm constructed a graph using improved neighborhood models. In addition, taking advantages of local statistics, a new pair-wise region comparison predicate that was insensitive to noises was proposed to determine the mergence of any two of adjacent subregions.

RESULTS AND CONCLUSION

Experimental results have shown that the proposed method could improve the segmentation accuracy by 1.5-5.6% in comparison with three often used segmentation methods, and should be capable of segmenting breast tumors in US images.