Characterization of coronary plaque regions in intravascular ultrasound images using a hybrid ensemble classifier

Deep Learning Paradigm and Its Bias for Coronary Artery Wall Segmentation in Intravascular Ultrasound Scans: A Closer Look

BACKGROUND AND MOTIVATION

Coronary artery disease (CAD) has the highest mortality rate; therefore, its diagnosis is vital. Intravascular ultrasound (IVUS) is a high-resolution imaging solution that can image coronary arteries, but the diagnosis software via wall segmentation and quantification has been evolving. In this study, a deep learning (DL) paradigm was explored along with its bias.

METHODS

Using a PRISMA model, 145 best UNet-based and non-UNet-based methods for wall segmentation were selected and analyzed for their characteristics and scientific and clinical validation. This study computed the coronary wall thickness by estimating the inner and outer borders of the coronary artery IVUS cross-sectional scans. Further, the review explored the bias in the DL system for the first time when it comes to wall segmentation in IVUS scans. Three bias methods, namely (i) ranking, (ii) radial, and (iii) regional area, were applied and compared using a Venn diagram. Finally, the study presented explainable AI (XAI) paradigms in the DL framework.

FINDINGS AND CONCLUSIONS

UNet provides a powerful paradigm for the segmentation of coronary walls in IVUS scans due to its ability to extract automated features at different scales in encoders, reconstruct the segmented image using decoders, and embed the variants in skip connections. Most of the research was hampered by a lack of motivation for XAI and pruned AI (PAI) models. None of the UNet models met the criteria for bias-free design. For clinical assessment and settings, it is necessary to move from a paper-to-practice approach.

Recent Trends in Artificial Intelligence-Assisted Coronary Atherosclerotic Plaque Characterization

Coronary artery disease is a major cause of morbidity and mortality worldwide. Its underlying histopathology is the atherosclerotic plaque, which comprises lipid, fibrous and—when chronic—calcium components. Intravascular ultrasound (IVUS) and intravascular optical coherence tomography (IVOCT) performed during invasive coronary angiography are reference standards for characterizing the atherosclerotic plaque. Fine image spatial resolution attainable with contemporary coronary computed tomographic angiography (CCTA) has enabled noninvasive plaque assessment, including identifying features associated with vulnerable plaques known to presage acute coronary events. Manual interpretation of IVUS, IVOCT and CCTA images demands scarce physician expertise and high time cost. This has motivated recent research into and development of artificial intelligence (AI)-assisted methods for image processing, feature extraction, plaque identification and characterization. We performed parallel searches of the medical and technical literature from 1995 to 2021 focusing respectively on human plaque characterization using various imaging modalities and the use of AI-assisted computer aided diagnosis (CAD) to detect and classify atherosclerotic plaques, including their composition and the presence of high-risk features denoting vulnerable plaques. A total of 122 publications were selected for evaluation and the analysis was summarized in terms of data sources, methods—machine versus deep learning—and performance metrics. Trends in AI-assisted plaque characterization are detailed and prospective research challenges discussed. Future directions for the development of accurate and efficient CAD systems to characterize plaque noninvasively using CCTA are proposed.

Extraction of media adventitia and luminal intima borders by reconstructing intravascular ultrasound image sequences with vascular structural continuity

PURPOSE

Most published methods directly achieve vessel membrane border detection on cross-sectional intravascular ultrasound (IVUS) images. The vascular structural continuity that exists in entire IVUS image sequences has been overlooked. However, this continuity can have a helpful role in the delineation of vessel membrane contours. To achieve the vessel membrane segmentation more effectively through employing this continuity, a strategy, referred to as multiangle reconstruction, segmentation, and recovery (RSR), is proposed in this paper.

METHODS

Four main steps are contained in the multiangle-RSR: first, a combination of sampling and interpolation is employed to reconstruct long-axis-model IVUS frames, in which continuity information becomes available. Second, a clustering algorithm is conducted on long-axis-model IVUS frames to roughly extract the media-adventitia (MA) and lumen-intima (LI) boundaries. Third, the segmentation results of cross-sectional IVUS frames are recovered based on the rough results of long-axis-model IVUS frames, and an optimization process that combines downsampling, fitting and smoothing is designed to reduce the interference of bifurcation and side vessels.

RESULTS

Multiangle-RSR is tested on a public dataset, and the Hausdorff distance (HD), Jaccard measure (JM), and percentage of area difference (PAD) are utilized as quantitative evaluation metrics. Mean HDs of 0.34 and 0.29 mm are obtained for MA border detection and LI border detection, respectively, which decrease by 43.3% and 9.4%, respectively, compared with their counterparts in previously published approaches. Furthermore, the mean JM is 0.87 for both MA border detection and LI border detection. The mean PADs of the MA contour extraction and the LI contour extraction are 0.10 and 0.11, respectively.

CONCLUSION

The results indicate that the proposed strategy effectively introduces vascular structural continuity by reconstructing long-axis-model IVUS frames and achieves more precise extraction of MA and LI borders.

Training and validation of a deep learning architecture for the automatic analysis of coronary angiography

BACKGROUND

In recent years, the use of deep learning has become more commonplace in the biomedical field and its development will greatly assist clinical and imaging data interpretation. Most existing machine learning methods for coronary angiography analysis are limited to a single aspect.

AIMS

We aimed to achieve an automatic and multimodal analysis to recognise and quantify coronary angiography, integrating multiple aspects, including the identification of coronary artery segments and the recognition of lesion morphology.

METHODS

A data set of 20,612 angiograms was retrospectively collected, among which 13,373 angiograms were labelled with coronary artery segments, and 7,239 were labelled with special lesion morphology. Trained and optimised by these labelled data, one network recognised 20 different segments of coronary arteries, while the other detected lesion morphology, including measures of lesion diameter stenosis as well as calcification, thrombosis, total occlusion, and dissection detections in an input angiogram.

RESULTS

For segment prediction, the recognition accuracy was 98.4%, and the recognition sensitivity was 85.2%. For detecting lesion morphologies including stenotic lesion, total occlusion, calcification, thrombosis, and dissection, the F1 scores were 0.829, 0.810, 0.802, 0.823, and 0.854, respectively. Only two seconds were needed for the automatic recognition.

CONCLUSIONS

Our deep learning architecture automatically provides a coronary diagnostic map by integrating multiple aspects. This helps cardiologists to flag and diagnose lesion severity and morphology during the intervention.

A Domain Enriched Deep Learning Approach to Classify Atherosclerosis using Intravascular Ultrasound Imaging

Intravascular ultrasound (IVUS) imaging is widely used for diagnostic imaging in interventional cardiology. The detection and quantification of atherosclerosis from acquired images is typically performed manually by medical experts or by virtual histology IVUS (VH-IVUS) software. VH-IVUS analyzes backscattered radio frequency (RF) signals to provide a color-coded tissue map, and is the method of choice for assessing atherosclerotic plaque in situ. However, a significant amount of tissue cannot be analyzed in reasonable time because the method can be applied just once per cardiac cycle. Furthermore, only hardware and software compatible with RF signal acquisition and processing may be used. We present an image-based tissue characterization method that can be applied to entire acquisition sequences post hoc for the assessment of diseased vessels. The pixel-based method utilizes domain knowledge of arterial pathology and physiology, and leverages technological advances of convolutional neural networks to segment diseased vessel walls into the same tissue classes as virtual histology using only grayscale IVUS images. The method was trained and tested on patches extracted from VH-IVUS images acquired from several patients, and achieved overall accuracy of 93.5% for all segmented tissue. Imposing physically-relevant spatial constraints driven by domain knowledge was key to achieving such strong performance. This enriched approach offers capabilities akin to VH-IVUS without the constraints of RF signals or limited once-per-cycle analysis, offering superior potential information acquisition speed, reduced hardware and software requirements, and more widespread applicability. Such an approach may well yield promise for future clinical and research applications.

Automated classification of dense calcium tissues in gray-scale intravascular ultrasound images using a deep belief network

Background

IVUS is widely used to quantitatively assess coronary artery disease. The purpose of this study was to automatically characterize dense calcium (DC) tissue in the gray scale intravascular ultrasound (IVUS) images using the image textural features.

Methods

A total of 316 Gy-scale IVUS and corresponding virtual histology images from 26 patients with acute coronary syndrome who underwent IVUS along with X-ray angiography between October 2009 to September 2014 were retrospectively acquired and analyzed. One expert performed all procedures and assessed their IVUS scans. After image acquisition, the DC candidate and corresponding acoustic shadow regions were automatically determined. Then, nine image-base feature groups were extracted from the DC candidates. In order to reduce the dimensionalities, principal component analysis (PCA) was performed, and selected feature sets were utilized as an input for a deep belief network. Classification results were validated using 10-fold cross validation.

Results

The dimensionality of the feature map was efficiently reduced by 50% (from 66 to 33) without any performance decrease using PCA method. Sensitivity, specificity, and accuracy of the proposed method were 92.8 ± 0.1%, 85.1 ± 0.1%, and 88.4 ± 0.1%, respectively (p < 0.05). We found that the window size could largely influence the characterization results, and selected the 5 × 5 size as the best condition. We also validated the performance superiority of the proposed method with traditional classification methods.

Conclusions

These experimental results suggest that the proposed method has significant clinical applicability for IVUS-based cardiovascular diagnosis.

Lumen-intima and media-adventitia segmentation in IVUS images using supervised classifications of arterial layers and morphological structures

BACKGROUND

Intravascular ultrasound (IVUS) provides axial grey-scale images of blood vessels. The large number of images require automatic analysis, specifically to identify the lumen and outer vessel wall. However, the high amount of noise, the presence of artifacts and anatomical structures, such as bifurcations, calcifications and fibrotic plaques, usually hinder the proper automatic segmentation of the vessel wall.

METHODS

Lumen, media, adventitia and surrounding tissues are automatically detected using Support Vector Machines (SVMs). The classification performance of the SVMs vary according to the kind of structure present within each region of the image. Random Forest (RF) is used to detect different morphological structures and to modify the initial layer classification depending on the detected structure. The resulting classification maps are fed into a segmentation method based on deformable contours to detect lumen-intima (LI) and media-adventitia (MA) interfaces.

RESULTS

The modifications in the layer classifications according to the presence of structures proved to be effective improving LI and MA segmentations. The proposed method reaches a Jaccard Measure (JM) of 0.88 ± 0.08 for LI segmentation, compared with 0.88 ± 0.05 of a semiautomatic method. When looking at MA, our method reaches a JM of 0.84 ± 0.09, and outperforms previous automatic methods in terms of HD, with 0.51mm ± 0.30.

CONCLUSIONS

A simple modification to the arterial layer classification produces results that match and improve state-of-the-art fully-automatic segmentation methods for LI and MA in 20MHz IVUS images. For LI segmentation, the proposed automatic method performs accurately as semi-automatic methods. For MA segmentation, our method matched the quality of state-of-the-art automatic methods described in the literature. Furthermore, our implementation is modular and open-source, allowing for future extensions and improvements.

Chronic Liver Disease Classification Using Hybrid Whale Optimization with Simulated Annealing and Ensemble Classifier

Chronic liver disease (CLD), which indicates the inflammatory condition of the liver, leads to cirrhosis or even partial or total liver dysfunction when left untreated. A non-invasive approach for evaluating CLD with computed tomography (CT) images is proposed using an ensemble of classifiers. To accurately classify CLD, the hybrid whale optimization algorithm with simulated annealing (WOA-SA) is used in selecting an optimal set of features. The proposed method employs seven sets of features with a total of 73–3D (three-dimensional) texture features. A hybrid ensemble classifier with support vector machine (SVM), k—Nearest Neighbor (k-NN), and random forest (RF) classifiers are used to classify liver diseases. Experimental analysis is performed on clinical CT images datasets, which include normal liver, fatty liver, metastasis, cirrhosis, and cancerous samples. The optimal features selected using the WOA-SA improve the accuracy of CLD classification for the five classes of diseases mentioned above. The accuracy of the liver classification using ensemble classifier yields approximately 98% with a 95% confidence interval (CI) of (0.7789, 1.0000) and an error rate of 1.9%. The performance of the proposed method is compared with two existing algorithms and the sensitivity and specificity yield an overall average of 96% and 93%, with 95% confidence interval of (0.7513, 1.0000) and (0.7126, 1.0000), respectively. Classification of CLD based on ensemble classifier illustrates the effectiveness of the proposed method and the comparison analysis demonstrates the superiority of the methodology.

Minimal ensemble based on subset selection using ECG to diagnose categories of CAN

BACKGROUND AND OBJECTIVE

Early diagnosis of cardiac autonomic neuropathy (CAN) is critical for reversing or decreasing its progression and prevent complications. Diagnostic accuracy or precision is one of the core requirements of CAN detection. As the standard Ewing battery tests suffer from a number of shortcomings, research in automating and improving the early detection of CAN has recently received serious attention in identifying additional clinical variables and designing advanced ensembles of classifiers to improve the accuracy or precision of CAN diagnostics. Although large ensembles are commonly proposed for the automated diagnosis of CAN, large ensembles are characterized by slow processing speed and computational complexity. This paper applies ECG features and proposes a new ensemble-based approach for diagnosis of CAN progression.

METHODS

We introduce a Minimal Ensemble Based On Subset Selection (MEBOSS) for the diagnosis of all categories of CAN including early, definite and atypical CAN. MEBOSS is based on a novel multi-tier architecture applying classifier subset selection as well as the training subset selection during several steps of its operation. Our experiments determined the diagnostic accuracy or precision obtained in 5 × 2 cross-validation for various options employed in MEBOSS and other classification systems.

RESULTS

The experiments demonstrate the operation of the MEBOSS procedure invoking the most effective classifiers available in the open source software environment SageMath. The results of our experiments show that for the large DiabHealth database of CAN related parameters MEBOSS outperformed other classification systems available in SageMath and achieved 94% to 97% precision in 5 × 2 cross-validation correctly distinguishing any two CAN categories to a maximum of five categorizations including control, early, definite, severe and atypical CAN.

CONCLUSIONS

These results show that MEBOSS architecture is effective and can be recommended for practical implementations in systems for the diagnosis of CAN progression.