A Computationally Efficient Approach to Segmentation of the Aorta and Coronary Arteries Using Deep Learning

Automatic 3D Segmentation and Identification of Anomalous Aortic Origin of the Coronary Arteries Combining Multi-view 2D Convolutional Neural Networks

This work aimed to automatically segment and classify the coronary arteries with either normal or anomalous origin from the aorta (AAOCA) using convolutional neural networks (CNNs), seeking to enhance and fasten clinician diagnosis. We implemented three single-view 2D Attention U-Nets with 3D view integration and trained them to automatically segment the aortic root and coronary arteries of 124 computed tomography angiographies (CTAs), with normal coronaries or AAOCA. Furthermore, we automatically classified the segmented geometries as normal or AAOCA using a decision tree model. For CTAs in the test set (n = 13), we obtained median Dice score coefficients of 0.95 and 0.84 for the aortic root and the coronary arteries, respectively. Moreover, the classification between normal and AAOCA showed excellent performance with accuracy, precision, and recall all equal to 1 in the test set. We developed a deep learning-based method to automatically segment and classify normal coronary and AAOCA. Our results represent a step towards an automatic screening and risk profiling of patients with AAOCA, based on CTA.

Automatic thoracic aorta calcium quantification using deep learning in non-contrast ECG-gated CT images

Thoracic aorta calcium (TAC) can be assessed from cardiac computed tomography (CT) studies to improve cardiovascular risk prediction. The aim of this study was to develop a fully automatic system to detect TAC and to evaluate its performance for classifying the patients into four TAC risk categories. The method started by segmenting the thoracic aorta, combining three UNets trained with axial, sagittal and coronal CT images. Afterwards, the surrounding lesion candidates were classified using three combined convolutional neural networks (CNNs) trained with orthogonal patches. Image datasets included 1190 non-enhanced ECG-gated cardiac CT studies from a cohort of cardiovascular patients (age 57 ± 9 years, 80% men, 65% TAC > 0). In the test set (N = 119), the combination of UNets was able to successfully segment the thoracic aorta with a mean volume difference of 0.3 ± 11.7 ml (<6%) and a median Dice coefficient of 0.947. The combined CNNs accurately classified the lesion candidates and 87% of the patients (N = 104) were accurately placed in their corresponding risk categories (Kappa = 0.826, ICC = 0.9915). TAC measurement can be estimated automatically from cardiac CT images using UNets to isolate the thoracic aorta and CNNs to classify calcified lesions.

Automatic Detection and Classification of Hypertensive Retinopathy with Improved Convolution Neural Network and Improved SVM

Hypertensive retinopathy (HR) results from the microvascular retinal changes triggered by hypertension, which is the most common leading cause of preventable blindness worldwide. Therefore, it is necessary to develop an automated system for HR detection and evaluation using retinal images. We aimed to propose an automated approach to identify and categorize the various degrees of HR severity. A new network called the spatial convolution module (SCM) combines cross-channel and spatial information, and the convolution operations extract helpful features. The present model is evaluated using publicly accessible datasets ODIR, INSPIREVR, and VICAVR. We applied the augmentation to artificially increase the dataset of 1200 fundus images. The different HR severity levels of normal, mild, moderate, severe, and malignant are finally classified with the reduced time when compared to the existing models because in the proposed model, convolutional layers run only once on the input fundus images, which leads to a speedup and reduces the processing time in detecting the abnormalities in the vascular structure. According to the findings, the improved SVM had the highest detection and classification accuracy rate in the vessel classification with an accuracy of 98.99% and completed the task in 160.4 s. The ten-fold classification achieved the highest accuracy of 98.99%, i.e., 0.27 higher than the five-fold classification accuracy and the improved KNN classifier achieved an accuracy of 98.72%. When computation efficiency is a priority, the proposed model's ability to quickly recognize different HR severity levels is significant.

Deep Learning Paradigm and Its Bias for Coronary Artery Wall Segmentation in Intravascular Ultrasound Scans: A Closer Look

BACKGROUND AND MOTIVATION

Coronary artery disease (CAD) has the highest mortality rate; therefore, its diagnosis is vital. Intravascular ultrasound (IVUS) is a high-resolution imaging solution that can image coronary arteries, but the diagnosis software via wall segmentation and quantification has been evolving. In this study, a deep learning (DL) paradigm was explored along with its bias.

METHODS

Using a PRISMA model, 145 best UNet-based and non-UNet-based methods for wall segmentation were selected and analyzed for their characteristics and scientific and clinical validation. This study computed the coronary wall thickness by estimating the inner and outer borders of the coronary artery IVUS cross-sectional scans. Further, the review explored the bias in the DL system for the first time when it comes to wall segmentation in IVUS scans. Three bias methods, namely (i) ranking, (ii) radial, and (iii) regional area, were applied and compared using a Venn diagram. Finally, the study presented explainable AI (XAI) paradigms in the DL framework.

FINDINGS AND CONCLUSIONS

UNet provides a powerful paradigm for the segmentation of coronary walls in IVUS scans due to its ability to extract automated features at different scales in encoders, reconstruct the segmented image using decoders, and embed the variants in skip connections. Most of the research was hampered by a lack of motivation for XAI and pruned AI (PAI) models. None of the UNet models met the criteria for bias-free design. For clinical assessment and settings, it is necessary to move from a paper-to-practice approach.

ImageCAS: A large-scale dataset and benchmark for coronary artery segmentation based on computed tomography angiography images

Cardiovascular disease (CVD) accounts for about half of non-communicable diseases. Vessel stenosis in the coronary artery is considered to be the major risk of CVD. Computed tomography angiography (CTA) is one of the widely used noninvasive imaging modalities in coronary artery diagnosis due to its superior image resolution. Clinically, segmentation of coronary arteries is essential for the diagnosis and quantification of coronary artery disease. Recently, a variety of works have been proposed to address this problem. However, on one hand, most works rely on in-house datasets, and only a few works published their datasets to the public which only contain tens of images. On the other hand, their source code have not been published, and most follow-up works have not made comparison with existing works, which makes it difficult to judge the effectiveness of the methods and hinders the further exploration of this challenging yet critical problem in the community. In this paper, we propose a large-scale dataset for coronary artery segmentation on CTA images. In addition, we have implemented a benchmark in which we have tried our best to implement several typical existing methods. Furthermore, we propose a strong baseline method which combines multi-scale patch fusion and two-stage processing to extract the details of vessels. Comprehensive experiments show that the proposed method achieves better performance than existing works on the proposed large-scale dataset. The benchmark and the dataset are published at https://github.com/XiaoweiXu/ImageCAS-A-Large-Scale-Dataset-and-Benchmark-for-Coronary-Artery-Segmentation-based-on-CT.

Automatic prediction of acute coronary syndrome based on pericoronary adipose tissue and atherosclerotic plaques

Cardiovascular disease is the leading cause of human death worldwide, and acute coronary syndrome (ACS) is a common first manifestation of this. Studies have shown that pericoronary adipose tissue (PCAT) computed tomography (CT) attenuation and atherosclerotic plaque characteristics can be used to predict future adverse ACS events. However, radiomics-based methods have limitations in extracting features of PCAT and atherosclerotic plaques. Therefore, we propose a hybrid deep learning framework capable of extracting coronary CT angiography (CCTA) imaging features of both PCAT and atherosclerotic plaques for ACS prediction. The framework designs a two-stream CNN feature extraction (TSCFE) module to extract the features of PCAT and atherosclerotic plaques, respectively, and a channel feature fusion (CFF) to explore feature correlations between their features. Specifically, a trilinear-based fully-connected (FC) prediction module stepwise maps high-dimensional representations to low-dimensional label spaces. The framework was validated in retrospectively collected suspected coronary artery disease cases examined by CCTA. The prediction accuracy, sensitivity, specificity, and area under curve (AUC) are all higher than the classical image classification networks and state-of-the-art medical image classification methods. The experimental results show that the proposed method can effectively and accurately extract CCTA imaging features of PCAT and atherosclerotic plaques and explore the feature correlations to produce impressive performance. Thus, it has the potential value to be applied in clinical applications for accurate ACS prediction.

Latest Developments in Adapting Deep Learning for Assessing TAVR Procedures and Outcomes

Aortic valve defects are among the most prevalent clinical conditions. A severely damaged or non-functioning aortic valve is commonly replaced with a bioprosthetic heart valve (BHV) via the transcatheter aortic valve replacement (TAVR) procedure. Accurate pre-operative planning is crucial for a successful TAVR outcome. Assessment of computational fluid dynamics (CFD), finite element analysis (FEA), and fluid-solid interaction (FSI) analysis offer a solution that has been increasingly utilized to evaluate BHV mechanics and dynamics. However, the high computational costs and the complex operation of computational modeling hinder its application. Recent advancements in the deep learning (DL) domain can offer a real-time surrogate that can render hemodynamic parameters in a few seconds, thus guiding clinicians to select the optimal treatment option. Herein, we provide a comprehensive review of classical computational modeling approaches, medical imaging, and DL approaches for planning and outcome assessment of TAVR. Particularly, we focus on DL approaches in previous studies, highlighting the utilized datasets, deployed DL models, and achieved results. We emphasize the critical challenges and recommend several future directions for innovative researchers to tackle. Finally, an end-to-end smart DL framework is outlined for real-time assessment and recommendation of the best BHV design for TAVR. Ultimately, deploying such a framework in future studies will support clinicians in minimizing risks during TAVR therapy planning and will help in improving patient care.

A benchmark study of convolutional neural networks in fully automatic segmentation of aortic root

Recent clinical studies have suggested that introducing 3D patient-specific aortic root models into the pre-operative assessment procedure of transcatheter aortic valve replacement (TAVR) would reduce the incident rate of peri-operative complications. Tradition manual segmentation is labor-intensive and low-efficient, which cannot meet the clinical demands of processing large data volumes. Recent developments in machine learning provided a viable way for accurate and efficient medical image segmentation for 3D patient-specific models automatically. This study quantitively evaluated the auto segmentation quality and efficiency of the four popular segmentation-dedicated three-dimensional (3D) convolutional neural network (CNN) architectures, including 3D UNet, VNet, 3D Res-UNet and SegResNet. All the CNNs were implemented in PyTorch platform, and low-dose CTA image sets of 98 anonymized patients were retrospectively selected from the database for training and testing of the CNNs. The results showed that despite all four 3D CNNs having similar recall, Dice similarity coefficient (DSC), and Jaccard index on the segmentation of the aortic root, the Hausdorff distance (HD) of the segmentation results from 3D Res-UNet is 8.56 ± 2.28, which is only 9.8% higher than that of VNet, but 25.5% and 86.4% lower than that of 3D UNet and SegResNet, respectively. In addition, 3D Res-UNet and VNet also performed better in the 3D deviation location of interest analysis focusing on the aortic valve and the bottom of the aortic root. Although 3D Res-UNet and VNet are evenly matched in the aspect of classical segmentation quality evaluation metrics and 3D deviation location of interest analysis, 3D Res-UNet is the most efficient CNN architecture with an average segmentation time of 0.10 ± 0.04 s, which is 91.2%, 95.3% and 64.3% faster than 3D UNet, VNet and SegResNet, respectively. The results from this study suggested that 3D Res-UNet is a suitable candidate for accurate and fast automatic aortic root segmentation for pre-operative assessment of TAVR.

A U-Shaped Network Based on Multi-level Feature and Dual-Attention Coordination Mechanism for Coronary Artery Segmentation of CCTA Images

PURPOSE

Computed tomography coronary angiography (CCTA) images provide optimal visualization of coronary arteries to aid in diagnosing coronary heart disease (CHD). With the deep convolutional neural network, this work aims to develop an intelligent and lightweight coronary artery segmentation algorithm that can be deployed in hospital systems to assist clinicians in quantitatively analyzing CHD.

METHODS

With the multi-level feature fusion, we proposed Dual-Attention Coordination U-Net (DAC-UNet) that achieves automated coronary artery segmentation in 2D CCTA images. The coronary artery occupies a small region, and the foreground and background are extremely unbalanced. For this reason, the more original information can be retained by fusing related features between adjacent layers, which is conducive to recovering the small coronary artery area. The dual-attention coordination mechanism can select valid information and filter redundant information. Moreover, the complementation and coordination of double attention factors can enhance the integrity of features of coronary arteries, reduce the interference of non-coronary arteries, and prevent over-learning. With gradual learning, the balanced character of double attention factors promotes the generalization ability of the model to enhance coronary artery localization and contour detail segmentation.

RESULTS

Compared with existing related segmentation methods, our method achieves a certain degree of improvement in 2D CCTA images for the segmentation accuracy of coronary arteries with a mean Dice index of 0.7920. Furthermore, the method can obtain relatively accurate results even in a small sample dataset and is easy to implement and deploy, which is promising. The code is available at: https://github.com/windfly666/Segmentation .

CONCLUSION

Our method can capture the coronary artery structure end-to-end, which can be used as a fundamental means for automatic detection of coronary artery stenosis, blood flow reserve fraction analysis, and assisting clinicians in diagnosing CHD.

Review of Semantic Segmentation of Medical Images Using Modified Architectures of UNET

In biomedical image analysis, information about the location and appearance of tumors and lesions is indispensable to aid doctors in treating and identifying the severity of diseases. Therefore, it is essential to segment the tumors and lesions. MRI, CT, PET, ultrasound, and X-ray are the different imaging systems to obtain this information. The well-known semantic segmentation technique is used in medical image analysis to identify and label regions of images. The semantic segmentation aims to divide the images into regions with comparable characteristics, including intensity, homogeneity, and texture. UNET is the deep learning network that segments the critical features. However, UNETs basic architecture cannot accurately segment complex MRI images. This review introduces the modified and improved models of UNET suitable for increasing segmentation accuracy.

Detecting Coronary Artery Disease from Computed Tomography Images Using a Deep Learning Technique

In recent times, coronary artery disease (CAD) has become one of the leading causes of morbidity and mortality across the globe. Diagnosing the presence and severity of CAD in individuals is essential for choosing the best course of treatment. Presently, computed tomography (CT) provides high spatial resolution images of the heart and coronary arteries in a short period. On the other hand, there are many challenges in analyzing cardiac CT scans for signs of CAD. Research studies apply machine learning (ML) for high accuracy and consistent performance to overcome the limitations. It allows excellent visualization of the coronary arteries with high spatial resolution. Convolutional neural networks (CNN) are widely applied in medical image processing to identify diseases. However, there is a demand for efficient feature extraction to enhance the performance of ML techniques. The feature extraction process is one of the factors in improving ML techniques’ efficiency. Thus, the study intends to develop a method to detect CAD from CT angiography images. It proposes a feature extraction method and a CNN model for detecting the CAD in minimum time with optimal accuracy. Two datasets are utilized to evaluate the performance of the proposed model. The present work is unique in applying a feature extraction model with CNN for CAD detection. The experimental analysis shows that the proposed method achieves 99.2% and 98.73% prediction accuracy, with F1 scores of 98.95 and 98.82 for benchmark datasets. In addition, the outcome suggests that the proposed CNN model achieves the area under the receiver operating characteristic and precision-recall curve of 0.92 and 0.96, 0.91 and 0.90 for datasets 1 and 2, respectively. The findings highlight that the performance of the proposed feature extraction and CNN model is superior to the existing models.

Automated Identification of Coronary Arteries in Assisting Inexperienced Readers: Comparison between Two Commercial Vendors

Background: to assess the performance and speed of two commercially available advanced cardiac software packages in the automated identification of coronary vessels as an aiding tool for inexperienced readers. Methods: Hundred and sixty patients undergoing coronary CT angiography (CCTA) were prospectively enrolled from February until September 2021 and randomized in two groups, each one composed by 80 patients. Patients in group 1 were scanned on Revolution EVO CT Scanner (GE Healthcare), while patients in group 2 had the CCTA performed on Brilliance iCT (Philips Healthcare); each examination was evaluated on the respective vendor proprietary advanced cardiac software (software 1 and 2, respectively). Two inexperienced readers in cardiac imaging verified the software performance in the automated identification of the three major coronary vessels: (RCA, LCx, and LAD) and in the number of identified coronary segments. Time of analysis was also recorded. Results: software 1 correctly and automatically nominated 202/240 (84.2%) of the three main coronary vessels, while software 2 correctly identified 191/240 (79.6%) (p = 0.191). Software 1 achieved greater performances in recognizing the LCx (81.2% versus 67.5%; p = 0.048), while no differences have been reported in detecting the RCA (p = 0.679), and the LAD (p = 0.618). On a per-segment analysis, software 1 outperformed software 2, automatically detecting 942/1062 (88.7%) coronary segments, while software 2 detected 797/1078 (73.9%) (p < 0.001). Average reconstruction and detection time was of 13.8 s for software 1 and 21.9 s for software 2 (p < 0.001). Conclusions: automated cardiac software packages are a reliable and time-saving tool for inexperienced reader. Software 1 outperforms software 2 and might therefore better assist inexperienced CCTA readers in automated identification of the three main vessels and coronaries segments, with a consistent time saving of the reading session.