A robust coronary artery identification and centerline extraction method in angiographies

HAGMN-UQ: Hyper association graph matching network with uncertainty quantification for coronary artery semantic labeling

Coronary artery disease (CAD) is one of the leading causes of death worldwide. Accurate extraction of individual arterial branches from invasive coronary angiograms (ICA) is critical for CAD diagnosis and detection of stenosis. Generating semantic segmentation for coronary arteries through deep learning-based models presents challenges due to the morphological similarity among different types of coronary arteries, making it difficult to maintain high accuracy while keeping low computational complexity. To address this challenge, we propose an innovative approach using the hyper association graph-matching neural network with uncertainty quantification (HAGMN-UQ) for coronary artery semantic labeling on ICAs. The graph-matching procedure maps the arterial branches between two individual graphs, so that the unlabeled arterial segments are classified by the labeled segments, and the coronary artery semantic labeling is achieved. Leveraging hypergraphs not only extends representation capabilities beyond pairwise relationships, but also improves the robustness and accuracy of the graph matching by enabling the modeling of higher-order associations. In addition, employing the uncertainty quantification to determine the trustworthiness of graph matching reduces the required number of comparisons, so as to accelerate the inference speed. Consequently, our model achieved an accuracy of 0.9211 for coronary artery semantic labeling with a fast inference speed, leading to an effective and efficient prediction in real-time clinical decision-making scenarios.

AGMN: Association Graph-based Graph Matching Network for Coronary Artery Semantic Labeling on Invasive Coronary Angiograms

Semantic labeling of coronary arterial segments in invasive coronary angiography (ICA) is important for automated assessment and report generation of coronary artery stenosis in computer-aided coronary artery disease (CAD) diagnosis. However, separating and identifying individual coronary arterial segments is challenging because morphological similarities of different branches on the coronary arterial tree and human-to-human variabilities exist. Inspired by the training procedure of interventional cardiologists for interpreting the structure of coronary arteries, we propose an association graph-based graph matching network (AGMN) for coronary arterial semantic labeling. We first extract the vascular tree from invasive coronary angiography (ICA) and convert it into multiple individual graphs. Then, an association graph is constructed from two individual graphs where each vertex represents the relationship between two arterial segments. Thus, we convert the arterial segment labeling task into a vertex classification task; ultimately, the semantic artery labeling becomes equivalent to identifying the artery-to-artery correspondence on graphs. More specifically, the AGMN extracts the vertex features by the embedding module using the association graph, aggregates the features from adjacent vertices and edges by graph convolution network, and decodes the features to generate the semantic mappings between arteries. By learning the mapping of arterial branches between two individual graphs, the unlabeled arterial segments are classified by the labeled segments to achieve semantic labeling. A dataset containing 263 ICAs was employed to train and validate the proposed model, and a five-fold cross-validation scheme was performed. Our AGMN model achieved an average accuracy of 0.8264, an average precision of 0.8276, an average recall of 0.8264, and an average F1-score of 0.8262, which significantly outperformed existing coronary artery semantic labeling methods. In conclusion, we have developed and validated a new algorithm with high accuracy, interpretability, and robustness for coronary artery semantic labeling on ICAs.

EAGMN: Coronary artery semantic labeling using edge attention graph matching network

Coronary artery disease (CAD) is one of the primary causes leading deaths worldwide. The presence of atherosclerotic lesions in coronary arteries is the underlying pathophysiological basis of CAD, and accurate extraction of individual arterial branches using invasive coronary angiography (ICA) is crucial for stenosis detection and CAD diagnosis. However, deep-learning-based models face challenges in generating semantic segmentation for coronary arteries due to the morphological similarity among different types of arteries. To address this challenge, we propose an innovative approach called the Edge Attention Graph Matching Network (EAGMN) for coronary artery semantic labeling. Inspired by the learning process of interventional cardiologists in interpreting ICA images, our model compares arterial branches between two individual graphs generated from different ICAs. We begin with extracting individual graphs based on the vascular tree obtained from the ICA. Each node in the individual graph represents an arterial segment, and the EAGMN aims to learn the similarity between nodes from the two individual graphs. By converting the coronary artery semantic segmentation task into a graph node similarity comparison task, identifying the node-to-node correspondence would assign semantic labels for each arterial branch. More specifically, the EAGMN utilizes the association graph constructed from the two individual graphs as input. A graph attention module is employed for feature embedding and aggregation, while a decoder generates the linear assignment for node-to-node semantic mapping. Based on the learned node-to-node relationships, unlabeled coronary arterial segments are classified using the labeled coronary arterial segments, thereby achieving semantic labeling. A dataset with 263 labeled ICAs is used to train and validate the EAGMN. Experimental results indicate the EAGMN achieved a weighted accuracy of 0.8653, a weighted precision of 0.8656, a weighted recall of 0.8653 and a weighted F1-score of 0.8643. Furthermore, we employ ZORRO to provide interpretability and explainability of the graph matching for artery semantic labeling. These findings highlight the potential of the EAGMN for accurate and efficient coronary artery semantic labeling using ICAs. By leveraging the inherent characteristics of ICAs and incorporating graph matching techniques, our proposed model provides a promising solution for improving CAD diagnosis and treatment.

A framework of myocardial bridge detection with x-ray angiography sequence

BACKGROUND

Myocardial bridges are congenital anatomical abnormalities in which myocardium covers a segment of coronary arteries, leading to stenocardia, myocardial ischemia, and sudden cardiac death in severe cases. However, automatic diagnosis of myocardial bridge presents significant challenges.

METHOD

A novel framework of myocardial bridge detection with x-ray angiography sequence is proposed, which can realize automatic detection of vessel stenosis and myocardial bridge. Firstly, we employ a novel neural network model for coronary vessel segmentation, which consists of both CNNs and transformer structures to effectively extract both local and global information of the vessels. Secondly, we describe the vessel segment information, establish the vessel tree in the image, and fuse the vessel tree information between sequences. Finally, based on vessel stenosis detection, we realize automatic detection of the myocardial bridge by querying the blood vessels between the image sequence information.

RESULTS

In experiment, we evaluate the segmentation results using two metrics, Dice and ASD, and achieve scores of 0.917 and 1.39, respectively. In the stenosis detection, we achieve an average accuracy rate of 92.7% in stenosis detection among 262 stenoses. In multi-frame image processing, vessels in different frames can be well-matched, and the accuracy of myocardial bridge detection achieves 75%.

CONCLUSIONS

Our experimental results demonstrate that the algorithm can automatically detect stenosis and myocardial bridge, providing a new idea for subsequent automatic diagnosis of coronary vessels.

Prior skeleton based online deep reinforcement learning for coronary artery centerline extraction

Coronary centerline extraction is an essential technique for X-ray coronary angiography (XCA) image analysis, which provides qualitative and quantitative guidance for percutaneous coronary intervention (PCI). In this paper, an online deep reinforcement learning method for coronary centerline extraction is proposed based on the prior vascular skeleton. Firstly, with XCA image preprocessing (foreground extraction and vessel segmentation) results, the improved ZhangSuen image thinning algorithm is used to rapidly extract the preliminary vascular skeleton network. On this basis, according to the spatial-temporal and morphological continuity of the angiography image sequence, the connectivity of different branches is determined using k-means clustering, and the vessel segments are then grouped, screened, and reconnected to obtain the aorta and its major branches. Finally, using the previous results as prior information, an online Deep Q-Network (DQN) reinforcement learning method is proposed to optimize each branch simultaneously. It comprehensively considers grayscale intensity and eigenvector continuity to achieve the combination of data-driven and model-driven without pre-training. Experimental results on clinical images and the third-party dataset demonstrate that the proposed method can accurately extract, restructure, and optimize the centerline of XCA images with a higher overall accuracy than the existing state-of-the-art methods.

Predictors of Non-Obstructive Coronary Artery Disease in Patients Undergoing Elective Coronary Angiography

Background

Appropriate patient selection for coronary angiography (CAG) is essential to minimize the unnecessary risk of morbidities and exposure to radiation and iodinated contrast. This becomes even more relevant in low-to-middle-income settings where most health expenditures are out-of-pocket due to lack of medical insurance. We determined predictors of non-obstructive coronaries (NOC) in patients undergoing elective CAG.

Methods

CathPCI Registry®, single-center data was extracted for 25,472 patients who had CAG over an eight year period. After excluding patients for compelling conditions or known CAD, 2,984 (11.7%) patients were included in this study. Non-Obstructive Coronaries was defined as <50% left main coronary artery and major epicardial vessel stenosis. Multiple Cox proportional algorithm was employed to report prevalence ratios (PR) of predictors of NOC along with 95% confidence interval.

Results

Mean age of patients was 57.9 ± 9.7 years, 23.5% were women. Preprocedural non-invasive testing (NIT) was performed in 46% of the patients; of which 95.5% reported to be positive but only 67.3% were stratified as high risk. Of 2,984 patients undergoing elective CAG, 711 (24%) had NOC. Predictors of NOC included younger age <50 years (PR: 1.3, CI: 1.0-1.5), Women (1.8, 1.5-2.1), low (1.9, 1.5-2.5) and intermediate risk stratification (1.3, 1.0-1.6) on Modified Framingham Risk Score and inappropriate (2.7, 1.6-4.3) and uncertain (1.3, 1.1-1.6) classification of CAG on Appropriate Use Criteria. Patients with heart failure as an indication of CAG (1.7, 1.4-2.0) and No NIT or positive low risk NIT (1.8, 1.5-2.2) were more likely to have NOC.

Conclusion

Approximately one out of four patients undergoing elective CAG had NOC. Yield of diagnostic catheterization can be improved by adjudicating NIT especially in younger patients, women, patients with heart failure as an indication of CAG, patients classified as inappropriate on Appropriate Use Criteria and patients categorized as low or intermediate risk on MFRS.

X-ray coronary centerline extraction based on C-UNet and a multifactor reconnection algorithm

BACKGROUND AND OBJECTIVE

Accurate extraction of the coronary artery centerline is crucial in the processes of coronary artery reconstruction, coronary artery stenosis or lesion detection, and surgical navigation. Furthermore, in clinical medicine, the complex background of angiography, low signal-to-noise ratio, and complex vascular structure make coronary artery centerline extraction challenging. In this study, a direct centerline extraction method is proposed that automatically and accurately extracts vascular centerlines from X-ray coronary angiography images based on deep learning and conventional methods.

METHODS

In this study, a coronary artery centerline extraction method is proposed that comprises two parts: the preliminary centerline extraction network based on U-Net with a residual network, called C-UNet, and the multifactor centerline reconnection algorithm based on the geometric characteristics of blood vessels.

RESULTS

The qualitative and quantitative results demonstrate the effectiveness of the presented method. In this study, three widely used evaluation indices were adopted to evaluate the performance of the method: precision, recall, and F1_Score. The experimental results show that this method can accurately extract coronary artery centerlines.

CONCLUSIONS

The proposed centerline extraction method accurately extracts centerlines from X-ray coronary angiography images and improves both the accuracy and continuity of centerline extraction.

Development of an approach to extracting coronary arteries and detecting stenosis in invasive coronary angiograms

Purpose: In stable coronary artery disease (CAD), reduction in mortality and/or myocardial infarction with revascularization over medical therapy has not been reliably achieved. Coronary arteries are usually extracted to perform stenosis detection. As such, developing accurate segmentation of vascular structures and quantification of coronary arterial stenosis in invasive coronary angiograms (ICA) is necessary. Approach: A multi-input and multiscale (MIMS) U-Net with a two-stage recurrent training strategy was proposed for the automatic vessel segmentation. The proposed model generated a refined prediction map with the following two training stages: (i) stage I coarsely segmented the major coronary arteries from preprocessed single-channel ICAs and generated the probability map of arteries; and (ii) during the stage II, a three-channel image consisting of the original preprocessed image, a generated probability map, and an edge-enhanced image generated from the preprocessed image was fed to the proposed MIMS U-Net to produce the final segmentation result. After segmentation, an arterial stenosis detection algorithm was developed to extract vascular centerlines and calculate arterial diameters to evaluate stenotic level. Results: Experimental results demonstrated that the proposed method achieved an average Dice similarity coefficient of 0.8329, an average sensitivity of 0.8281, and an average specificity of 0.9979 in our dataset with 294 ICAs obtained from 73 patients. Moreover, our stenosis detection algorithm achieved a true positive rate of 0.6668 and a positive predictive value of 0.7043. Conclusions: Our proposed approach has great promise for clinical use and could help physicians improve diagnosis and therapeutic decisions for CAD.

A Lightweight Network for Accurate Coronary Artery Segmentation Using X-Ray Angiograms

An accurate and automated segmentation of coronary arteries in X-ray angiograms is essential for cardiologists to diagnose coronary artery disease in clinics. The existing deep learning-based coronary arteries segmentation models focus on using complex networks to improve the accuracy of segmentation while ignoring the computational cost. However, performing such segmentation networks requires a high-performance device with a powerful GPU and a high bandwidth memory. To address this issue, in this study, a lightweight deep learning network is developed for a better balance between computational cost and segmentation accuracy. We have made two efforts in designing the network. On the one hand, we adopt bottleneck residual blocks to replace the internal components in the encoder and decoder of the traditional U-Net to make the network more lightweight. On the other hand, we embed the two attention modules to model long-range dependencies in spatial and channel dimensions for the accuracy of segmentation. In addition, we employ Top-hat transforms and contrast-limited adaptive histogram equalization (CLAHE) as the pre-processing strategy to enhance the coronary arteries to further improve the accuracy. Experimental evaluations conducted on the coronary angiograms dataset show that the proposed lightweight network performs well for accurate coronary artery segmentation, achieving the sensitivity, specificity, accuracy, and area under the curve (AUC) of 0.8770, 0.9789, 0.9729, and 0.9910, respectively. It is noteworthy that the proposed network contains only 0.75 M of parameters, which achieves the best performance by the comparative experiments with popular segmentation networks (such as U-Net with 31.04 M of parameters). Experimental results demonstrate that our network can achieve better performance with an extremely low number of parameters. Furthermore, the generalization experiments indicate that our network can accurately segment coronary angiograms from other coronary angiograms' databases, which demonstrates the strong generalization and robustness of our network.

Automatic identification of end-diastolic and end-systolic cardiac frames from invasive coronary angiography videos

BACKGROUND

Automatic identification of proper image frames at the end-diastolic (ED) and end-systolic (ES) frames during the review of invasive coronary angiograms (ICA) is important to assess blood flow during a cardiac cycle, reconstruct the 3D arterial anatomy from bi-planar views, and generate the complementary fusion map with myocardial images. The current identification method primarily relies on visual interpretation, making it not only time-consuming but also less reproducible.

OBJECITVE

In this paper, we propose a new method to automatically identify angiographic image frames associated with the ED and ES cardiac phases.

METHOD

A detection algorithm is first used to detect the key points (i.e. landmarks) of coronary arteries, and then an optical flow method is employed to track the trajectories of the selected key points. The ED and ES frames are identified based on all these trajectories. Our method was tested with 62 ICA videos from two separate medical centers.

RESULTS

Comparing consensus interpretations by two human expert readers, excellent agreement was achieved by the proposed algorithm: the agreement rates within a one-frame range were 92.99% and 92.73% for the automatic identification of the ED and ES image frames, respectively.

CONCLUSION

The proposed automated method showed great potential for being an integral part of automated ICA image analysis.

H-SegNet: hybrid segmentation network for lung segmentation in chest radiographs using mask region-based convolutional neural network and adaptive closed polyline searching method

Chest x-ray (CXR) is one of the most commonly used imaging techniques for the detection and diagnosis of pulmonary diseases. One critical component in many computer-aided systems, for either detection or diagnosis in digital CXR, is the accurate segmentation of the lung. Due to low-intensity contrast around lung boundary and large inter-subject variance, it has been challenging to segment lung from structural CXR images accurately. In this work, we propose an automatic Hybrid Segmentation Network (H-SegNet) for lung segmentation on CXR. The proposed H-SegNet consists of two key steps: (1) an image preprocessing step based on a deep learning model to automatically extract coarse lung contours; (2) a refinement step to fine-tune the coarse segmentation results based on an improved principal curve-based method coupled with an improved machine learning method. Experimental results on several public datasets show that the proposed method achieves superior segmentation results in lung CXRs, compared with several state-of-the-art methods.

Automatic extraction and stenosis evaluation of coronary arteries in invasive coronary angiograms

BACKGROUND

Coronary artery disease (CAD) is the leading cause of death in the United States (US) and a major contributor to healthcare cost. Accurate segmentation of coronary arteries and detection of stenosis from invasive coronary angiography (ICA) are crucial in clinical decision making.

PURPOSE

We aim to develop an automatic method to extract coronary arteries by deep learning and detect arterial stenosis from ICAs.

METHODS

In this study, a deep learning model which integrates a feature pyramid with a U-Net++ model was developed to automatically segment coronary arteries in ICAs. A compound loss function which contains Dice loss, dilated Dice loss, and L2 regularization was utilized to train the proposed segmentation model. Following the segmentation, an algorithm which extracts vascular centerlines, calculates the diameters, and measures the stenotic levels, was developed to detect arterial stenosis.

RESULTS AND CONCLUSIONS

In the dataset consisting of 314 ICAs obtained from 99 patients, the segmentation model achieved an average Dice score of 0.8899, a sensitivity of 0.8595, and a specificity of 0.9960. In addition, the stenosis detection algorithm achieved a true positive rate of 0.6840 and a positive predictive value of 0.6998 on all types of stenosis, which has great promise to advance to clinical uses and could provide auxiliary suggestions for CAD diagnosis and treatment.

Ordered multi-path propagation for vessel centerline extraction

Vessel centerline extraction from x-ray angiography images is essential for vessel structure analysis in the diagnosis of coronary artery disease. However, complete and continuous centerline extraction remains a challenging task due to image noise, poor contrast, and complexity of vessel structure. Thus, an iterative multi-path search framework for automatic vessel centerline extraction is proposed. First, the seed points of the vessel structure are detected and sorted by confidence. With the ordered seed points, multi-bifurcation centerline is searched through multi-path propagation of wavefront and accumulated voting. Finally, the centerline is further extended piecewise by wavefront propagation on the basis of keypoint detection. The latter two steps are performed alternately to obtain the final centerline result. The proposed method is qualitatively and quantitatively evaluated on 1260 synthetic images and 50 clinical angiography images. The results demonstrate that our method has a highF1score of 87.8% ± 2.7% for the angiography images and achieves accurate and continuous results of vessel centerline extraction.

A coronary artery segmentation method based on region growing with variable sector search area

BACKGROUND:

Coronary artery image segmentation is an important auxiliary method for coronary artery disease diagnosis.

OBJECTIVE:

The classical region growing algorithms, which only consider the intensity of pixels, are noise-sensitive and require manual interaction. To this end, recent methods simultaneously consider the intensity of pixels and multi-scale analysis with the region growing. Nevertheless, these methods are not fully optimized and they suffer from the drawbacks of over- or under-segmentation in many cases.

METHODS:

In this paper, we propose a region growing based coronary artery segmentation method. Different from the existing methods, the variable sector search area is considered in the region growing technique. A growing rule is proposed to segment the vessel, which combines the Hessian vector and the region growing with the variable sector search area. To further improve the quality of segmentation, we propose an optimization of removing some small disconnected regions.

RESULTS:

Our proposed method can search more branches while segmenting the vessel, even the small ones. It keeps an acceptable performance when dealing with stenosis and large curvature of blood vessels.

CONCLUSIONS:

Quantitative evaluations are conducted on coronary angiography and the results show that the proposed method achieves a higher DSC ratio and a more reliable sensitivity ratio.

Iterative closest graph matching for non-rigid 3D/2D coronary arteries registration

Background and objective Fusion of the preoperative computed tomography angiography and intraoperative X-ray angiography images can considerably enhance the visual perception of physicians during percutaneous coronary interventions. This technique can provide 3D information of the arteries and reduce the uncertainty of 2D guidance images. For this purpose, 3D/2D vascular registration with high accuracy and robustness is crucial for performing accurate surgery. Methods In this study, we propose an iterative closest graph matching (ICGM) method that utilizes an alternative iteration framework including correspondence and transformation phases. A coarse-to-fine matching approach based on redundant graph matching is proposed for the correspondence phase. The transformation phase involves rigid and non-rigid transformations, in which rigid transformation is calculated using a closed-form solution, and non-rigid transformation is achieved using a statistical shape model established from a synthetic deformation dataset. Results The proposed method is evaluated and compared with nine state-of-the-art methods on simulated data and clinical datasets. Experiments demonstrate that our method is insensitive to the pose of data and robust to noise and deformation. Moreover, it outperforms other methods in terms of registering real data. Conclusions Given its high capture range, the proposed method can register 3D vessels without prior initialization in clinical practice.

Automated identification and grading of coronary artery stenoses with X-ray angiography

BACKGROUND AND OBJECTIVE

X-ray coronary angiography (XCA) remains the gold standard imaging technique for the diagnosis and treatment of cardiovascular disease. Automatic detection and grading of coronary stenoses in XCA are challenging problems due to the complex overlap of different background structures with intensity inhomogeneities. We present a new computerized image based method to accurately identify and quantify the stenosis severity on XCA.

METHODS

A unified framework, consisting of Hessian-based vessel enhancement, level-set skeletonization, improved measure of match measurement, and local extremum identification, is developed to distinctly reveal the vessel structures and accurately determine the stenosis grades. The methodology was validated on 143 consecutive patients who underwent diagnostic XCA through both qualitative and quantitative evaluations.

RESULTS

The presented algorithm was tested on a set of 267 vessel segments annotated by two expert cardiologists. The experimental results show that the method can effectively localize and quantify the vessel stenoses, achieving average detection accuracy, sensitivity, specificity, and F-score of 93.93%, 91.03%, 93.83%, 89.18%, respectively.

CONCLUSIONS

A fully automatic coronary analysis method is devised for vessel stenosis detection and grading in XCA. The presented approach can potentially serve as a generalized framework to handle different image modalities.

Detection of Lung Contour with Closed Principal Curve and Machine Learning

Radiation therapy plays an essential role in the treatment of cancer. In radiation therapy, the ideal radiation doses are delivered to the observed tumor while not affecting neighboring normal tissues. In three-dimensional computed tomography (3D-CT) scans, the contours of tumors and organs-at-risk (OARs) are often manually delineated by radiologists. The task is complicated and time-consuming, and the manually delineated results will be variable from different radiologists. We propose a semi-supervised contour detection algorithm, which firstly uses a few points of region of interest (ROI) as an approximate initialization. Then the data sequences are achieved by the closed polygonal line (CPL) algorithm, where the data sequences consist of the ordered projection indexes and the corresponding initial points. Finally, the smooth lung contour can be obtained, when the data sequences are trained by the backpropagation neural network model (BNNM). We use the private clinical dataset and the public Lung Image Database Consortium and Image Database Resource Initiative (LIDC-IDRI) dataset to measure the accuracy of the presented method, respectively. To the private dataset, experimental results on the initial points which are as low as 15% of the manually delineated points show that the Dice coefficient reaches up to 0.95 and the global error is as low as 1.47 × 10^-2. The performance of the proposed algorithm is also better than the cubic spline interpolation (CSI) algorithm. While on the public LIDC-IDRI dataset, our method achieves superior segmentation performance with average Dice of 0.83.

Review. Automatic Segmentation Techniques of the Coronary Artery Using CT Images in Acute Coronary Syndromes

Coronary artery disease represents one of the leading reasons of death worldwide, and acute coronary syndromes are their most devastating consequences. It is extremely important to identify the patients at risk for developing an acute myocardial infarction, and this goal can be achieved using noninvasive imaging techniques. Coronary computed tomography angiography (CCTA) is currently one of the most reliable methods used for assessing the coronary arteries; however, its use in emergency settings is sometimes limited due to time constraints. This paper presents the main characteristics of plaque vulnerability, the role of CCTA in the assessment of vulnerable plaques, and automatic segmentation techniques of the coronary artery tree based on CT angiography images. A detailed inventory of existing methods is given, representing the state-of-the-art of computational methods applied in vascular system segmentation, focusing on the current applications in acute coronary syndromes.