1
|
Lee J, Kim JN, Gomez-Perez L, Gharaibeh Y, Motairek I, Pereira GTR, Zimin VN, Dallan LAP, Hoori A, Al-Kindi S, Guagliumi G, Bezerra HG, Wilson DL. Automated Segmentation of Microvessels in Intravascular OCT Images Using Deep Learning. Bioengineering (Basel) 2022; 9:648. [PMID: 36354559 PMCID: PMC9687448 DOI: 10.3390/bioengineering9110648] [Citation(s) in RCA: 12] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/30/2022] [Revised: 10/27/2022] [Accepted: 11/02/2022] [Indexed: 09/03/2024] Open
Abstract
Microvessels in vascular plaque are associated with plaque progression and are found in plaque rupture and intra-plaque hemorrhage. To analyze this characteristic of vulnerability, we developed an automated deep learning method for detecting microvessels in intravascular optical coherence tomography (IVOCT) images. A total of 8403 IVOCT image frames from 85 lesions and 37 normal segments were analyzed. Manual annotation was performed using a dedicated software (OCTOPUS) previously developed by our group. Data augmentation in the polar (r,θ) domain was applied to raw IVOCT images to ensure that microvessels appear at all possible angles. Pre-processing methods included guidewire/shadow detection, lumen segmentation, pixel shifting, and noise reduction. DeepLab v3+ was used to segment microvessel candidates. A bounding box on each candidate was classified as either microvessel or non-microvessel using a shallow convolutional neural network. For better classification, we used data augmentation (i.e., angle rotation) on bounding boxes with a microvessel during network training. Data augmentation and pre-processing steps improved microvessel segmentation performance significantly, yielding a method with Dice of 0.71 ± 0.10 and pixel-wise sensitivity/specificity of 87.7 ± 6.6%/99.8 ± 0.1%. The network for classifying microvessels from candidates performed exceptionally well, with sensitivity of 99.5 ± 0.3%, specificity of 98.8 ± 1.0%, and accuracy of 99.1 ± 0.5%. The classification step eliminated the majority of residual false positives and the Dice coefficient increased from 0.71 to 0.73. In addition, our method produced 698 image frames with microvessels present, compared with 730 from manual analysis, representing a 4.4% difference. When compared with the manual method, the automated method improved microvessel continuity, implying improved segmentation performance. The method will be useful for research purposes as well as potential future treatment planning.
Collapse
|
|
3 |
12 |
2
|
Hoori A, Hu T, Lee J, Al-Kindi S, Rajagopalan S, Wilson DL. Deep learning segmentation and quantification method for assessing epicardial adipose tissue in CT calcium score scans. Sci Rep 2022; 12:2276. [PMID: 35145186 PMCID: PMC8831577 DOI: 10.1038/s41598-022-06351-z] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/27/2021] [Accepted: 01/11/2022] [Indexed: 11/12/2022] Open
Abstract
Epicardial adipose tissue volume (EAT) has been linked to coronary artery disease and the risk of major adverse cardiac events. As manual quantification of EAT is time-consuming, requires specialized training, and is prone to human error, we developed a deep learning method (DeepFat) for the automatic assessment of EAT on non-contrast low-dose CT calcium score images. Our DeepFat intuitively segmented the tissue enclosed by the pericardial sac on axial slices, using two preprocessing steps. First, we applied a HU-attention-window with a window/level 350/40-HU to draw attention to the sac and reduce numerical errors. Second, we applied a novel look ahead slab-of-slices with bisection ("bisect") in which we split the heart into halves and sequenced the lower half from bottom-to-middle and the upper half from top-to-middle, thereby presenting an always increasing curvature of the sac to the network. EAT volume was obtained by thresholding voxels within the sac in the fat window (- 190/- 30-HU). Compared to manual segmentation, our algorithm gave excellent results with volume Dice = 88.52% ± 3.3, slice Dice = 87.70% ± 7.5, EAT error = 0.5% ± 8.1, and R = 98.52% (p < 0.001). HU-attention-window and bisect improved Dice volume scores by 0.49% and 3.2% absolute, respectively. Variability between analysts was comparable to variability with DeepFat. Results compared favorably to those of previous publications.
Collapse
|
Research Support, N.I.H., Extramural |
3 |
10 |
3
|
Lee J, Pereira GTR, Gharaibeh Y, Kolluru C, Zimin VN, Dallan LAP, Kim JN, Hoori A, Al-Kindi SG, Guagliumi G, Bezerra HG, Wilson DL. Automated analysis of fibrous cap in intravascular optical coherence tomography images of coronary arteries. Sci Rep 2022; 12:21454. [PMID: 36509806 PMCID: PMC9744742 DOI: 10.1038/s41598-022-24884-1] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/31/2022] [Accepted: 11/22/2022] [Indexed: 12/14/2022] Open
Abstract
Thin-cap fibroatheroma (TCFA) and plaque rupture have been recognized as the most frequent risk factor for thrombosis and acute coronary syndrome. Intravascular optical coherence tomography (IVOCT) can identify TCFA and assess cap thickness, which provides an opportunity to assess plaque vulnerability. We developed an automated method that can detect lipidous plaque and assess fibrous cap thickness in IVOCT images. This study analyzed a total of 4360 IVOCT image frames of 77 lesions among 41 patients. Expert cardiologists manually labeled lipidous plaque based on established criteria. To improve segmentation performance, preprocessing included lumen segmentation, pixel-shifting, and noise filtering on the raw polar (r, θ) IVOCT images. We used the DeepLab-v3 plus deep learning model to classify lipidous plaque pixels. After lipid detection, we automatically detected the outer border of the fibrous cap using a special dynamic programming algorithm and assessed the cap thickness. Our method provided excellent discriminability of lipid plaque with a sensitivity of 85.8% and A-line Dice coefficient of 0.837. By comparing lipid angle measurements between two analysts following editing of our automated software, we found good agreement by Bland-Altman analysis (difference 6.7° ± 17°; mean ~ 196°). Our method accurately detected the fibrous cap from the detected lipid plaque. Automated analysis required a significant modification for only 5.5% frames. Furthermore, our method showed a good agreement of fibrous cap thickness between two analysts with Bland-Altman analysis (4.2 ± 14.6 µm; mean ~ 175 µm), indicating little bias between users and good reproducibility of the measurement. We developed a fully automated method for fibrous cap quantification in IVOCT images, resulting in good agreement with determinations by analysts. The method has great potential to enable highly automated, repeatable, and comprehensive evaluations of TCFAs.
Collapse
|
Research Support, N.I.H., Extramural |
3 |
9 |
4
|
Lee J, Kim JN, Gharaibeh Y, Zimin VN, Dallan LA, Pereira GT, Vergara-Martel A, Kolluru C, Hoori A, Bezerra HG, Wilson DL. OCTOPUS - Optical coherence tomography plaque and stent analysis software. Heliyon 2023; 9:e13396. [PMID: 36816277 PMCID: PMC9932655 DOI: 10.1016/j.heliyon.2023.e13396] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/09/2022] [Revised: 01/24/2023] [Accepted: 01/30/2023] [Indexed: 02/04/2023] Open
Abstract
Background and objective Compared with other imaging modalities, intravascular optical coherence tomography (IVOCT) has significant advantages for guiding percutaneous coronary interventions, assessing their outcomes, and characterizing plaque components. To aid IVOCT research studies, we developed the Optical Coherence TOmography PlaqUe and Stent (OCTOPUS) analysis software, which provides highly automated, comprehensive analysis of coronary plaques and stents in IVOCT images. Methods User specifications for OCTOPUS were obtained from detailed, iterative discussions with IVOCT analysts in the Cardiovascular Imaging Core Laboratory at University Hospitals Cleveland Medical Center, a leading laboratory for IVOCT image analysis. To automate image analysis results, the software includes several important algorithmic steps: pre-processing, deep learning plaque segmentation, machine learning identification of stent struts, and registration of pullbacks for sequential comparisons. Intuitive, interactive visualization and manual editing of segmentations were included in the software. Quantifications include stent deployment characteristics (e.g., stent area and stent strut malapposition), strut level analysis, calcium angle, and calcium thickness measurements. Interactive visualizations include (x,y) anatomical, en face, and longitudinal views with optional overlays (e.g., segmented calcifications). To compare images over time, linked visualizations were enabled to display up to four registered vessel segments at a time. Results OCTOPUS has been deployed for nearly 1 year and is currently being used in multiple IVOCT studies. Underlying plaque segmentation algorithm yielded excellent pixel-wise results (86.2% sensitivity and 0.781 F1 score). Using OCTOPUS on 34 new pullbacks, we determined that following automated segmentation, only 13% and 23% of frames needed any manual touch up for detailed lumen and calcification labeling, respectively. Only up to 3.8% of plaque pixels were modified, leading to an average editing time of only 7.5 s/frame, an approximately 80% reduction compared to manual analysis. Regarding stent analysis, sensitivity and precision were both greater than 90%, and each strut was successfully classified as either covered or uncovered with high sensitivity (94%) and specificity (90%). We demonstrated use cases for sequential analysis. To analyze plaque progression, we loaded multiple pullbacks acquired at different points (e.g., pre-stent, 3-month follow-up, and 18-month follow-up) and evaluated frame-level development of in-stent neo-atherosclerosis. In ex vivo cadaver experiments, the OCTOPUS software enabled visualization and quantitative evaluation of irregular stent deployment in the presence of calcifications identified in pre-stent images. Conclusions We introduced and evaluated the clinical application of a highly automated software package, OCTOPUS, for quantitative plaque and stent analysis in IVOCT images. The software is currently used as an offline tool for research purposes; however, the software's embedded algorithms may also be useful for real-time treatment planning.
Collapse
|
research-article |
2 |
5 |
5
|
Lee J, Kim JN, Pereira GTR, Gharaibeh Y, Kolluru C, Zimin VN, Dallan LAP, Motairek IK, Hoori A, Guagliumi G, Bezerra HG, Wilson DL. Automatic microchannel detection using deep learning in intravascular optical coherence tomography images. PROCEEDINGS OF SPIE--THE INTERNATIONAL SOCIETY FOR OPTICAL ENGINEERING 2022; 12034:120340S. [PMID: 36465096 PMCID: PMC9718371 DOI: 10.1117/12.2612697] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/17/2023]
Abstract
Microchannel formation is known to be a significant marker of plaque vulnerability, plaque rupture, and intraplaque hemorrhage, which are responsible for plaque progression. We developed a fully-automated method for detecting microchannels in intravascular optical coherence tomography (IVOCT) images using deep learning. A total of 3,075 IVOCT image frames across 41 patients having 62 microchannel segments were analyzed. Microchannel was manually annotated by expert cardiologists, according to previously established criteria. In order to improve segmentation performance, pre-processing including guidewire detection/removal, lumen segmentation, pixel-shifting, and noise filtering was applied to the raw (r,θ) IVOCT image. We used the DeepLab-v3 plus deep learning model with the Xception backbone network for identifying microchannel candidates. After microchannel candidate detection, each candidate was classified as either microchannel or no-microchannel using a convolutional neural network (CNN) classification model. Our method provided excellent segmentation of microchannel with a Dice coefficient of 0.811, sensitivity of 92.4%, and specificity of 99.9%. We found that pre-processing and data augmentation were very important to improve results. In addition, a CNN classification step was also helpful to rule out false positives. Furthermore, automated analysis missed only 3% of frames having microchannels and showed no false positives. Our method has great potential to enable highly automated, objective, repeatable, and comprehensive evaluations of vulnerable plaques and treatments. We believe that this method is promising for both research and clinical applications.
Collapse
|
research-article |
3 |
2 |
6
|
Lee J, Pereira GTR, Motairek I, Kim JN, Zimin VN, Dallan LAP, Hoori A, Al-Kindi S, Guagliumi G, Wilson DL. Neoatherosclerosis prediction using plaque markers in intravascular optical coherence tomography images. Front Cardiovasc Med 2022; 9:1079046. [PMID: 36588557 PMCID: PMC9794759 DOI: 10.3389/fcvm.2022.1079046] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/24/2022] [Accepted: 11/29/2022] [Indexed: 12/15/2022] Open
Abstract
Introduction In-stent neoatherosclerosis has emerged as a crucial factor in post-stent complications including late in-stent restenosis and very late stent thrombosis. In this study, we investigated the ability of quantitative plaque characteristics from intravascular optical coherence tomography (IVOCT) images taken just prior to stent implantation to predict neoatherosclerosis after implantation. Methods This was a sub-study of the TRiple Assessment of Neointima Stent FOrmation to Reabsorbable polyMer with Optical Coherence Tomography (TRANSFORM-OCT) trial. Images were obtained before and 18 months after stent implantation. Final analysis included images of 180 lesions from 90 patients; each patient had images of two lesions in different coronary arteries. A total of 17 IVOCT plaque features, including lesion length, lumen (e.g., area and diameter); calcium (e.g., angle and thickness); and fibrous cap (FC) features (e.g., thickness, surface area, and burden), were automatically extracted from the baseline IVOCT images before stenting using dedicated software developed by our group (OCTOPUS). The predictive value of baseline IVOCT plaque features for neoatherosclerosis development after stent implantation was assessed using univariate/multivariate logistic regression and receiver operating characteristic (ROC) analyses. Results Follow-up IVOCT identified stents with (n = 19) and without (n = 161) neoatherosclerosis. Greater lesion length and maximum calcium angle and features related to FC were associated with a higher prevalence of neoatherosclerosis after stent implantation (p < 0.05). Hierarchical clustering identified six clusters with the best prediction p-values. In univariate logistic regression analysis, maximum calcium angle, minimum calcium thickness, maximum FC angle, maximum FC area, FC surface area, and FC burden were significant predictors of neoatherosclerosis. Lesion length and features related to the lumen were not significantly different between the two groups. In multivariate logistic regression analysis, only larger FC surface area was strongly associated with neoatherosclerosis (odds ratio 1.38, 95% confidence interval [CI] 1.05-1.80, p < 0.05). The area under the ROC curve was 0.901 (95% CI 0.859-0.946, p < 0.05) for FC surface area. Conclusion Post-stent neoatherosclerosis can be predicted by quantitative IVOCT imaging of plaque characteristics prior to stent implantation. Our findings highlight the additional clinical benefits of utilizing IVOCT imaging in the catheterization laboratory to inform treatment decision-making and improve outcomes.
Collapse
|
research-article |
3 |
2 |
7
|
Gharaibeh Y, Lee J, Zimin VN, Kolluru C, Dallan LAP, Pereira GTR, Vergara-Martel A, Kim JN, Hoori A, Dong P, Gamage PT, Gu L, Bezerra HG, Al-Kindi S, Wilson DL. Prediction of stent under-expansion in calcified coronary arteries using machine learning on intravascular optical coherence tomography images. Sci Rep 2023; 13:18110. [PMID: 37872298 PMCID: PMC10593923 DOI: 10.1038/s41598-023-44610-9] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/22/2022] [Accepted: 10/10/2023] [Indexed: 10/25/2023] Open
Abstract
It can be difficult/impossible to fully expand a coronary artery stent in a heavily calcified coronary artery lesion. Under-expanded stents are linked to later complications. Here we used machine/deep learning to analyze calcifications in pre-stent intravascular optical coherence tomography (IVOCT) images and predicted the success of vessel expansion. Pre- and post-stent IVOCT image data were obtained from 110 coronary lesions. Lumen and calcifications in pre-stent images were segmented using deep learning, and lesion features were extracted. We analyzed stent expansion along the lesion, enabling frame, segmental, and whole-lesion analyses. We trained regression models to predict the post-stent lumen area and then computed the stent expansion index (SEI). Best performance (root-mean-square-error = 0.04 ± 0.02 mm2, r = 0.94 ± 0.04, p < 0.0001) was achieved when we used features from both lumen and calcification to train a Gaussian regression model for segmental analysis of 31 frames in length. Stents with minimum SEI > 80% were classified as "well-expanded;" others were "under-expanded." Under-expansion classification results (e.g., AUC = 0.85 ± 0.02) were significantly improved over a previous, simple calculation, as well as other machine learning solutions. Promising results suggest that such methods can identify lesions at risk of under-expansion that would be candidates for intervention lesion preparation (e.g., atherectomy).
Collapse
|
Research Support, N.I.H., Extramural |
2 |
2 |
8
|
Song Y, Wu H, Lee J, Kim J, Hoori A, Hu T, Zimin V, Makhlouf M, Al-Kindi S, Rajagopalan S, Yun CH, Hung CL, Wilson DL. Pericoronary adipose tissue feature analysis in computed tomography calcium score images in comparison to coronary computed tomography angiography. J Med Imaging (Bellingham) 2025; 12:014503. [PMID: 39866527 PMCID: PMC11759132 DOI: 10.1117/1.jmi.12.1.014503] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/19/2024] [Revised: 12/30/2024] [Accepted: 01/03/2025] [Indexed: 01/28/2025] Open
Abstract
Purpose We investigated the feasibility and advantages of using non-contrast CT calcium score (CTCS) images to assess pericoronary adipose tissue (PCAT) and its association with major adverse cardiovascular events (MACE). PCAT features from coronary computed tomography angiography (CCTA) have been shown to be associated with cardiovascular risk but are potentially confounded by iodine. If PCAT in CTCS images can be similarly analyzed, it would avoid this issue and enable its inclusion in formal risk assessment from readily available, low-cost CTCS images. Approach To identify coronaries in CTCS images that have subtle visual evidence of vessels, we registered CTCS with paired CCTA images having coronary labels. We developed an "axial-disk" method giving regions for analyzing PCAT features in three main coronary arteries. We analyzed hand-crafted and radiomic features using univariate and multivariate logistic regression prediction of MACE and compared results against those from CCTA. Results Registration accuracy was sufficient to enable the identification of PCAT regions in CTCS images. Motion or beam hardening artifacts were often prevalent in "high-contrast" CCTA but not CTCS. Mean HU and volume were increased in both CTCS and CCTA for the MACE group. There were significant positive correlations between some CTCS and CCTA features, suggesting that similar characteristics were obtained. Using hand-crafted/radiomics from CTCS and CCTA, AUCs were 0.83/0.79 and 0.83/0.77, respectively, whereas Agatston gave AUC = 0.73. Conclusions Preliminarily, PCAT features can be assessed from three main coronary arteries in non-contrast CTCS images with performance characteristics that are at the very least comparable to CCTA.
Collapse
|
research-article |
1 |
|
9
|
Hoori A, Hu T, Al-Kindi S, Rajagopalan S, Wilson DL. Automatic Deep Learning Segmentation and Quantification of Epicardial Adipose Tissue in Non-Contrast Cardiac CT scans. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2021; 2021:3938-3942. [PMID: 34892093 DOI: 10.1109/embc46164.2021.9630953] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/14/2023]
Abstract
An Automatic deep learning semantic segmentation (ADLS) using DeepLab-v3-plus technique is proposed for a full and accurate whole heart Epicardial adipose tissue (EAT) segmentation from non-contrast cardiac CT scan. The ADLS algorithm was trained on manual segmented scans of the enclosed region of the pericardium (sac), which represents the internal heart tissues where the EAT is located. A level of 40 Hounsfield unit (HU) and a window of 350 HU was applied to every axial slice for contrast enhancement. Each slice was associated with two additional consecutive slices, representing the three-channel single input image of the deep network. The detected output mask region, as a post-step, was thresholded between [-190, -30] HU to detect the EAT region. A median filter with kernel size 3mm was applied to remove the noise. Using 70 CT scans (50 training/20 testing), the ADLS showed excellent results compared to manual segmentation (ground truth). The total average Dice score was (89.31%±1.96) with a high correlation of (R=97.15%, p-value <0.001), while the average error of EAT volume was (0.79±9.21).Clinical Relevance- Epicardial adipose tissue (EAT) volume aids in predicting atherosclerosis development and is linked to major adverse cardiac events. However, accurate manual segmentation is considered tedious work and requires skilled expertise.
Collapse
|
|
4 |
|
10
|
Song Y, Hoori A, Wu H, Vembar M, Al-Kindi S, Ciancibello L, Terry JG, Jacobs DR, Carr JJ, Wilson DL. Improved bias and reproducibility of coronary artery calcification features using deconvolution. J Med Imaging (Bellingham) 2023; 10:014002. [PMID: 36647366 PMCID: PMC9836910 DOI: 10.1117/1.jmi.10.1.014002] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/27/2022] [Accepted: 12/07/2022] [Indexed: 01/15/2023] Open
Abstract
Purpose Our long-range goal is to improve whole-heart CT calcium scores by extracting quantitative features from individual calcifications. Here, we perform deconvolution to improve bias/reproducibility of small calcification assessments, which can be degraded at the normal CT calcium score image resolution. Approach We analyzed features of individual calcifications on repeated standard (2.5 mm) and thin (1.25 mm) slice scans from QRM-Cardio phantom, cadaver hearts, and CARDIA study participants. Preprocessing to improve the resolution involved of Lucy-Richardson deconvolution with a measured point spread function (PSF) or three-dimensional blind deconvolution in which the PSF was iteratively optimized on high detail structures such as calcifications in images. Results Using QRM with inserts having known mg-calcium, we determined that both blind and conventional deconvolution improved mass measurements nearly equally well on standard images. Further, deconvolved thin images gave an excellent recovery of actual mass scores, suggesting that such processing could be our gold standard. For CARDIA images, blind deconvolution greatly improved results on standard slices. Bias across 33 calcifications (without, with deconvolution) was (23%, 9%), (18%, 1%), and ( - 19 % , - 1 % ) for Agatston, volume, and mass scores, respectively. Reproducibility was (0.13, 0.10), (0.12, 0.08), and (0.11, 0.06), respectively. Mass scores were more reproducible than Agatston scores or volume scores. For many other calcification features, blind deconvolution improved reproducibility in 21 out of 24 features. Cadaver images showed similar improvements in bias/reproducibility and slightly better results with a measured PSF. Conclusions Deconvolution improves bias and reproducibility of multiple features extracted from individual calcifications in CT calcium score exams. Blind deconvolution is useful for improving feature assessments of coronary calcification in archived datasets.
Collapse
|
research-article |
2 |
|
11
|
Hoori A, Al-Kindi S, Hu T, Song Y, Wu H, Lee J, Tashtish N, Fu P, Gilkeson R, Rajagopalan S, Wilson DL. Enhancing cardiovascular risk prediction through AI-enabled calcium-omics. Sci Rep 2024; 14:11134. [PMID: 38750142 PMCID: PMC11096314 DOI: 10.1038/s41598-024-60584-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/20/2023] [Accepted: 04/24/2024] [Indexed: 05/18/2024] Open
Abstract
Whole-heart coronary calcium Agatston score is a well-established predictor of major adverse cardiovascular events (MACE), but it does not account for individual calcification features related to the pathophysiology of the disease (e.g., multiple-vessel disease, spread of the disease along the vessel, stable calcifications, numbers of lesions, and density). We used novel, hand-crafted calcification features (calcium-omics); Cox time-to-event modeling; elastic net; and up and down synthetic sampling methods for imbalanced data, to assess MACE risk. We used 2457 CT calcium score (CTCS) images enriched for MACE events from our large no-cost CLARIFY program (ClinicalTrials.gov Identifier: NCT04075162). Among calcium-omics features, numbers of calcifications, LAD mass, and diffusivity (a measure of spatial distribution) were especially important determinants of increased risk, with dense calcification (> 1000HU, stable calcifications) associated with reduced risk Our calcium-omics model with (training/testing, 80/20) gave C-index (80.5%/71.6%) and 2-year AUC (82.4%/74.8%). Although the C-index is notoriously impervious to model improvements, calcium-omics compared favorably to Agatston and gave a significant difference (P < 0.001). The calcium-omics model identified 73.5% of MACE cases in the high-risk group, a 13.2% improvement as compared to Agatston, suggesting that calcium-omics could be used to better identity candidates for intensive follow-up and therapies. The categorical net-reclassification index was NRI = 0.153. Our findings from this exploratory study suggest the utility of calcium-omics in improved risk prediction. These promising results will pave the way for more extensive, multi-institutional studies of calcium-omics.
Collapse
|
research-article |
1 |
|
12
|
Singh P, Hoori A, Freeze J, Hu T, Tashtish N, Gilkeson R, Li S, Rajagopalan S, Wilson DL, Al-Kindi S. Leveraging calcium score CT radiomics for heart failure risk prediction. Sci Rep 2024; 14:26898. [PMID: 39505933 PMCID: PMC11541497 DOI: 10.1038/s41598-024-77269-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/10/2023] [Accepted: 10/21/2024] [Indexed: 11/08/2024] Open
Abstract
Studies have used extensive clinical information to predict time-to-heart failure (HF) in patients with and without diabetes mellitus (DM). We aimed to determine a screening method using only computed tomography calcium scoring (CTCS) to assess HF risk. We analyzed CTCS scans from 1,998 patients (336 with type 2 diabetes) from a no-charge coronary artery calcium score registry (CLARIFY Study, Clinicaltrials.gov NCT04075162). We used deep learning to segment epicardial adipose tissue (EAT) and engineered radiomic features of calcifications ("calcium-omics") and EAT ("fat-omics"). We developed models incorporating radiomics to predict risk of incident HF in patients with and without type 2 diabetes. At a median follow-up of 1.7 years, 5% had incident HF. In the overall cohort, fat-omics (C-index: 77.3) outperformed models using clinical factors, EAT volume, Agatston score, calcium-omics, and calcium-and-fat-omics to predict HF. For DM patients, the calcium-omics model (C-index: 81.8) outperformed other models. In conclusion, CTCS-based models combining calcium and fat-omics can predict incident HF, outperforming prediction scores based on clinical factors.Please check article title if captured correctly.YesPlease check and confirm that the authors and their respective affiliations have been correctly identified and amend if necessary.Yes.
Collapse
|
research-article |
1 |
|
13
|
Lee J, Hu T, Williams MC, Hoori A, Wu H, Kim JN, Newby DE, Gilkeson R, Rajagopalan S, Wilson DL. Prediction of obstructive coronary artery disease using coronary calcification and epicardial adipose tissue assessments from CT calcium scoring scans. J Cardiovasc Comput Tomogr 2025:S1934-5925(25)00009-7. [PMID: 39909764 DOI: 10.1016/j.jcct.2025.01.007] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/03/2024] [Revised: 01/20/2025] [Accepted: 01/29/2025] [Indexed: 02/07/2025]
Abstract
BACKGROUND Low-cost/no-cost non-contrast CT calcium scoring (CTCS) exams can provide direct evidence of coronary atherosclerosis. In this study, using features from CTCS images, we developed a novel machine learning model to predict obstructive coronary artery disease (CAD), as defined by the coronary artery disease-reporting and data system (CAD-RADS). METHODS This study analyzed 1324 patients from the SCOT-HEART trial who underwent both CTCS and CT angiography. Obstructive CAD was defined as CAD-RADS 4A-5, while CAD-RADS 0-3 were considered non-obstructive CAD. We analyzed clinical, Agatston-score-derived, and epicardial fat-omics features to predict obstructive CAD. The most predictive features were selected using elastic net logistic regression and used to train a CatBoost model. Model performance was evaluated using 1000 repeated five-fold cross-validation and survival analyses to predict major adverse cardiovascular event (MACE) and revascularization. Generalizability was assessed using an external validation set of 2316 patients for survival predictions. RESULTS Among the 1324 patients, obstructive CAD was identified in 334 patients (25.2 %). Elastic net regression identified the top 14 features (5 clinical, 2 Agatston-score-derived, and 7 fat-omics). The proposed method achieved excellent performance for classifying obstructive CAD, with an AUC of 90.1 ± 0.9 % and sensitivity/specificity/accuracy of 83.5 ± 5.5 %/93.7 ± 1.9 %/82.4 ± 2.0 %. The inclusion of Agatston-score-derived and fat-omics features significantly improved classification performance. Survival analyses showed that both actual and predicted obstructive CAD significantly differentiated patients who experienced MACE and revascularization. CONCLUSIONS We developed a novel machine learning model to predict obstructive CAD from non-contrast CTCS scans. Our findings highlight the potential clinical benefits of CTCS imaging in identifying patients likely to benefit from advanced imaging.
Collapse
|
|
1 |
|
14
|
Lee J, Kim J, Hoori A, Al-Kindi S, Wilson D. TCT-313 Prediction of Major Adverse Cardiovascular Events Using Coronary Plaque Characteristics in Intravascular Optical Coherence Tomography Images. J Am Coll Cardiol 2022. [DOI: 10.1016/j.jacc.2022.08.366] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 10/14/2022]
|
|
3 |
|
15
|
Hoori A, Al-Kindi S, Hu T, Song Y, Wu H, Lee J, Tashtish N, Fu P, Gilkeson R, Ra-jagopalan S, Wilson DL. Enhancing cardiovascular risk prediction through AI-enabled calcium-omics. ARXIV 2023:arXiv:2308.12224v1. [PMID: 37664409 PMCID: PMC10473778] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Subscribe] [Scholar Register] [Indexed: 09/05/2023]
Abstract
Background Coronary artery calcium (CAC) is a powerful predictor of major adverse cardiovascular events (MACE). Traditional Agatston score simply sums the calcium, albeit in a non-linear way, leaving room for improved calcification assessments that will more fully capture the extent of disease. Objective To determine if AI methods using detailed calcification features (i.e., calcium-omics) can improve MACE prediction. Methods We investigated additional features of calcification including assessment of mass, volume, density, spatial distribution, territory, etc. We used a Cox model with elastic-net regularization on 2457 CT calcium score (CTCS) enriched for MACE events obtained from a large no-cost CLARIFY program (ClinicalTrials.gov Identifier: NCT04075162). We employed sampling techniques to enhance model training. We also investigated Cox models with selected features to identify explainable high-risk characteristics. Results Our proposed calcium-omics model with modified synthetic down sampling and up sampling gave C-index (80.5%/71.6%) and two-year AUC (82.4%/74.8%) for (80:20, training/testing), respectively (sampling was applied to the training set only). Results compared favorably to Agatston which gave C-index (71.3%/70.3%) and AUC (71.8%/68.8%), respectively. Among calcium-omics features, numbers of calcifications, LAD mass, and diffusivity (a measure of spatial distribution) were important determinants of increased risk, with dense calcification (>1000HU) associated with lower risk. The calcium-omics model reclassified 63% of MACE patients to the high risk group in a held-out test. The categorical net-reclassification index was NRI=0.153. Conclusions AI analysis of coronary calcification can lead to improved results as compared to Agatston scoring. Our findings suggest the utility of calcium-omics in improved prediction of risk.
Collapse
|
Preprint |
2 |
|
16
|
Lee J, Gharaibeh Y, Dong P, Dallan LAP, Pereira GTR, Kim JN, Hoori A, Gu L, Bezerra HG, Cortese B, Wilson DL. Computational Analysis of Intravascular OCT Images for Future Clinical Support: A Comprehensive Review. IEEE Rev Biomed Eng 2025; PP:1-18. [PMID: 40030885 DOI: 10.1109/rbme.2025.3530244] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/05/2025]
Abstract
Over the past two decades, intravascular optical coherence tomography (IVOCT) has emerged as a promising tool for planning percutaneous coronary interventions (PCI), studying coronary artery disease, and assessing treatments. With its nearhistological resolution and optical contrast, IVOCT uniquely evaluates coronary plaque characteristics, enhancing the guidance of interventional procedures. Artificial intelligence (AI) techniques have been widely applied to IVOCT imaging, providing fast and accurate automated interpretation. These techniques hold significant potential for both clinical and research purposes. Clinically, automated analysis offers comprehensive assessments of coronary plaques, leading to better treatment decisions during PCI. For research, automated interpretation of IVOCT opens new avenues to understand the pathophysiology of coronary atherosclerosis. However, these techniques face several limitations, including issues related to spatial resolution, challenges in manual assessments, and the additional time required for these analyses. This review covers recent advancements and applications of AI techniques and computational simulation methods in IVOCT image analysis, including vessel wall segmentation, plaque characterization, stent analysis, and their clinical applications. Furthermore, we discuss the potential of AI-enhanced IVOCT analysis to facilitate personalized decision-making, potentially improving short- and long-term patient outcomes.
Collapse
|
|
1 |
|
17
|
Lee J, Kim JN, Dallan LAP, Zimin VN, Hoori A, Hassani NS, Makhlouf MHE, Guagliumi G, Bezerra HG, Wilson DL. Deep learning segmentation of fibrous cap in intravascular optical coherence tomography images. Sci Rep 2024; 14:4393. [PMID: 38388637 PMCID: PMC10884035 DOI: 10.1038/s41598-024-55120-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/21/2023] [Accepted: 02/20/2024] [Indexed: 02/24/2024] Open
Abstract
Thin-cap fibroatheroma (TCFA) is a prominent risk factor for plaque rupture. Intravascular optical coherence tomography (IVOCT) enables identification of fibrous cap (FC), measurement of FC thicknesses, and assessment of plaque vulnerability. We developed a fully-automated deep learning method for FC segmentation. This study included 32,531 images across 227 pullbacks from two registries (TRANSFORM-OCT and UHCMC). Images were semi-automatically labeled using our OCTOPUS with expert editing using established guidelines. We employed preprocessing including guidewire shadow detection, lumen segmentation, pixel-shifting, and Gaussian filtering on raw IVOCT (r,θ) images. Data were augmented in a natural way by changing θ in spiral acquisitions and by changing intensity and noise values. We used a modified SegResNet and comparison networks to segment FCs. We employed transfer learning from our existing much larger, fully-labeled calcification IVOCT dataset to reduce deep-learning training. Postprocessing with a morphological operation enhanced segmentation performance. Overall, our method consistently delivered better FC segmentation results (Dice: 0.837 ± 0.012) than other deep-learning methods. Transfer learning reduced training time by 84% and reduced the need for more training samples. Our method showed a high level of generalizability, evidenced by highly-consistent segmentations across five-fold cross-validation (sensitivity: 85.0 ± 0.3%, Dice: 0.846 ± 0.011) and the held-out test (sensitivity: 84.9%, Dice: 0.816) sets. In addition, we found excellent agreement of FC thickness with ground truth (2.95 ± 20.73 µm), giving clinically insignificant bias. There was excellent reproducibility in pre- and post-stenting pullbacks (average FC angle: 200.9 ± 128.0°/202.0 ± 121.1°). Our fully automated, deep-learning FC segmentation method demonstrated excellent performance, generalizability, and reproducibility on multi-center datasets. It will be useful for multiple research purposes and potentially for planning stent deployments that avoid placing a stent edge over an FC.
Collapse
|
research-article |
1 |
|
18
|
Lee J, Gharaibeh Y, Zimin VN, Kim JN, Hassani NS, Dallan LAP, Pereira GTR, Makhlouf MHE, Hoori A, Wilson DL. Plaque Characteristics Derived from Intravascular Optical Coherence Tomography That Predict Cardiovascular Death. Bioengineering (Basel) 2024; 11:843. [PMID: 39199801 PMCID: PMC11351967 DOI: 10.3390/bioengineering11080843] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/26/2024] [Revised: 08/14/2024] [Accepted: 08/16/2024] [Indexed: 09/01/2024] Open
Abstract
This study aimed to investigate whether plaque characteristics derived from intravascular optical coherence tomography (IVOCT) could predict a long-term cardiovascular (CV) death. This study was a single-center, retrospective study on 104 patients who had undergone IVOCT-guided percutaneous coronary intervention. Plaque characterization was performed using Optical Coherence TOmography PlaqUe and Stent (OCTOPUS) software developed by our group. A total of 31 plaque features, including lesion length, lumen, calcium, fibrous cap (FC), and vulnerable plaque features (e.g., microchannel), were computed from the baseline IVOCT images. The discriminatory power for predicting CV death was determined using univariate/multivariate logistic regressions. Of 104 patients, CV death was identified in 24 patients (23.1%). Univariate logistic regression revealed that lesion length, calcium angle, calcium thickness, FC angle, FC area, and FC surface area were significantly associated with CV death (p < 0.05). In the multivariate logistic analysis, only the FC surface area (OR 2.38, CI 0.98-5.83, p < 0.05) was identified as a significant determinant for CV death, highlighting the importance of the 3D lesion analysis. The AUC of FC surface area for predicting CV death was 0.851 (95% CI 0.800-0.927, p < 0.05). Patients with CV death had distinct plaque characteristics (i.e., large FC surface area) in IVOCT. Studies such as this one might someday lead to recommendations for pharmaceutical and interventional approaches.
Collapse
|
research-article |
1 |
|
19
|
Wu H, Song Y, Hoori A, Lee J, Al-Kindi SG, Huang WM, Yun CH, Hung CL, Rajagopalan S, Wilson DL. Cardiac CT Perfusion Imaging of Pericoronary Adipose Tissue (PCAT) Highlighting Potential Confounds in CTA Analysis. J Clin Med 2025; 14:769. [PMID: 39941441 PMCID: PMC11818118 DOI: 10.3390/jcm14030769] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/08/2024] [Revised: 01/12/2025] [Accepted: 01/20/2025] [Indexed: 02/16/2025] Open
Abstract
Background: Features of pericoronary adipose tissue (PCAT) from coronary computed tomography angiography (CCTA) are associated with inflammation and cardiovascular risk. As PCAT is vascularly connected with coronary vasculature, the presence of iodine is a potential confounding factor on PCAT HU and textures that has not been adequately investigated. We aim to use dynamic cardiac CT perfusion (CCTP) to understand the perfusion of PCAT and determine its effects on PCAT assessment. Methods: From CCTP, we analyzed HU dynamics of territory-specific PCAT, the myocardium, and other adipose depots in patients with coronary artery disease. HU, blood flow, and radiomics were assessed over time. Changes from peak aorta time, Pa, chosen to model the acquisition time of CCTA, were obtained. Results: HU in PCAT increased more than in other adipose depots. Blood flow in PCAT was ~23% of that in the contiguous myocardium. A two-second offset [before, after] Pa resulted in [4 ± 1.1 HU, 3 ± 1.5 HU] differences in PCAT, giving a 7 HU swing. Due to changes in HU, the apparent PCAT volume reduced by ~15% from the first scan (P1) to Pa using a conventional fat window. Comparing radiomic features over time, 78% of features changed >10% relative to P1. Distal and proximal to a significant stenosis, we found less enhancement and longer time-to-peak distally in PCAT. Conclusions: CCTP elucidates blood flow in PCAT and enables the analysis of PCAT features over time. PCAT assessments (HU, apparent volume, and radiomics) are sensitive to acquisition timing and obstructive stenosis, which may confound the interpretation of PCAT in CCTA images. Data normalization may be in order.
Collapse
|
research-article |
1 |
|
20
|
Hu T, Freeze J, Singh P, Kim J, Song Y, Wu H, Lee J, Al-Kindi S, Rajagopalan S, Wilson DL, Hoori A. AI prediction of cardiovascular events using opportunistic epicardial adipose tissue assessments from CT calcium score. ARXIV 2024:arXiv:2401.16190v1. [PMID: 38351935 PMCID: PMC10862931] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Figures] [Subscribe] [Scholar Register] [Indexed: 02/19/2024]
Abstract
Background Recent studies have used basic epicardial adipose tissue (EAT) assessments (e.g., volume and mean HU) to predict risk of atherosclerosis-related, major adverse cardiovascular events (MACE). Objectives Create novel, hand-crafted EAT features, "fat-omics", to capture the pathophysiology of EAT and improve MACE prediction. Methods We segmented EAT using a previously-validated deep learning method with optional manual correction. We extracted 148 radiomic features (morphological, spatial, and intensity) and used Cox elastic-net for feature reduction and prediction of MACE. Results Traditional fat features gave marginal prediction (EAT-volume/EAT-mean-HU/BMI gave C-index 0.53/0.55/0.57, respectively). Significant improvement was obtained with 15 fat-omics features (C-index=0.69, test set). High-risk features included volume-of-voxels-having-elevated-HU-[-50, -30-HU] and HU-negative-skewness, both of which assess high HU, which as been implicated in fat inflammation. Other high-risk features include kurtosis-of-EAT-thickness, reflecting the heterogeneity of thicknesses, and EAT-volume-in-the-top-25%-of-the-heart, emphasizing adipose near the proximal coronary arteries. Kaplan-Meyer plots of Cox-identified, high- and low-risk patients were well separated with the median of the fat-omics risk, while high-risk group having HR 2.4 times that of the low-risk group (P<0.001). Conclusion Preliminary findings indicate an opportunity to use more finely tuned, explainable assessments on EAT for improved cardiovascular risk prediction.
Collapse
|
Preprint |
1 |
|
21
|
Hu T, Freeze J, Singh P, Kim J, Song Y, Wu H, Lee J, Al-Kindi S, Rajagopalan S, Wilson DL, Hoori A. Artificial Intelligence Prediction of Cardiovascular Events Using Opportunistic Epicardial Adipose Tissue Assessments From Computed Tomography Calcium Score. JACC. ADVANCES 2024; 3:101188. [PMID: 39372475 PMCID: PMC11450955 DOI: 10.1016/j.jacadv.2024.101188] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 01/28/2024] [Revised: 07/10/2024] [Accepted: 07/11/2024] [Indexed: 10/08/2024]
Abstract
Background Recent studies have used basic epicardial adipose tissue (EAT) assessments (eg, volume and mean Hounsfield unit [HU]) to predict risk of atherosclerosis-related, major adverse cardiovascular events (MACEs). Objectives The purpose of this study was to create novel, hand-crafted EAT features, "fat-omics," to capture the pathophysiology of EAT and improve MACE prediction. Methods We studied a cohort of 400 patients with low-dose cardiac computed tomography calcium score examinations. We purposefully used a MACE-enriched cohort (56% event rate) for feature engineering purposes. We divided the cohort into training/testing sets (80%/20%). We segmented EAT using a previously validated, deep-learning method with optional manual correction. We extracted 148 initial EAT features (eg, morphologic, spatial, and HU), dubbed fat-omics, and used Cox elastic-net for feature reduction and prediction of MACE. Bootstrap validation gave CIs. Results Traditional EAT features gave marginal prediction (EAT-volume/EAT-mean-HU/BMI gave C-indices 0.53/0.55/0.57, respectively). Significant improvement was obtained with the 15-feature fat-omics model (C-index = 0.69, test set). High-risk features included the volume-of-voxels-having-elevated-HU-[-50,-30-HU] and HU-negative-skewness, both of which assess high HU values in EAT, a property implicated in fat inflammation. Other high-risk features include kurtosis-of-EAT-thickness, reflecting the heterogeneity of thicknesses, and EAT-volume-in-the-top-25%-of-the-heart, emphasizing adipose near the proximal coronary arteries. Kaplan-Meyer plots of Cox-identified, high- and low-risk patients were well separated with the median of the fat-omics risk, with the high-risk group having an HR 2.4 times that of the low-risk group (P < 0.001). Conclusions Preliminary findings indicate an opportunity to use finely tuned, explainable assessments on EAT for improved cardiovascular risk prediction.
Collapse
|
research-article |
1 |
|