1
|
Mineo R, Salanitri FP, Bellitto G, Kavasidis I, Filippo OD, Millesimo M, Ferrari GMD, Aldinucci M, Giordano D, Palazzo S, D'Ascenzo F, Spampinato C. A Convolutional-Transformer Model for FFR and iFR Assessment From Coronary Angiography. IEEE TRANSACTIONS ON MEDICAL IMAGING 2024; 43:2866-2877. [PMID: 38954582 DOI: 10.1109/tmi.2024.3383283] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 07/04/2024]
Abstract
The quantification of stenosis severity from X-ray catheter angiography is a challenging task. Indeed, this requires to fully understand the lesion's geometry by analyzing dynamics of the contrast material, only relying on visual observation by clinicians. To support decision making for cardiac intervention, we propose a hybrid CNN-Transformer model for the assessment of angiography-based non-invasive fractional flow-reserve (FFR) and instantaneous wave-free ratio (iFR) of intermediate coronary stenosis. Our approach predicts whether a coronary artery stenosis is hemodynamically significant and provides direct FFR and iFR estimates. This is achieved through a combination of regression and classification branches that forces the model to focus on the cut-off region of FFR (around 0.8 FFR value), which is highly critical for decision-making. We also propose a spatio-temporal factorization mechanisms that redesigns the transformer's self-attention mechanism to capture both local spatial and temporal interactions between vessel geometry, blood flow dynamics, and lesion morphology. The proposed method achieves state-of-the-art performance on a dataset of 778 exams from 389 patients. Unlike existing methods, our approach employs a single angiography view and does not require knowledge of the key frame; supervision at training time is provided by a classification loss (based on a threshold of the FFR/iFR values) and a regression loss for direct estimation. Finally, the analysis of model interpretability and calibration shows that, in spite of the complexity of angiographic imaging data, our method can robustly identify the location of the stenosis and correlate prediction uncertainty to the provided output scores.
Collapse
|
2
|
Doolub G, Khurshid S, Theriault-Lauzier P, Nolin Lapalme A, Tastet O, So D, Labrecque Langlais E, Cobin D, Avram R. Revolutionising Acute Cardiac Care With Artificial Intelligence: Opportunities and Challenges. Can J Cardiol 2024:S0828-282X(24)00443-4. [PMID: 38901544 DOI: 10.1016/j.cjca.2024.06.011] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/06/2024] [Revised: 05/29/2024] [Accepted: 06/12/2024] [Indexed: 06/22/2024] Open
Abstract
This article reviews the application of artificial intelligence (AI) in acute cardiac care, highlighting its potential to transform patient outcomes in the face of the global burden of cardiovascular diseases. It explores how AI algorithms can rapidly and accurately process data for the prediction and diagnosis of acute cardiac conditions. The review examines AI's impact on patient health across various diagnostic tools such as echocardiography, electrocardiography, coronary angiography, cardiac computed tomography, and magnetic resonance imaging, discusses the regulatory landscape for AI in health care, and categorises AI algorithms by their risk levels. Furthermore, it addresses the challenges of data quality, generalisability, bias, transparency, and regulatory considerations, underscoring the necessity for inclusive data and robust validation processes. The review concludes with future perspectives on integrating AI into clinical workflows and the ongoing need for research, regulation, and innovation to harness AI's full potential in improving acute cardiac care.
Collapse
Affiliation(s)
- Gemina Doolub
- Department of Medicine, Montréal Heart Institute, Université de Montréal, Montréal, Québec, Canada
| | - Shaan Khurshid
- Cardiovascular Disease Initiative, Broad Institute of MIT and Harvard, Cambridge, Massachusetts, USA; Demoulas Center for Cardiac Arrhythmias, Massachusetts General Hospital, Boston, Massachusetts, USA
| | | | - Alexis Nolin Lapalme
- Department of Medicine, Montréal Heart Institute, Université de Montréal, Montréal, Québec, Canada; Heartwise (heartwise.ai), Montréal Heart Institute, Montréal, Québec, Canada; Mila-Québec AI Institute, Montréal, Québec, Canada
| | - Olivier Tastet
- Heartwise (heartwise.ai), Montréal Heart Institute, Montréal, Québec, Canada
| | - Derek So
- University of Ottawa, Heart Institute, Ottawa, Ontario, Canada
| | | | - Denis Cobin
- Heartwise (heartwise.ai), Montréal Heart Institute, Montréal, Québec, Canada
| | - Robert Avram
- Department of Medicine, Montréal Heart Institute, Université de Montréal, Montréal, Québec, Canada; Heartwise (heartwise.ai), Montréal Heart Institute, Montréal, Québec, Canada.
| |
Collapse
|
3
|
Elias P, Jain SS, Poterucha T, Randazzo M, Lopez Jimenez F, Khera R, Perez M, Ouyang D, Pirruccello J, Salerno M, Einstein AJ, Avram R, Tison GH, Nadkarni G, Natarajan V, Pierson E, Beecy A, Kumaraiah D, Haggerty C, Avari Silva JN, Maddox TM. Artificial Intelligence for Cardiovascular Care-Part 1: Advances: JACC Review Topic of the Week. J Am Coll Cardiol 2024; 83:2472-2486. [PMID: 38593946 DOI: 10.1016/j.jacc.2024.03.400] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/01/2024] [Accepted: 03/14/2024] [Indexed: 04/11/2024]
Abstract
Recent artificial intelligence (AI) advancements in cardiovascular care offer potential enhancements in diagnosis, treatment, and outcomes. Innovations to date focus on automating measurements, enhancing image quality, and detecting diseases using novel methods. Applications span wearables, electrocardiograms, echocardiography, angiography, genetics, and more. AI models detect diseases from electrocardiograms at accuracy not previously achieved by technology or human experts, including reduced ejection fraction, valvular heart disease, and other cardiomyopathies. However, AI's unique characteristics necessitate rigorous validation by addressing training methods, real-world efficacy, equity concerns, and long-term reliability. Despite an exponentially growing number of studies in cardiovascular AI, trials showing improvement in outcomes remain lacking. A number are currently underway. Embracing this rapidly evolving technology while setting a high evaluation benchmark will be crucial for cardiology to leverage AI to enhance patient care and the provider experience.
Collapse
Affiliation(s)
- Pierre Elias
- Seymour, Paul and Gloria Milstein Division of Cardiology, Columbia University Irving Medical Center, New York, New York, USA; Department of Biomedical Informatics Columbia University Irving Medical Center, New York, New York, USA
| | - Sneha S Jain
- Division of Cardiology, Stanford University School of Medicine, Palo Alto, California, USA
| | - Timothy Poterucha
- Seymour, Paul and Gloria Milstein Division of Cardiology, Columbia University Irving Medical Center, New York, New York, USA
| | - Michael Randazzo
- Division of Cardiology, University of Chicago Medical Center, Chicago, Illinois, USA
| | | | - Rohan Khera
- Division of Cardiology, Yale School of Medicine, New Haven, Connecticut, USA
| | - Marco Perez
- Division of Cardiology, Stanford University School of Medicine, Palo Alto, California, USA
| | - David Ouyang
- Division of Cardiology, Cedars-Sinai Medical Center, Los Angeles, California, USA
| | - James Pirruccello
- Division of Cardiology, University of California-San Francisco, San Francisco, California, USA
| | - Michael Salerno
- Division of Cardiology, Stanford University School of Medicine, Palo Alto, California, USA
| | - Andrew J Einstein
- Seymour, Paul and Gloria Milstein Division of Cardiology, Columbia University Irving Medical Center, New York, New York, USA
| | - Robert Avram
- Division of Cardiology, Montreal Heart Institute, Montreal, Quebec, Canada
| | - Geoffrey H Tison
- Division of Cardiology, University of California-San Francisco, San Francisco, California, USA
| | - Girish Nadkarni
- Icahn School of Medicine at Mount Sinai, New York, New York, USA
| | | | - Emma Pierson
- Department of Computer Science, Cornell Tech, New York, New York, USA
| | - Ashley Beecy
- NewYork-Presbyterian Health System, New York, New York, USA; Division of Cardiology, Weill Cornell Medical College, New York, New York, USA
| | - Deepa Kumaraiah
- Seymour, Paul and Gloria Milstein Division of Cardiology, Columbia University Irving Medical Center, New York, New York, USA; NewYork-Presbyterian Health System, New York, New York, USA
| | - Chris Haggerty
- Department of Biomedical Informatics Columbia University Irving Medical Center, New York, New York, USA; NewYork-Presbyterian Health System, New York, New York, USA
| | - Jennifer N Avari Silva
- Division of Cardiology, Washington University School of Medicine, St Louis, Missouri, USA
| | - Thomas M Maddox
- Division of Cardiology, Washington University School of Medicine, St Louis, Missouri, USA.
| |
Collapse
|
4
|
Labrecque Langlais É, Corbin D, Tastet O, Hayek A, Doolub G, Mrad S, Tardif JC, Tanguay JF, Marquis-Gravel G, Tison GH, Kadoury S, Le W, Gallo R, Lesage F, Avram R. Evaluation of stenoses using AI video models applied to coronary angiography. NPJ Digit Med 2024; 7:138. [PMID: 38783037 PMCID: PMC11116436 DOI: 10.1038/s41746-024-01134-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/14/2023] [Accepted: 05/10/2024] [Indexed: 05/25/2024] Open
Abstract
The coronary angiogram is the gold standard for evaluating the severity of coronary artery disease stenoses. Presently, the assessment is conducted visually by cardiologists, a method that lacks standardization. This study introduces DeepCoro, a ground-breaking AI-driven pipeline that integrates advanced vessel tracking and a video-based Swin3D model that was trained and validated on a dataset comprised of 182,418 coronary angiography videos spanning 5 years. DeepCoro achieved a notable precision of 71.89% in identifying coronary artery segments and demonstrated a mean absolute error of 20.15% (95% CI: 19.88-20.40) and a classification AUROC of 0.8294 (95% CI: 0.8215-0.8373) in stenosis percentage prediction compared to traditional cardiologist assessments. When compared to two expert interventional cardiologists, DeepCoro achieved lower variability than the clinical reports (19.09%; 95% CI: 18.55-19.58 vs 21.00%; 95% CI: 20.20-21.76, respectively). In addition, DeepCoro can be fine-tuned to a different modality type. When fine-tuned on quantitative coronary angiography assessments, DeepCoro attained an even lower mean absolute error of 7.75% (95% CI: 7.37-8.07), underscoring the reduced variability inherent to this method. This study establishes DeepCoro as an innovative video-based, adaptable tool in coronary artery disease analysis, significantly enhancing the precision and reliability of stenosis assessment.
Collapse
Affiliation(s)
- Élodie Labrecque Langlais
- Department of Electrical Engineering, Polytechnique Montréal, Montreal, QC, Canada
- Heartwise (heartwise.ai), Montreal Heart Institute, Montreal, QC, Canada
| | - Denis Corbin
- Heartwise (heartwise.ai), Montreal Heart Institute, Montreal, QC, Canada
- Department of Medicine, Montreal Heart Institute, Université de Montréal, Montreal, QC, Canada
| | - Olivier Tastet
- Heartwise (heartwise.ai), Montreal Heart Institute, Montreal, QC, Canada
- Department of Medicine, Montreal Heart Institute, Université de Montréal, Montreal, QC, Canada
| | - Ahmad Hayek
- Department of Medicine, Montreal Heart Institute, Université de Montréal, Montreal, QC, Canada
| | - Gemina Doolub
- Department of Medicine, Montreal Heart Institute, Université de Montréal, Montreal, QC, Canada
| | - Sebastián Mrad
- Department of Medicine, Montreal Heart Institute, Université de Montréal, Montreal, QC, Canada
| | - Jean-Claude Tardif
- Department of Medicine, Montreal Heart Institute, Université de Montréal, Montreal, QC, Canada
| | - Jean-François Tanguay
- Department of Medicine, Montreal Heart Institute, Université de Montréal, Montreal, QC, Canada
| | | | - Geoffrey H Tison
- Department of Medicine, University of California, San Francisco, CA, USA
| | - Samuel Kadoury
- Department of Computer Engineering, Polytechnique Montréal, Montreal, QC, Canada
| | - William Le
- Department of Computer Engineering, Polytechnique Montréal, Montreal, QC, Canada
| | - Richard Gallo
- Department of Medicine, Montreal Heart Institute, Université de Montréal, Montreal, QC, Canada
| | - Frederic Lesage
- Department of Electrical Engineering, Polytechnique Montréal, Montreal, QC, Canada
- Department of Medicine, Montreal Heart Institute, Université de Montréal, Montreal, QC, Canada
| | - Robert Avram
- Heartwise (heartwise.ai), Montreal Heart Institute, Montreal, QC, Canada.
- Department of Medicine, Montreal Heart Institute, Université de Montréal, Montreal, QC, Canada.
| |
Collapse
|
5
|
Chang SS, Lin CT, Wang WC, Hsu KC, Wu YL, Liu CH, Fann YC. Optimizing ensemble U-Net architectures for robust coronary vessel segmentation in angiographic images. Sci Rep 2024; 14:6640. [PMID: 38503839 PMCID: PMC10951254 DOI: 10.1038/s41598-024-57198-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/17/2023] [Accepted: 03/15/2024] [Indexed: 03/21/2024] Open
Abstract
Automated coronary angiography assessment requires precise vessel segmentation, a task complicated by uneven contrast filling and background noise. Our research introduces an ensemble U-Net model, SE-RegUNet, designed to accurately segment coronary vessels using 100 labeled angiographies from angiographic images. SE-RegUNet incorporates RegNet encoders and squeeze-and-excitation blocks to enhance feature extraction. A dual-phase image preprocessing strategy further improves the model's performance, employing unsharp masking and contrast-limited adaptive histogram equalization. Following fivefold cross-validation and Ranger21 optimization, the SE-RegUNet 4GF model emerged as the most effective, evidenced by performance metrics such as a Dice score of 0.72 and an accuracy of 0.97. Its potential for real-world application is highlighted by its ability to process images at 41.6 frames per second. External validation on the DCA1 dataset demonstrated the model's consistent robustness, achieving a Dice score of 0.76 and an accuracy of 0.97. The SE-RegUNet 4GF model's precision in segmenting blood vessels in coronary angiographies showcases its remarkable efficiency and accuracy. However, further development and clinical testing are necessary before it can be routinely implemented in medical practice.
Collapse
Affiliation(s)
- Shih-Sheng Chang
- Division of Cardiovascular Medicine, China Medical University Hospital, Taichung, Taiwan
- School of Medicine, College of Medicine, China Medical University, Taichung, Taiwan
| | - Ching-Ting Lin
- Artificial Intelligence Center, China Medical University Hospital, Taichung, Taiwan
| | - Wei-Chun Wang
- Department of Neurology, China Medical University Hospital, Taichung, Taiwan
- Neuroscience and Brain Disease Center, China Medical University, Taichung, Taiwan
- Artificial Intelligence Center, China Medical University Hospital, Taichung, Taiwan
| | - Kai-Cheng Hsu
- Artificial Intelligence Center, China Medical University Hospital, Taichung, Taiwan
- Department of Neurology, China Medical University Hospital, Taichung, Taiwan
- Neuroscience and Brain Disease Center, China Medical University, Taichung, Taiwan
- School of Medicine, College of Medicine, China Medical University, Taichung, Taiwan
| | - Ya-Lun Wu
- Artificial Intelligence Center, China Medical University Hospital, Taichung, Taiwan
| | - Chia-Hao Liu
- Division of Cardiovascular Medicine, China Medical University Hospital, Taichung, Taiwan
| | - Yang C Fann
- Division of Intramural Research, National Institute of Neurological Disorders and Stroke, National Institutes of Health, 35 Convent Dr., Bethesda, MD, 20892, USA.
| |
Collapse
|
6
|
Wu C, Xu C, Ou S, Wu X, Guo J, Qi Y, Cai S. A novel approach for diabetic foot diagnosis: Deep learning-based detection of lower extremity arterial stenosis. Diabetes Res Clin Pract 2024; 207:111032. [PMID: 38049035 DOI: 10.1016/j.diabres.2023.111032] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/04/2023] [Revised: 11/23/2023] [Accepted: 11/30/2023] [Indexed: 12/06/2023]
Abstract
PURPOSE OF THE STUDY Assessing the lower extremity arterial stenosis scores (LEASS) in patients with diabetic foot ulcer (DFU) is a challenging task that requires considerable time and efforts from physicians, and it may yield varying results. The presence of vascular wall calcification and other irrelevant tissue information surrounding the vessel can further compound the difficulties of this evaluation. Automatic detection of lower extremity arterial stenosis (LEAS) is expected to help doctors develop treatment plans for patients faster. METHODS In this paper, we first reconstructed the 3D model of blood vessels by medical digital image processing and then utilized it as the training data for deep learning (DL) in conjunction with the non-calcified part of blood vessels in the original data. We proposed an improved model of vascular stenosis small target detection based on YOLOv5. We added Convolutional Block Attention Module (CBAM) in backbone, replaced Path Aggregation Network (PANET) with Bidirectional Feature Pyramid Network (BiFPN) and replaced C3 with GhostC3 in neck to improve the recognition of three types of stenosis targets (I: <50 %, II: 51 % - 99 %, III: completely occluded). Additionally, we utilized K-Means++ instead of K-Means for better algorithm convergence performance, and enhanced the Complete-IoU (CIoU) loss function to Alpha-Scylla-IoU (ASIoU) loss for faster reasoning and convergence. Lastly, we conducted comparisons between our approach and five other prominent models. RESULT Our method had the best average ability to detect three types of stenosis with 85.40% mean Average Precision (mAP) and 74.60 Frames Per Second (FPS) and explored the possibility of applying DL to the detection of LEAS in diabetic foot. The code is available at github.com/wuchongxin/yolov5_LEAS.git.
Collapse
Affiliation(s)
- Chongxin Wu
- School of Automation, Guangdong University of Technology, Guangzhou 510006, China
| | - Changpeng Xu
- Department of Orthopaedics, Guangdong Second Provincial General Hospital, Guangzhou 510317, China
| | - Shuanji Ou
- Department of Orthopaedics, Guangdong Second Provincial General Hospital, Guangzhou 510317, China
| | - Xiaodong Wu
- Department of Orthopaedics, Guangdong Second Provincial General Hospital, Guangzhou 510317, China
| | - Jing Guo
- School of Automation, Guangdong University of Technology, Guangzhou 510006, China
| | - Yong Qi
- Department of Orthopaedics, Guangdong Second Provincial General Hospital, Guangzhou 510317, China; Guangdong Traditional Medical and Sports Injury Rehabilitation Research Institute, Guangdong Second Provincial General Hospital, Guangzhou 510317, China.
| | - Shuting Cai
- School of Integrated Circuits, Guangdong University of Technology, Guangzhou 510006, China.
| |
Collapse
|
7
|
Wulamu A, Luo J, Chen S, Zheng H, Wang T, Yang R, Jiao L, Zhang T. CASMatching strategy for automated detection and quantification of carotid artery stenosis based on digital subtraction angiography. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2024; 243:107871. [PMID: 37925855 DOI: 10.1016/j.cmpb.2023.107871] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/28/2023] [Revised: 09/16/2023] [Accepted: 10/15/2023] [Indexed: 11/07/2023]
Abstract
BACKGROUND AND OBJECTIVE Automated detection and quantification of carotid artery stenosis is a crucial task in establishing a computer-aided diagnostic system for brain diseases. Digital subtraction angiography (DSA) is known as the "gold standard" for carotid stenosis diagnosis. It is commonly used to identify carotid artery stenosis and measure morphological indices of the stenosis. However, using deep learning to detect stenosis based on DSA images and further quantitatively predicting the morphological indices remain a challenge due the absence of prior work. In this paper, we propose a quantitative method for predicting morphological indices of carotid stenosis. METHODS Our method adopts a two-stage pipeline, first locating regions suitable for predicting morphological indices by object detection model, and then using a regression model to predict indices. A novel Carotid Artery Stenosis Matching (CASMatching) strategy is introduced into the object detection to model the matching relationship between a stenosis and multiple normal vessel segments. The proposed Match-ness branch predicts a Match-ness score for each normal vessel segment to indicate the degree of matching to the stenosis. A novel Direction Distance-IoU (2DIoU) loss based on the Distance-IoU loss is proposed to make the model focused more on the bounding box regression in the direction of vessel extension. After detection, the normal vessel segment with the highest Match-ness score and the stenosis are intercepted from the original image, then fed into a regression model to predict morphological indices and calculate the degree of stenosis. RESULTS Our method is trained and evaluated on a dataset collected from three different manufacturers' monoplane X-ray systems. The results show that the proposed components in the object detector substantially improve the detection performance of normal vascular segments. For the prediction of morphological indices, our model achieves Mean Absolute Error of 0.378, 0.221, 4.9 on reference vessel diameter (RVD), minimum lumen diameter (MLD) and stenosis degree. CONCLUSIONS Our method can precisely localize the carotid stenosis and the normal vessel segment suitable for predicting RVD of the stenosis, and further achieve accurate quantification, providing a novel solution for the quantification of carotid artery stenosis.
Collapse
Affiliation(s)
- Aziguli Wulamu
- Department of Computer, School of Computer and Communication Engineering, University of Science and Technology Beijing (USTB), Beijing, China; Beijing Key Laboratory of Knowledge Engineering for Materials Science, Beijing, China.
| | - Jichang Luo
- Department of Neurosurgery, Xuanwu Hospital, Capital Medical University, Beijing, China; China International Neuroscience Institute (China-INI), Beijing, China
| | - Saian Chen
- Department of Computer, School of Computer and Communication Engineering, University of Science and Technology Beijing (USTB), Beijing, China; Beijing Key Laboratory of Knowledge Engineering for Materials Science, Beijing, China
| | - Han Zheng
- Education Department of Guangxi Zhuang Autonomous Region, Key Laboratory of AI and Information Processing (Hechi University), Hechi, Guangxi 546300, China.
| | - Tao Wang
- Department of Neurosurgery, Xuanwu Hospital, Capital Medical University, Beijing, China; China International Neuroscience Institute (China-INI), Beijing, China
| | - Renjie Yang
- Department of Neurosurgery, Xuanwu Hospital, Capital Medical University, Beijing, China; China International Neuroscience Institute (China-INI), Beijing, China
| | - Liqun Jiao
- Department of Neurosurgery, Xuanwu Hospital, Capital Medical University, Beijing, China; China International Neuroscience Institute (China-INI), Beijing, China; Department of Interventional Radiology, Xuanwu Hospital, Capital Medical University, Beijing, China.
| | - Taohong Zhang
- Department of Computer, School of Computer and Communication Engineering, University of Science and Technology Beijing (USTB), Beijing, China; Beijing Key Laboratory of Knowledge Engineering for Materials Science, Beijing, China.
| |
Collapse
|
8
|
Park J, Kweon J, Kim YI, Back I, Chae J, Roh JH, Kang DY, Lee PH, Ahn JM, Kang SJ, Park DW, Lee SW, Lee CW, Park SW, Park SJ, Kim YH. Selective ensemble methods for deep learning segmentation of major vessels in invasive coronary angiography. Med Phys 2023; 50:7822-7839. [PMID: 37310802 DOI: 10.1002/mp.16554] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/10/2022] [Revised: 03/29/2023] [Accepted: 05/26/2023] [Indexed: 06/15/2023] Open
Abstract
BACKGROUND Invasive coronary angiography (ICA) is a primary imaging modality that visualizes the lumen area of coronary arteries for diagnosis and interventional guidance. In the current practice of quantitative coronary analysis (QCA), semi-automatic segmentation tools require labor-intensive and time-consuming manual correction, limiting their application in the catheterization room. PURPOSE This study aims to propose rank-based selective ensemble methods that improve the segmentation performance and reduce morphological errors that limit fully automated quantification of coronary artery using deep-learning segmentation of ICA. METHODS Two selective ensemble methods proposed in this work integrated the weighted ensemble approach with per-image quality estimation. The segmentation outcomes from five base models with different loss functions were ranked either by mask morphology or estimated dice similarity coefficient (DSC). The final output was determined by imposing different weights according to the ranks. The ranking criteria based on mask morphology were formulated from empirical insight to avoid frequent types of segmentation errors (MSEN), while the estimation of DSCs was performed by comparing the pseudo-ground truth generated from a meta-learner (ESEN). Five-fold cross-validation was performed with the internal dataset of 7426 coronary angiograms from 2924 patients, and prediction model was externally validated with 556 images of 226 patients. RESULTS The selective ensemble methods improved the segmentation performance with DSCs up to 93.07% and provided a better delineation of coronary lesion with local DSCs of up to 93.93%, outperforming all individual models. Proposed methods also minimized the chances of mask disconnection in the most narrowed regions to 2.10%. The robustness of the proposed methods was also evident in the external validation. Inference time for major vessel segmentation was approximately one-sixth of a second. CONCLUSION Proposed methods successfully reduced morphological errors in the predicted masks and were able to enhance the robustness of the automatic segmentation. The results suggest better applicability of real-time QCA-based diagnostic methods in routine clinical settings.
Collapse
Affiliation(s)
- Jeeone Park
- Department of Medical Science, Asan Medical Institute of Convergence Science and Technology, Asan Medical Center, University of Ulsan College of Medicine, Seoul, South Korea
| | - Jihoon Kweon
- Department of Convergence Medicine, Asan Medical Center, University of Ulsan College of Medicine, Seoul, South Korea
| | - Young In Kim
- Department of Medical Science, Asan Medical Institute of Convergence Science and Technology, Asan Medical Center, University of Ulsan College of Medicine, Seoul, South Korea
| | - Inwook Back
- Division of Cardiology, Department of Internal Medicine, Medical Center, University of Ulsan College of Medicine, Asan, Seoul, South Korea
| | - Jihye Chae
- Division of Cardiology, Department of Internal Medicine, Medical Center, University of Ulsan College of Medicine, Asan, Seoul, South Korea
| | - Jae-Hyung Roh
- Department of Cardiology, Chungnam National University Sejong Hospital, Chungnam National University School of Medicine, Daejeon, South Korea
| | - Do-Yoon Kang
- Division of Cardiology, Department of Internal Medicine, Medical Center, University of Ulsan College of Medicine, Asan, Seoul, South Korea
| | - Pil Hyung Lee
- Division of Cardiology, Department of Internal Medicine, Medical Center, University of Ulsan College of Medicine, Asan, Seoul, South Korea
| | - Jung-Min Ahn
- Division of Cardiology, Department of Internal Medicine, Medical Center, University of Ulsan College of Medicine, Asan, Seoul, South Korea
| | - Soo-Jin Kang
- Division of Cardiology, Department of Internal Medicine, Medical Center, University of Ulsan College of Medicine, Asan, Seoul, South Korea
| | - Duk-Woo Park
- Division of Cardiology, Department of Internal Medicine, Medical Center, University of Ulsan College of Medicine, Asan, Seoul, South Korea
| | - Seung-Whan Lee
- Division of Cardiology, Department of Internal Medicine, Medical Center, University of Ulsan College of Medicine, Asan, Seoul, South Korea
| | - Cheol Whan Lee
- Division of Cardiology, Department of Internal Medicine, Medical Center, University of Ulsan College of Medicine, Asan, Seoul, South Korea
| | - Seong-Wook Park
- Division of Cardiology, Department of Internal Medicine, Medical Center, University of Ulsan College of Medicine, Asan, Seoul, South Korea
| | - Seung-Jung Park
- Division of Cardiology, Department of Internal Medicine, Medical Center, University of Ulsan College of Medicine, Asan, Seoul, South Korea
| | - Young-Hak Kim
- Division of Cardiology, Department of Internal Medicine, Medical Center, University of Ulsan College of Medicine, Asan, Seoul, South Korea
| |
Collapse
|
9
|
Wu H, Zhao J, Li J, Zeng Y, Wu W, Zhou Z, Wu S, Xu L, Song M, Yu Q, Song Z, Chen L. One-Stage Detection without Segmentation for Multi-Type Coronary Lesions in Angiography Images Using Deep Learning. Diagnostics (Basel) 2023; 13:3011. [PMID: 37761378 PMCID: PMC10528585 DOI: 10.3390/diagnostics13183011] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/07/2023] [Revised: 09/12/2023] [Accepted: 09/18/2023] [Indexed: 09/29/2023] Open
Abstract
It is rare to use the one-stage model without segmentation for the automatic detection of coronary lesions. This study sequentially enrolled 200 patients with significant stenoses and occlusions of the right coronary and categorized their angiography images into two angle views: The CRA (cranial) view of 98 patients with 2453 images and the LAO (left anterior oblique) view of 176 patients with 3338 images. Randomization was performed at the patient level to the training set and test set using a 7:3 ratio. YOLOv5 was adopted as the key model for direct detection. Four types of lesions were studied: Local Stenosis (LS), Diffuse Stenosis (DS), Bifurcation Stenosis (BS), and Chronic Total Occlusion (CTO). At the image level, the precision, recall, mAP@0.1, and mAP@0.5 predicted by the model were 0.64, 0.68, 0.66, and 0.49 in the CRA view and 0.68, 0.73, 0.70, and 0.56 in the LAO view, respectively. At the patient level, the precision, recall, and F1scores predicted by the model were 0.52, 0.91, and 0.65 in the CRA view and 0.50, 0.94, and 0.64 in the LAO view, respectively. YOLOv5 performed the best for lesions of CTO and LS at both the image level and the patient level. In conclusion, the one-stage model without segmentation as YOLOv5 is feasible to be used in automatic coronary lesion detection, with the most suitable types of lesions as LS and CTO.
Collapse
Affiliation(s)
- Hui Wu
- Department of Biomedical Engineering, Faculty of Environment and Life, Beijing University of Technology, Beijing 100124, China
| | - Jing Zhao
- Department of Geriatrics, The Third Medical Center of Chinese PLA General Hospital, Beijing 100039, China
| | - Jiehui Li
- State Key Laboratory of Cardiovascular Disease, Department of Cardiac Surgery, National Center for Cardiovascular Diseases, Fuwai Hospital, Chinese Academy of Medical Sciences, Peking Union Medical College, Beijing 100037, China
| | - Yan Zeng
- Department of Research Center, Shanghai United Imaging Intelligence Co., Ltd., Shanghai 201807, China
| | - Weiwei Wu
- College of Biomedical Engineering, Capital Medical University, Beijing 100069, China
| | - Zhuhuang Zhou
- Department of Biomedical Engineering, Faculty of Environment and Life, Beijing University of Technology, Beijing 100124, China
| | - Shuicai Wu
- Department of Biomedical Engineering, Faculty of Environment and Life, Beijing University of Technology, Beijing 100124, China
| | - Liang Xu
- State Key Laboratory of Cardiovascular Disease, Department of Structural Heart Disease, National Center for Cardiovascular Diseases, Fuwai Hospital, Chinese Academy of Medical Sciences, Peking Union Medical College, Beijing 100037, China
| | - Min Song
- State Key Laboratory of Cardiovascular Disease, Department of Cardiac Surgery, National Center for Cardiovascular Diseases, Fuwai Hospital, Chinese Academy of Medical Sciences, Peking Union Medical College, Beijing 100037, China
| | - Qibin Yu
- State Key Laboratory of Cardiovascular Disease, Department of Cardiac Surgery, National Center for Cardiovascular Diseases, Fuwai Hospital, Chinese Academy of Medical Sciences, Peking Union Medical College, Beijing 100037, China
| | - Ziwei Song
- Department of Biomedical Engineering, Faculty of Environment and Life, Beijing University of Technology, Beijing 100124, China
| | - Lin Chen
- Department of Biomedical Engineering, Faculty of Environment and Life, Beijing University of Technology, Beijing 100124, China
| |
Collapse
|
10
|
Yan Y, Wang T, Zhang R, Liu Y, Hu W, Sitti M. Magnetically assisted soft milli-tools for occluded lumen morphology detection. SCIENCE ADVANCES 2023; 9:eadi3979. [PMID: 37585531 PMCID: PMC10431716 DOI: 10.1126/sciadv.adi3979] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/24/2023] [Accepted: 07/17/2023] [Indexed: 08/18/2023]
Abstract
Methodologies based on intravascular imaging have revolutionized the diagnosis and treatment of endovascular diseases. However, current methods are limited in detecting, i.e., visualizing and crossing, complicated occluded vessels. Therefore, we propose a miniature soft tool comprising a magnet-assisted active deformation segment (ADS) and a fluid drag-driven segment (FDS) to visualize and cross the occlusions with various morphologies. First, via soft-bodied deformation and interaction, the ADS could visualize the structure details of partial occlusions with features as small as 0.5 millimeters. Then, by leveraging the fluidic drag from the pulsatile flow, the FDS could automatically detect an entry point selectively from severe occlusions with complicated microchannels whose diameters are down to 0.2 millimeters. The functions have been validated in both biologically relevant phantoms and organs ex vivo. This soft tool could help enhance the efficacy of minimally invasive medicine for the diagnosis and treatment of occlusions in various circulatory systems.
Collapse
Affiliation(s)
- Yingbo Yan
- Physical Intelligence Department, Max Planck Institute for Intelligent Systems, Stuttgart 70569, Germany
- Laboratory for Multiscale Mechanics and Medical Science, SV LAB, School of Aerospace, Xi’an Jiaotong University, Xi’an 710049, China
| | - Tianlu Wang
- Physical Intelligence Department, Max Planck Institute for Intelligent Systems, Stuttgart 70569, Germany
| | - Rongjing Zhang
- Physical Intelligence Department, Max Planck Institute for Intelligent Systems, Stuttgart 70569, Germany
| | - Yilun Liu
- Laboratory for Multiscale Mechanics and Medical Science, SV LAB, School of Aerospace, Xi’an Jiaotong University, Xi’an 710049, China
| | - Wenqi Hu
- Physical Intelligence Department, Max Planck Institute for Intelligent Systems, Stuttgart 70569, Germany
| | - Metin Sitti
- Physical Intelligence Department, Max Planck Institute for Intelligent Systems, Stuttgart 70569, Germany
- Department of Information Technology and Electrical Engineering, ETH Zurich, 8092 Zurich, Switzerland
- School of Medicine and College of Engineering, Koç University, Istanbul 34450, Turkey
| |
Collapse
|
11
|
Avram R, Olgin JE, Ahmed Z, Verreault-Julien L, Wan A, Barrios J, Abreau S, Wan D, Gonzalez JE, Tardif JC, So DY, Soni K, Tison GH. CathAI: fully automated coronary angiography interpretation and stenosis estimation. NPJ Digit Med 2023; 6:142. [PMID: 37568050 PMCID: PMC10421915 DOI: 10.1038/s41746-023-00880-1] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/05/2023] [Accepted: 07/21/2023] [Indexed: 08/13/2023] Open
Abstract
Coronary angiography is the primary procedure for diagnosis and management decisions in coronary artery disease (CAD), but ad-hoc visual assessment of angiograms has high variability. Here we report a fully automated approach to interpret angiographic coronary artery stenosis from standard coronary angiograms. Using 13,843 angiographic studies from 11,972 adult patients at University of California, San Francisco (UCSF), between April 1, 2008 and December 31, 2019, we train neural networks to accomplish four sequential necessary tasks for automatic coronary artery stenosis localization and estimation. Algorithms are internally validated against criterion-standard labels for each task in hold-out test datasets. Algorithms are then externally validated in real-world angiograms from the University of Ottawa Heart Institute (UOHI) and also retrained using quantitative coronary angiography (QCA) data from the Montreal Heart Institute (MHI) core lab. The CathAI system achieves state-of-the-art performance across all tasks on unselected, real-world angiograms. Positive predictive value, sensitivity and F1 score are all ≥90% to identify projection angle and ≥93% for left/right coronary artery angiogram detection. To predict obstructive CAD stenosis (≥70%), CathAI exhibits an AUC of 0.862 (95% CI: 0.843-0.880). In UOHI external validation, CathAI achieves AUC 0.869 (95% CI: 0.830-0.907) to predict obstructive CAD. In the MHI QCA dataset, CathAI achieves an AUC of 0.775 (95%. CI: 0.594-0.955) after retraining. In conclusion, multiple purpose-built neural networks can function in sequence to accomplish automated analysis of real-world angiograms, which could increase standardization and reproducibility in angiographic coronary stenosis assessment.
Collapse
Affiliation(s)
- Robert Avram
- Division of Cardiology, Department of Medicine, University of California, San Francisco, Cardiology, 505 Parnassus Avenue, San Francisco, CA, 94143, USA
- Division of Cardiology, Department of Medicine, Montreal Heart Institute - Université de Montréal, 5000 Rue Belanger, Montreal, QC, H1T 1C8, Canada
| | - Jeffrey E Olgin
- Division of Cardiology, Department of Medicine, University of California, San Francisco, Cardiology, 505 Parnassus Avenue, San Francisco, CA, 94143, USA
- Cardiovascular Research Institute, University of California, San Francisco, CA, 94143, USA
| | - Zeeshan Ahmed
- Division of Cardiology, Department of Medicine, University of Ottawa Heart Institute, University of Ottawa, 40 Ruskin Street, Ottawa, ON, K1Y 4W7, Canada
| | - Louis Verreault-Julien
- Division of Cardiology, Department of Medicine, University of Ottawa Heart Institute, University of Ottawa, 40 Ruskin Street, Ottawa, ON, K1Y 4W7, Canada
| | - Alvin Wan
- Cardiovascular Research Institute, University of California, San Francisco, CA, 94143, USA
| | - Joshua Barrios
- Division of Cardiology, Department of Medicine, University of California, San Francisco, Cardiology, 505 Parnassus Avenue, San Francisco, CA, 94143, USA
| | - Sean Abreau
- Division of Cardiology, Department of Medicine, University of California, San Francisco, Cardiology, 505 Parnassus Avenue, San Francisco, CA, 94143, USA
| | - Derek Wan
- Department of Electrical Engineering and Computer Science, RISE Lab, University of California, Berkeley, Soda Hall, Berkeley, CA, 94720-1770, USA
| | - Joseph E Gonzalez
- Department of Electrical Engineering and Computer Science, RISE Lab, University of California, Berkeley, Soda Hall, Berkeley, CA, 94720-1770, USA
| | - Jean-Claude Tardif
- Division of Cardiology, Department of Medicine, Montreal Heart Institute - Université de Montréal, 5000 Rue Belanger, Montreal, QC, H1T 1C8, Canada
| | - Derek Y So
- Division of Cardiology, Department of Medicine, University of Ottawa Heart Institute, University of Ottawa, 40 Ruskin Street, Ottawa, ON, K1Y 4W7, Canada
| | - Krishan Soni
- Division of Cardiology, Department of Medicine, University of California, San Francisco, Cardiology, 505 Parnassus Avenue, San Francisco, CA, 94143, USA
| | - Geoffrey H Tison
- Division of Cardiology, Department of Medicine, University of California, San Francisco, Cardiology, 505 Parnassus Avenue, San Francisco, CA, 94143, USA.
- Cardiovascular Research Institute, University of California, San Francisco, CA, 94143, USA.
- Department of Electrical Engineering and Computer Science, RISE Lab, University of California, Berkeley, Soda Hall, Berkeley, CA, 94720-1770, USA.
- Bakar Computational Health Sciences Institute, University of California, San Francisco, 94158, USA.
| |
Collapse
|
12
|
Ling H, Chen B, Guan R, Xiao Y, Yan H, Chen Q, Bi L, Chen J, Feng X, Pang H, Song C. Deep Learning Model for Coronary Angiography. J Cardiovasc Transl Res 2023; 16:896-904. [PMID: 36928587 DOI: 10.1007/s12265-023-10368-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/31/2022] [Accepted: 03/02/2023] [Indexed: 03/18/2023]
Abstract
The visual inspection of coronary artery stenosis is known to be significantly affected by variation, due to the presence of other tissues, camera movements, and uneven illumination. More accurate and intelligent coronary angiography diagnostic models are necessary for improving the above problems. In this study, 2980 medical images from 949 patients are collected and a novel deep learning-based coronary angiography (DLCAG) diagnose system is proposed. Firstly, we design a module of coronary classification. Then, we introduce RetinaNet to balance positive and negative samples and improve the recognition accuracy. Additionally, DLCAG adopts instance segmentation to segment the stenosis of vessels and depict the degree of the stenosis vessels. Our DLCAG is available at http://101.132.120.184:8077/ . When doctors use our system, all they need to do is login to the system, upload the coronary angiography videos. Then, a diagnose report is automatically generated.
Collapse
Affiliation(s)
- Hao Ling
- Department of Cardiology, Second Hospital of Jilin University, Changchun, 130012, China
| | - Biqian Chen
- Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education, College of Computer Science and Technology, Jilin University, Changchun, 130012, China
| | - Renchu Guan
- Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education, College of Computer Science and Technology, Jilin University, Changchun, 130012, China
| | - Yu Xiao
- Department of Cardiology, Second Hospital of Jilin University, Changchun, 130012, China
| | - Hui Yan
- Department of Cardiology, Second Hospital of Jilin University, Changchun, 130012, China
| | - Qingyu Chen
- Department of Cardiology, Sixth People's Hospital, Shanghai Jiaotong University, Shanghai, 200233, China
| | - Lianru Bi
- Department of Cardiology, the Eighth Affiliated Hospital of Sun Yat Sen University, Shenzhen, 518033, China
| | - Jingbo Chen
- Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education, College of Computer Science and Technology, Jilin University, Changchun, 130012, China
| | - Xiaoyue Feng
- Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education, College of Computer Science and Technology, Jilin University, Changchun, 130012, China
| | - Haoyu Pang
- Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education, College of Computer Science and Technology, Jilin University, Changchun, 130012, China
| | - Chunli Song
- Department of Cardiology, Second Hospital of Jilin University, Changchun, 130012, China.
| |
Collapse
|
13
|
Wahab Sait AR, Dutta AK. Developing a Deep-Learning-Based Coronary Artery Disease Detection Technique Using Computer Tomography Images. Diagnostics (Basel) 2023; 13:diagnostics13071312. [PMID: 37046530 PMCID: PMC10093692 DOI: 10.3390/diagnostics13071312] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/28/2023] [Revised: 03/26/2023] [Accepted: 03/30/2023] [Indexed: 04/03/2023] Open
Abstract
Coronary artery disease (CAD) is one of the major causes of fatalities across the globe. The recent developments in convolutional neural networks (CNN) allow researchers to detect CAD from computed tomography (CT) images. The CAD detection model assists physicians in identifying cardiac disease at earlier stages. The recent CAD detection models demand a high computational cost and a more significant number of images. Therefore, this study intends to develop a CNN-based CAD detection model. The researchers apply an image enhancement technique to improve the CT image quality. The authors employed You look only once (YOLO) V7 for extracting the features. Aquila optimization is used for optimizing the hyperparameters of the UNet++ model to predict CAD. The proposed feature extraction technique and hyperparameter tuning approach reduces the computational costs and improves the performance of the UNet++ model. Two datasets are utilized for evaluating the performance of the proposed CAD detection model. The experimental outcomes suggest that the proposed method achieves an accuracy, recall, precision, F1-score, Matthews correlation coefficient, and Kappa of 99.4, 98.5, 98.65, 98.6, 95.35, and 95 and 99.5, 98.95, 98.95, 98.95, 96.35, and 96.25 for datasets 1 and 2, respectively. In addition, the proposed model outperforms the recent techniques by obtaining the area under the receiver operating characteristic and precision-recall curve of 0.97 and 0.95, and 0.96 and 0.94 for datasets 1 and 2, respectively. Moreover, the proposed model obtained a better confidence interval and standard deviation of [98.64–98.72] and 0.0014, and [97.41–97.49] and 0.0019 for datasets 1 and 2, respectively. The study’s findings suggest that the proposed model can support physicians in identifying CAD with limited resources.
Collapse
|
14
|
Cong C, Kato Y, Vasconcellos HDD, Ostovaneh MR, Lima JAC, Ambale-Venkatesh B. Deep learning-based end-to-end automated stenosis classification and localization on catheter coronary angiography. Front Cardiovasc Med 2023; 10:944135. [PMID: 36824452 PMCID: PMC9941145 DOI: 10.3389/fcvm.2023.944135] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/14/2022] [Accepted: 01/16/2023] [Indexed: 02/09/2023] Open
Abstract
Background Automatic coronary angiography (CAG) assessment may help in faster screening and diagnosis of stenosis in patients with atherosclerotic disease. We aimed to provide an end-to-end workflow that separates cases with normal or mild stenoses from those with higher stenosis severities to facilitate safety screening of a large volume of the CAG images. Methods A deep learning-based end-to-end workflow was employed as follows: (1) Candidate frame selection from CAG videograms with Convolutional Neural Network (CNN) + Long Short Term Memory (LSTM) network, (2) Stenosis classification with Inception-v3 using 2 or 3 categories (<25%, >25%, and/or total occlusion) with and without redundancy training, and (3) Stenosis localization with two methods of class activation map (CAM) and anchor-based feature pyramid network (FPN). Overall 13,744 frames from 230 studies were used for the stenosis classification training and fourfold cross-validation for image-, artery-, and per-patient-level. For the stenosis localization training and fourfold cross-validation, 690 images with > 25% stenosis were used. Results Our model achieved an accuracy of 0.85, sensitivity of 0.96, and AUC of 0.86 in per-patient level stenosis classification. Redundancy training was effective to improve classification performance. Stenosis position localization was adequate with better quantitative results in anchor-based FPN model, achieving global-sensitivity for left coronary artery (LCA) and right coronary artery (RCA) of 0.68 and 0.70. Conclusion We demonstrated a fully automatic end-to-end deep learning-based workflow that eliminates the vessel extraction and segmentation step in coronary artery stenosis classification and localization on CAG images. This tool may be useful to facilitate safety screening in high-volume centers and in clinical trial settings.
Collapse
Affiliation(s)
- Chao Cong
- Division of Cardiology, Johns Hopkins University, Baltimore, MD, United States
- School of Electrical and Electronic Engineering, Chongqing University of Technology, Chongqing, China
| | - Yoko Kato
- Division of Cardiology, Johns Hopkins University, Baltimore, MD, United States
| | | | | | - Joao A. C. Lima
- Division of Cardiology, Johns Hopkins University, Baltimore, MD, United States
| | | |
Collapse
|
15
|
Chu M, Wu P, Li G, Yang W, Gutiérrez-Chico JL, Tu S. Advances in Diagnosis, Therapy, and Prognosis of Coronary Artery Disease Powered by Deep Learning Algorithms. JACC. ASIA 2023; 3:1-14. [PMID: 36873752 PMCID: PMC9982227 DOI: 10.1016/j.jacasi.2022.12.005] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 10/18/2022] [Revised: 11/29/2022] [Accepted: 12/01/2022] [Indexed: 02/17/2023]
Abstract
Percutaneous coronary intervention has been a standard treatment strategy for patients with coronary artery disease with continuous ebullient progress in technology and techniques. The application of artificial intelligence and deep learning in particular is currently boosting the development of interventional solutions, improving the efficiency and objectivity of diagnosis and treatment. The ever-growing amount of data and computing power together with cutting-edge algorithms pave the way for the integration of deep learning into clinical practice, which has revolutionized the interventional workflow in imaging processing, interpretation, and navigation. This review discusses the development of deep learning algorithms and their corresponding evaluation metrics together with their clinical applications. Advanced deep learning algorithms create new opportunities for precise diagnosis and tailored treatment with a high degree of automation, reduced radiation, and enhanced risk stratification. Generalization, interpretability, and regulatory issues are remaining challenges that need to be addressed through joint efforts from multidisciplinary community.
Collapse
Affiliation(s)
- Miao Chu
- Biomedical Instrument Institute, School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China
| | - Peng Wu
- Biomedical Instrument Institute, School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China
| | - Guanyu Li
- Biomedical Instrument Institute, School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China.,Department of Cardiology, Aarhus University Hospital, Aarhus, Denmark
| | - Wei Yang
- School of Biomedical Engineering, Southern Medical University, Guangzhou, Guangdong, China
| | | | - Shengxian Tu
- Biomedical Instrument Institute, School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China
| |
Collapse
|
16
|
Han T, Ai D, Li X, Fan J, Song H, Wang Y, Yang J. Coronary artery stenosis detection via proposal-shifted spatial-temporal transformer in X-ray angiography. Comput Biol Med 2023; 153:106546. [PMID: 36641935 DOI: 10.1016/j.compbiomed.2023.106546] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/04/2022] [Revised: 01/03/2023] [Accepted: 01/10/2023] [Indexed: 01/13/2023]
Abstract
Accurate detection of coronary artery stenosis in X-ray angiography (XRA) images is crucial for the diagnosis and treatment of coronary artery disease. However, stenosis detection remains a challenging task due to complicated vascular structures, poor imaging quality, and fickle lesions. While devoted to accurate stenosis detection, most methods are inefficient in the exploitation of spatio-temporal information of XRA sequences, leading to a limited performance on the task. To overcome the problem, we propose a new stenosis detection framework based on a Transformer-based module to aggregate proposal-level spatio-temporal features. In the module, proposal-shifted spatio-temporal tokenization (PSSTT) scheme is devised to gather spatio-temporal region-of-interest (RoI) features for obtaining visual tokens within a local window. Then, the Transformer-based feature aggregation (TFA) network takes the tokens as the inputs to enhance the RoI features by learning the long-range spatio-temporal context for final stenosis prediction. The effectiveness of our method was validated by conducting qualitative and quantitative experiments on 233 XRA sequences of coronary artery. Our method achieves a high F1 score of 90.88%, outperforming other 15 state-of-the-art detection methods. It demonstrates that our method can perform accurate stenosis detection from XRA images due to the strong ability to aggregate spatio-temporal features.
Collapse
Affiliation(s)
- Tao Han
- Laboratory of Beijing Engineering Research Center of Mixed Reality and Advanced Display, School of Optics and Photonics, Beijing Institute of Technology, Beijing, 100081, China
| | - Danni Ai
- Laboratory of Beijing Engineering Research Center of Mixed Reality and Advanced Display, School of Optics and Photonics, Beijing Institute of Technology, Beijing, 100081, China.
| | - Xinyu Li
- Laboratory of Beijing Engineering Research Center of Mixed Reality and Advanced Display, School of Optics and Photonics, Beijing Institute of Technology, Beijing, 100081, China
| | - Jingfan Fan
- Laboratory of Beijing Engineering Research Center of Mixed Reality and Advanced Display, School of Optics and Photonics, Beijing Institute of Technology, Beijing, 100081, China
| | - Hong Song
- School of Computer Science and Technology, Beijing Institute of Technology, Beijing, 100081, China
| | - Yining Wang
- Department of Radiology, Peking Union Medical College Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, 100730, China.
| | - Jian Yang
- Laboratory of Beijing Engineering Research Center of Mixed Reality and Advanced Display, School of Optics and Photonics, Beijing Institute of Technology, Beijing, 100081, China.
| |
Collapse
|
17
|
Meng Y, Du Z, Zhao C, Dong M, Pienta D, Tang J, Zhou W. Automatic extraction of coronary arteries using deep learning in invasive coronary angiograms. Technol Health Care 2023; 31:2303-2317. [PMID: 37545276 DOI: 10.3233/thc-230278] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 08/08/2023]
Abstract
BACKGROUND Accurate extraction of coronary arteries from invasive coronary angiography (ICA) images is essential for the diagnosis and risk stratification of coronary artery disease (CAD). OBJECTIVE In this study, a novel deep learning (DL) method is proposed for automatically extracting coronary arteries from ICA images. METHODS A convolutional neural network (CNN) was developed with full-scale skip connections and full-scale deep supervisions. The encoder architecture was based on the residual and inception modules to obtain multi-scale features from multiple convolutional layers with different window shapes. Transfer learning was utilized to improve both the initial performance and learning efficiency. A hybrid loss function was employed to further optimize the segmentation model. RESULTS The model was tested on a data set of 616 ICAs obtained from 210 patients, composed of 437 images for training, 49 images for validation, and 130 images for testing. The segmentation model achieved a Dice score of 0.8942, a sensitivity of 0.8735, a specificity of 0.9954, and a Hausdorff distance of 6.0794 mm; it could predict arteries for a single ICA frame in 0.2114 seconds. CONCLUSIONS The results showed that our model outperformed the state-of-the-art deep-learning models. Our new method has great potential for clinical use.
Collapse
Affiliation(s)
- Yinghui Meng
- School of Computer and Communication Engineering, Zhengzhou University of Light Industry, Zhengzhou, Henan, China
| | - Zhenglong Du
- School of Computer and Communication Engineering, Zhengzhou University of Light Industry, Zhengzhou, Henan, China
| | - Chen Zhao
- Department of Applied Computing, Michigan Technological University, Houghton, MI, USA
| | - Minghao Dong
- School of Computer and Communication Engineering, Zhengzhou University of Light Industry, Zhengzhou, Henan, China
| | - Drew Pienta
- Department of Mechanical Engineering-Engineering Mechanics, Michigan Technological University, Houghton, MI, USA
| | - Jinshan Tang
- Department of Health Administration and Policy, College of Health and Human Services, George Mason University, Fairfax, VA, USA
| | - Weihua Zhou
- Department of Applied Computing, Michigan Technological University, Houghton, MI, USA
- Center for Biocomputing and Digital Health, Institute of Computing and Cybersystems, Michigan Technological University, Houghton, MI, USA
- Health Research Institute, Michigan Technological University, Houghton, MI, USA
| |
Collapse
|
18
|
Kimna C, Miller Naranjo B, Eckert F, Fan D, Arcuti D, Mela P, Lieleg O. Tailored mechanosensitive nanogels release drugs upon exposure to different levels of stenosis. NANOSCALE 2022; 14:17196-17209. [PMID: 36226684 DOI: 10.1039/d2nr03292a] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/16/2023]
Abstract
Owing to the unhealthy lifestyle and genetic susceptibility of today's population, atherosclerosis is one of the global leading causes of life-threatening cardiovascular diseases. Although a rapid intervention is required for severe blood vessel constrictions, a systemic administration of anticoagulant drugs is not the preferred method of choice as the associated risk of bleeding complications is high. In this study, we present mechanosensitive nanogels that exhibit tunable degrees of disintegration upon exposure to different levels of stenosis. Those nanogels can be further functionalized to encapsulate charged drug molecules such as heparin, and they efficiently release their cargo when passing stenotic constrictions; however, passive drug leakage in the absence of mechanical shear stress is very low. Furthermore, heparin molecules liberated from those mechanosensitive nanogels show a similar blood clot lysis efficiency as the free drug molecules, which demonstrates that drug encapsulation into those nanogels does not interfere with the functionality of the cargo. Thus, the hemocompatible and mechanoresponsive nanogels developed here represent a smart and efficient drug delivery platform that can offer safer solutions for vascular therapy.
Collapse
Affiliation(s)
- Ceren Kimna
- School of Engineering and Design, Department of Materials Engineering, Technical University of Munich, Boltzmannstraße 15, 85748 Garching, Germany
- Center for Protein Assemblies (CPA) and Munich Institute of Biomedical Engineering, Technical University of Munich, Ernst-Otto-Fischer Straße 8, 85748, Garching, Germany
| | - Bernardo Miller Naranjo
- School of Engineering and Design, Department of Materials Engineering, Technical University of Munich, Boltzmannstraße 15, 85748 Garching, Germany
- Center for Protein Assemblies (CPA) and Munich Institute of Biomedical Engineering, Technical University of Munich, Ernst-Otto-Fischer Straße 8, 85748, Garching, Germany
| | - Franziska Eckert
- School of Engineering and Design, Department of Materials Engineering, Technical University of Munich, Boltzmannstraße 15, 85748 Garching, Germany
- Center for Protein Assemblies (CPA) and Munich Institute of Biomedical Engineering, Technical University of Munich, Ernst-Otto-Fischer Straße 8, 85748, Garching, Germany
| | - Di Fan
- School of Engineering and Design, Department of Materials Engineering, Technical University of Munich, Boltzmannstraße 15, 85748 Garching, Germany
- Center for Protein Assemblies (CPA) and Munich Institute of Biomedical Engineering, Technical University of Munich, Ernst-Otto-Fischer Straße 8, 85748, Garching, Germany
| | - Dario Arcuti
- Medical Materials and Implants, Department of Mechanical Engineering and Munich Institute of Biomedical Engineering, TUM School of Engineering and Design, Technical University of Munich, Boltzmannstraße 15, 85748, Garching, Germany
| | - Petra Mela
- Medical Materials and Implants, Department of Mechanical Engineering and Munich Institute of Biomedical Engineering, TUM School of Engineering and Design, Technical University of Munich, Boltzmannstraße 15, 85748, Garching, Germany
| | - Oliver Lieleg
- School of Engineering and Design, Department of Materials Engineering, Technical University of Munich, Boltzmannstraße 15, 85748 Garching, Germany
- Center for Protein Assemblies (CPA) and Munich Institute of Biomedical Engineering, Technical University of Munich, Ernst-Otto-Fischer Straße 8, 85748, Garching, Germany
| |
Collapse
|
19
|
Sawano S, Kodera S, Sato M, Katsushika S, Sukeda I, Takeuchi H, Shinohara H, Kobayashi A, Takiguchi H, Hirose K, Kamon T, Saito A, Kiriyama H, Miura M, Minatsuki S, Kikuchi H, Higashikuni Y, Takeda N, Fujiu K, Ando J, Akazawa H, Morita H, Komuro I. Age prediction from coronary angiography using a deep neural network: Age as a potential label to extract prognosis-related imaging features. PLoS One 2022; 17:e0276928. [PMID: 36301966 PMCID: PMC9612526 DOI: 10.1371/journal.pone.0276928] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/26/2022] [Accepted: 10/16/2022] [Indexed: 12/03/2022] Open
Abstract
Coronary angiography (CAG) is still considered the reference standard for coronary artery assessment, especially in the treatment of acute coronary syndrome (ACS). Although aging causes changes in coronary arteries, the age-related imaging features on CAG and their prognostic relevance have not been fully characterized. We hypothesized that a deep neural network (DNN) model could be trained to estimate vascular age only using CAG and that this age prediction from CAG could show significant associations with clinical outcomes of ACS. A DNN was trained to estimate vascular age using ten separate frames from each of 5,923 CAG videos from 572 patients. It was then tested on 1,437 CAG videos from 144 patients. Subsequently, 298 ACS patients who underwent percutaneous coronary intervention (PCI) were analysed to assess whether predicted age by DNN was associated with clinical outcomes. Age predicted as a continuous variable showed mean absolute error of 4 years with R squared of 0.72 (r = 0.856). Among the ACS patients stratified by predicted age from CAG images before PCI, major adverse cardiovascular events (MACE) were more frequently observed in the older vascular age group than in the younger vascular age group (p = 0.017). Furthermore, after controlling for actual age, gender, peak creatine kinase, and history of heart failure, the older vascular age group independently suffered from more MACE (hazard ratio 2.14, 95% CI 1.07 to 4.29, p = 0.032). The vascular age estimated based on CAG imaging by DNN showed high predictive value. The age predicted from CAG images by DNN could have significant associations with clinical outcomes in patients with ACS.
Collapse
Affiliation(s)
- Shinnosuke Sawano
- Department of Cardiovascular Medicine, The University of Tokyo Hospital, Tokyo, Japan
| | - Satoshi Kodera
- Department of Cardiovascular Medicine, The University of Tokyo Hospital, Tokyo, Japan
- * E-mail:
| | - Masataka Sato
- Department of Cardiovascular Medicine, The University of Tokyo Hospital, Tokyo, Japan
| | - Susumu Katsushika
- Department of Cardiovascular Medicine, The University of Tokyo Hospital, Tokyo, Japan
| | - Issei Sukeda
- Department of Cardiovascular Medicine, The University of Tokyo Hospital, Tokyo, Japan
| | - Hirotoshi Takeuchi
- Department of Cardiovascular Medicine, The University of Tokyo Hospital, Tokyo, Japan
| | - Hiroki Shinohara
- Department of Cardiovascular Medicine, The University of Tokyo Hospital, Tokyo, Japan
| | - Atsushi Kobayashi
- Department of Cardiovascular Medicine, The University of Tokyo Hospital, Tokyo, Japan
| | - Hiroshi Takiguchi
- Department of Cardiovascular Medicine, The University of Tokyo Hospital, Tokyo, Japan
| | - Kazutoshi Hirose
- Department of Cardiovascular Medicine, The University of Tokyo Hospital, Tokyo, Japan
| | - Tatsuya Kamon
- Department of Cardiovascular Medicine, The University of Tokyo Hospital, Tokyo, Japan
| | - Akihito Saito
- Department of Cardiovascular Medicine, The University of Tokyo Hospital, Tokyo, Japan
| | - Hiroyuki Kiriyama
- Department of Cardiovascular Medicine, The University of Tokyo Hospital, Tokyo, Japan
| | - Mizuki Miura
- Department of Cardiovascular Medicine, The University of Tokyo Hospital, Tokyo, Japan
| | - Shun Minatsuki
- Department of Cardiovascular Medicine, The University of Tokyo Hospital, Tokyo, Japan
| | - Hironobu Kikuchi
- Department of Cardiovascular Medicine, The University of Tokyo Hospital, Tokyo, Japan
| | - Yasutomi Higashikuni
- Department of Cardiovascular Medicine, The University of Tokyo Hospital, Tokyo, Japan
| | - Norifumi Takeda
- Department of Cardiovascular Medicine, The University of Tokyo Hospital, Tokyo, Japan
| | - Katsuhito Fujiu
- Department of Cardiovascular Medicine, The University of Tokyo Hospital, Tokyo, Japan
- Department of Advanced Cardiology, The University of Tokyo, Tokyo, Japan
| | - Jiro Ando
- Department of Cardiovascular Medicine, The University of Tokyo Hospital, Tokyo, Japan
| | - Hiroshi Akazawa
- Department of Cardiovascular Medicine, The University of Tokyo Hospital, Tokyo, Japan
| | - Hiroyuki Morita
- Department of Cardiovascular Medicine, The University of Tokyo Hospital, Tokyo, Japan
| | - Issei Komuro
- Department of Cardiovascular Medicine, The University of Tokyo Hospital, Tokyo, Japan
| |
Collapse
|
20
|
Classification of Left and Right Coronary Arteries in Coronary Angiographies Using Deep Learning. ELECTRONICS 2022. [DOI: 10.3390/electronics11132087] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/30/2022]
Abstract
Multi-frame X-ray images (videos) of the coronary arteries obtained using coronary angiography (CAG) provide detailed information about the anatomy and blood flow in the coronary arteries and play a pivotal role in diagnosing and treating ischemic heart disease. Deep learning has the potential to quickly and accurately quantify narrowings and blockages of the arteries from CAG videos. A CAG consists of videos acquired separately for the left coronary artery and the right coronary artery (LCA and RCA, respectively). The pathology for LCA and RCA is typically only reported for the entire CAG, and not for the individual videos. However, training of stenosis quantification models is difficult when the RCA and LCA information of the videos are unknown. Here, we present a deep learning-based approach for classifying LCA and RCA in CAG videos. Our approach enables linkage of videos with the reported pathological findings. We manually labeled 3545 and 520 videos (approximately seven videos per CAG) to enable training and testing of the models, respectively. We obtained F1 scores of 0.99 on the test set for LCA and RCA classification LCA and RCA classification on the test set. The classification performance was further investigated with extensive experiments across different model architectures (R(2+1)D, X3D, and MVIT), model input sizes, data augmentations, and the number of videos used for training. Our results showed that CAG videos could be accurately curated using deep learning, which is an essential preprocessing step for a downstream application in diagnostics of coronary artery disease.
Collapse
|
21
|
Ovalle-Magallanes E, Avina-Cervantes JG, Cruz-Aceves I, Ruiz-Pinales J. Improving convolutional neural network learning based on a hierarchical bezier generative model for stenosis detection in X-ray images. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2022; 219:106767. [PMID: 35364481 DOI: 10.1016/j.cmpb.2022.106767] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/17/2021] [Revised: 03/09/2022] [Accepted: 03/19/2022] [Indexed: 06/14/2023]
Abstract
BACKGROUND AND OBJECTIVE Automatic detection of stenosis on X-ray Coronary Angiography (XCA) images may help diagnose early coronary artery disease. Stenosis is manifested by a buildup of plaque in the arteries, decreasing the blood flow to the heart, increasing the risk of a heart attack. Convolutional Neural Networks (CNNs) have been successfully applied to identify pathological, regular, and featured tissues on rich and diverse medical image datasets. Nevertheless, CNNs find operative and performing limitations while working with small and poorly diversified databases. Transfer learning from large natural image datasets (such as ImageNet) has become a de-facto method to improve neural networks performance in the medical image domain. METHODS This paper proposes a novel Hierarchical Bezier-based Generative Model (HBGM) to improve the CNNs training process to detect stenosis. Herein, artificial image patches are generated to enlarge the original database, speeding up network convergence. The artificial dataset consists of 10,000 images containing 50% stenosis and 50% non-stenosis cases. Besides, a reliable Fréchet Inception Distance (FID) is used to evaluate the generated data quantitatively. Therefore, by using the proposed framework, the network is pre-trained with the artificial datasets and subsequently fine-tuned using the real XCA training dataset. The real dataset consists of 250 XCA image patches, selecting 125 images for stenosis and the remainder for non-stenosis cases. Furthermore, a Convolutional Block Attention Module (CBAM) was included in the network architecture as a self-attention mechanism to improve the efficiency of the network. RESULTS The results showed that the pre-trained networks using the proposed generative model outperformed the results concerning training from scratch. Particularly, an accuracy, precision, sensitivity, and F1-score of 0.8934, 0.9031, 0.8746, 0.8880, 0.9111, respectively, were achieved. The generated artificial dataset obtains a mean FID of 84.0886, with more realistic visual XCA images. CONCLUSIONS Different ResNet architectures for stenosis detection have been evaluated, including attention modules into the network. Numerical results demonstrated that by using the HBGM is obtained a higher performance than training from scratch, even outperforming the ImageNet pre-trained models.
Collapse
Affiliation(s)
- Emmanuel Ovalle-Magallanes
- Telematics and Digital Signal Processing Research groups (CAs), Engineering Division, Campus Irapuato-Salamanca, University of Guanajuato, Carretera Salamanca-Valle de Santiago km 3.5 + 1.8km, Comunidad de Palo Blanco, Salamanca, 36885 Guanajuato, Mexico.
| | - Juan Gabriel Avina-Cervantes
- Telematics and Digital Signal Processing Research groups (CAs), Engineering Division, Campus Irapuato-Salamanca, University of Guanajuato, Carretera Salamanca-Valle de Santiago km 3.5 + 1.8km, Comunidad de Palo Blanco, Salamanca, 36885 Guanajuato, Mexico.
| | - Ivan Cruz-Aceves
- CONACYT, Center for Research in Mathematics (CIMAT), A.C., Jalisco S/N, Col. Valenciana, Guanajuato, 36000 Guanajuato, Mexico.
| | - Jose Ruiz-Pinales
- Telematics and Digital Signal Processing Research groups (CAs), Engineering Division, Campus Irapuato-Salamanca, University of Guanajuato, Carretera Salamanca-Valle de Santiago km 3.5 + 1.8km, Comunidad de Palo Blanco, Salamanca, 36885 Guanajuato, Mexico.
| |
Collapse
|
22
|
Automatic coronary artery segmentation and diagnosis of stenosis by deep learning based on computed tomographic coronary angiography. Eur Radiol 2022; 32:6037-6045. [PMID: 35394183 DOI: 10.1007/s00330-022-08761-z] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/30/2021] [Revised: 03/05/2022] [Accepted: 03/21/2022] [Indexed: 02/05/2023]
Abstract
OBJECTIVES Coronary computed tomography angiography (CCTA) has rapidly developed in the coronary artery disease (CAD) field. However, manual coronary artery tree segmentation and reconstruction are time-consuming and tedious. Deep learning algorithms have been successfully developed for medical image analysis to process extensive data. Thus, we aimed to develop a deep learning tool for automatic coronary artery reconstruction and an automated CAD diagnosis model based on a large, single-centre retrospective CCTA cohort. METHODS Automatic CAD diagnosis consists of two subtasks. One is a segmentation task, which aims to extract the region of interest (ROI) from original images with U-Net. The second task is an identification task, which we implemented using 3DNet. The coronary artery tree images and clinical parameters were input into 3DNet, and the CAD diagnosis result was output. RESULTS We built a coronary artery segmentation model based on CCTA images with the corresponding labelling. The segmentation model had a mean Dice value of 0.771 ± 0.021. Based on this model, we built an automated diagnosis model (classification model) for CAD. The average accuracy and area under the receiver operating characteristic curve (AUC) were 0.750 ± 0.056 and 0.737, respectively. CONCLUSION Herein, using a deep learning algorithm, we realized the rapid classification and diagnosis of CAD from CCTA images in two steps. Our deep learning model can automatically segment the coronary artery quickly and accurately and can deliver a diagnosis of ≥ 50% coronary artery stenosis. Artificial intelligence methods such as deep learning have the potential to elevate the efficiency in CCTA image analysis considerably. KEY POINTS • The deep learning model rapidly achieved a high Dice value (0.771 ± 0.0210) in the autosegmentation of coronary arteries using CCTA images. • Based on the segmentation model, we built a CAD autoclassifier with the 3DNet algorithm, which achieved a good diagnostic performance (AUC) of 0.737. • The deep neural network could be used in the image postprocessing of coronary computed tomography angiography to achieve a quick and accurate diagnosis of CAD.
Collapse
|
23
|
Molenaar MA, Selder JL, Nicolas J, Claessen BE, Mehran R, Bescós JO, Schuuring MJ, Bouma BJ, Verouden NJ, Chamuleau SAJ. Current State and Future Perspectives of Artificial Intelligence for Automated Coronary Angiography Imaging Analysis in Patients with Ischemic Heart Disease. Curr Cardiol Rep 2022; 24:365-376. [PMID: 35347566 PMCID: PMC8979928 DOI: 10.1007/s11886-022-01655-y] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Accepted: 01/03/2022] [Indexed: 12/17/2022]
Abstract
PURPOSE OF REVIEW Artificial intelligence (AI) applications in (interventional) cardiology continue to emerge. This review summarizes the current state and future perspectives of AI for automated imaging analysis in invasive coronary angiography (ICA). RECENT FINDINGS Recently, 12 studies on AI for automated imaging analysis In ICA have been published. In these studies, machine learning (ML) models have been developed for frame selection, segmentation, lesion assessment, and functional assessment of coronary flow. These ML models have been developed on monocenter datasets (in range 31-14,509 patients) and showed moderate to good performance. However, only three ML models were externally validated. Given the current pace of AI developments for the analysis of ICA, less-invasive, objective, and automated diagnosis of CAD can be expected in the near future. Further research on this technology in the catheterization laboratory may assist and improve treatment allocation, risk stratification, and cath lab logistics by integrating ICA analysis with other clinical characteristics.
Collapse
Affiliation(s)
- Mitchel A Molenaar
- Amsterdam University Medical Centers-Location VU Medical Center, Department of Cardiology, University of Amsterdam, Amsterdam, The Netherlands.
- Amsterdam University Medical Centers-Location Academic Medical Center, Department of Cardiology, University of Amsterdam, Amsterdam, The Netherlands.
| | - Jasper L Selder
- Amsterdam University Medical Centers-Location VU Medical Center, Department of Cardiology, University of Amsterdam, Amsterdam, The Netherlands
| | - Johny Nicolas
- The Zena and Michael A. Wiener Cardiovascular Institute, Icahn School of Medicine at Mount Sinai, One Gustave L. Levy Place, Box 1030, New York, NY, 10029-6574, USA
| | - Bimmer E Claessen
- Amsterdam University Medical Centers-Location VU Medical Center, Department of Cardiology, University of Amsterdam, Amsterdam, The Netherlands
| | - Roxana Mehran
- The Zena and Michael A. Wiener Cardiovascular Institute, Icahn School of Medicine at Mount Sinai, One Gustave L. Levy Place, Box 1030, New York, NY, 10029-6574, USA
| | | | - Mark J Schuuring
- Amsterdam University Medical Centers-Location Academic Medical Center, Department of Cardiology, University of Amsterdam, Amsterdam, The Netherlands
| | - Berto J Bouma
- Amsterdam University Medical Centers-Location Academic Medical Center, Department of Cardiology, University of Amsterdam, Amsterdam, The Netherlands
| | - Niels J Verouden
- Amsterdam University Medical Centers-Location VU Medical Center, Department of Cardiology, University of Amsterdam, Amsterdam, The Netherlands
| | - Steven A J Chamuleau
- Amsterdam University Medical Centers-Location VU Medical Center, Department of Cardiology, University of Amsterdam, Amsterdam, The Netherlands
- Amsterdam University Medical Centers-Location Academic Medical Center, Department of Cardiology, University of Amsterdam, Amsterdam, The Netherlands
- Amsterdam Cardiovascular Sciences, Amsterdam University Medical Centers-Location Academic Medical Center, University of Amsterdam, Amsterdam, The Netherlands
| |
Collapse
|
24
|
Liu MH, Zhao C, Wang S, Jia H, Yu B. Artificial Intelligence—A Good Assistant to Multi-Modality Imaging in Managing Acute Coronary Syndrome. Front Cardiovasc Med 2022; 8:782971. [PMID: 35252367 PMCID: PMC8888682 DOI: 10.3389/fcvm.2021.782971] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/25/2021] [Accepted: 12/29/2021] [Indexed: 11/19/2022] Open
Abstract
Acute coronary syndrome is the leading cause of cardiac death and has a significant impact on patient prognosis. Early identification and proper management are key to ensuring better outcomes and have improved significantly with the development of various cardiovascular imaging modalities. Recently, the use of artificial intelligence as a method of enhancing the capability of cardiovascular imaging has grown. AI can inform the decision-making process, as it enables existing modalities to perform more efficiently and make more accurate diagnoses. This review demonstrates recent applications of AI in cardiovascular imaging to facilitate better patient care.
Collapse
Affiliation(s)
- Ming-hao Liu
- Department of Cardiology, The 2nd Affiliated Hospital of Harbin Medical University, Harbin, China
- The Key Laboratory of Myocardial Ischemia, Chinese Ministry of Education, Harbin, China
| | - Chen Zhao
- Department of Cardiology, The 2nd Affiliated Hospital of Harbin Medical University, Harbin, China
- The Key Laboratory of Myocardial Ischemia, Chinese Ministry of Education, Harbin, China
| | - Shengfang Wang
- Department of Cardiology, The 2nd Affiliated Hospital of Harbin Medical University, Harbin, China
- The Key Laboratory of Myocardial Ischemia, Chinese Ministry of Education, Harbin, China
| | - Haibo Jia
- Department of Cardiology, The 2nd Affiliated Hospital of Harbin Medical University, Harbin, China
- The Key Laboratory of Myocardial Ischemia, Chinese Ministry of Education, Harbin, China
- *Correspondence: Haibo Jia
| | - Bo Yu
- Department of Cardiology, The 2nd Affiliated Hospital of Harbin Medical University, Harbin, China
- The Key Laboratory of Myocardial Ischemia, Chinese Ministry of Education, Harbin, China
- Bo Yu
| |
Collapse
|
25
|
Joloudari JH, Saadatfar H, GhasemiGol M, Alizadehsani R, Sani ZA, Hasanzadeh F, Hassannataj E, Sharifrazi D, Mansor Z. FCM-DNN: diagnosing coronary artery disease by deep accuracy fuzzy C-means clustering model. MATHEMATICAL BIOSCIENCES AND ENGINEERING : MBE 2022; 19:3609-3635. [PMID: 35341267 DOI: 10.3934/mbe.2022167] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/14/2023]
Abstract
Cardiovascular disease is one of the most challenging diseases in middle-aged and older people, which causes high mortality. Coronary artery disease (CAD) is known as a common cardiovascular disease. A standard clinical tool for diagnosing CAD is angiography. The main challenges are dangerous side effects and high angiography costs. Today, the development of artificial intelligence-based methods is a valuable achievement for diagnosing disease. Hence, in this paper, artificial intelligence methods such as neural network (NN), deep neural network (DNN), and fuzzy C-means clustering combined with deep neural network (FCM-DNN) are developed for diagnosing CAD on a cardiac magnetic resonance imaging (CMRI) dataset. The original dataset is used in two different approaches. First, the labeled dataset is applied to the NN and DNN to create the NN and DNN models. Second, the labels are removed, and the unlabeled dataset is clustered via the FCM method, and then, the clustered dataset is fed to the DNN to create the FCM-DNN model. By utilizing the second clustering and modeling, the training process is improved, and consequently, the accuracy is increased. As a result, the proposed FCM-DNN model achieves the best performance with a 99.91% accuracy specifying 10 clusters, i.e., 5 clusters for healthy subjects and 5 clusters for sick subjects, through the 10-fold cross-validation technique compared to the NN and DNN models reaching the accuracies of 92.18% and 99.63%, respectively. To the best of our knowledge, no study has been conducted for CAD diagnosis on the CMRI dataset using artificial intelligence methods. The results confirm that the proposed FCM-DNN model can be helpful for scientific and research centers.
Collapse
Affiliation(s)
| | - Hamid Saadatfar
- Department of Computer Engineering, Faculty of Engineering, University of Birjand, Birjand, Iran
| | - Mohammad GhasemiGol
- Department of Computer Engineering, Faculty of Engineering, University of Birjand, Birjand, Iran
| | - Roohallah Alizadehsani
- Institute for Intelligent Systems Research and Innovation, Deakin University, Geelong, VIC 3216, Australia
| | - Zahra Alizadeh Sani
- Rajaie Cardiovascular Medical and Research Center, Iran University of Medical Sciences, Tehran, Iran
- Omid hospital, Iran University of Medical Sciences, Tehran, Iran
| | | | - Edris Hassannataj
- Department of Nursing, School of Nursing and Allied Medical Sciences, Maragheh Faculty of Medical Sciences, Maragheh, Iran
| | - Danial Sharifrazi
- Department of Computer Engineering, School of Technical and Engineering, Shiraz Branch, Islamic Azad University, Shiraz, Iran
| | - Zulkefli Mansor
- Faculty of Information Science and Technology, Universiti Kebangsaan Malaysia, UKM Bangi 43600, Malaysia
| |
Collapse
|
26
|
Liu X, Huang Y, Xie L, Wang X, Guan C, Du T, Chen D, Zou T, Shi Z, Li A, Zhao S, Xu Y, Zhang H, Xu B. Automatic construction of coronary artery tree structure based on vessel blood flow tracking. Catheter Cardiovasc Interv 2022; 99 Suppl 1:1378-1385. [PMID: 35077599 DOI: 10.1002/ccd.30061] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 11/17/2021] [Accepted: 12/20/2021] [Indexed: 11/07/2022]
Abstract
We sought to propose an innovative vessel blood flow tracking (VBFT) method to extract coronary artery tree (CAT) and to assess the effectiveness of this VBFT versus the single-frame method. Construction of a CAT from a segmented artery is the basis of artificial intelligence-aided angiographic diagnosis. However, construction of a CAT using a single frame remains challenging, due to bifurcations and overlaps in two-dimensional angiograms. Overall, 13,222 angiograms, including 28,539 vessels, were retrospectively collected from 3275 patients and were then annotated. Coronary arteries were automatically segmented by a previously established deep neural networks (DNNs), and the skeleton lines were then extracted from segmentation images to construct CAT using the single-frame method and the VBFT method. Additionally, 1322 angiograms with 2201 vessels were used to test these two methods. Compared to the single-frame method, the VBFT method can significantly improve the accuracy of CAT as (84.3% vs. 72.3%; p < 0.001). Overlap (OV) was higher in the VBFT group than that in the Single-Frame group (91.1% vs. 87.5%; p < 0.001). The VBFT method significantly reduced the incidence of the lack of branching (7.30% vs. 13.9%, p < 0.001), insufficient length (6.70% vs. 11.0%, p < 0.001), and redundant branches (1.60% vs. 3.10%, p < 0.001). The VBFT method improved the extraction of a CAT structure, which will facilitate the development of artificial intelligence-aided angiographic diagnosis. Cardiologists can efficiently diagnose CAD using this method.
Collapse
Affiliation(s)
- Xuqing Liu
- Beijing University of Posts and Telecommunications, Beijing, China
| | - Yunfei Huang
- Catheterization Laboratories, Fu Wai Hospital, National Center for Cardiovascular Diseases, Chinese Academy of Medical Sciences, Beijing, China
| | - Lihua Xie
- Catheterization Laboratories, Fu Wai Hospital, National Center for Cardiovascular Diseases, Chinese Academy of Medical Sciences, Beijing, China
| | - Xiaofei Wang
- Beijing University of Posts and Telecommunications, Beijing, China
| | - Changdong Guan
- Catheterization Laboratories, Fu Wai Hospital, National Center for Cardiovascular Diseases, Chinese Academy of Medical Sciences, Beijing, China
| | - Tianming Du
- Beijing University of Posts and Telecommunications, Beijing, China
| | - Donghao Chen
- Beijing University of Posts and Telecommunications, Beijing, China
| | - Tongqiang Zou
- Catheterization Laboratories, Fu Wai Hospital, National Center for Cardiovascular Diseases, Chinese Academy of Medical Sciences, Beijing, China
| | - Zhenpeng Shi
- Catheterization Laboratories, Fu Wai Hospital, National Center for Cardiovascular Diseases, Chinese Academy of Medical Sciences, Beijing, China
| | - Ang Li
- Catheterization Laboratories, Fu Wai Hospital, National Center for Cardiovascular Diseases, Chinese Academy of Medical Sciences, Beijing, China
| | | | - Yang Xu
- Beijing Redcdn Technology Co., Ltd, Beijing, China
| | - Honggang Zhang
- Beijing University of Posts and Telecommunications, Beijing, China
| | - Bo Xu
- Catheterization Laboratories, Fu Wai Hospital, National Center for Cardiovascular Diseases, Chinese Academy of Medical Sciences, Beijing, China.,National Clinical Research Center for Cardiovascular Diseases, Beijing, China
| |
Collapse
|
27
|
Zhang R, E H, Yuan L, He J, Zhang H, Zhang S, Wang Y, Song M, Wang L. MBNM: Multi-branch network based on memory features for long-tailed medical image recognition. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2021; 212:106448. [PMID: 34670168 DOI: 10.1016/j.cmpb.2021.106448] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/04/2021] [Accepted: 09/28/2021] [Indexed: 06/13/2023]
Abstract
BACKGROUND AND OBJECTIVES Deep learning algorithms show revolutionary potential in computer-aided diagnosis. These computer-aided diagnosis techniques often rely on large-scale, balanced standard datasets. However, there are many rare diseases in real clinical scenarios, which makes the medical datasets present a highly imbalanced long-tailed distribution, leading to the poor generalization ability of deep learning models. Currently, most algorithms to solve this problem involve more complex modules and loss functions. But for complicated tasks in the medical domain, usually suffer from issues such as increased inference time and unstable performance. Therefore, it is a great challenge to develop a computer-aided diagnosis algorithm for long-tailed medical data. METHODS We proposed the Multi-Branch Network based on Memory Features (MBNM) for Long-Tailed Medical Image Recognition. MBNM includes three branches, where each branch focuses on a different learning task: 1) the regular learning branch learns the generalizable feature representations; 2) the tail learning branch gains extra intra-class diversity for the tail classes through the feature memory module and the improved reverse sampler to improve the classification performance of the tail classes; 3) the fusion balance branch integrates various decision-making advantages and introduces an adaptive loss function to re-balance the classification performance of easy and difficult samples. RESULTS We conducted experiments on the multi-disease Ophthalmic OCT datasets with imbalance factors of 98.48 and skin image datasets Skin-7 with imbalance factors of 58.3. The Accuracy, MCR, F1-Score, Precision, and AUC of our model were significantly improved over the strong baselines in the auxiliary diagnosis scenario where the clinical medical data is extremely imbalanced. Furthermore, we demonstrated that MBNM outperforms the state-of-the-art models on the publicly available natural image datasets (CIFAR-10 and CIFAR-100). CONCLUSIONS The proposed algorithm can solve the problem of imbalanced data distribution with little added cost. In addition, the memory module does not act in the inference phase, thereby saving inference time. And it shows outstanding performance on medical images and natural images with a variety of imbalance factors.
Collapse
Affiliation(s)
- Ruru Zhang
- School of Computer Science, Beijing University of Posts and Telecommunications, Beijing, 100876, China; Education Department Information Network Engineering Research Center, Beijing University of Posts and Telecommunications, Beijing, 100876, China.
| | - Haihong E
- School of Computer Science, Beijing University of Posts and Telecommunications, Beijing, 100876, China; Education Department Information Network Engineering Research Center, Beijing University of Posts and Telecommunications, Beijing, 100876, China.
| | - Lifei Yuan
- Hebei Eye Hospital, Hebei, 054001, China.
| | - Jiawen He
- School of Computer Science, Beijing University of Posts and Telecommunications, Beijing, 100876, China; Education Department Information Network Engineering Research Center, Beijing University of Posts and Telecommunications, Beijing, 100876, China.
| | - Hongxing Zhang
- School of Computer Science, Beijing University of Posts and Telecommunications, Beijing, 100876, China; Education Department Information Network Engineering Research Center, Beijing University of Posts and Telecommunications, Beijing, 100876, China.
| | | | | | - Meina Song
- School of Computer Science, Beijing University of Posts and Telecommunications, Beijing, 100876, China; Education Department Information Network Engineering Research Center, Beijing University of Posts and Telecommunications, Beijing, 100876, China.
| | - Lifei Wang
- Hebei Eye Hospital, Hebei, 054001, China.
| |
Collapse
|
28
|
Current Status and Future Perspective of Artificial Intelligence in the Management of Peptic Ulcer Bleeding: A Review of Recent Literature. J Clin Med 2021; 10:jcm10163527. [PMID: 34441823 PMCID: PMC8397124 DOI: 10.3390/jcm10163527] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/17/2021] [Revised: 08/09/2021] [Accepted: 08/10/2021] [Indexed: 02/07/2023] Open
Abstract
With the decreasing incidence of peptic ulcer bleeding (PUB) over the past two decades, the clinician experience of managing patients with PUB has also declined, especially for young endoscopists. A patient with PUB management requires collaborative care involving the emergency department, gastroenterologist, radiologist, and surgeon, from initial assessment to hospital discharge. The application of artificial intelligence (AI) methods has remarkably improved people's lives. In particular, AI systems have shown great potential in many areas of gastroenterology to increase human performance. Colonoscopy polyp detection or diagnosis by an AI system was recently introduced for commercial use to improve endoscopist performance. Although PUB is a longstanding health problem, these newly introduced AI technologies may soon impact endoscopists' clinical practice by improving the quality of care for these patients. To update the current status of AI application in PUB, we reviewed recent relevant literature and provided future perspectives that are required to integrate such AI tools into real-world practice.
Collapse
|
29
|
Nam B, Kim JY, Kim IY, Cho BH. Selective Prediction LSTM for Time Series Health Datasets using Unit-wise Batch Standardization: Algorithm Development and Validation (Preprint). JMIR Med Inform 2021; 10:e30587. [PMID: 35289753 PMCID: PMC8965672 DOI: 10.2196/30587] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/21/2021] [Revised: 11/16/2021] [Accepted: 01/02/2022] [Indexed: 11/13/2022] Open
Abstract
Background In any health care system, both the classification of data and the confidence level of such classifications are important. Therefore, a selective prediction model is required to classify time series health data according to confidence levels of prediction. Objective This study aims to develop a method using long short-term memory (LSTM) models with a reject option for time series health data classification. Methods An existing selective prediction method was adopted to implement an option for rejecting a classification output in LSTM models. However, a conventional selection function approach to LSTM does not achieve acceptable performance during learning stages. To tackle this problem, we proposed a unit-wise batch standardization that attempts to normalize each hidden unit in LSTM to apply the structural characteristics of LSTM models that concern the selection function. Results The ability of our method to approximate the target confidence level was compared by coverage violations for 2 time series of health data sets consisting of human activity and arrhythmia. For both data sets, our approach yielded lower average coverage violations (0.98% and 1.79% for each data set) than those of the conventional approach. In addition, the classification performance when using the reject option was compared with that of other normalization methods. Our method demonstrated superior performance for selective risk (12.63% and 17.82% for each data set), false-positive rates (2.09% and 5.8% for each data set), and false-negative rates (10.58% and 17.24% for each data set). Conclusions Our normalization approach can help make selective predictions for time series health data. We expect this technique to enhance the confidence of users in classification systems and improve collaborative efforts between humans and artificial intelligence in the medical field through the use of classification that considers confidence.
Collapse
Affiliation(s)
- Borum Nam
- Department of Electronic Engineering, Hanyang University, Seoul, Republic of Korea
| | - Joo Young Kim
- Department of Biomedical Engineering, Hanyang University, Seoul, Republic of Korea
| | - In Young Kim
- Department of Biomedical Engineering, Hanyang University, Seoul, Republic of Korea
| | - Baek Hwan Cho
- Medical AI Research Center, Samsung Medical Center, Seoul, Republic of Korea
| |
Collapse
|