1
|
Kusumoto D, Akiyama T, Hashimoto M, Iwabuchi Y, Katsuki T, Kimura M, Akiba Y, Sawada H, Inohara T, Yuasa S, Fukuda K, Jinzaki M, Ieda M. A deep learning-based automated diagnosis system for SPECT myocardial perfusion imaging. Sci Rep 2024; 14:13583. [PMID: 38866884 PMCID: PMC11169468 DOI: 10.1038/s41598-024-64445-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/12/2024] [Accepted: 06/10/2024] [Indexed: 06/14/2024] Open
Abstract
Images obtained from single-photon emission computed tomography for myocardial perfusion imaging (MPI SPECT) contain noises and artifacts, making cardiovascular disease diagnosis difficult. We developed a deep learning-based diagnosis support system using MPI SPECT images. Single-center datasets of MPI SPECT images (n = 5443) were obtained and labeled as healthy or coronary artery disease based on diagnosis reports. Three axes of four-dimensional datasets, resting, and stress conditions of three-dimensional reconstruction data, were reconstructed, and an AI model was trained to classify them. The trained convolutional neural network showed high performance [area under the curve (AUC) of the ROC curve: approximately 0.91; area under the recall precision curve: 0.87]. Additionally, using unsupervised learning and the Grad-CAM method, diseased lesions were successfully visualized. The AI-based automated diagnosis system had the highest performance (88%), followed by cardiologists with AI-guided diagnosis (80%) and cardiologists alone (65%). Furthermore, diagnosis time was shorter for AI-guided diagnosis (12 min) than for cardiologists alone (31 min). Our high-quality deep learning-based diagnosis support system may benefit cardiologists by improving diagnostic accuracy and reducing working hours.
Collapse
Affiliation(s)
- Dai Kusumoto
- Department of Cardiology, Keio University School of Medicine, 35 Shinanomachi, Shinjuku-Ku, Tokyo, 160-8582, Japan.
- Center for Preventive Medicine, Keio University School of Medicine, 35 Shinanomachi, Shinjuku-Ku, Tokyo, 160-8582, Japan.
| | - Takumi Akiyama
- Department of Cardiology, Keio University School of Medicine, 35 Shinanomachi, Shinjuku-Ku, Tokyo, 160-8582, Japan
| | - Masahiro Hashimoto
- Department of Radiology, Keio University School of Medicine, 35 Shinanomachi, Shinjuku-Ku, Tokyo, 160-8582, Japan
| | - Yu Iwabuchi
- Department of Radiology, Keio University School of Medicine, 35 Shinanomachi, Shinjuku-Ku, Tokyo, 160-8582, Japan
| | - Toshiomi Katsuki
- Department of Cardiology, Keio University School of Medicine, 35 Shinanomachi, Shinjuku-Ku, Tokyo, 160-8582, Japan
| | - Mai Kimura
- Department of Cardiology, Keio University School of Medicine, 35 Shinanomachi, Shinjuku-Ku, Tokyo, 160-8582, Japan
| | - Yohei Akiba
- Department of Cardiology, Keio University School of Medicine, 35 Shinanomachi, Shinjuku-Ku, Tokyo, 160-8582, Japan
| | - Hiromune Sawada
- Department of Cardiology, Keio University School of Medicine, 35 Shinanomachi, Shinjuku-Ku, Tokyo, 160-8582, Japan
| | - Taku Inohara
- Department of Cardiology, Keio University School of Medicine, 35 Shinanomachi, Shinjuku-Ku, Tokyo, 160-8582, Japan
| | - Shinsuke Yuasa
- Department of Cardiovascular Medicine, Okayama University Hospital, Okayama, 700-8558, Japan
| | - Keiichi Fukuda
- Department of Cardiology, Keio University School of Medicine, 35 Shinanomachi, Shinjuku-Ku, Tokyo, 160-8582, Japan
| | - Masahiro Jinzaki
- Department of Radiology, Keio University School of Medicine, 35 Shinanomachi, Shinjuku-Ku, Tokyo, 160-8582, Japan
| | - Masaki Ieda
- Department of Cardiology, Keio University School of Medicine, 35 Shinanomachi, Shinjuku-Ku, Tokyo, 160-8582, Japan
| |
Collapse
|
2
|
Liu B, Yu W, Zhang F, Shi Y, Yang L, Jiang Q, Wang Y, Wang Y. Detecting obstructive coronary artery disease with machine learning: rest-only gated single photon emission computed tomography myocardial perfusion imaging combined with coronary artery calcium score and cardiovascular risk factors. Quant Imaging Med Surg 2023; 13:1524-1536. [PMID: 36915324 PMCID: PMC10006131 DOI: 10.21037/qims-22-758] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/21/2022] [Accepted: 12/08/2022] [Indexed: 02/09/2023]
Abstract
Background The rest-only single photon emission computed tomography (SPECT) myocardial perfusion imaging (MPI) has low diagnostic performance for obstructive coronary artery disease (CAD). Coronary artery calcium score (CACS) is strongly associated with obstructive CAD. The aim of this study was to investigate the performance of rest-only gated SPECT MPI combined with CACS and cardiovascular risk factors in diagnosing obstructive CAD through machine learning (ML). Methods We enrolled 253 suspected CAD patients who underwent the 1-stop rest-only SPECT MPI and computed tomography (CT) scan due to stress test-related contraindications. Myocardial perfusion and wall motion were assessed using quantitative perfusion SPECT + quantitative gated SPECT (QPS + QGS) automated quantification software. The Agatston algorithm was used to calculate CACS. The clinical data of patients, including cardiovascular risk factors, were collected. Based on feature selection and clinical experience, 8 factors were identified as modeling variables. Subsequently, patients were divided randomly into 2 groups: the training (70%) and test (30%) groups. The performance of 8 supervised ML algorithms was evaluated in the training and test groups. Results Obstructive CAD was diagnosed by coronary angiography in 94 (37.2%, 94/253) patients. In the training group, the area under the receiver operator characteristic (ROC) curve (AUC) of the random forest was the highest, and the AUCs of Logistic, extreme gradient boosting (XGBoost), support vector machine (SVM), and adaptive boosting (AdaBoost) were all above 0.9. In the test group, the AUC of recursive partitioning and regression trees (Rpart) was the highest (0.911). Rpart and Naïve Bayes had the highest accuracy (0.840). Rpart had a sensitivity and specificity of 0.851 and 0.821, respectively; Naïve Bayes had a sensitivity and specificity of 0.809 and 0.893, respectively. Next was Logistic, with an accuracy of 0.827, a sensitivity of 0.872, and a specificity of 0.750. The random forest and XGBoost algorithms also had high accuracy, which was 0.813 for each algorithm. Conclusions Rest-only SPECT MPI combined with CACS and cardiovascular risk factors using an ML algorithm to detect obstructive CAD is feasible. Among the algorithms validated in the test group, Rpart, Naïve Bayes, XGBoost, Logistic, and random forest are all highly accurate for diagnosing obstructive CAD. The application of ML in resting MPI and CACS may be used for screening obstructive CAD.
Collapse
Affiliation(s)
- Bao Liu
- Department of Nuclear Medicine, The Third Affiliated Hospital of Soochow University, Changzhou, China.,The Nuclear Medicine and Molecular Imaging Clinical Translation Institute of Soochow University, Changzhou, China
| | - Wenji Yu
- Department of Nuclear Medicine, The Third Affiliated Hospital of Soochow University, Changzhou, China.,The Nuclear Medicine and Molecular Imaging Clinical Translation Institute of Soochow University, Changzhou, China
| | - Feifei Zhang
- Department of Nuclear Medicine, The Third Affiliated Hospital of Soochow University, Changzhou, China.,The Nuclear Medicine and Molecular Imaging Clinical Translation Institute of Soochow University, Changzhou, China
| | - Yunmei Shi
- Department of Nuclear Medicine, The Third Affiliated Hospital of Soochow University, Changzhou, China.,The Nuclear Medicine and Molecular Imaging Clinical Translation Institute of Soochow University, Changzhou, China
| | - Le Yang
- Department of Nuclear Medicine, The Third Affiliated Hospital of Soochow University, Changzhou, China.,The Nuclear Medicine and Molecular Imaging Clinical Translation Institute of Soochow University, Changzhou, China
| | - Qi Jiang
- Department of Nuclear Medicine, The Third Affiliated Hospital of Soochow University, Changzhou, China.,The Nuclear Medicine and Molecular Imaging Clinical Translation Institute of Soochow University, Changzhou, China
| | - Yufeng Wang
- Department of Nuclear Medicine, The Third Affiliated Hospital of Soochow University, Changzhou, China.,The Nuclear Medicine and Molecular Imaging Clinical Translation Institute of Soochow University, Changzhou, China
| | - Yuetao Wang
- Department of Nuclear Medicine, The Third Affiliated Hospital of Soochow University, Changzhou, China.,The Nuclear Medicine and Molecular Imaging Clinical Translation Institute of Soochow University, Changzhou, China
| |
Collapse
|
3
|
Apostolopoulos ID, Papandrianos NI, Feleki A, Moustakidis S, Papageorgiou EI. Deep learning-enhanced nuclear medicine SPECT imaging applied to cardiac studies. EJNMMI Phys 2023; 10:6. [PMID: 36705775 PMCID: PMC9883373 DOI: 10.1186/s40658-022-00522-7] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/29/2022] [Accepted: 12/19/2022] [Indexed: 01/28/2023] Open
Abstract
Deep learning (DL) has a growing popularity and is a well-established method of artificial intelligence for data processing, especially for images and videos. Its applications in nuclear medicine are broad and include, among others, disease classification, image reconstruction, and image de-noising. Positron emission tomography (PET) and single-photon emission computerized tomography (SPECT) are major image acquisition technologies in nuclear medicine. Though several studies have been conducted to apply DL in many nuclear medicine domains, such as cancer detection and classification, few studies have employed such methods for cardiovascular disease applications. The present paper reviews recent DL approaches focused on cardiac SPECT imaging. Extensive research identified fifty-five related studies, which are discussed. The review distinguishes between major application domains, including cardiovascular disease diagnosis, SPECT attenuation correction, image denoising, full-count image estimation, and image reconstruction. In addition, major findings and dominant techniques employed for the mentioned task are revealed. Current limitations of DL approaches and future research directions are discussed.
Collapse
Affiliation(s)
- Ioannis D. Apostolopoulos
- grid.11047.330000 0004 0576 5395Department of Medical Physics, School of Medicine, University of Patras, 26504 Patras, Greece ,grid.410558.d0000 0001 0035 6670Department of Energy Systems, University of Thessaly, Gaiopolis Campus, 41500 Larisa, Greece
| | - Nikolaos I. Papandrianos
- grid.410558.d0000 0001 0035 6670Department of Energy Systems, University of Thessaly, Gaiopolis Campus, 41500 Larisa, Greece
| | - Anna Feleki
- grid.410558.d0000 0001 0035 6670Department of Energy Systems, University of Thessaly, Gaiopolis Campus, 41500 Larisa, Greece
| | - Serafeim Moustakidis
- grid.410558.d0000 0001 0035 6670Department of Energy Systems, University of Thessaly, Gaiopolis Campus, 41500 Larisa, Greece ,AIDEAS OÜ, 10117 Tallinn, Estonia
| | - Elpiniki I. Papageorgiou
- grid.410558.d0000 0001 0035 6670Department of Energy Systems, University of Thessaly, Gaiopolis Campus, 41500 Larisa, Greece
| |
Collapse
|
4
|
Papandrianos NI, Apostolopoulos ID, Feleki A, Moustakidis S, Kokkinos K, Papageorgiou EI. AI-based classification algorithms in SPECT myocardial perfusion imaging for cardiovascular diagnosis: a review. Nucl Med Commun 2023; 44:1-11. [PMID: 36514926 DOI: 10.1097/mnm.0000000000001634] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/15/2022]
Abstract
In the last few years, deep learning has made a breakthrough and established its position in machine learning classification problems in medical image analysis. Deep learning has recently displayed remarkable applicability in a range of different medical applications, as well as in nuclear cardiology. This paper implements a literature review protocol and reports the latest advances in artificial intelligence (AI)-based classification in SPECT myocardial perfusion imaging in heart disease diagnosis. The representative and most recent works are reported to demonstrate the use of AI and deep learning technologies in medical image analysis in nuclear cardiology for cardiovascular diagnosis. This review also analyses the primary outcomes of the presented research studies and suggests future directions focusing on the explainability of the deployed deep-learning systems in clinical practice.
Collapse
Affiliation(s)
| | | | - Anna Feleki
- Department of Energy Systems, University of Thessaly, Larisa, Greece
| | - Serafeim Moustakidis
- Department of Energy Systems, University of Thessaly, Larisa, Greece
- AIDEAS OÜ, Tallinn, Estonia
| | | | | |
Collapse
|
5
|
Lee C, Kim H. Machine learning-based predictive modeling of depression in hypertensive populations. PLoS One 2022; 17:e0272330. [PMID: 35905087 PMCID: PMC9337649 DOI: 10.1371/journal.pone.0272330] [Citation(s) in RCA: 11] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/18/2022] [Accepted: 07/18/2022] [Indexed: 11/19/2022] Open
Abstract
We aimed to develop prediction models for depression among U.S. adults with hypertension using various machine learning (ML) approaches. Moreover, we analyzed the mechanisms of the developed models. This cross-sectional study included 8,628 adults with hypertension (11.3% with depression) from the National Health and Nutrition Examination Survey (2011–2020). We selected several significant features using feature selection methods to build the models. Data imbalance was managed with random down-sampling. Six different ML classification methods implemented in the R package caret—artificial neural network, random forest, AdaBoost, stochastic gradient boosting, XGBoost, and support vector machine—were employed with 10-fold cross-validation for predictions. Model performance was assessed by examining the area under the receiver operating characteristic curve (AUC), accuracy, precision, sensitivity, specificity, and F1-score. For an interpretable algorithm, we used the variable importance evaluation function in caret. Of all classification models, artificial neural network trained with selected features (n = 30) achieved the highest AUC (0.813) and specificity (0.780) in predicting depression. Support vector machine predicted depression with the highest accuracy (0.771), precision (0.969), sensitivity (0.774), and F1-score (0.860). The most frequent and important features contributing to the models included the ratio of family income to poverty, triglyceride level, white blood cell count, age, sleep disorder status, the presence of arthritis, hemoglobin level, marital status, and education level. In conclusion, ML algorithms performed comparably in predicting depression among hypertensive populations. Furthermore, the developed models shed light on variables’ relative importance, paving the way for further clinical research.
Collapse
Affiliation(s)
- Chiyoung Lee
- School of Nursing & Health Studies, University of Washington Bothell, Bothell, Washington, United States of America
- * E-mail:
| | - Heewon Kim
- The Department of Electrical and Computer Engineering, Automation and Systems Research Institute, Seoul National University, Seoul, Korea
| |
Collapse
|
6
|
An Explainable Classification Method of SPECT Myocardial Perfusion Images in Nuclear Cardiology Using Deep Learning and Grad-CAM. APPLIED SCIENCES-BASEL 2022. [DOI: 10.3390/app12157592] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/01/2023]
Abstract
Background: This study targets the development of an explainable deep learning methodology for the automatic classification of coronary artery disease, utilizing SPECT MPI images. Deep learning is currently judged as non-transparent due to the model’s complex non-linear structure, and thus, it is considered a «black box», making it hard to gain a comprehensive understanding of its internal processes and explain its behavior. Existing explainable artificial intelligence tools can provide insights into the internal functionality of deep learning and especially of convolutional neural networks, allowing transparency and interpretation. Methods: This study seeks to address the identification of patients’ CAD status (infarction, ischemia or normal) by developing an explainable deep learning pipeline in the form of a handcrafted convolutional neural network. The proposed RGB-CNN model utilizes various pre- and post-processing tools and deploys a state-of-the-art explainability tool to produce more interpretable predictions in decision making. The dataset includes cases from 625 patients as stress and rest representations, comprising 127 infarction, 241 ischemic, and 257 normal cases previously classified by a doctor. The imaging dataset was split into 20% for testing and 80% for training, of which 15% was further used for validation purposes. Data augmentation was employed to increase generalization. The efficacy of the well-known Grad-CAM-based color visualization approach was also evaluated in this research to provide predictions with interpretability in the detection of infarction and ischemia in SPECT MPI images, counterbalancing any lack of rationale in the results extracted by the CNNs. Results: The proposed model achieved 93.3% accuracy and 94.58% AUC, demonstrating efficient performance and stability. Grad-CAM has shown to be a valuable tool for explaining CNN-based judgments in SPECT MPI images, allowing nuclear physicians to make fast and confident judgments by using the visual explanations offered. Conclusions: Prediction results indicate a robust and efficient model based on the deep learning methodology which is proposed for CAD diagnosis in nuclear medicine.
Collapse
|
7
|
Papandrianos NI, Feleki A, Papageorgiou EI, Martini C. Deep Learning-Based Automated Diagnosis for Coronary Artery Disease Using SPECT-MPI Images. J Clin Med 2022; 11:jcm11133918. [PMID: 35807203 PMCID: PMC9267142 DOI: 10.3390/jcm11133918] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/06/2022] [Revised: 06/28/2022] [Accepted: 06/29/2022] [Indexed: 12/12/2022] Open
Abstract
(1) Background: Single-photon emission computed tomography (SPECT) myocardial perfusion imaging (MPI) is a long-established estimation methodology for medical diagnosis using image classification illustrating conditions in coronary artery disease. For these procedures, convolutional neural networks have proven to be very beneficial in achieving near-optimal accuracy for the automatic classification of SPECT images. (2) Methods: This research addresses the supervised learning-based ideal observer image classification utilizing an RGB-CNN model in heart images to diagnose CAD. For comparison purposes, we employ VGG-16 and DenseNet-121 pre-trained networks that are indulged in an image dataset representing stress and rest mode heart states acquired by SPECT. In experimentally evaluating the method, we explore a wide repertoire of deep learning network setups in conjunction with various robust evaluation and exploitation metrics. Additionally, to overcome the image dataset cardinality restrictions, we take advantage of the data augmentation technique expanding the set into an adequate number. Further evaluation of the model was performed via 10-fold cross-validation to ensure our model's reliability. (3) Results: The proposed RGB-CNN model achieved an accuracy of 91.86%, while VGG-16 and DenseNet-121 reached 88.54% and 86.11%, respectively. (4) Conclusions: The abovementioned experiments verify that the newly developed deep learning models may be of great assistance in nuclear medicine and clinical decision-making.
Collapse
Affiliation(s)
- Nikolaos I. Papandrianos
- Department of Energy Systems, University of Thessaly, Gaiopolis Campus, 41500 Larisa, Greece; (A.F.); (E.I.P.)
- Correspondence: ; Tel.: +30-693-6064613
| | - Anna Feleki
- Department of Energy Systems, University of Thessaly, Gaiopolis Campus, 41500 Larisa, Greece; (A.F.); (E.I.P.)
| | - Elpiniki I. Papageorgiou
- Department of Energy Systems, University of Thessaly, Gaiopolis Campus, 41500 Larisa, Greece; (A.F.); (E.I.P.)
| | - Chiara Martini
- Department of Diagnostic, Parma University Hospital, Via Gramsci 14, 43125 Parma, Italy;
- Department of Medicine and Surgery, Section of Radiology, University of Parma, Maggiore Hospital, Via Gramsci 14, 43125 Parma, Italy
| |
Collapse
|