1
|
Lin H, Chen K, Xue Y, Zhong S, Chen L, Ye M. Coronary heart disease prediction method fusing domain-adaptive transfer learning with graph convolutional networks (GCN). Sci Rep 2023; 13:14276. [PMID: 37652917 PMCID: PMC10471677 DOI: 10.1038/s41598-023-33124-z] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/08/2022] [Accepted: 04/07/2023] [Indexed: 09/02/2023] Open
Abstract
Graph convolutional networks (GCNs) have achieved impressive results in many medical scenarios involving graph node classification tasks. However, there are difficulties in transfer learning for graph representation learning and graph network models. Most GNNs work only in a single domain and cannot transfer the learned knowledge to other domains. Coronary Heart Disease (CHD) is a high-mortality disease, and there are non-public and significant differences in CHD datasets for current research, which makes it difficult to perform unified transfer learning. Therefore, in this paper, we propose a novel adversarial domain-adaptive multichannel graph convolutional network (DAMGCN) that can perform graph transfer learning on cross-domain tasks to achieve cross-domain medical knowledge transfer on different CHD datasets. First, we use a two-channel GCN model for feature aggregation using local consistency and global consistency. Then, a uniform node representation is generated for different graphs using an attention mechanism. Finally, we provide a domain adversarial module to decrease the discrepancies between the source and target domain classifiers and optimize the three loss functions in order to accomplish source and target domain knowledge transfer. The experimental findings demonstrate that our model performs best on three CHD datasets, and its performance is greatly enhanced by graph transfer learning.
Collapse
Affiliation(s)
- Huizhong Lin
- Department of Cardiology, Fujian Heart Medical Center, Fujian Institute of Coronary Heart Disease, Fujian Medical University Union Hospital, Fuzhou, 350001, People's Republic of China
| | - Kaizhi Chen
- College of Computer and Data Science, Fuzhou University, Fujian, 350108, People's Republic of China
| | - Yutao Xue
- College of Computer and Data Science, Fuzhou University, Fujian, 350108, People's Republic of China
| | - Shangping Zhong
- College of Computer and Data Science, Fuzhou University, Fujian, 350108, People's Republic of China
| | - Lianglong Chen
- Department of Cardiology, Fujian Heart Medical Center, Fujian Institute of Coronary Heart Disease, Fujian Medical University Union Hospital, Fuzhou, 350001, People's Republic of China
| | - Mingfang Ye
- Department of Cardiology, Fujian Heart Medical Center, Fujian Institute of Coronary Heart Disease, Fujian Medical University Union Hospital, Fuzhou, 350001, People's Republic of China.
| |
Collapse
|
2
|
de Santana JRG, Costa MGF, Costa Filho CFF. A New Approach to Classify Cardiac Arrythmias Using 2D Convolutional Neural Networks. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2021; 2021:566-570. [PMID: 34891357 DOI: 10.1109/embc46164.2021.9630938] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/13/2023]
Abstract
Cardiovascular diseases are the number one cause of death worldwide. Detecting cardiovascular diseases in its early stages could effectively reduce the mortality rate by providing timely treatment. In this study, we propose a new methodology to detect arrythmias, using 2D Convolutional Neural Networks. The main characteristic of the proposed methodology is the use of 15 x15 pixels gray-level images, containing the values of a heartbeat of the ECG signal. This work aims to detect 17 arrythmias. To validate and test the proposed methodology, MIT-BIH database, the main benchmark database available in literature, was used. When compared to other results previously published, the obtained precision, 92.31%, is in the state-of-the-art.Clinical Relevance- The presented work provides an automatic method to detect arrythmias in ECG signals by a new methodology.
Collapse
|
3
|
Jang JH, Kim TY, Yoon D. Effectiveness of Transfer Learning for Deep Learning-Based Electrocardiogram Analysis. Healthc Inform Res 2021; 27:19-28. [PMID: 33611873 PMCID: PMC7921576 DOI: 10.4258/hir.2021.27.1.19] [Citation(s) in RCA: 11] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/28/2020] [Accepted: 12/21/2020] [Indexed: 11/23/2022] Open
Abstract
Objectives Many deep learning-based predictive models evaluate the waveforms of electrocardiograms (ECGs). Because deep learning-based models are data-driven, large and labeled biosignal datasets are required. Most individual researchers find it difficult to collect adequate training data. We suggest that transfer learning can be used to solve this problem and increase the effectiveness of biosignal analysis. Methods We applied the weights of a pretrained model to another model that performed a different task (i.e., transfer learning). We used 2,648,100 unlabeled 8.2-second-long samples of ECG II data to pretrain a convolutional autoencoder (CAE) and employed the CAE to classify 12 ECG rhythms within a dataset, which had 10,646 10-second-long 12-lead ECGs with 11 rhythm labels. We split the datasets into training and test datasets in an 8:2 ratio. To confirm that transfer learning was effective, we evaluated the performance of the classifier after the proposed transfer learning, random initialization, and two-dimensional transfer learning as the size of the training dataset was reduced. All experiments were repeated 10 times using a bootstrapping method. The CAE performance was evaluated by calculating the mean squared errors (MSEs) and that of the ECG rhythm classifier by deriving F1-scores. Results The MSE of the CAE was 626.583. The mean F1-scores of the classifiers after bootstrapping of 100%, 50%, and 25% of the training dataset were 0.857, 0.843, and 0.835, respectively, when the proposed transfer learning was applied and 0.843, 0.831, and 0.543, respectively, after random initialization was applied. Conclusions Transfer learning effectively overcomes the data shortages that can compromise ECG domain analysis by deep learning.
Collapse
Affiliation(s)
- Jong-Hwan Jang
- Department of Biomedical Informatics, Ajou University School of Medicine, Suwon, Korea
| | - Tae Young Kim
- Department of Biomedical Informatics, Ajou University School of Medicine, Suwon, Korea
| | - Dukyong Yoon
- Department of Biomedical Informatics, Ajou University School of Medicine, Suwon, Korea.,Department of Biomedical Sciences, Graduate School of Medicine, Ajou University, Suwon, Korea
| |
Collapse
|
4
|
Somani S, Russak AJ, Richter F, Zhao S, Vaid A, Chaudhry F, De Freitas JK, Naik N, Miotto R, Nadkarni GN, Narula J, Argulian E, Glicksberg BS. Deep learning and the electrocardiogram: review of the current state-of-the-art. Europace 2021; 23:1179-1191. [PMID: 33564873 PMCID: PMC8350862 DOI: 10.1093/europace/euaa377] [Citation(s) in RCA: 85] [Impact Index Per Article: 28.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/21/2020] [Accepted: 11/25/2020] [Indexed: 12/22/2022] Open
Abstract
In the recent decade, deep learning, a subset of artificial intelligence and machine learning, has been used to identify patterns in big healthcare datasets for disease phenotyping, event predictions, and complex decision making. Public datasets for electrocardiograms (ECGs) have existed since the 1980s and have been used for very specific tasks in cardiology, such as arrhythmia, ischemia, and cardiomyopathy detection. Recently, private institutions have begun curating large ECG databases that are orders of magnitude larger than the public databases for ingestion by deep learning models. These efforts have demonstrated not only improved performance and generalizability in these aforementioned tasks but also application to novel clinical scenarios. This review focuses on orienting the clinician towards fundamental tenets of deep learning, state-of-the-art prior to its use for ECG analysis, and current applications of deep learning on ECGs, as well as their limitations and future areas of improvement.
Collapse
Affiliation(s)
- Sulaiman Somani
- The Hasso Plattner Institute for Digital Health at Mount Sinai, Icahn School of Medicine at Mount Sinai, One Gustave L. Levy Pl., New York, NY 10029, USA
| | - Adam J Russak
- The Hasso Plattner Institute for Digital Health at Mount Sinai, Icahn School of Medicine at Mount Sinai, One Gustave L. Levy Pl., New York, NY 10029, USA.,Department of Medicine, Icahn School of Medicine at Mount Sinai, New York, NY, USA
| | - Felix Richter
- The Hasso Plattner Institute for Digital Health at Mount Sinai, Icahn School of Medicine at Mount Sinai, One Gustave L. Levy Pl., New York, NY 10029, USA
| | - Shan Zhao
- The Hasso Plattner Institute for Digital Health at Mount Sinai, Icahn School of Medicine at Mount Sinai, One Gustave L. Levy Pl., New York, NY 10029, USA.,Department of Anesthesiology, Perioperative and Pain Medicine, Icahn School of Medicine at Mount Sinai, New York, NY, USA
| | - Akhil Vaid
- The Hasso Plattner Institute for Digital Health at Mount Sinai, Icahn School of Medicine at Mount Sinai, One Gustave L. Levy Pl., New York, NY 10029, USA
| | - Fayzan Chaudhry
- The Hasso Plattner Institute for Digital Health at Mount Sinai, Icahn School of Medicine at Mount Sinai, One Gustave L. Levy Pl., New York, NY 10029, USA.,Department of Genetics and Genomic Sciences, Icahn School of Medicine at Mount Sinai, New York, NY, USA
| | - Jessica K De Freitas
- The Hasso Plattner Institute for Digital Health at Mount Sinai, Icahn School of Medicine at Mount Sinai, One Gustave L. Levy Pl., New York, NY 10029, USA.,Department of Genetics and Genomic Sciences, Icahn School of Medicine at Mount Sinai, New York, NY, USA
| | - Nidhi Naik
- The Hasso Plattner Institute for Digital Health at Mount Sinai, Icahn School of Medicine at Mount Sinai, One Gustave L. Levy Pl., New York, NY 10029, USA
| | - Riccardio Miotto
- The Hasso Plattner Institute for Digital Health at Mount Sinai, Icahn School of Medicine at Mount Sinai, One Gustave L. Levy Pl., New York, NY 10029, USA.,Department of Genetics and Genomic Sciences, Icahn School of Medicine at Mount Sinai, New York, NY, USA
| | - Girish N Nadkarni
- The Hasso Plattner Institute for Digital Health at Mount Sinai, Icahn School of Medicine at Mount Sinai, One Gustave L. Levy Pl., New York, NY 10029, USA.,Department of Medicine, Icahn School of Medicine at Mount Sinai, New York, NY, USA.,The Charles Bronfman Institute for Personalized Medicine, Icahn School of Medicine at Mount Sinai, New York, NY, USA
| | - Jagat Narula
- Mount Sinai Heart, Icahn School of Medicine at Mount Sinai, New York, NY, USA.,Department of Cardiology, Icahn School of Medicine at Mount Sinai, New York, NY, USA
| | - Edgar Argulian
- Mount Sinai Heart, Icahn School of Medicine at Mount Sinai, New York, NY, USA.,Department of Cardiology, Icahn School of Medicine at Mount Sinai, New York, NY, USA
| | - Benjamin S Glicksberg
- The Hasso Plattner Institute for Digital Health at Mount Sinai, Icahn School of Medicine at Mount Sinai, One Gustave L. Levy Pl., New York, NY 10029, USA.,Department of Genetics and Genomic Sciences, Icahn School of Medicine at Mount Sinai, New York, NY, USA
| |
Collapse
|
6
|
Quer G, Arnaout R, Henne M, Arnaout R. Machine Learning and the Future of Cardiovascular Care: JACC State-of-the-Art Review. J Am Coll Cardiol 2021; 77:300-313. [PMID: 33478654 PMCID: PMC7839163 DOI: 10.1016/j.jacc.2020.11.030] [Citation(s) in RCA: 159] [Impact Index Per Article: 53.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/23/2020] [Revised: 11/12/2020] [Accepted: 11/13/2020] [Indexed: 12/14/2022]
Abstract
The role of physicians has always been to synthesize the data available to them to identify diagnostic patterns that guide treatment and follow response. Today, increasingly sophisticated machine learning algorithms may grow to support clinical experts in some of these tasks. Machine learning has the potential to benefit patients and cardiologists, but only if clinicians take an active role in bringing these new algorithms into practice. The aim of this review is to introduce clinicians who are not data science experts to key concepts in machine learning that will allow them to better understand the field and evaluate new literature and developments. The current published data in machine learning for cardiovascular disease is then summarized, using both a bibliometric survey, with code publicly available to enable similar analysis for any research topic of interest, and select case studies. Finally, several ways that clinicians can and must be involved in this emerging field are presented.
Collapse
Affiliation(s)
- Giorgio Quer
- Scripps Research Translational Institute, La Jolla, California, USA. https://twitter.com/giorgioquer
| | - Ramy Arnaout
- Division of Clinical Pathology, Department of Pathology, Beth Israel Deaconess Medical Center, Beth Israel Lahey Health, Boston, Massachusetts, USA
| | - Michael Henne
- Department of Medicine, Division of Cardiology, University of California, San Francisco, California, USA
| | - Rima Arnaout
- Department of Medicine, Division of Cardiology, Bakar Computational Health Sciences Institute, Center for Intelligent Imaging, University of California, San Francisco, California, USA.
| |
Collapse
|
8
|
Tadesse GA, Javed H, Weldemariam K, Zhu T. A Spectral-longitudinal Model for Detection of Heart Attack from 12-lead Electrocardiogram Waveforms. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2020; 2020:6009-6012. [PMID: 33019341 DOI: 10.1109/embc44109.2020.9176253] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
Abstract
Cardiovascular diseases (CVDs) remain responsible for millions of deaths annually. Myocardial infarction (MI) is the most prevalent condition among CVDs. Although datadriven approaches have been applied to predict CVDs from ECG signals, comparatively little work has been done on the use of multiple-lead ECG traces and their efficient integration to diagnose CVDs. In this paper, we propose an end-to-end trainable and joint spectral-longitudinal model to predict heart attack using data-level fusion of multiple ECG leads. The spectral stage transforms the time-series waveforms to stacked spectrograms and encodes the frequency-time characteristics, whilst the longitudinal model helps to utilise the temporal dependency that exists in these waveforms using recurrent networks. We validate the proposed approach using a public MI dataset. Our results show that the proposed spectrallongitudinal model achieves the highest performance compared to the baseline methods.
Collapse
|
9
|
Tadesse GA, Javed H, Thanh NLN, Thi HDH, Tan LV, Thwaites L, Clifton DA, Zhu T. Multi-Modal Diagnosis of Infectious Diseases in the Developing World. IEEE J Biomed Health Inform 2020; 24:2131-2141. [PMID: 31944967 DOI: 10.1109/jbhi.2019.2959839] [Citation(s) in RCA: 12] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
In low and middle income countries, infectious diseases continue to have a significant impact, particularly amongst the poorest in society. Tetanus and hand foot and mouth disease (HFMD) are two such diseases and, in both, death is associated with autonomic nervous system dysfunction (ANSD). Currently, photoplethysmogram or electrocardiogram monitoring is used to detect deterioration in these patients, however expensive clinical monitors are often required. In this study, we employ low-cost and mobile wearable devices to collect patient vital signs unobtrusively; and we develop machine learning algorithms for automatic and rapid triage of patients that provide efficient use of clinical resources. Existing methods are mainly dependent on the prior detection of clinical features with limited exploitation of multi-modal physiological data. Moreover, the latest developments in deep learning (e.g. cross-domain transfer learning) have not been sufficiently applied for infectious disease diagnosis. In this paper, we present a fusion of multi-modal physiological data to predict the severity of ANSD with a hierarchy of resource-aware decision making. First, an on-site triage process is performed using a simple classifier. Second, personalised longitudinal modelling is employed that takes the previous states of the patient into consideration. We have also employed a spectrogram representation of the physiological waveforms to exploit existing networks for cross-domain transfer learning, which avoids the laborious and data intensive process of training a network from scratch. Results show that the proposed framework has promising potential in supporting severity grading of infectious diseases in low-resources settings, such as in the developing world.
Collapse
|