1
|
Zhao Q, Geng S, Wang B, Sun Y, Nie W, Bai B, Yu C, Zhang F, Tang G, Zhang D, Zhou Y, Liu J, Hong S. Deep Learning in Heart Sound Analysis: From Techniques to Clinical Applications. HEALTH DATA SCIENCE 2024; 4:0182. [PMID: 39387057 PMCID: PMC11461928 DOI: 10.34133/hds.0182] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 12/12/2023] [Revised: 08/09/2024] [Accepted: 08/13/2024] [Indexed: 10/12/2024]
Abstract
Importance: Heart sound auscultation is a routinely used physical examination in clinical practice to identify potential cardiac abnormalities. However, accurate interpretation of heart sounds requires specialized training and experience, which limits its generalizability. Deep learning, a subset of machine learning, involves training artificial neural networks to learn from large datasets and perform complex tasks with intricate patterns. Over the past decade, deep learning has been successfully applied to heart sound analysis, achieving remarkable results and accumulating substantial heart sound data for model training. Although several reviews have summarized deep learning algorithms for heart sound analysis, there is a lack of comprehensive summaries regarding the available heart sound data and the clinical applications. Highlights: This review will compile the commonly used heart sound datasets, introduce the fundamentals and state-of-the-art techniques in heart sound analysis and deep learning, and summarize the current applications of deep learning for heart sound analysis, along with their limitations and areas for future improvement. Conclusions: The integration of deep learning into heart sound analysis represents a significant advancement in clinical practice. The growing availability of heart sound datasets and the continuous development of deep learning techniques contribute to the improvement and broader clinical adoption of these models. However, ongoing research is needed to address existing challenges and refine these technologies for broader clinical use.
Collapse
Affiliation(s)
- Qinghao Zhao
- Department of Cardiology,
Peking University People’s Hospital, Beijing, China
| | | | - Boya Wang
- Key Laboratory of Carcinogenesis and Translational Research (Ministry of Education/Beijing), Department of Gastrointestinal Oncology,
Peking University Cancer Hospital and Institute, Beijing, China
| | - Yutong Sun
- Department of Cardiology,
Peking University People’s Hospital, Beijing, China
| | - Wenchang Nie
- Department of Cardiology,
Peking University People’s Hospital, Beijing, China
| | - Baochen Bai
- Department of Cardiology,
Peking University People’s Hospital, Beijing, China
| | - Chao Yu
- Department of Cardiology,
Peking University People’s Hospital, Beijing, China
| | - Feng Zhang
- Department of Cardiology,
Peking University People’s Hospital, Beijing, China
| | - Gongzheng Tang
- National Institute of Health Data Science,
Peking University, Beijing, China
- Institute of Medical Technology,
Health Science Center of Peking University, Beijing, China
| | | | - Yuxi Zhou
- Department of Computer Science,
Tianjin University of Technology, Tianjin, China
- DCST, BNRist, RIIT, Institute of Internet Industry,
Tsinghua University, Beijing, China
| | - Jian Liu
- Department of Cardiology,
Peking University People’s Hospital, Beijing, China
| | - Shenda Hong
- National Institute of Health Data Science,
Peking University, Beijing, China
- Institute of Medical Technology,
Health Science Center of Peking University, Beijing, China
| |
Collapse
|
2
|
Cinquino M, Demir SM, Shumba AT, Schioppa EJ, Fachechi L, Rizzi F, Qualtieri A, Patrono L, Mastronardi VM, De Vittorio M. Enhancing cardiovascular health monitoring: Simultaneous multi-artery cardiac markers recording with flexible and bio-compatible AlN piezoelectric sensors. Biosens Bioelectron 2024; 267:116790. [PMID: 39332253 DOI: 10.1016/j.bios.2024.116790] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/29/2024] [Revised: 09/10/2024] [Accepted: 09/16/2024] [Indexed: 09/29/2024]
Abstract
Continuous monitoring of cardiovascular parameters like pulse wave velocity (PWV), blood pressure wave (BPW), stiffness index (SI), reflection index (RI), mean arterial pressure (MAP), and cardio-ankle vascular index (CAVI) has significant clinical importance for the early diagnosis of cardiovascular diseases (CVDs). Standard approaches, including echocardiography, impedance cardiography, or hemodynamic monitoring, are hindered by expensive and bulky apparatus and accessibility only in specialized facilities. Moreover, noninvasive techniques like sphygmomanometry, electrocardiography, and arterial tonometry often lack accuracy due to external electrical interferences, artifacts produced by unreliable electrode contacts, misreading from placement errors, or failure in detecting transient issues and trends. Here, we report a bio-compatible, flexible, noninvasive, low-cost piezoelectric sensor for continuous and real-time cardiovascular monitoring. The sensor, utilizing a thin aluminum nitride film on a flexible Kapton substrate, is used to extract heart rate, blood pressure waves, pulse wave velocities, and cardio-ankle vascular index from four arterial pulse sites: carotid, brachial, radial, and posterior tibial arteries. This simultaneous recording, for the first time in the same experiment, allows to provide a comprehensive cardiovascular patient's health profile. In a test with a 28-year-old male subject, the sensor yielded the SI = 7.1 ± 0.2 m/s, RI = 54.4 ± 0.5 %, MAP = 86.2 ± 1.5 mmHg, CAVI = 7.8 ± 0.2, and seven PWVs from the combination of the four different arterial positions, in good agreement with the typical values reported in the literature. These findings make the proposed technology a powerful tool to facilitate personalized medical diagnosis in preventing CVDs.
Collapse
Affiliation(s)
- Marco Cinquino
- Center for Biomolecular Nanotechnologies, Istituto Italiano di Tecnologia, Arnesano, LE, 73010, Italy.
| | - Suleyman Mahircan Demir
- Center for Biomolecular Nanotechnologies, Istituto Italiano di Tecnologia, Arnesano, LE, 73010, Italy; Department of Electronics and Telecommunications, Politecnico di Torino, Corso Duca degli Abruzzi, Torino, TO, 10129, Italy
| | - Angela Tafadzwa Shumba
- Center for Biomolecular Nanotechnologies, Istituto Italiano di Tecnologia, Arnesano, LE, 73010, Italy; Department of Innovation Engineering, University of Salento, Lecce, LE, 73100, Italy
| | - Enrico Junior Schioppa
- Inmatica S.p.A., BE-Pilot Palace, Strada Comunale Tufi, Monteroni di Lecce, LE, 73047, Italy
| | - Luca Fachechi
- Center for Biomolecular Nanotechnologies, Istituto Italiano di Tecnologia, Arnesano, LE, 73010, Italy
| | - Francesco Rizzi
- Center for Biomolecular Nanotechnologies, Istituto Italiano di Tecnologia, Arnesano, LE, 73010, Italy
| | - Antonio Qualtieri
- Center for Biomolecular Nanotechnologies, Istituto Italiano di Tecnologia, Arnesano, LE, 73010, Italy
| | - Luigi Patrono
- Department of Innovation Engineering, University of Salento, Lecce, LE, 73100, Italy
| | - Vincenzo Mariano Mastronardi
- Center for Biomolecular Nanotechnologies, Istituto Italiano di Tecnologia, Arnesano, LE, 73010, Italy; Department of Innovation Engineering, University of Salento, Lecce, LE, 73100, Italy.
| | - Massimo De Vittorio
- Center for Biomolecular Nanotechnologies, Istituto Italiano di Tecnologia, Arnesano, LE, 73010, Italy; Department of Innovation Engineering, University of Salento, Lecce, LE, 73100, Italy
| |
Collapse
|
3
|
De Fazio R, Spongano L, De Vittorio M, Patrono L, Visconti P. Machine Learning Algorithms for Processing and Classifying Unsegmented Phonocardiographic Signals: An Efficient Edge Computing Solution Suitable for Wearable Devices. SENSORS (BASEL, SWITZERLAND) 2024; 24:3853. [PMID: 38931636 PMCID: PMC11207414 DOI: 10.3390/s24123853] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/23/2024] [Revised: 06/04/2024] [Accepted: 06/11/2024] [Indexed: 06/28/2024]
Abstract
The phonocardiogram (PCG) can be used as an affordable way to monitor heart conditions. This study proposes the training and testing of several classifiers based on SVMs (support vector machines), k-NN (k-Nearest Neighbor), and NNs (neural networks) to perform binary ("Normal"/"Pathologic") and multiclass ("Normal", "CAD" (coronary artery disease), "MVP" (mitral valve prolapse), and "Benign" (benign murmurs)) classification of PCG signals, without heart sound segmentation algorithms. Two datasets of 482 and 826 PCG signals from the Physionet/CinC 2016 dataset are used to train the binary and multiclass classifiers, respectively. Each PCG signal is pre-processed, with spike removal, denoising, filtering, and normalization; afterward, it is divided into 5 s frames with a 1 s shift. Subsequently, a feature set is extracted from each frame to train and test the binary and multiclass classifiers. Concerning the binary classification, the trained classifiers yielded accuracies ranging from 92.4 to 98.7% on the test set, with memory occupations from 92.7 kB to 11.1 MB. Regarding the multiclass classification, the trained classifiers achieved accuracies spanning from 95.3 to 98.6% on the test set, occupying a memory portion from 233 kB to 14.1 MB. The NNs trained and tested in this work offer the best trade-off between performance and memory occupation, whereas the trained k-NN models obtained the best performance at the cost of large memory occupation (up to 14.1 MB). The classifiers' performance slightly depends on the signal quality, since a denoising step is performed during pre-processing. To this end, the signal-to-noise ratio (SNR) was acquired before and after the denoising, indicating an improvement between 15 and 30 dB. The trained and tested models occupy relatively little memory, enabling their implementation in resource-limited systems.
Collapse
Affiliation(s)
- Roberto De Fazio
- Department of Innovation Engineering, University of Salento, 73100 Lecce, Italy; (R.D.F.); (L.S.); (M.D.V.); (L.P.)
| | - Lorenzo Spongano
- Department of Innovation Engineering, University of Salento, 73100 Lecce, Italy; (R.D.F.); (L.S.); (M.D.V.); (L.P.)
- Center for Biomolecular Nanotechnologies, Italian Institute of Technology, 73010 Arnesano, Italy
| | - Massimo De Vittorio
- Department of Innovation Engineering, University of Salento, 73100 Lecce, Italy; (R.D.F.); (L.S.); (M.D.V.); (L.P.)
- Center for Biomolecular Nanotechnologies, Italian Institute of Technology, 73010 Arnesano, Italy
| | - Luigi Patrono
- Department of Innovation Engineering, University of Salento, 73100 Lecce, Italy; (R.D.F.); (L.S.); (M.D.V.); (L.P.)
| | - Paolo Visconti
- Department of Innovation Engineering, University of Salento, 73100 Lecce, Italy; (R.D.F.); (L.S.); (M.D.V.); (L.P.)
- Center for Biomolecular Nanotechnologies, Italian Institute of Technology, 73010 Arnesano, Italy
| |
Collapse
|
4
|
Ogawa S, Namino F, Mori T, Sato G, Yamakawa T, Saito S. AI diagnosis of heart sounds differentiated with super StethoScope. J Cardiol 2024; 83:265-271. [PMID: 37734656 DOI: 10.1016/j.jjcc.2023.09.007] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/06/2023] [Revised: 08/04/2023] [Accepted: 09/13/2023] [Indexed: 09/23/2023]
Abstract
In the aging global society, heart failure and valvular heart diseases, including aortic stenosis, are affecting millions of people and healthcare systems worldwide. Although the number of effective treatment options has increased in recent years, the lack of effective screening methods is provoking continued high mortality and rehospitalization rates. Appropriately, auscultation has been the primary option for screening such patients, however, challenges arise due to the variability in auscultation skills, the objectivity of the clinical method, and the presence of sounds inaudible to the human ear. To address challenges associated with the current approach towards auscultation, the hardware of Super StethoScope was developed. This paper is composed of (1) a background literature review of bioacoustic research regarding heart disease detection, (2) an introduction of our approach to heart sound research and development of Super StethoScope, (3) a discussion of the application of remote auscultation to telemedicine, and (4) results of a market needs survey on traditional and remote auscultation. Heart sounds and murmurs, if collected properly, have been shown to closely represent heart disease characteristics. Correspondingly, the main characteristics of Super StethoScope include: (1) simultaneous collection of electrocardiographic and heart sound for the detection of heart rate variability, (2) optimized signal-to-noise ratio in the audible frequency bands, and (3) acquisition of heart sounds including the inaudible frequency ranges. Due to the ability to visualize the data, the device is able to provide quantitative results without disturbance by sound quality alterations during remote auscultations. An online survey of 3648 doctors confirmed that auscultation is the common examination method used in today's clinical practice and revealed that artificial intelligence-based heart sound analysis systems are expected to be integrated into clinicians' practices. Super StethoScope would open new horizons for heart sound research and telemedicine.
Collapse
|
5
|
Centracchio J, Parlato S, Esposito D, Andreozzi E. Accurate Localization of First and Second Heart Sounds via Template Matching in Forcecardiography Signals. SENSORS (BASEL, SWITZERLAND) 2024; 24:1525. [PMID: 38475062 DOI: 10.3390/s24051525] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/02/2024] [Revised: 02/21/2024] [Accepted: 02/23/2024] [Indexed: 03/14/2024]
Abstract
Cardiac auscultation is an essential part of physical examination and plays a key role in the early diagnosis of many cardiovascular diseases. The analysis of phonocardiography (PCG) recordings is generally based on the recognition of the main heart sounds, i.e., S1 and S2, which is not a trivial task. This study proposes a method for an accurate recognition and localization of heart sounds in Forcecardiography (FCG) recordings. FCG is a novel technique able to measure subsonic vibrations and sounds via small force sensors placed onto a subject's thorax, allowing continuous cardio-respiratory monitoring. In this study, a template-matching technique based on normalized cross-correlation was used to automatically recognize heart sounds in FCG signals recorded from six healthy subjects at rest. Distinct templates were manually selected from each FCG recording and used to separately localize S1 and S2 sounds, as well as S1-S2 pairs. A simultaneously recorded electrocardiography (ECG) trace was used for performance evaluation. The results show that the template matching approach proved capable of separately classifying S1 and S2 sounds in more than 96% of all heartbeats. Linear regression, correlation, and Bland-Altman analyses showed that inter-beat intervals were estimated with high accuracy. Indeed, the estimation error was confined within 10 ms, with negligible impact on heart rate estimation. Heart rate variability (HRV) indices were also computed and turned out to be almost comparable with those obtained from ECG. The preliminary yet encouraging results of this study suggest that the template matching approach based on normalized cross-correlation allows very accurate heart sounds localization and inter-beat intervals estimation.
Collapse
Affiliation(s)
- Jessica Centracchio
- Department of Electrical Engineering and Information Technologies, University of Naples Federico II, Via Claudio, 21, I-80125 Naples, Italy
| | - Salvatore Parlato
- Department of Electrical Engineering and Information Technologies, University of Naples Federico II, Via Claudio, 21, I-80125 Naples, Italy
| | - Daniele Esposito
- Department of Electrical Engineering and Information Technologies, University of Naples Federico II, Via Claudio, 21, I-80125 Naples, Italy
| | - Emilio Andreozzi
- Department of Electrical Engineering and Information Technologies, University of Naples Federico II, Via Claudio, 21, I-80125 Naples, Italy
| |
Collapse
|
6
|
Li L, Huang M, Dao L, Feng X, Liu Y, Wei C, Liu F, Zhang J, Xu F. Construction and validation of a method for automated time label segmentation of heart sounds. Front Artif Intell 2024; 6:1309750. [PMID: 38274051 PMCID: PMC10808603 DOI: 10.3389/frai.2023.1309750] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/08/2023] [Accepted: 12/26/2023] [Indexed: 01/27/2024] Open
Abstract
Heart sound detection technology plays an important role in the prediction of cardiovascular disease, but the most significant heart sounds are fleeting and may be imperceptible. Hence, obtaining heart sound information in an efficient and accurate manner will be helpful for the prediction and diagnosis of heart disease. To obtain heart sound information, we designed an audio data analysis tool to segment the heart sounds from single heart cycle, and validated the heart rate using a finger oxygen meter. The results from our validated technique could be used to realize heart sound segmentation. Our robust algorithmic platform was able to segment the heart sounds, which could then be compared in terms of their difference from the background. A combination of an electronic stethoscope and artificial intelligence technology was used for the digital collection of heart sounds and the intelligent identification of the first (S1) and second (S2) heart sounds. Our approach can provide an objective basis for the auscultation of heart sounds and visual display of heart sounds and murmurs.
Collapse
Affiliation(s)
- Liuying Li
- Department of Traditional Chinese Medicine, Zigong First People's Hospital, Zigong, Sichuan, China
| | - Min Huang
- Department of Physiology, School of Basic Medicine, Chengdu Medical College, Sichuan, China
| | - Ling Dao
- Department of Cardiology, The First Affiliated Hospital of Zhengzhou University, Zhengzhou, China
- Department of Clinical Medicine, Chengdu Medical College, Sichuan, China
| | - Xixi Feng
- Department of Public Health, Chengdu Medical College, Sichuan, China
| | - Yifeng Liu
- Department of Clinical Medicine, Chengdu Medical College, Sichuan, China
| | - Changyou Wei
- Department of Traditional Chinese Medicine, Zigong First People's Hospital, Zigong, Sichuan, China
| | - Fangfang Liu
- Art College, Southwest Minzu University, Sichuan, China
| | - Jing Zhang
- MOEMIL Laboratory, School of Optoelectronic Information, University of Electronic Science and Technology of China, Chengdu, China
| | - Fan Xu
- Department of Public Health, Chengdu Medical College, Sichuan, China
| |
Collapse
|
7
|
Ogunpola A, Saeed F, Basurra S, Albarrak AM, Qasem SN. Machine Learning-Based Predictive Models for Detection of Cardiovascular Diseases. Diagnostics (Basel) 2024; 14:144. [PMID: 38248021 PMCID: PMC10813849 DOI: 10.3390/diagnostics14020144] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/27/2023] [Revised: 12/21/2023] [Accepted: 12/25/2023] [Indexed: 01/23/2024] Open
Abstract
Cardiovascular diseases present a significant global health challenge that emphasizes the critical need for developing accurate and more effective detection methods. Several studies have contributed valuable insights in this field, but it is still necessary to advance the predictive models and address the gaps in the existing detection approaches. For instance, some of the previous studies have not considered the challenge of imbalanced datasets, which can lead to biased predictions, especially when the datasets include minority classes. This study's primary focus is the early detection of heart diseases, particularly myocardial infarction, using machine learning techniques. It tackles the challenge of imbalanced datasets by conducting a comprehensive literature review to identify effective strategies. Seven machine learning and deep learning classifiers, including K-Nearest Neighbors, Support Vector Machine, Logistic Regression, Convolutional Neural Network, Gradient Boost, XGBoost, and Random Forest, were deployed to enhance the accuracy of heart disease predictions. The research explores different classifiers and their performance, providing valuable insights for developing robust prediction models for myocardial infarction. The study's outcomes emphasize the effectiveness of meticulously fine-tuning an XGBoost model for cardiovascular diseases. This optimization yields remarkable results: 98.50% accuracy, 99.14% precision, 98.29% recall, and a 98.71% F1 score. Such optimization significantly enhances the model's diagnostic accuracy for heart disease.
Collapse
Affiliation(s)
- Adedayo Ogunpola
- DAAI Research Group, College of Computing and Digital Technology, Birmingham City University, Birmingham B4 7XG, UK; (A.O.); (S.B.)
| | - Faisal Saeed
- DAAI Research Group, College of Computing and Digital Technology, Birmingham City University, Birmingham B4 7XG, UK; (A.O.); (S.B.)
| | - Shadi Basurra
- DAAI Research Group, College of Computing and Digital Technology, Birmingham City University, Birmingham B4 7XG, UK; (A.O.); (S.B.)
| | - Abdullah M. Albarrak
- Computer Science Department, College of Computer and Information Sciences, Imam Mohammad Ibn Saud Islamic University (IMSIU), Riyadh 11432, Saudi Arabia; (A.M.A.); (S.N.Q.)
| | - Sultan Noman Qasem
- Computer Science Department, College of Computer and Information Sciences, Imam Mohammad Ibn Saud Islamic University (IMSIU), Riyadh 11432, Saudi Arabia; (A.M.A.); (S.N.Q.)
| |
Collapse
|
8
|
Liao S, Wang B, Lin S. Optimizing cardiovascular image segmentation through integrated hierarchical features and attention mechanisms. Technol Health Care 2024; 32:403-413. [PMID: 38759064 PMCID: PMC11191477 DOI: 10.3233/thc-248035] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 05/19/2024]
Abstract
BACKGROUND Cardiovascular diseases are the top cause of death in China. Manual segmentation of cardiovascular images, prone to errors, demands an automated, rapid, and precise solution for clinical diagnosis. OBJECTIVE The paper highlights deep learning in automatic cardiovascular image segmentation, efficiently identifying pixel regions of interest for auxiliary diagnosis and research in cardiovascular diseases. METHODS In our study, we introduce innovative Region Weighted Fusion (RWF) and Shape Feature Refinement (SFR) modules, utilizing polarized self-attention for significant performance improvement in multiscale feature integration and shape fine-tuning. The RWF module includes reshaping, weight computation, and feature fusion, enhancing high-resolution attention computation and reducing information loss. Model optimization through loss functions offers a more reliable solution for cardiovascular medical image processing. RESULTS Our method excels in segmentation accuracy, emphasizing the vital role of the RWF module. It demonstrates outstanding performance in cardiovascular image segmentation, potentially raising clinical practice standards. CONCLUSIONS Our method ensures reliable medical image processing, guiding cardiovascular segmentation for future advancements in practical healthcare and contributing scientifically to enhanced disease diagnosis and treatment.
Collapse
Affiliation(s)
- Shijia Liao
- School of Informatics, Xiamen University, Xiamen, Fujian, China
| | - Bin Wang
- School of Informatics, Xiamen University, Xiamen, Fujian, China
- Emergency Department, Xiamen Cardiovascular Hospital of Xiamen University, Xiamen University, Xiamen, Fujian, China
| | - Shiming Lin
- School of Informatics, Xiamen University, Xiamen, Fujian, China
- School of Information Engineering, Changji University, Changji, Xinjiang Uygur Autonomous Region, China
| |
Collapse
|
9
|
Han S, Jeon W, Gong W, Kwak IY. MCHeart: Multi-Channel-Based Heart Signal Processing Scheme for Heart Noise Detection Using Deep Learning. BIOLOGY 2023; 12:1291. [PMID: 37887001 PMCID: PMC10604338 DOI: 10.3390/biology12101291] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/30/2023] [Revised: 09/22/2023] [Accepted: 09/26/2023] [Indexed: 10/28/2023]
Abstract
In this study, we constructed a model to predict abnormal cardiac sounds using a diverse set of auscultation data collected from various auscultation positions. Abnormal heart sounds were identified by extracting features such as peak intervals and noise characteristics during systole and diastole. Instead of using raw signal data, we transformed them into log-mel 2D spectrograms, which were employed as input variables for the CNN model. The advancement of our model involves integrating a deep learning architecture with feature extraction techniques based on existing knowledge of cardiac data. Specifically, we propose a multi-channel-based heart signal processing (MCHeart) scheme, which incorporates our proposed features into the deep learning model. Additionally, we introduce the ReLCNN model by applying residual blocks and MHA mechanisms to the LCNN architecture. By adding murmur features with a smoothing function and training the ReLCNN model, the weighted accuracy of the model increased from 79.6% to 83.6%, showing a performance improvement of approximately 4% point compared to the LCNN baseline model.
Collapse
Affiliation(s)
- Soyul Han
- Department of Applied Statistics, Chung-Ang University, Seoul 06974, Republic of Korea;
| | - Woongsun Jeon
- School of Electrical and Electronics Engineering, Chung-Ang University, Seoul 06974, Republic of Korea;
| | - Wuming Gong
- Lillehei Heart Institute, University of Minnesota, Minneapolis, MN 55455, USA;
| | - Il-Youp Kwak
- Department of Applied Statistics, Chung-Ang University, Seoul 06974, Republic of Korea;
| |
Collapse
|