1
|
Zhao Q, Geng S, Wang B, Sun Y, Nie W, Bai B, Yu C, Zhang F, Tang G, Zhang D, Zhou Y, Liu J, Hong S. Deep Learning in Heart Sound Analysis: From Techniques to Clinical Applications. HEALTH DATA SCIENCE 2024; 4:0182. [PMID: 39387057 PMCID: PMC11461928 DOI: 10.34133/hds.0182] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 12/12/2023] [Revised: 08/09/2024] [Accepted: 08/13/2024] [Indexed: 10/12/2024]
Abstract
Importance: Heart sound auscultation is a routinely used physical examination in clinical practice to identify potential cardiac abnormalities. However, accurate interpretation of heart sounds requires specialized training and experience, which limits its generalizability. Deep learning, a subset of machine learning, involves training artificial neural networks to learn from large datasets and perform complex tasks with intricate patterns. Over the past decade, deep learning has been successfully applied to heart sound analysis, achieving remarkable results and accumulating substantial heart sound data for model training. Although several reviews have summarized deep learning algorithms for heart sound analysis, there is a lack of comprehensive summaries regarding the available heart sound data and the clinical applications. Highlights: This review will compile the commonly used heart sound datasets, introduce the fundamentals and state-of-the-art techniques in heart sound analysis and deep learning, and summarize the current applications of deep learning for heart sound analysis, along with their limitations and areas for future improvement. Conclusions: The integration of deep learning into heart sound analysis represents a significant advancement in clinical practice. The growing availability of heart sound datasets and the continuous development of deep learning techniques contribute to the improvement and broader clinical adoption of these models. However, ongoing research is needed to address existing challenges and refine these technologies for broader clinical use.
Collapse
Affiliation(s)
- Qinghao Zhao
- Department of Cardiology,
Peking University People’s Hospital, Beijing, China
| | | | - Boya Wang
- Key Laboratory of Carcinogenesis and Translational Research (Ministry of Education/Beijing), Department of Gastrointestinal Oncology,
Peking University Cancer Hospital and Institute, Beijing, China
| | - Yutong Sun
- Department of Cardiology,
Peking University People’s Hospital, Beijing, China
| | - Wenchang Nie
- Department of Cardiology,
Peking University People’s Hospital, Beijing, China
| | - Baochen Bai
- Department of Cardiology,
Peking University People’s Hospital, Beijing, China
| | - Chao Yu
- Department of Cardiology,
Peking University People’s Hospital, Beijing, China
| | - Feng Zhang
- Department of Cardiology,
Peking University People’s Hospital, Beijing, China
| | - Gongzheng Tang
- National Institute of Health Data Science,
Peking University, Beijing, China
- Institute of Medical Technology,
Health Science Center of Peking University, Beijing, China
| | | | - Yuxi Zhou
- Department of Computer Science,
Tianjin University of Technology, Tianjin, China
- DCST, BNRist, RIIT, Institute of Internet Industry,
Tsinghua University, Beijing, China
| | - Jian Liu
- Department of Cardiology,
Peking University People’s Hospital, Beijing, China
| | - Shenda Hong
- National Institute of Health Data Science,
Peking University, Beijing, China
- Institute of Medical Technology,
Health Science Center of Peking University, Beijing, China
| |
Collapse
|
2
|
Mi J, Feng T, Wang H, Pei Z, Tang H. Beat-by-Beat Estimation of Hemodynamic Parameters in Left Ventricle Based on Phonocardiogram and Photoplethysmography Signals Using a Deep Learning Model: Preliminary Study. Bioengineering (Basel) 2024; 11:842. [PMID: 39199800 PMCID: PMC11351883 DOI: 10.3390/bioengineering11080842] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/12/2024] [Revised: 07/26/2024] [Accepted: 07/30/2024] [Indexed: 09/01/2024] Open
Abstract
Beat-by-beat monitoring of hemodynamic parameters in the left ventricle contributes to the early diagnosis and treatment of heart failure, valvular heart disease, and other cardiovascular diseases. Current accurate measurement methods for ventricular hemodynamic parameters are inconvenient for monitoring hemodynamic indexes in daily life. The objective of this study is to propose a method for estimating intraventricular hemodynamic parameters in a beat-to-beat style based on non-invasive PCG (phonocardiogram) and PPG (photoplethysmography) signals. Three beagle dogs were used as subjects. PCG, PPG, electrocardiogram (ECG), and invasive blood pressure signals in the left ventricle were synchronously collected while epinephrine medicine was injected into the veins to produce hemodynamic variations. Various doses of epinephrine were used to produce hemodynamic variations. A total of 40 records (over 12,000 cardiac cycles) were obtained. A deep neural network was built to simultaneously estimate four hemodynamic parameters of one cardiac cycle by inputting the PCGs and PPGs of the cardiac cycle. The outputs of the network were four hemodynamic parameters: left ventricular systolic blood pressure (SBP), left ventricular diastolic blood pressure (DBP), maximum rate of left ventricular pressure rise (MRR), and maximum rate of left ventricular pressure decline (MRD). The model built in this study consisted of a residual convolutional module and a bidirectional recurrent neural network module which learnt the local features and context relations, respectively. The training mode of the network followed a regression model, and the loss function was set as mean square error. When the network was trained and tested on one subject using a five-fold validation scheme, the performances were very good. The average correlation coefficients (CCs) between the estimated values and measured values were generally greater than 0.90 for SBP, DBP, MRR, and MRD. However, when the network was trained with one subject's data and tested with another subject's data, the performance degraded somewhat. The average CCs reduced from over 0.9 to 0.7 for SBP, DBP, and MRD; however, MRR had higher consistency, with the average CC reducing from over 0.9 to about 0.85 only. The generalizability across subjects could be improved if individual differences were considered. The performance indicates the possibility that hemodynamic parameters could be estimated by PCG and PPG signals collected on the body surface. With the rapid development of wearable devices, it has up-and-coming applications for self-monitoring in home healthcare environments.
Collapse
Affiliation(s)
- Jiachen Mi
- School of Biomedical Engineering, Dalian University of Technology, Dalian 116024, China; (J.M.); (T.F.); (H.W.)
| | - Tengfei Feng
- School of Biomedical Engineering, Dalian University of Technology, Dalian 116024, China; (J.M.); (T.F.); (H.W.)
| | - Hongkai Wang
- School of Biomedical Engineering, Dalian University of Technology, Dalian 116024, China; (J.M.); (T.F.); (H.W.)
- Liaoning Key Lab of Integrated Circuit and Biomedical Electronic System, Dalian University of Technology, Dalian 116024, China
- Dalian Key Laboratory of Digital Medicine for Critical Diseases, Dalian 116024, China
| | - Zuowei Pei
- Department of Cardiology, Central Hospital of Dalian University of Technology, No.826 Xinan Road, Dalian 116033, China;
| | - Hong Tang
- School of Biomedical Engineering, Dalian University of Technology, Dalian 116024, China; (J.M.); (T.F.); (H.W.)
- Liaoning Key Lab of Integrated Circuit and Biomedical Electronic System, Dalian University of Technology, Dalian 116024, China
- Dalian Key Laboratory of Digital Medicine for Critical Diseases, Dalian 116024, China
| |
Collapse
|
3
|
Baker S, Yogavijayan T, Kandasamy Y. Towards Non-Invasive and Continuous Blood Pressure Monitoring in Neonatal Intensive Care Using Artificial Intelligence: A Narrative Review. Healthcare (Basel) 2023; 11:3107. [PMID: 38131997 PMCID: PMC10743031 DOI: 10.3390/healthcare11243107] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/26/2023] [Revised: 11/29/2023] [Accepted: 12/04/2023] [Indexed: 12/23/2023] Open
Abstract
Preterm birth is a live birth that occurs before 37 completed weeks of pregnancy. Approximately 11% of babies are born preterm annually worldwide. Blood pressure (BP) monitoring is essential for managing the haemodynamic stability of preterm infants and impacts outcomes. However, current methods have many limitations associated, including invasive measurement, inaccuracies, and infection risk. In this narrative review, we find that artificial intelligence (AI) is a promising tool for the continuous measurement of BP in a neonatal cohort, based on data obtained from non-invasive sensors. Our findings highlight key sensing technologies, AI techniques, and model assessment metrics for BP sensing in the neonatal cohort. Moreover, our findings show that non-invasive BP monitoring leveraging AI has shown promise in adult cohorts but has not been broadly explored for neonatal cohorts. We conclude that there is a significant research opportunity in developing an innovative approach to provide a non-invasive alternative to existing continuous BP monitoring methods, which has the potential to improve outcomes for premature babies.
Collapse
Affiliation(s)
- Stephanie Baker
- College of Science and Engineering, James Cook University, Cairns, QLD 4878, Australia
| | - Thiviya Yogavijayan
- College of Medicine and Dentistry, James Cook University, Townsville, QLD 4811, Australia;
| | - Yogavijayan Kandasamy
- Department of Neonatology, Townsville University Hospital, Townsville, QLD 4811, Australia;
| |
Collapse
|
4
|
Walker SB, Badke CM, Carroll MS, Honegger KS, Fawcett A, Weese-Mayer DE, Sanchez-Pinto LN. Novel approaches to capturing and using continuous cardiorespiratory physiological data in hospitalized children. Pediatr Res 2023; 93:396-404. [PMID: 36329224 DOI: 10.1038/s41390-022-02359-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/02/2022] [Revised: 08/16/2022] [Accepted: 10/11/2022] [Indexed: 11/06/2022]
Abstract
Continuous cardiorespiratory physiological monitoring is a cornerstone of care in hospitalized children. The data generated by monitoring devices coupled with machine learning could transform the way we provide care. This scoping review summarizes existing evidence on novel approaches to continuous cardiorespiratory monitoring in hospitalized children. We aimed to identify opportunities for the development of monitoring technology and the use of machine learning to analyze continuous physiological data to improve the outcomes of hospitalized children. We included original research articles published on or after January 1, 2001, involving novel approaches to collect and use continuous cardiorespiratory physiological data in hospitalized children. OVID Medline, PubMed, and Embase databases were searched. We screened 2909 articles and performed full-text extraction of 105 articles. We identified 58 articles describing novel devices or approaches, which were generally small and single-center. In addition, we identified 47 articles that described the use of continuous physiological data in prediction models, but only 7 integrated multidimensional data (e.g., demographics, laboratory results). We identified three areas for development: (1) further validation of promising novel devices; (2) more studies of models integrating multidimensional data with continuous cardiorespiratory data; and (3) further dissemination, implementation, and validation of prediction models using continuous cardiorespiratory data. IMPACT: We performed a comprehensive scoping review of novel approaches to capture and use continuous cardiorespiratory physiological data for monitoring, diagnosis, providing care, and predicting events in hospitalized infants and children, from novel devices to machine learning-based prediction models. We identified three key areas for future development: (1) further validation of promising novel devices; (2) more studies of models integrating multidimensional data with continuous cardiorespiratory data; and (3) further dissemination, implementation, and validation of prediction models using cardiorespiratory data.
Collapse
Affiliation(s)
- Sarah B Walker
- Department of Pediatrics, Northwestern University Feinberg School of Medicine, Chicago, IL, USA. .,Stanley Manne Children's Research Institute, Ann & Robert H. Lurie Children's Hospital of Chicago, Chicago, IL, USA.
| | - Colleen M Badke
- Department of Pediatrics, Northwestern University Feinberg School of Medicine, Chicago, IL, USA.,Stanley Manne Children's Research Institute, Ann & Robert H. Lurie Children's Hospital of Chicago, Chicago, IL, USA
| | - Michael S Carroll
- Department of Pediatrics, Northwestern University Feinberg School of Medicine, Chicago, IL, USA.,Stanley Manne Children's Research Institute, Ann & Robert H. Lurie Children's Hospital of Chicago, Chicago, IL, USA
| | - Kyle S Honegger
- Department of Pediatrics, Northwestern University Feinberg School of Medicine, Chicago, IL, USA.,Stanley Manne Children's Research Institute, Ann & Robert H. Lurie Children's Hospital of Chicago, Chicago, IL, USA
| | - Andrea Fawcett
- Department of Pediatrics, Northwestern University Feinberg School of Medicine, Chicago, IL, USA.,Stanley Manne Children's Research Institute, Ann & Robert H. Lurie Children's Hospital of Chicago, Chicago, IL, USA
| | - Debra E Weese-Mayer
- Department of Pediatrics, Northwestern University Feinberg School of Medicine, Chicago, IL, USA.,Stanley Manne Children's Research Institute, Ann & Robert H. Lurie Children's Hospital of Chicago, Chicago, IL, USA
| | - L Nelson Sanchez-Pinto
- Department of Pediatrics, Northwestern University Feinberg School of Medicine, Chicago, IL, USA.,Stanley Manne Children's Research Institute, Ann & Robert H. Lurie Children's Hospital of Chicago, Chicago, IL, USA
| |
Collapse
|
5
|
Chen Y, Hou A, Wu X, Cong T, Zhou Z, Jiao Y, Luo Y, Wang Y, Mi W, Cao J. Assessing Hemorrhagic Shock Severity Using the Second Heart Sound Determined from Phonocardiogram: A Novel Approach. MICROMACHINES 2022; 13:mi13071027. [PMID: 35888843 PMCID: PMC9316924 DOI: 10.3390/mi13071027] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/04/2022] [Revised: 06/26/2022] [Accepted: 06/26/2022] [Indexed: 12/04/2022]
Abstract
Introduction: Hemorrhagic shock (HS) is a severe medical emergency. Early diagnosis of HS is important for clinical treatment. In this paper, we report a flexible material-based heart sound monitoring device which can evaluate the degree of HS through a phonocardiogram (PCG) change. Methods: Progressive hemorrhage treatments (H1, H2, and H3 stage) were used in swine to build animal models. The PCG sensor was mounted on the chest of the swine. Routine monitoring was used at the same time. Results: This study showed that arterial blood pressure decreased significantly from the H1 phase, while second heart sound amplitude (S2A) and energy (S2E) decreased significantly from the H2 phase. Both S2A and S2E correlated well with BP (p < 0.001). The heart rate, pulse pressure variation and serum hemoglobin level significantly changed in the H3 stage (p < 0.05). Discussion: The change of second heart sound (S2) was at the H2 stage and was earlier than routine monitoring methods. Therefore, PCG change may be a new indicator for the early detection of HS severity.
Collapse
Affiliation(s)
- Yan Chen
- Department of Anesthesiology, the First Medical Center of Chinese PLA General Hospital, Beijing 100853, China; (Y.C.); (A.H.); (X.W.); (T.C.); (Z.Z.); (Y.J.); (Y.L.); (W.M.)
| | - Aisheng Hou
- Department of Anesthesiology, the First Medical Center of Chinese PLA General Hospital, Beijing 100853, China; (Y.C.); (A.H.); (X.W.); (T.C.); (Z.Z.); (Y.J.); (Y.L.); (W.M.)
| | - Xiaodong Wu
- Department of Anesthesiology, the First Medical Center of Chinese PLA General Hospital, Beijing 100853, China; (Y.C.); (A.H.); (X.W.); (T.C.); (Z.Z.); (Y.J.); (Y.L.); (W.M.)
| | - Ting Cong
- Department of Anesthesiology, the First Medical Center of Chinese PLA General Hospital, Beijing 100853, China; (Y.C.); (A.H.); (X.W.); (T.C.); (Z.Z.); (Y.J.); (Y.L.); (W.M.)
| | - Zhikang Zhou
- Department of Anesthesiology, the First Medical Center of Chinese PLA General Hospital, Beijing 100853, China; (Y.C.); (A.H.); (X.W.); (T.C.); (Z.Z.); (Y.J.); (Y.L.); (W.M.)
| | - Youyou Jiao
- Department of Anesthesiology, the First Medical Center of Chinese PLA General Hospital, Beijing 100853, China; (Y.C.); (A.H.); (X.W.); (T.C.); (Z.Z.); (Y.J.); (Y.L.); (W.M.)
| | - Yungen Luo
- Department of Anesthesiology, the First Medical Center of Chinese PLA General Hospital, Beijing 100853, China; (Y.C.); (A.H.); (X.W.); (T.C.); (Z.Z.); (Y.J.); (Y.L.); (W.M.)
| | - Yuheng Wang
- The Faculty of Electrical Engineering and Computer Science, Ningbo University, Ningbo 315211, China;
| | - Weidong Mi
- Department of Anesthesiology, the First Medical Center of Chinese PLA General Hospital, Beijing 100853, China; (Y.C.); (A.H.); (X.W.); (T.C.); (Z.Z.); (Y.J.); (Y.L.); (W.M.)
| | - Jiangbei Cao
- Department of Anesthesiology, the First Medical Center of Chinese PLA General Hospital, Beijing 100853, China; (Y.C.); (A.H.); (X.W.); (T.C.); (Z.Z.); (Y.J.); (Y.L.); (W.M.)
- Correspondence:
| |
Collapse
|
6
|
Continuous and Noninvasive Estimation of Right Ventricle Systolic Blood Pressure Using Heart Sound Signal by Deep Bidirectional LSTM Network. APPLIED SCIENCES-BASEL 2020. [DOI: 10.3390/app10165466] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/22/2023]
Abstract
Objective: Timely monitoring right ventricular systolic blood pressure (RVSBP) is helpful in the early detection of pulmonary hypertension (PH). However, it is not easy to monitor RVSBP directly. The objective of this paper is to develop a deep learning technique for RVSBP noninvasive estimation using heart sound (HS) signals supported by (electrocardiography) ECG signals without complex features extraction. Methods: Five beagle dog subjects were used. The medicine U-44069 was injected into the subjects to induce a wide range of RVSBP variation. The blood pressure in right ventricle, ECG of lead I and HS signals were recorded simultaneously. Thirty-two records were collected. The relations between RVSBP and cyclic HS signals were modeled by the Bidirectional Long Short-Term Memory (Bi-LSTM) network. Results: The mean absolute error (MAE) ± standard deviation (SD) inside record was 1.85 ± 1.82 mmHg. It was 4.37 ± 2.49 mmHg across record but within subject. The corrective factors were added after training the Bi-LSTM network across subjects. Finally, the MAE ± SD from 12.46 ± 6.56 mmHg dropped to 6.37 ± 4.90 mmHg across subjects. Significance: Our work was the first to apply the Bi-LSTM network to build relations between the HS signal and RVSBP. This work suggested a noninvasive and continuous RVSBP estimation using the HS signal supported by the ECG signal by deep learning architecture without the need of healthcare professionals.
Collapse
|