1
|
Chowdhury FA, Hosain MK, Bin Islam MS, Hossain MS, Basak P, Mahmud S, Murugappan M, Chowdhury MEH. ECG waveform generation from radar signals: A deep learning perspective. Comput Biol Med 2024; 176:108555. [PMID: 38749323 DOI: 10.1016/j.compbiomed.2024.108555] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/19/2024] [Revised: 05/01/2024] [Accepted: 05/05/2024] [Indexed: 05/31/2024]
Abstract
Cardiovascular diagnostics relies heavily on the ECG (ECG), which reveals significant information about heart rhythm and function. Despite their significance, traditional ECG measures employing electrodes have limitations. As a result of extended electrode attachments, patients may experience skin irritation or pain, and motion artifacts may interfere with signal accuracy. Additionally, ECG monitoring usually requires highly trained professionals and specialized equipment, which increases the treatment's complexity and cost. In critical care scenarios, such as continuous monitoring of hospitalized patients, wearable sensors for collecting ECG data may be difficult to use. Although there are issues with ECG, it remains a valuable tool for diagnosing and monitoring cardiac disorders due to its non-invasive nature and the detailed information it provides about the heart. The goal of this study is to present an innovative method for generating continuous ECG waveforms from non-contact radar data by using Deep Learning. The method can eliminate the need for invasive or wearable biosensors and expensive equipment to collect ECGs. In this paper, we propose the MultiResLinkNet, a one-dimensional convolutional neural network (1D CNN) model for generating ECG signals from radar waveforms. With the help of a publicly accessible radar benchmark dataset, an end-to-end DL architecture is trained and assessed. There are six ports of raw radar data in this dataset, along with ground truth physiological signals collected from 30 participants in five distinct scenarios: Resting, Valsalva, Apnea, Tilt-up, and Tilt-down. By using strong temporal and spectral measurements, we assessed our proposed framework's ability to convert ECG data from Radar signals in three distinct scenarios, namely Resting, Valsalva, and Apnea (RVA). ECG segmentation performed better by MultiResLinkNet than by state-of-the-art networks in both combined and individual cases. As a result of the simulations, the resting, valsalva, and RVA scenarios showed the highest average temporal values, respectively: 66.09523 ± 19.33, 60.13625 ± 21.92, and 61.86265 ± 21.37. In addition, it exhibited the highest spectral correlation values (82.4388 ± 18.42 (Resting), 77.05186 ± 23.26 (Valsalva), 74.65785 ± 23.17 (Apnea), and 79.96201 ± 20.82 (RVA)), along with minimal temporal and spectral errors in almost every case. The qualitative evaluation revealed strong similarities between generated and actual ECG waveforms. As a result of our method of forecasting ECG patterns from remote radar data, we can monitor high-risk patients, especially those undergoing surgery.
Collapse
Affiliation(s)
- Farhana Ahmed Chowdhury
- Department of Electronics and Telecommunication Engineering, Rajshahi University of Engineering and Technology, Rajshahi, 6204, Bangladesh
| | - Md Kamal Hosain
- Department of Electronics and Telecommunication Engineering, Rajshahi University of Engineering and Technology, Rajshahi, 6204, Bangladesh
| | - Md Sakib Bin Islam
- Department of Biomedical Engineering, Military Institute of Science and Technology, Dhaka, Bangladesh
| | - Md Shafayet Hossain
- Department of Electrical, Electronics and Systems Engineering, Universiti Kebangsaan Malaysia, Bangi, Selangor, 43600, Malaysia
| | - Promit Basak
- Department of Electrical and Electronic Engineering, University of Dhaka, Dhaka, 1000, Bangladesh
| | - Sakib Mahmud
- Department of Electrical Engineering, Qatar University, Doha, 2713, Qatar
| | - M Murugappan
- Intelligent Signal Processing (ISP) Research Lab, Department of Electronics and Communication Engineering, Kuwait College of Science and Technology, Block 4, Doha, Kuwait; Department of Electronics and Communication Engineering, Vels Institute of Sciences, Technology, and Advanced Studies, Chennai, Tamilnadu, India.
| | | |
Collapse
|
2
|
Mehrjouseresht P, Hail RE, Karsmakers P, Schreurs DMMP. Respiration and Heart Rate Monitoring in Smart Homes: An Angular-Free Approach with an FMCW Radar. SENSORS (BASEL, SWITZERLAND) 2024; 24:2448. [PMID: 38676065 PMCID: PMC11054141 DOI: 10.3390/s24082448] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/27/2024] [Revised: 03/28/2024] [Accepted: 04/09/2024] [Indexed: 04/28/2024]
Abstract
This paper proposes a new approach for wide angle monitoring of vital signs in smart home applications. The person is tracked using an indoor radar. Upon detecting the person to be static, the radar automatically focuses its beam on that location, and subsequently breathing and heart rates are extracted from the reflected signals using continuous wavelet transform (CWT) analysis. In this way, leveraging the radar's on-chip processor enables real-time monitoring of vital signs across varying angles. In our experiment, we employ a commercial multi-input multi-output (MIMO) millimeter-wave FMCW radar to monitor vital signs within a range of 1.15 to 2.3 m and an angular span of -44.8 to +44.8 deg. In the Bland-Altman plot, the measured results indicate the average difference of -1.5 and 0.06 beats per minute (BPM) relative to the reference for heart rate and breathing rate, respectively.
Collapse
Affiliation(s)
- Pouya Mehrjouseresht
- Waves: Core Research and Engineering (WaveCoRE), Department of Electrical Engineering (ESAT), KU Leuven, B-3001 Leuven, Belgium;
| | - Reda El Hail
- Division of Declarative Languages and Artificial Intelligence (DTAI), Leuven.AI, Department of Computer Science, KU Leuven, B-2440 Geel, Belgium; (R.E.H.); (P.K.)
- Flanders Make, MPRO, B-3000 Leuven, Belgium
| | - Peter Karsmakers
- Division of Declarative Languages and Artificial Intelligence (DTAI), Leuven.AI, Department of Computer Science, KU Leuven, B-2440 Geel, Belgium; (R.E.H.); (P.K.)
- Flanders Make, MPRO, B-3000 Leuven, Belgium
| | - Dominique M. M.-P. Schreurs
- Waves: Core Research and Engineering (WaveCoRE), Department of Electrical Engineering (ESAT), KU Leuven, B-3001 Leuven, Belgium;
| |
Collapse
|
3
|
Baumann S, Stone R, Kim JYM. Introducing the Pi-CON Methodology to Overcome Usability Deficits during Remote Patient Monitoring. SENSORS (BASEL, SWITZERLAND) 2024; 24:2260. [PMID: 38610471 PMCID: PMC11014368 DOI: 10.3390/s24072260] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/04/2024] [Revised: 03/25/2024] [Accepted: 03/27/2024] [Indexed: 04/14/2024]
Abstract
The adoption of telehealth has soared, and with that the acceptance of Remote Patient Monitoring (RPM) and virtual care. A review of the literature illustrates, however, that poor device usability can impact the generated data when using Patient-Generated Health Data (PGHD) devices, such as wearables or home use medical devices, when used outside a health facility. The Pi-CON methodology is introduced to overcome these challenges and guide the definition of user-friendly and intuitive devices in the future. Pi-CON stands for passive, continuous, and non-contact, and describes the ability to acquire health data, such as vital signs, continuously and passively with limited user interaction and without attaching any sensors to the patient. The paper highlights the advantages of Pi-CON by leveraging various sensors and techniques, such as radar, remote photoplethysmography, and infrared. It illustrates potential concerns and discusses future applications Pi-CON could be used for, including gait and fall monitoring by installing an omnipresent sensor based on the Pi-CON methodology. This would allow automatic data collection once a person is recognized, and could be extended with an integrated gateway so multiple cameras could be installed to enable data feeds to a cloud-based interface, allowing clinicians and family members to monitor patient health status remotely at any time.
Collapse
Affiliation(s)
| | | | - Joseph Yun-Ming Kim
- Industrial and Manufacturing Systems Engineering, Iowa State University, 2529 Union Dr, Ames, IA 50011, USA; (S.B.); (R.S.)
| |
Collapse
|
4
|
Liebetruth M, Kehe K, Steinritz D, Sammito S. Systematic Literature Review Regarding Heart Rate and Respiratory Rate Measurement by Means of Radar Technology. SENSORS (BASEL, SWITZERLAND) 2024; 24:1003. [PMID: 38339721 PMCID: PMC10857015 DOI: 10.3390/s24031003] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/18/2023] [Revised: 01/23/2024] [Accepted: 01/30/2024] [Indexed: 02/12/2024]
Abstract
The use of radar technology for non-contact measurement of vital parameters is increasingly being examined in scientific studies. Based on a systematic literature search in the PubMed, German National Library, Austrian Library Network (Union Catalog), Swiss National Library and Common Library Network databases, the accuracy of heart rate and/or respiratory rate measurements by means of radar technology was analyzed. In 37% of the included studies on the measurement of the respiratory rate and in 48% of those on the measurement of the heart rate, the maximum deviation was 5%. For a tolerated deviation of 10%, the corresponding percentages were 85% and 87%, respectively. However, the quantitative comparability of the results available in the current literature is very limited due to a variety of variables. The elimination of the problem of confounding variables and the continuation of the tendency to focus on the algorithm applied will continue to constitute a central topic of radar-based vital parameter measurement. Promising fields of application of research can be found in particular in areas that require non-contact measurements. This includes infection events, emergency medicine, disaster situations and major catastrophic incidents.
Collapse
Affiliation(s)
- Magdalena Liebetruth
- German Air Force Centre of Aerospace Medicine, 51147 Cologne, Germany
- Department of Occupational Medicine, Faculty of Medicine, Otto von Guericke University of Magdeburg, 39120 Magdeburg, Germany
| | - Kai Kehe
- Bundeswehr Medical Service Headquarter, Department A-VI Public Health, 56072 Koblenz, Germany
| | - Dirk Steinritz
- Bundeswehr Institute of Pharmacology and Toxicology, 80937 Munich, Germany
| | - Stefan Sammito
- German Air Force Centre of Aerospace Medicine, 51147 Cologne, Germany
- Department of Occupational Medicine, Faculty of Medicine, Otto von Guericke University of Magdeburg, 39120 Magdeburg, Germany
| |
Collapse
|
5
|
Gaiduk M, Serrano Alarcón Á, Seepold R, Martínez Madrid N. Current status and prospects of automatic sleep stages scoring: Review. Biomed Eng Lett 2023; 13:247-272. [PMID: 37519865 PMCID: PMC10382458 DOI: 10.1007/s13534-023-00299-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/31/2023] [Revised: 06/07/2023] [Accepted: 06/18/2023] [Indexed: 08/01/2023] Open
Abstract
The scoring of sleep stages is one of the essential tasks in sleep analysis. Since a manual procedure requires considerable human and financial resources, and incorporates some subjectivity, an automated approach could result in several advantages. There have been many developments in this area, and in order to provide a comprehensive overview, it is essential to review relevant recent works and summarise the characteristics of the approaches, which is the main aim of this article. To achieve it, we examined articles published between 2018 and 2022 that dealt with the automated scoring of sleep stages. In the final selection for in-depth analysis, 125 articles were included after reviewing a total of 515 publications. The results revealed that automatic scoring demonstrates good quality (with Cohen's kappa up to over 0.80 and accuracy up to over 90%) in analysing EEG/EEG + EOG + EMG signals. At the same time, it should be noted that there has been no breakthrough in the quality of results using these signals in recent years. Systems involving other signals that could potentially be acquired more conveniently for the user (e.g. respiratory, cardiac or movement signals) remain more challenging in the implementation with a high level of reliability but have considerable innovation capability. In general, automatic sleep stage scoring has excellent potential to assist medical professionals while providing an objective assessment.
Collapse
Affiliation(s)
- Maksym Gaiduk
- HTWG Konstanz – University of Applied Sciences, Alfred-Wachtel-Str.8, 78462 Konstanz, Germany
| | | | - Ralf Seepold
- HTWG Konstanz – University of Applied Sciences, Alfred-Wachtel-Str.8, 78462 Konstanz, Germany
| | | |
Collapse
|
6
|
Battiston G, Régnier R, Galibert O. Evaluation Protocol for Analogue Intelligent Medical Radars: Towards a Systematic Approach Based on Theory and a State of the Art. SENSORS (BASEL, SWITZERLAND) 2023; 23:3036. [PMID: 36991747 PMCID: PMC10054009 DOI: 10.3390/s23063036] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 12/19/2022] [Revised: 02/08/2023] [Accepted: 03/09/2023] [Indexed: 06/19/2023]
Abstract
We propose the basis for a systematised approach to the performance evaluation of analogue intelligent medical radars. In the first part, we review the literature on the evaluation of medical radars and compare the provided experimental elements with models from radar theory in order to identify the key physical parameters that will be useful to develop a comprehensive protocol. In the second part, we present our experimental equipment, protocol and metrics to carry out such an evaluation.
Collapse
|
7
|
Lim S, Jang GS, Song W, Kim BH, Kim DH. Non-Contact VITAL Signs Monitoring of a Patient Lying on Surgical Bed Using Beamforming FMCW Radar. SENSORS (BASEL, SWITZERLAND) 2022; 22:8167. [PMID: 36365862 PMCID: PMC9656893 DOI: 10.3390/s22218167] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 09/20/2022] [Revised: 10/17/2022] [Accepted: 10/20/2022] [Indexed: 06/16/2023]
Abstract
Respiration and heartrates are important information for surgery. When the vital signs of the patient lying prone are monitored using radar installed on the back of the surgical bed, the surgeon's movements reduce the accuracy of these monitored vital signs. This study proposes a method for enhancing the monitored vital sign accuracies of a patient lying on a surgical bed using a 60 GHz frequency modulated continuous wave (FMCW) radar system with beamforming. The vital sign accuracies were enhanced by applying a fast Fourier transform (FFT) for range and beamforming which suppress the noise generated at different ranges and angles from the patient's position. The experiment was performed for a patient lying on a surgical bed with or without surgeon. Comparing a continuous-wave (CW) Doppler radar, the FMCW radar with beamforming improved almost 22 dB of signal-to-interference and noise ratio (SINR) for vital signals. More than 90% accuracy of monitoring respiration and heartrates was achieved even though the surgeon was located next to the patient as an interferer. It was analyzed using a proposed vital signal model included in the radar IF equation.
Collapse
Affiliation(s)
| | | | | | | | - Dong Hyun Kim
- SMG-SNU Boramae Medical Center, 20, Boramae-ro 5-gil, Dongjak-gu, Seoul 07061, Korea
| |
Collapse
|
8
|
Salem M, Elkaseer A, El-Maddah IAM, Youssef KY, Scholz SG, Mohamed HK. Non-Invasive Data Acquisition and IoT Solution for Human Vital Signs Monitoring: Applications, Limitations and Future Prospects. SENSORS (BASEL, SWITZERLAND) 2022; 22:s22176625. [PMID: 36081081 PMCID: PMC9460364 DOI: 10.3390/s22176625] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/26/2022] [Revised: 08/22/2022] [Accepted: 08/30/2022] [Indexed: 05/06/2023]
Abstract
The rapid development of technology has brought about a revolution in healthcare stimulating a wide range of smart and autonomous applications in homes, clinics, surgeries and hospitals. Smart healthcare opens the opportunity for a qualitative advance in the relations between healthcare providers and end-users for the provision of healthcare such as enabling doctors to diagnose remotely while optimizing the accuracy of the diagnosis and maximizing the benefits of treatment by enabling close patient monitoring. This paper presents a comprehensive review of non-invasive vital data acquisition and the Internet of Things in healthcare informatics and thus reports the challenges in healthcare informatics and suggests future work that would lead to solutions to address the open challenges in IoT and non-invasive vital data acquisition. In particular, the conducted review has revealed that there has been a daunting challenge in the development of multi-frequency vital IoT systems, and addressing this issue will help enable the vital IoT node to be reachable by the broker in multiple area ranges. Furthermore, the utilization of multi-camera systems has proven its high potential to increase the accuracy of vital data acquisition, but the implementation of such systems has not been fully developed with unfilled gaps to be bridged. Moreover, the application of deep learning to the real-time analysis of vital data on the node/edge side will enable optimal, instant offline decision making. Finally, the synergistic integration of reliable power management and energy harvesting systems into non-invasive data acquisition has been omitted so far, and the successful implementation of such systems will lead to a smart, robust, sustainable and self-powered healthcare system.
Collapse
Affiliation(s)
- Mahmoud Salem
- Institute for Automation and Applied Informatics, Karlsruhe Institute of Technology, 76344 Eggenstein-Leopoldshafen, Germany
- Correspondence: ; Tel.: +49-0-721-608-25632
| | - Ahmed Elkaseer
- Institute for Automation and Applied Informatics, Karlsruhe Institute of Technology, 76344 Eggenstein-Leopoldshafen, Germany
- Karlsruhe Nano Micro Facility, Karlsruhe Institute of Technology, 76344 Eggenstein-Leopoldshafen, Germany
- Faculty of Engineering, Port Said University, Port Said 42526, Egypt
| | | | - Khaled Y. Youssef
- Faculty of Navigation Science and Space Technology, Beni-Suef University, Beni-Suef 2731070, Egypt
| | - Steffen G. Scholz
- Institute for Automation and Applied Informatics, Karlsruhe Institute of Technology, 76344 Eggenstein-Leopoldshafen, Germany
- Karlsruhe Nano Micro Facility, Karlsruhe Institute of Technology, 76344 Eggenstein-Leopoldshafen, Germany
- College of Engineering, Swansea University, Swansea SA2 8PP, UK
| | - Hoda K. Mohamed
- Faculty of Engineering, Ain Shams University, Cairo 11535, Egypt
| |
Collapse
|
9
|
Blind Source Separation Based on Double-Mutant Butterfly Optimization Algorithm. SENSORS 2022; 22:s22113979. [PMID: 35684599 PMCID: PMC9182827 DOI: 10.3390/s22113979] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 05/02/2022] [Revised: 05/17/2022] [Accepted: 05/20/2022] [Indexed: 02/04/2023]
Abstract
The conventional blind source separation independent component analysis method has the problem of low-separation performance. In addition, the basic butterfly optimization algorithm has the problem of insufficient search capability. In order to solve the above problems, an independent component analysis method based on the double-mutant butterfly optimization algorithm (DMBOA) is proposed in this paper. The proposed method employs the kurtosis of the signal as the objective function. By optimizing the objective function, blind source separation of the signals is realized. Based on the original butterfly optimization algorithm, DMBOA introduces dynamic transformation probability and population reconstruction mechanisms to coordinate global and local search, and when the optimization stagnates, the population is reconstructed to increase diversity and avoid falling into local optimization. The differential evolution operator is introduced to mutate at the global position update, and the sine cosine operator is introduced to mutate at the local position update, hence, enhancing the local search capability of the algorithm. To begin, 12 classical benchmark test problems were selected to evaluate the effectiveness of DMBOA. The results reveal that DMBOA outperformed the other benchmark algorithms. Following that, DMBOA was utilized for the blind source separation of mixed image and speech signals. The simulation results show that the DMBOA can realize the blind source separation of an observed signal successfully and achieve higher separation performance than the compared algorithms.
Collapse
|
10
|
Classification of Respiratory States Using Spectrogram with Convolutional Neural Network. APPLIED SCIENCES-BASEL 2022. [DOI: 10.3390/app12041895] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/04/2023]
Abstract
This paper proposes an approach to the classification of respiration states based on a neural network model by visualizing respiratory signals using a spectrogram. The analysis and processing of human biosignals are still considered some of the most crucial and fundamental research areas in both signal processing and medical applications. Recently, learning-based algorithms in signal and image processing for medical applications have shown significant improvement from both quantitative and qualitative perspectives. Human respiration is still considered an important factor for diagnosis, and it plays a key role in preventing fatal diseases in practice. This paper chiefly deals with a contactless-based approach for the acquisition of respiration data using an ultra-wideband (UWB) radar sensor because it is simple and easy for use in an experimental setup and shows high accuracy in distance estimation. This paper proposes the classification of respiratory states by using a feature visualization scheme, a spectrogram, and a neural network model. The proposed method shows competitive and promising results in the classification of respiratory states. The experimental results also show that the method provides better accuracy (precision: 0.86 and specificity: 0.90) than conventional methods that use expensive equipment for respiration measurement.
Collapse
|