1
|
Qiu Y, Ma X, Li X, Fan S, Deng Z, Huang X. Non-Contact Blood Pressure Estimation From Radar Signals by a Stacked Deformable Convolution Network. IEEE J Biomed Health Inform 2024; 28:4553-4564. [PMID: 38743528 DOI: 10.1109/jbhi.2024.3400961] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 05/16/2024]
Abstract
This study introduces a contactless blood pressure monitoring approach that combines conventional radar signal processing with novel deep learning architectures. During the preprocessing phase, datasets suitable for synchronization are created by integrating Kalman filtering, multiscale bandpass filters, and a periodic extraction method in the time domain. These data comprise data on chest micro variations, encapsulating a complex array of physiological and biomedical information reflective of cardiac micromotions. The Radar-based Stacked Deformable convolution Network (RSD-Net) integrates channel and spatial self attention mechanisms within a deformable convolutional framework to enhance feature extraction from radar signals. The network architecture systematically employs deformable convolutions for initial deep feature extraction from individual signals. Subsequently, continuous blood pressure estimation is conducted using self attention mechanisms on feature map from single source coupled with multi-feature map channel attention. The performance of model is corroborated via the open-source dataset procured using a non-invasive 24 GHz six-port continuous wave radar system. The dataset, encompassing readings from 30 healthy individuals subjected to diverse conditions including rest, the Valsalva maneuver, apnea, and tilt-table examinations. It serves to substantiate the validity and resilience of the proposed method in the non-contact assessment of continuous blood pressure. Evaluation metrics reveal Pearson correlation coefficients of 0.838 for systolic and 0.797 for diastolic blood pressure predictions. The Mean Error (ME) and Standard Deviation (SD) for systolic and diastolic blood pressure measurements are -0.32 ±6.14 mmHg and -0.20 ±5.50 mmHg, respectively. The ablation study assesses the contribution of different structural components of the RSD-Net, validating their significance in the overall of model performance.
Collapse
|
2
|
Cai F, Wu T, Lure FYM. E-BDL: Enhanced Band-Dependent Learning Framework for Augmented Radar Sensing. SENSORS (BASEL, SWITZERLAND) 2024; 24:4620. [PMID: 39066018 PMCID: PMC11280770 DOI: 10.3390/s24144620] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/26/2024] [Revised: 07/07/2024] [Accepted: 07/16/2024] [Indexed: 07/28/2024]
Abstract
Radar sensors, leveraging the Doppler effect, enable the nonintrusive capture of kinetic and physiological motions while preserving privacy. Deep learning (DL) facilitates radar sensing for healthcare applications such as gait recognition and vital-sign measurement. However, band-dependent patterns, indicating variations in patterns and power scales associated with frequencies in time-frequency representation (TFR), challenge radar sensing applications using DL. Frequency-dependent characteristics and features with lower power scales may be overlooked during representation learning. This paper proposes an Enhanced Band-Dependent Learning framework (E-BDL) comprising an adaptive sub-band filtering module, a representation learning module, and a sub-view contrastive module to fully detect band-dependent features in sub-frequency bands and leverage them for classification. Experimental validation is conducted on two radar datasets, including gait abnormality recognition for Alzheimer's disease (AD) and AD-related dementia (ADRD) risk evaluation and vital-sign monitoring for hemodynamics scenario classification. For hemodynamics scenario classification, E-BDL-ResNet achieves competitive performance in overall accuracy and class-wise evaluations compared to recent methods. For ADRD risk evaluation, the results demonstrate E-BDL-ResNet's superior performance across all candidate models, highlighting its potential as a clinical tool. E-BDL effectively detects salient sub-bands in TFRs, enhancing representation learning and improving the performance and interpretability of DL-based models.
Collapse
Affiliation(s)
- Fulin Cai
- School of Computing and Augmented Intelligence, Arizona State University, Tempe, AZ 85287, USA;
- ASU-Mayo Center for Innovative Imaging, Arizona State University, Tempe, AZ 85287, USA
| | - Teresa Wu
- School of Computing and Augmented Intelligence, Arizona State University, Tempe, AZ 85287, USA;
- ASU-Mayo Center for Innovative Imaging, Arizona State University, Tempe, AZ 85287, USA
| | | |
Collapse
|
3
|
Albrecht NC, Langer D, Krauss D, Richer R, Abel L, Eskofier BM, Rohleder N, Koelpin A. EmRad: Ubiquitous Vital Sign Sensing Using Compact Continuous-Wave Radars. IEEE OPEN JOURNAL OF ENGINEERING IN MEDICINE AND BIOLOGY 2024; 5:725-734. [PMID: 39184969 PMCID: PMC11342936 DOI: 10.1109/ojemb.2024.3420241] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/10/2024] [Revised: 04/11/2024] [Accepted: 05/22/2024] [Indexed: 08/27/2024] Open
Abstract
In biomedical monitoring, non-intrusive and continuous tracking of vital signs is a crucial yet challenging objective. Although accurate, traditional methods, such as electrocardiography (ECG) and photoplethysmography (PPG), necessitate direct contact with the patient, posing limitations for long-term and unobtrusive monitoring. To address this challenge, we introduce the EmRad system, an innovative solution harnessing the capabilities of continuous-wave (CW) radar technology for the contactless detection of vital signs, including heart rate and respiratory rate. EmRad discerns itself by emphasizing miniaturization, performance, scalability, and its ability to generate large-scale datasets in various environments. This article explains the system's design, focusing on signal processing strategies and motion artifact reduction to ensure precise vital sign extraction. The EmRad system's versatility is showcased through various case studies, highlighting its potential to transform vital sign monitoring in research and clinical contexts.
Collapse
Affiliation(s)
- Nils C. Albrecht
- Institute of High-Frequency TechnologyTechnische Universität Hamburg21073HamburgGermany
| | - Dominik Langer
- Institute of High-Frequency TechnologyTechnische Universität Hamburg21073HamburgGermany
| | - Daniel Krauss
- Machine Learning and Data Analytics LabFriedrich-Alexander-Universität Erlangen-Nürnberg (FAU)91054ErlangenGermany
| | - Robert Richer
- Machine Learning and Data Analytics LabFriedrich-Alexander-Universität Erlangen-Nürnberg (FAU)91054ErlangenGermany
| | - Luca Abel
- Machine Learning and Data Analytics LabFriedrich-Alexander-Universität Erlangen-Nürnberg (FAU)91054ErlangenGermany
| | - Bjoern M. Eskofier
- Machine Learning and Data Analytics LaboratoryFriedrich-Alexander-Universität Erlangen-Nürnberg (FAU)91054ErlangenGermany
- Translational Digital Health Group, Institute of AI for HealthHelmholtz Zentrum München – German Research Center for Environmental Health85764NeuherbergGermany
| | - Nicolas Rohleder
- Chair of Health Psychology, Institute of PsychologyFriedrich-Alexander-Universität Erlangen-Nürnberg (FAU)91054ErlangenGermany
| | - Alexander Koelpin
- Institute of High-Frequency TechnologyTechnische Universität Hamburg21073HamburgGermany
| |
Collapse
|
4
|
Shirotori M, Sugitani Y. Change-point detection using diffusion maps for sleep apnea monitoring with contact-free sensors. PLoS One 2024; 19:e0306139. [PMID: 38935677 PMCID: PMC11210822 DOI: 10.1371/journal.pone.0306139] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/25/2023] [Accepted: 06/11/2024] [Indexed: 06/29/2024] Open
Abstract
Monitoring and improving the quality of sleep are crucial from a public health perspective. In this study, we propose a change-point detection method using diffusion maps for a more accurate detection of respiratory arrest points. Conventional change-point detection methods are limited when dealing with complex nonlinear data structures, and the proposed method overcomes these limitations. The proposed method embeds subsequence data in a low-dimensional space while considering the global and local structures of the data and uses the distance between the data as the score of the change point. Experiments using synthetic and real-world contact-free sensor data confirmed the superiority of the proposed method when dealing with noise, and it detected apnea events with greater accuracy than conventional methods. In addition to improving sleep monitoring, the proposed method can be applied in other fields, such as healthcare, manufacturing, and finance. This study will contribute to the development of advanced monitoring systems that adapt to diverse conditions while protecting privacy.
Collapse
Affiliation(s)
- Momo Shirotori
- Digital Strategy Department, Chugai Pharmaceutical Co., Ltd., Chuo-ku, Tokyo, Japan
| | - Yasuo Sugitani
- Digital Strategy Department, Chugai Pharmaceutical Co., Ltd., Chuo-ku, Tokyo, Japan
- Biometrics Department, Chugai Pharmaceutical Co., Ltd, Chuo-ku, Tokyo, Japan
| |
Collapse
|
5
|
Chowdhury FA, Hosain MK, Bin Islam MS, Hossain MS, Basak P, Mahmud S, Murugappan M, Chowdhury MEH. ECG waveform generation from radar signals: A deep learning perspective. Comput Biol Med 2024; 176:108555. [PMID: 38749323 DOI: 10.1016/j.compbiomed.2024.108555] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/19/2024] [Revised: 05/01/2024] [Accepted: 05/05/2024] [Indexed: 05/31/2024]
Abstract
Cardiovascular diagnostics relies heavily on the ECG (ECG), which reveals significant information about heart rhythm and function. Despite their significance, traditional ECG measures employing electrodes have limitations. As a result of extended electrode attachments, patients may experience skin irritation or pain, and motion artifacts may interfere with signal accuracy. Additionally, ECG monitoring usually requires highly trained professionals and specialized equipment, which increases the treatment's complexity and cost. In critical care scenarios, such as continuous monitoring of hospitalized patients, wearable sensors for collecting ECG data may be difficult to use. Although there are issues with ECG, it remains a valuable tool for diagnosing and monitoring cardiac disorders due to its non-invasive nature and the detailed information it provides about the heart. The goal of this study is to present an innovative method for generating continuous ECG waveforms from non-contact radar data by using Deep Learning. The method can eliminate the need for invasive or wearable biosensors and expensive equipment to collect ECGs. In this paper, we propose the MultiResLinkNet, a one-dimensional convolutional neural network (1D CNN) model for generating ECG signals from radar waveforms. With the help of a publicly accessible radar benchmark dataset, an end-to-end DL architecture is trained and assessed. There are six ports of raw radar data in this dataset, along with ground truth physiological signals collected from 30 participants in five distinct scenarios: Resting, Valsalva, Apnea, Tilt-up, and Tilt-down. By using strong temporal and spectral measurements, we assessed our proposed framework's ability to convert ECG data from Radar signals in three distinct scenarios, namely Resting, Valsalva, and Apnea (RVA). ECG segmentation performed better by MultiResLinkNet than by state-of-the-art networks in both combined and individual cases. As a result of the simulations, the resting, valsalva, and RVA scenarios showed the highest average temporal values, respectively: 66.09523 ± 19.33, 60.13625 ± 21.92, and 61.86265 ± 21.37. In addition, it exhibited the highest spectral correlation values (82.4388 ± 18.42 (Resting), 77.05186 ± 23.26 (Valsalva), 74.65785 ± 23.17 (Apnea), and 79.96201 ± 20.82 (RVA)), along with minimal temporal and spectral errors in almost every case. The qualitative evaluation revealed strong similarities between generated and actual ECG waveforms. As a result of our method of forecasting ECG patterns from remote radar data, we can monitor high-risk patients, especially those undergoing surgery.
Collapse
Affiliation(s)
- Farhana Ahmed Chowdhury
- Department of Electronics and Telecommunication Engineering, Rajshahi University of Engineering and Technology, Rajshahi, 6204, Bangladesh
| | - Md Kamal Hosain
- Department of Electronics and Telecommunication Engineering, Rajshahi University of Engineering and Technology, Rajshahi, 6204, Bangladesh
| | - Md Sakib Bin Islam
- Department of Biomedical Engineering, Military Institute of Science and Technology, Dhaka, Bangladesh
| | - Md Shafayet Hossain
- Department of Electrical, Electronics and Systems Engineering, Universiti Kebangsaan Malaysia, Bangi, Selangor, 43600, Malaysia
| | - Promit Basak
- Department of Electrical and Electronic Engineering, University of Dhaka, Dhaka, 1000, Bangladesh
| | - Sakib Mahmud
- Department of Electrical Engineering, Qatar University, Doha, 2713, Qatar
| | - M Murugappan
- Intelligent Signal Processing (ISP) Research Lab, Department of Electronics and Communication Engineering, Kuwait College of Science and Technology, Block 4, Doha, Kuwait; Department of Electronics and Communication Engineering, Vels Institute of Sciences, Technology, and Advanced Studies, Chennai, Tamilnadu, India.
| | | |
Collapse
|
6
|
Fan S, Deng Z. Chest Wall Motion Model of Cardiac Activity for Radar-Based Vital-Sign-Detection System. SENSORS (BASEL, SWITZERLAND) 2024; 24:2058. [PMID: 38610269 PMCID: PMC11014240 DOI: 10.3390/s24072058] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/29/2024] [Revised: 03/18/2024] [Accepted: 03/20/2024] [Indexed: 04/14/2024]
Abstract
An increasing number of studies on non-contact vital sign detection using radar are now beginning to turn to data-driven neural network approaches rather than traditional signal-processing methods. However, there are few radar datasets available for deep learning due to the difficulty of acquiring and labeling the data, which require specialized equipment and physician collaboration. This paper presents a new model of heartbeat-induced chest wall motion (CWM) with the goal of generating a large amount of simulation data to support deep learning methods. An in-depth analysis of published CWM data collected by the VICON Infrared (IR) motion capture system and continuous wave (CW) radar system during respiratory hold was used to summarize the motion characteristics of each stage within a cardiac cycle. In combination with the physiological properties of the heartbeat, appropriate mathematical functions were selected to describe these movement properties. The model produced simulation data that closely matched the measured data as evaluated by dynamic time warping (DTW) and the root-mean-squared error (RMSE). By adjusting the model parameters, the heartbeat signals of different individuals were simulated. This will accelerate the application of data-driven deep learning methods in radar-based non-contact vital sign detection research and further advance the field.
Collapse
Affiliation(s)
| | - Zhenmiao Deng
- School of Electronics and Communication Engineering, Shenzhen Campus of Sun Yat-sen University, Shenzhen 518107, China;
| |
Collapse
|
7
|
Yuan S, Fan S, Deng Z, Pan P. Heart Rate Variability Monitoring Based on Doppler Radar Using Deep Learning. SENSORS (BASEL, SWITZERLAND) 2024; 24:2026. [PMID: 38610238 PMCID: PMC11013767 DOI: 10.3390/s24072026] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/18/2024] [Revised: 03/17/2024] [Accepted: 03/19/2024] [Indexed: 04/14/2024]
Abstract
The potential of microwave Doppler radar in non-contact vital sign detection is significant; however, prevailing radar-based heart rate (HR) and heart rate variability (HRV) monitoring technologies often necessitate data lengths surpassing 10 s, leading to increased detection latency and inaccurate HRV estimates. To address this problem, this paper introduces a novel network integrating a frequency representation module and a residual in residual module for the precise estimation and tracking of HR from concise time series, followed by HRV monitoring. The network adeptly transforms radar signals from the time domain to the frequency domain, yielding high-resolution spectrum representation within specified frequency intervals. This significantly reduces latency and improves HRV estimation accuracy by using data that are only 4 s in length. This study uses simulation data, Frequency-Modulated Continuous-Wave radar-measured data, and Continuous-Wave radar data to validate the model. Experimental results show that despite the shortened data length, the average heart rate measurement accuracy of the algorithm remains above 95% with no loss of estimation accuracy. This study contributes an efficient heart rate variability estimation algorithm to the domain of non-contact vital sign detection, offering significant practical application value.
Collapse
Affiliation(s)
| | | | - Zhenmiao Deng
- School of Electronics and Communication Engineering, Shenzhen Campus of Sun Yat-sen University, Shenzhen 518107, China; (S.Y.); (S.F.); (P.P.)
| | | |
Collapse
|
8
|
Xu J, Smaling HJA, Schoones JW, Achterberg WP, van der Steen JT. Noninvasive monitoring technologies to identify discomfort and distressing symptoms in persons with limited communication at the end of life: a scoping review. BMC Palliat Care 2024; 23:78. [PMID: 38515049 PMCID: PMC10956214 DOI: 10.1186/s12904-024-01371-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/04/2023] [Accepted: 01/29/2024] [Indexed: 03/23/2024] Open
Abstract
BACKGROUND Discomfort and distressing symptoms are common at the end of life, while people in this stage are often no longer able to express themselves. Technologies may aid clinicians in detecting and treating these symptoms to improve end-of-life care. This review provides an overview of noninvasive monitoring technologies that may be applied to persons with limited communication at the end of life to identify discomfort. METHODS A systematic search was performed in nine databases, and experts were consulted. Manuscripts were included if they were written in English, Dutch, German, French, Japanese or Chinese, if the monitoring technology measured discomfort or distressing symptoms, was noninvasive, could be continuously administered for 4 hours and was potentially applicable for bed-ridden people. The screening was performed by two researchers independently. Information about the technology, its clinimetrics (validity, reliability, sensitivity, specificity, responsiveness), acceptability, and feasibility were extracted. RESULTS Of the 3,414 identified manuscripts, 229 met the eligibility criteria. A variety of monitoring technologies were identified, including actigraphy, brain activity monitoring, electrocardiography, electrodermal activity monitoring, surface electromyography, incontinence sensors, multimodal systems, and noncontact monitoring systems. The main indicators of discomfort monitored by these technologies were sleep, level of consciousness, risk of pressure ulcers, urinary incontinence, agitation, and pain. For the end-of-life phase, brain activity monitors could be helpful and acceptable to monitor the level of consciousness during palliative sedation. However, no manuscripts have reported on the clinimetrics, feasibility, and acceptability of the other technologies for the end-of-life phase. CONCLUSIONS Noninvasive monitoring technologies are available to measure common symptoms at the end of life. Future research should evaluate the quality of evidence provided by existing studies and investigate the feasibility, acceptability, and usefulness of these technologies in the end-of-life setting. Guidelines for studies on healthcare technologies should be better implemented and further developed.
Collapse
Affiliation(s)
- Jingyuan Xu
- Department of Public Health and Primary Care, Leiden University Medical Center, Hippocratespad 21, Gebouw 3, Postzone V0-P, P.O. Box 9600, 2300 RC, Leiden, The Netherlands.
| | - Hanneke J A Smaling
- Department of Public Health and Primary Care, Leiden University Medical Center, Hippocratespad 21, Gebouw 3, Postzone V0-P, P.O. Box 9600, 2300 RC, Leiden, The Netherlands
- University Network for the Care Sector Zuid-Holland, Leiden University Medical Center, Leiden, The Netherlands
| | - Jan W Schoones
- Directorate of Research Policy, Leiden University Medical Center, Leiden, The Netherlands
| | - Wilco P Achterberg
- Department of Public Health and Primary Care, Leiden University Medical Center, Hippocratespad 21, Gebouw 3, Postzone V0-P, P.O. Box 9600, 2300 RC, Leiden, The Netherlands
- University Network for the Care Sector Zuid-Holland, Leiden University Medical Center, Leiden, The Netherlands
| | - Jenny T van der Steen
- Department of Public Health and Primary Care, Leiden University Medical Center, Hippocratespad 21, Gebouw 3, Postzone V0-P, P.O. Box 9600, 2300 RC, Leiden, The Netherlands
- Department of Primary and Community Care, and Radboudumc Alzheimer Center, Radboud university medical center, Nijmegen, The Netherlands
| |
Collapse
|
9
|
Ahmed S, Yoon S, Cho SH. A public dataset of dogs vital signs recorded with ultra wideband radar and reference sensors. Sci Data 2024; 11:107. [PMID: 38253685 PMCID: PMC10803748 DOI: 10.1038/s41597-024-02947-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/30/2023] [Accepted: 01/10/2024] [Indexed: 01/24/2024] Open
Abstract
Recently, radar sensors have been extensively used for vital sign monitoring in dogs, owing to their noncontact and noninvasive nature. However, a public dataset on dog vital signs has yet to be proposed since capturing data from dogs requires special training and approval. This work presents the first ever ultra wideband radar-based dog vital sign (UWB-DVS) dataset, which was captured in two independent scenarios. In the first scenario, clinical reference sensors are attached to the fainted dogs, and data from UWB radar and reference sensors are captured synchronously. In the second scenario, the dogs can move freely, and video recordings are provided as a reference for movement detection and breathing extraction. For technical validation, a high correlation, above 0.9, is found between the radar and clinical reference sensors for both the heart rate and breathing rate measurements in scenario 1. In scenario 2, the vital signs and movement of the dogs are shown in the form of dashboards, demonstrating the long-term monitoring capability of the radar sensor.
Collapse
Affiliation(s)
- Shahzad Ahmed
- Department of Electronic Engineering, Hanyang University, Seoul, 04763, South Korea
| | - Seongkwon Yoon
- Department of Electronic Engineering, Hanyang University, Seoul, 04763, South Korea
| | - Sung Ho Cho
- Department of Electronic Engineering, Hanyang University, Seoul, 04763, South Korea.
| |
Collapse
|
10
|
Chen K, Duan Y, Huang Y, Hu W, Xie Y. A Deep Learning Method of Human Identification from Radar Signal for Daily Sleep Health Monitoring. Bioengineering (Basel) 2023; 11:2. [PMID: 38275570 PMCID: PMC10813377 DOI: 10.3390/bioengineering11010002] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/20/2023] [Revised: 12/15/2023] [Accepted: 12/18/2023] [Indexed: 01/27/2024] Open
Abstract
Radar signal has been shown as a promising source for human identification. In daily home sleep-monitoring scenarios, large-scale motion features may not always be practical, and the heart motion or respiration data may not be as ideal as they are in a controlled laboratory setting. Human identification from radar sequences is still a challenging task. Furthermore, there is a need to address the open-set recognition problem for radar sequences, which has not been sufficiently studied. In this paper, we propose a deep learning-based approach for human identification using radar sequences captured during sleep in a daily home-monitoring setup. To enhance robustness, we preprocess the sequences to mitigate environmental interference before employing a deep convolution neural network for human identification. We introduce a Principal Component Space feature representation to detect unknown sequences. Our method is rigorously evaluated using both a public data set and a set of experimentally acquired radar sequences. We report a labeling accuracy of 98.2% and 96.8% on average for the two data sets, respectively, which outperforms the state-of-the-art techniques. Our method excels at accurately distinguishing unknown sequences from labeled ones, with nearly 100% detection of unknown samples and minimal misclassification of labeled samples as unknown.
Collapse
Affiliation(s)
- Ken Chen
- Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, China; (K.C.); (Y.D.)
| | - Yulong Duan
- Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, China; (K.C.); (Y.D.)
| | - Yi Huang
- Shenzhen HUAYI Medical Technologies Co., Ltd., Shenzhen 518055, China; (Y.H.); (W.H.)
| | - Wei Hu
- Shenzhen HUAYI Medical Technologies Co., Ltd., Shenzhen 518055, China; (Y.H.); (W.H.)
| | - Yaoqin Xie
- Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, China; (K.C.); (Y.D.)
| |
Collapse
|
11
|
Eren C, Karamzadeh S, Kartal M. Radar human breathing dataset for applications of ambient assisted living and search and rescue operations. Data Brief 2023; 51:109757. [PMID: 38053604 PMCID: PMC10694063 DOI: 10.1016/j.dib.2023.109757] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/03/2023] [Revised: 10/09/2023] [Accepted: 10/30/2023] [Indexed: 12/07/2023] Open
Abstract
This dataset consists of signatures of human vital signs that are recorded by ultrawideband radar and lidar sensors. The data acquisition scene considers the human posture models(supine/lateral/facedown), different radar antenna angles towards the human, various set of distances and operational radar characteristics (bandwidth selection/mean power). The raw data files of lidar&radar and processed data files are presented separately in the data repository. The lidar sensor is chosen as a reference sensor. There are 432 data records, and each data scene's trial number is eight. There is a homogeneous wooden table to mimic clutter while forming a dataset. Thus, this dataset covers applications of search and rescue operations, sleep monitoring, and ambient assisted living (AAL) applications.
Collapse
Affiliation(s)
- Cansu Eren
- Satellite Communication and Remote Sensing, Department of Communication Systems, Informatics Institute, Istanbul Technical University, Istanbul, Türkiye
| | - Saeid Karamzadeh
- Millimeter Wave Technologies, Intelligent Wireless System, Silicon Austria Labs (SAL), 4040 Linz, Austria. Electrical and Electronics Engineering Department, Faculty of Engineering and Natural Sciences, Bahçeşehir University, 34349 Istanbul, Türkiye
| | - Mesut Kartal
- Department of Electronics and Communication Engineering, Istanbul Technical University, Istanbul, Türkiye
| |
Collapse
|
12
|
El Abbaoui A, Sodoyer D, Elbahhar F. Contactless Heart and Respiration Rates Estimation and Classification of Driver Physiological States Using CW Radar and Temporal Neural Networks. SENSORS (BASEL, SWITZERLAND) 2023; 23:9457. [PMID: 38067830 PMCID: PMC10708560 DOI: 10.3390/s23239457] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 10/03/2023] [Revised: 10/27/2023] [Accepted: 10/30/2023] [Indexed: 12/18/2023]
Abstract
The measurement and analysis of vital signs are a subject of significant research interest, particularly for monitoring the driver's physiological state, which is of crucial importance for road safety. Various approaches have been proposed using contact techniques to measure vital signs. However, all of these methods are invasive and cumbersome for the driver. This paper proposes using a non-contact sensor based on continuous wave (CW) radar at 24 GHz to measure vital signs. We associate these measurements with distinct temporal neural networks to analyze the signals to detect and extract heart and respiration rates as well as classify the physiological state of the driver. This approach offers robust performance in estimating the exact values of heart and respiration rates and in classifying the driver's physiological state. It is non-invasive and requires no physical contact with the driver, making it particularly practical and safe. The results presented in this paper, derived from the use of a 1D Convolutional Neural Network (1D-CNN), a Temporal Convolutional Network (TCN), a Recurrent Neural Network particularly the Bidirectional Long Short-Term Memory (Bi-LSTM), and a Convolutional Recurrent Neural Network (CRNN). Among these, the CRNN emerged as the most effective Deep Learning approach for vital signal analysis.
Collapse
Affiliation(s)
- Amal El Abbaoui
- COSYS-LEOST, University Gustave Eiffel, F-59650 Villeneuve d’Ascq, France;
| | | | - Fouzia Elbahhar
- COSYS-LEOST, University Gustave Eiffel, F-59650 Villeneuve d’Ascq, France;
| |
Collapse
|
13
|
Shaw V, Pah ND, Rani P, Mahapatra PK, Pankaj D, Kumar DK. Impact of Biological Sex on Radar-Measured Heart Sound Quality. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2023; 2023:1-5. [PMID: 38083734 DOI: 10.1109/embc40787.2023.10340554] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/18/2023]
Abstract
Radar based contact-free technology has number of potential applications for monitoring the cardiopulmonary functions of patients. However, no study has evaluated the effect of gender on the quality of the recordings. This study makes an attempt to distinguish radar based recording of male and female subjects. The study analysed a publicly available dataset of radar-recorded heart sound signals from both male and female subjects. Here, we exploit the reference signal-to-noise ratio (RSNR) to quantify the signal's quality. The results indicate that there is a significant difference in the signal quality between males and females, with males having a higher RSNR value compared to females. This could be a limitation in the widespread use of the current radar based cardiopulmonary recording techniques and overcoming this should be considered for future research.Clinical relevance- This work has highlighted the gender based difference. By considering this, the radar based cardiopulmonary device has the potential for being used for patients requiring long-term monitoring.
Collapse
|
14
|
Boiko A, Martínez Madrid N, Seepold R. Contactless Technologies, Sensors, and Systems for Cardiac and Respiratory Measurement during Sleep: A Systematic Review. SENSORS (BASEL, SWITZERLAND) 2023; 23:s23115038. [PMID: 37299762 DOI: 10.3390/s23115038] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/12/2023] [Revised: 05/22/2023] [Accepted: 05/23/2023] [Indexed: 06/12/2023]
Abstract
Sleep is essential to physical and mental health. However, the traditional approach to sleep analysis-polysomnography (PSG)-is intrusive and expensive. Therefore, there is great interest in the development of non-contact, non-invasive, and non-intrusive sleep monitoring systems and technologies that can reliably and accurately measure cardiorespiratory parameters with minimal impact on the patient. This has led to the development of other relevant approaches, which are characterised, for example, by the fact that they allow greater freedom of movement and do not require direct contact with the body, i.e., they are non-contact. This systematic review discusses the relevant methods and technologies for non-contact monitoring of cardiorespiratory activity during sleep. Taking into account the current state of the art in non-intrusive technologies, we can identify the methods of non-intrusive monitoring of cardiac and respiratory activity, the technologies and types of sensors used, and the possible physiological parameters available for analysis. To do this, we conducted a literature review and summarised current research on the use of non-contact technologies for non-intrusive monitoring of cardiac and respiratory activity. The inclusion and exclusion criteria for the selection of publications were established prior to the start of the search. Publications were assessed using one main question and several specific questions. We obtained 3774 unique articles from four literature databases (Web of Science, IEEE Xplore, PubMed, and Scopus) and checked them for relevance, resulting in 54 articles that were analysed in a structured way using terminology. The result was 15 different types of sensors and devices (e.g., radar, temperature sensors, motion sensors, cameras) that can be installed in hospital wards and departments or in the environment. The ability to detect heart rate, respiratory rate, and sleep disorders such as apnoea was among the characteristics examined to investigate the overall effectiveness of the systems and technologies considered for cardiorespiratory monitoring. In addition, the advantages and disadvantages of the considered systems and technologies were identified by answering the identified research questions. The results obtained allow us to determine the current trends and the vector of development of medical technologies in sleep medicine for future researchers and research.
Collapse
Affiliation(s)
- Andrei Boiko
- Ubiquitous Computing Laboratory, Department of Computer Science, HTWG Konstanz-University of Applied Sciences, Alfred-Wachtel-Str. 8, 78462 Konstanz, Germany
| | - Natividad Martínez Madrid
- Internet of Things Laboratory, School of Informatics, Reutlingen University, Alteburgstr. 150, 72762 Reutlingen, Germany
| | - Ralf Seepold
- Ubiquitous Computing Laboratory, Department of Computer Science, HTWG Konstanz-University of Applied Sciences, Alfred-Wachtel-Str. 8, 78462 Konstanz, Germany
| |
Collapse
|
15
|
An Efficient Heart Rate Measurement System Using Medical Radar and LSTM Neural Network. JOURNAL OF ELECTRICAL AND COMPUTER ENGINEERING 2022. [DOI: 10.1155/2022/4696163] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/05/2022]
Abstract
This research proposes a noncontact heart rate measurement method using medical radar and artificial intelligence techniques. This technique has a significant role in the design and development of a wireless system that monitors the body’s vital signs. Firstly, based on a signal model describing chest surface movement, we propose a method to create a dataset for the training process using the long-short-term memory model. Secondly, a novel method to extract chest motion from the received radar signal is proposed. Finally, the heart rate will be estimated by using the obtained model and the received motion signal. The performance of the proposed method is evaluated through the root mean square error parameter as well as compared with other methods. Experimental results evaluated according to Bland–Altman achieved an accuracy of 96.67%.
Collapse
|
16
|
Ji S, Zhang Z, Xia Z, Wen H, Zhu J, Zhao K. RBHHM: A novel remote cardiac cycle detection model based on heartbeat harmonics. Biomed Signal Process Control 2022. [DOI: 10.1016/j.bspc.2022.103936] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
|
17
|
Domnik C, Meuleners M, Degen C. Radar Evaluation Setup for the Replication of Chest Wall Movement from Vital Signs. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2022; 2022:837-841. [PMID: 36085631 DOI: 10.1109/embc48229.2022.9871203] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/15/2023]
Abstract
In this paper we present a setup to generate micro movement which is analog to the chest wall micro movement from vital signs. The movement is produced by a loudspeaker powered by a function generator. Since it is difficult to isolate and reproduce effects in the context of vital signs measurements with the human body, this setup allows an easier development of radar post processing algorithms. In addition, some effects are difficult to measure with a human, for example heart diseases like cardiac arrhythmia. To evaluate the setup, we present reference measurements with a human. Also, we show the results of measurements with the setup made with three different radar systems, which use different center frequencies: 24 GHz, 60 GHz and 77 GHz. The setup is able to create absolutely smooth and exact movement which is linear to the applied voltage. This is important in order to simulate several effects in the heart and breathing movement.
Collapse
|
18
|
Yan B, Zhang H, Yao Y, Liu C, Jian P, Wang P, Du L, Chen X, Fang Z, Wu Y. Heart signatures: Open-set person identification based on cardiac radar signals. Biomed Signal Process Control 2022. [DOI: 10.1016/j.bspc.2021.103306] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/02/2022]
|
19
|
Yoo S, Ahmed S, Kang S, Hwang D, Lee J, Son J, Cho SH. Radar Recorded Child Vital Sign Public Dataset and Deep Learning-Based Age Group Classification Framework for Vehicular Application. SENSORS 2021; 21:s21072412. [PMID: 33807429 PMCID: PMC8036835 DOI: 10.3390/s21072412] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/19/2021] [Revised: 03/26/2021] [Accepted: 03/29/2021] [Indexed: 11/16/2022]
Abstract
The ongoing intense development of short-range radar systems and their improved capability of measuring small movements make these systems reliable solutions for the extraction of human vital signs in a contactless fashion. The continuous contactless monitoring of vital signs can be considered in a wide range of applications, such as remote healthcare solutions and context-aware smart sensor development. Currently, the provision of radar-recorded datasets of human vital signs is still an open issue. In this paper, we present a new frequency-modulated continuous wave (FMCW) radar-recorded vital sign dataset for 50 children aged less than 13 years. A clinically approved vital sign monitoring sensor was also deployed as a reference, and data from both sensors were time-synchronized. With the presented dataset, a new child age-group classification system based on GoogLeNet is proposed to develop a child safety sensor for smart vehicles. The radar-recorded vital signs of children are divided into several age groups, and the GoogLeNet framework is trained to predict the age of unknown human test subjects.
Collapse
Affiliation(s)
- Sungwon Yoo
- Department of Electronic Engineering, Hanyang University, Seoul 04763, Korea; (S.Y.); (S.A.); (S.K.)
| | - Shahzad Ahmed
- Department of Electronic Engineering, Hanyang University, Seoul 04763, Korea; (S.Y.); (S.A.); (S.K.)
| | - Sun Kang
- Department of Electronic Engineering, Hanyang University, Seoul 04763, Korea; (S.Y.); (S.A.); (S.K.)
| | - Duhyun Hwang
- Electronics Convenience Control Evaluation Team, Hyundai Motor Company, Gyeonggi 18280, Korea; (D.H.); (J.L.); (J.S.)
| | - Jungjun Lee
- Electronics Convenience Control Evaluation Team, Hyundai Motor Company, Gyeonggi 18280, Korea; (D.H.); (J.L.); (J.S.)
| | - Jungduck Son
- Electronics Convenience Control Evaluation Team, Hyundai Motor Company, Gyeonggi 18280, Korea; (D.H.); (J.L.); (J.S.)
| | - Sung Ho Cho
- Department of Electronic Engineering, Hanyang University, Seoul 04763, Korea; (S.Y.); (S.A.); (S.K.)
- Correspondence:
| |
Collapse
|
20
|
Slapničar G, Wang W, Luštrek M. Classification of Hemodynamics Scenarios from a Public Radar Dataset Using a Deep Learning Approach. SENSORS (BASEL, SWITZERLAND) 2021; 21:1836. [PMID: 33800716 PMCID: PMC7961385 DOI: 10.3390/s21051836] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/11/2021] [Revised: 02/28/2021] [Accepted: 03/03/2021] [Indexed: 11/16/2022]
Abstract
Contact-free sensors offer important advantages compared to traditional wearables. Radio-frequency sensors (e.g., radars) offer the means to monitor cardiorespiratory activity of people without compromising their privacy, however, only limited information can be obtained via movement, traditionally related to heart or breathing rate. We investigated whether five complex hemodynamics scenarios (resting, apnea simulation, Valsalva maneuver, tilt up and tilt down on a tilt table) can be classified directly from publicly available contact and radar input signals in an end-to-end deep learning approach. A series of robust k-fold cross-validation evaluation experiments were conducted in which neural network architectures and hyperparameters were optimized, and different data input modalities (contact, radar and fusion) and data types (time and frequency domain) were investigated. We achieved reasonably high accuracies of 88% for contact, 83% for radar and 88% for fusion of modalities. These results are valuable in showing large potential of radar sensing even for more complex scenarios going beyond just heart and breathing rate. Such contact-free sensing can be valuable for fast privacy-preserving hospital screenings and for cases where traditional werables are impossible to use.
Collapse
Affiliation(s)
- Gašper Slapničar
- Department of Intelligent Systems, Jožef Stefan Institute, 1000 Ljubljana, Slovenia;
- Jožef Stefan International Postgraduate School, 1000 Ljubljana, Slovenia
| | - Wenjin Wang
- Department of Electrical Engineering, Eindhoven University of Technology, 5600 MB Eindhoven, The Netherlands; or
- Philips Research Eindhoven, 5656 AE Eindhoven, The Netherlands
| | - Mitja Luštrek
- Department of Intelligent Systems, Jožef Stefan Institute, 1000 Ljubljana, Slovenia;
- Jožef Stefan International Postgraduate School, 1000 Ljubljana, Slovenia
| |
Collapse
|
21
|
Contactless analysis of heart rate variability during cold pressor test using radar interferometry and bidirectional LSTM networks. Sci Rep 2021; 11:3025. [PMID: 33542260 PMCID: PMC7862409 DOI: 10.1038/s41598-021-81101-1] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/13/2020] [Accepted: 01/04/2021] [Indexed: 11/08/2022] Open
Abstract
Contactless measurement of heart rate variability (HRV), which reflects changes of the autonomic nervous system (ANS) and provides crucial information on the health status of a person, would provide great benefits for both patients and doctors during prevention and aftercare. However, gold standard devices to record the HRV, such as the electrocardiograph, have the common disadvantage that they need permanent skin contact with the patient. Being connected to a monitoring device by cable reduces the mobility, comfort, and compliance by patients. Here, we present a contactless approach using a 24 GHz Six-Port-based radar system and an LSTM network for radar heart sound segmentation. The best scores are obtained using a two-layer bidirectional LSTM architecture. To verify the performance of the proposed system not only in a static measurement scenario but also during a dynamic change of HRV parameters, a stimulation of the ANS through a cold pressor test is integrated in the study design. A total of 638 minutes of data is gathered from 25 test subjects and is analysed extensively. High F-scores of over 95% are achieved for heartbeat detection. HRV indices such as HF norm are extracted with relative errors around 5%. Our proposed approach is capable to perform contactless and convenient HRV monitoring and is therefore suitable for long-term recordings in clinical environments and home-care scenarios.
Collapse
|
22
|
Continuous In-Bed Monitoring of Vital Signs Using a Multi Radar Setup for Freely Moving Patients. SENSORS 2020; 20:s20205827. [PMID: 33076283 PMCID: PMC7602469 DOI: 10.3390/s20205827] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 09/18/2020] [Revised: 10/08/2020] [Accepted: 10/09/2020] [Indexed: 01/31/2023]
Abstract
In hospitals, continuous monitoring of vital parameters can provide valuable information about the course of a patient’s illness and allows early warning of emergencies. To enable such monitoring without restricting the patient’s freedom of movement and comfort, a radar system is attached under the mattress which consists of four individual radar modules to cover the entire width of the bed. Using radar, heartbeat and respiration can be measured without contact and through clothing. By processing the raw radar data, the presence of a patient can be determined and movements are categorized into the classes “bed exit”, “bed entry”, and “on bed movement”. Using this information, the vital parameters can be assessed in sections where the patient lies calmly in bed. In the first step, the presence and movement classification is demonstrated using recorded training and test data. Next, the radar was modified to perform vital sign measurements synchronized to a gold standard device. The evaluation of the individual radar modules shows that, regardless of the lying position of the test person, at least one of the radar modules delivers accurate results for continuous monitoring.
Collapse
|