1
|
Schroth CA, Eckrich C, Kakouche I, Fabian S, von Stryk O, Zoubir AM, Muma M. Emergency Response Person Localization and Vital Sign Estimation Using a Semi-Autonomous Robot Mounted SFCW Radar. IEEE Trans Biomed Eng 2024; 71:1756-1769. [PMID: 38190678 DOI: 10.1109/tbme.2024.3350789] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/10/2024]
Abstract
The large number and scale of natural and man-made disasters have led to an urgent demand for technologies that enhance the safety and efficiency of search and rescue teams. Semi-autonomous rescue robots are beneficial, especially when searching inaccessible terrains, or dangerous environments, such as collapsed infrastructures. For search and rescue missions in degraded visual conditions or non-line of sight scenarios, radar-based approaches may contribute to acquire valuable, and otherwise unavailable information. This article presents a complete signal processing chain for radar-based multi-person detection, 2D-MUSIC localization and breathing frequency estimation. The proposed method shows promising results on a challenging emergency response dataset that we collected using a semi-autonomous robot equipped with a commercially available through-wall radar system. The dataset is composed of 62 scenarios of various difficulty levels with up to five persons captured in different postures, angles and ranges including wooden and stone obstacles that block the radar line of sight. Ground truth data for reference locations, respiration, electrocardiogram, and acceleration signals are included.
Collapse
|
2
|
Hornig L, Szmola B, Pätzold W, Vox JP, Wolf KI. Evaluation of Lateral Radar Positioning for Vital Sign Monitoring: An Empirical Study. SENSORS (BASEL, SWITZERLAND) 2024; 24:3548. [PMID: 38894339 PMCID: PMC11175299 DOI: 10.3390/s24113548] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/12/2024] [Revised: 05/24/2024] [Accepted: 05/28/2024] [Indexed: 06/21/2024]
Abstract
Vital sign monitoring is dominated by precise but costly contact-based sensors. Contactless devices such as radars provide a promising alternative. In this article, the effects of lateral radar positions on breathing and heartbeat extraction are evaluated based on a sleep study. A lateral radar position is a radar placement from which multiple human body zones are mapped onto different radar range sections. These body zones can be used to extract breathing and heartbeat motions independently from one another via these different range sections. Radars were positioned above the bed as a conventional approach and on a bedside table as well as at the foot end of the bed as lateral positions. These positions were evaluated based on six nights of sleep collected from healthy volunteers with polysomnography (PSG) as a reference system. For breathing extraction, comparable results were observed for all three radar positions. For heartbeat extraction, a higher level of agreement between the radar foot end position and the PSG was found. An example of the distinction between thoracic and abdominal breathing using a lateral radar position is shown. Lateral radar positions could lead to a more detailed analysis of movements along the body, with the potential for diagnostic applications.
Collapse
Affiliation(s)
- Lars Hornig
- Fraunhofer Institute for Digital Media Technology IDMT, Oldenburg Branch for Hearing, Speech and Audio Technology HSA, Marie-Curie-Straße 2, 26129 Oldenburg, Germany; (B.S.); (W.P.); (J.P.V.); (K.I.W.)
| | - Benedek Szmola
- Fraunhofer Institute for Digital Media Technology IDMT, Oldenburg Branch for Hearing, Speech and Audio Technology HSA, Marie-Curie-Straße 2, 26129 Oldenburg, Germany; (B.S.); (W.P.); (J.P.V.); (K.I.W.)
- Medizinische Physik, Carl von Ossietzky University of Oldenburg, 26046 Oldenburg, Germany
- Department of Neurology, School of Medicine and Health Science, Carl von Ossietzky University of Oldenburg, 26046 Oldenburg, Germany
| | - Wiebke Pätzold
- Fraunhofer Institute for Digital Media Technology IDMT, Oldenburg Branch for Hearing, Speech and Audio Technology HSA, Marie-Curie-Straße 2, 26129 Oldenburg, Germany; (B.S.); (W.P.); (J.P.V.); (K.I.W.)
| | - Jan Paul Vox
- Fraunhofer Institute for Digital Media Technology IDMT, Oldenburg Branch for Hearing, Speech and Audio Technology HSA, Marie-Curie-Straße 2, 26129 Oldenburg, Germany; (B.S.); (W.P.); (J.P.V.); (K.I.W.)
| | - Karen Insa Wolf
- Fraunhofer Institute for Digital Media Technology IDMT, Oldenburg Branch for Hearing, Speech and Audio Technology HSA, Marie-Curie-Straße 2, 26129 Oldenburg, Germany; (B.S.); (W.P.); (J.P.V.); (K.I.W.)
| |
Collapse
|
3
|
Baumann S, Stone R, Kim JYM. Introducing the Pi-CON Methodology to Overcome Usability Deficits during Remote Patient Monitoring. SENSORS (BASEL, SWITZERLAND) 2024; 24:2260. [PMID: 38610471 PMCID: PMC11014368 DOI: 10.3390/s24072260] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/04/2024] [Revised: 03/25/2024] [Accepted: 03/27/2024] [Indexed: 04/14/2024]
Abstract
The adoption of telehealth has soared, and with that the acceptance of Remote Patient Monitoring (RPM) and virtual care. A review of the literature illustrates, however, that poor device usability can impact the generated data when using Patient-Generated Health Data (PGHD) devices, such as wearables or home use medical devices, when used outside a health facility. The Pi-CON methodology is introduced to overcome these challenges and guide the definition of user-friendly and intuitive devices in the future. Pi-CON stands for passive, continuous, and non-contact, and describes the ability to acquire health data, such as vital signs, continuously and passively with limited user interaction and without attaching any sensors to the patient. The paper highlights the advantages of Pi-CON by leveraging various sensors and techniques, such as radar, remote photoplethysmography, and infrared. It illustrates potential concerns and discusses future applications Pi-CON could be used for, including gait and fall monitoring by installing an omnipresent sensor based on the Pi-CON methodology. This would allow automatic data collection once a person is recognized, and could be extended with an integrated gateway so multiple cameras could be installed to enable data feeds to a cloud-based interface, allowing clinicians and family members to monitor patient health status remotely at any time.
Collapse
Affiliation(s)
| | | | - Joseph Yun-Ming Kim
- Industrial and Manufacturing Systems Engineering, Iowa State University, 2529 Union Dr, Ames, IA 50011, USA; (S.B.); (R.S.)
| |
Collapse
|
4
|
Liebetruth M, Kehe K, Steinritz D, Sammito S. Systematic Literature Review Regarding Heart Rate and Respiratory Rate Measurement by Means of Radar Technology. SENSORS (BASEL, SWITZERLAND) 2024; 24:1003. [PMID: 38339721 PMCID: PMC10857015 DOI: 10.3390/s24031003] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/18/2023] [Revised: 01/23/2024] [Accepted: 01/30/2024] [Indexed: 02/12/2024]
Abstract
The use of radar technology for non-contact measurement of vital parameters is increasingly being examined in scientific studies. Based on a systematic literature search in the PubMed, German National Library, Austrian Library Network (Union Catalog), Swiss National Library and Common Library Network databases, the accuracy of heart rate and/or respiratory rate measurements by means of radar technology was analyzed. In 37% of the included studies on the measurement of the respiratory rate and in 48% of those on the measurement of the heart rate, the maximum deviation was 5%. For a tolerated deviation of 10%, the corresponding percentages were 85% and 87%, respectively. However, the quantitative comparability of the results available in the current literature is very limited due to a variety of variables. The elimination of the problem of confounding variables and the continuation of the tendency to focus on the algorithm applied will continue to constitute a central topic of radar-based vital parameter measurement. Promising fields of application of research can be found in particular in areas that require non-contact measurements. This includes infection events, emergency medicine, disaster situations and major catastrophic incidents.
Collapse
Affiliation(s)
- Magdalena Liebetruth
- German Air Force Centre of Aerospace Medicine, 51147 Cologne, Germany
- Department of Occupational Medicine, Faculty of Medicine, Otto von Guericke University of Magdeburg, 39120 Magdeburg, Germany
| | - Kai Kehe
- Bundeswehr Medical Service Headquarter, Department A-VI Public Health, 56072 Koblenz, Germany
| | - Dirk Steinritz
- Bundeswehr Institute of Pharmacology and Toxicology, 80937 Munich, Germany
| | - Stefan Sammito
- German Air Force Centre of Aerospace Medicine, 51147 Cologne, Germany
- Department of Occupational Medicine, Faculty of Medicine, Otto von Guericke University of Magdeburg, 39120 Magdeburg, Germany
| |
Collapse
|
5
|
El Abbaoui A, Sodoyer D, Elbahhar F. Contactless Heart and Respiration Rates Estimation and Classification of Driver Physiological States Using CW Radar and Temporal Neural Networks. SENSORS (BASEL, SWITZERLAND) 2023; 23:9457. [PMID: 38067830 PMCID: PMC10708560 DOI: 10.3390/s23239457] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 10/03/2023] [Revised: 10/27/2023] [Accepted: 10/30/2023] [Indexed: 12/18/2023]
Abstract
The measurement and analysis of vital signs are a subject of significant research interest, particularly for monitoring the driver's physiological state, which is of crucial importance for road safety. Various approaches have been proposed using contact techniques to measure vital signs. However, all of these methods are invasive and cumbersome for the driver. This paper proposes using a non-contact sensor based on continuous wave (CW) radar at 24 GHz to measure vital signs. We associate these measurements with distinct temporal neural networks to analyze the signals to detect and extract heart and respiration rates as well as classify the physiological state of the driver. This approach offers robust performance in estimating the exact values of heart and respiration rates and in classifying the driver's physiological state. It is non-invasive and requires no physical contact with the driver, making it particularly practical and safe. The results presented in this paper, derived from the use of a 1D Convolutional Neural Network (1D-CNN), a Temporal Convolutional Network (TCN), a Recurrent Neural Network particularly the Bidirectional Long Short-Term Memory (Bi-LSTM), and a Convolutional Recurrent Neural Network (CRNN). Among these, the CRNN emerged as the most effective Deep Learning approach for vital signal analysis.
Collapse
Affiliation(s)
- Amal El Abbaoui
- COSYS-LEOST, University Gustave Eiffel, F-59650 Villeneuve d’Ascq, France;
| | | | - Fouzia Elbahhar
- COSYS-LEOST, University Gustave Eiffel, F-59650 Villeneuve d’Ascq, France;
| |
Collapse
|
6
|
Mauro G, De Carlos Diez M, Ott J, Servadei L, Cuellar MP, Morales-Santos DP. Few-Shot User-Adaptable Radar-Based Breath Signal Sensing. SENSORS (BASEL, SWITZERLAND) 2023; 23:804. [PMID: 36679598 PMCID: PMC9865656 DOI: 10.3390/s23020804] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 12/07/2022] [Revised: 01/04/2023] [Accepted: 01/07/2023] [Indexed: 06/17/2023]
Abstract
Vital signs estimation provides valuable information about an individual's overall health status. Gathering such information usually requires wearable devices or privacy-invasive settings. In this work, we propose a radar-based user-adaptable solution for respiratory signal prediction while sitting at an office desk. Such an approach leads to a contact-free, privacy-friendly, and easily adaptable system with little reference training data. Data from 24 subjects are preprocessed to extract respiration information using a 60 GHz frequency-modulated continuous wave radar. With few training examples, episodic optimization-based learning allows for generalization to new individuals. Episodically, a convolutional variational autoencoder learns how to map the processed radar data to a reference signal, generating a constrained latent space to the central respiration frequency. Moreover, autocorrelation over recorded radar data time assesses the information corruption due to subject motions. The model learning procedure and breathing prediction are adjusted by exploiting the motion corruption level. Thanks to the episodic acquired knowledge, the model requires an adaptation time of less than one and two seconds for one to five training examples, respectively. The suggested approach represents a novel, quickly adaptable, non-contact alternative for office settings with little user motion.
Collapse
Affiliation(s)
- Gianfranco Mauro
- Infineon Technologies AG, Am Campeon 1-15, 85579 Neubiberg, Germany
- Department of Electronic and Computer Technology, University of Granada, Avenida de Fuente Nueva s/n, 18071 Granada, Spain
| | | | - Julius Ott
- Infineon Technologies AG, Am Campeon 1-15, 85579 Neubiberg, Germany
- Department of Electrical and Computer Engineering, Technical University of Munich, Arcisstrasse 21, 80333 Munich, Germany
| | - Lorenzo Servadei
- Infineon Technologies AG, Am Campeon 1-15, 85579 Neubiberg, Germany
- Department of Electrical and Computer Engineering, Technical University of Munich, Arcisstrasse 21, 80333 Munich, Germany
| | - Manuel P. Cuellar
- Department of Computer Science and Artificial Intelligence, University of Granada, C/. Pdta. Daniel Saucedo Aranda s/n, 18015 Granada, Spain
| | - Diego P. Morales-Santos
- Department of Electronic and Computer Technology, University of Granada, Avenida de Fuente Nueva s/n, 18071 Granada, Spain
| |
Collapse
|
7
|
Babatain W, Buttner U, El-Atab N, Hussain MM. Graphene and Liquid Metal Integrated Multifunctional Wearable Platform for Monitoring Motion and Human-Machine Interfacing. ACS NANO 2022; 16:20305-20317. [PMID: 36201180 DOI: 10.1021/acsnano.2c06180] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/16/2023]
Abstract
Motion sensors are an essential component of many electronic systems. However, the development of inertial motion sensors based on fatigue-free soft proof mass has not been explored extensively in the field of soft electronics. Nontoxic gallium-based liquid metals are an emerging class of material that exhibit attractive electromechanical properties, making them excellent proof mass materials for inertial sensors. Here, we propose and demonstrate a fully soft laser-induced graphene (LIG) and liquid metal-based inertial sensor integrated with temperature, humidity, and breathing sensors. The inertial sensor design confines a graphene-coated liquid metal droplet inside a fluidic channel, rolling over LIG resistive electrode. The proposed sensor architecture and material realize a highly mobile proof mass and a vibrational space for its oscillation. The inertial sensor exhibits a high sensitivity of 6.52% m-1 s2 and excellent repeatability (over 12 500 cycles). The platform is fabricated using a scalable, rapid laser writing technique and integrated with a programmable system on a chip (PSoC) to function as a stand-alone system for real-time wireless monitoring of movement patterns and the control of a robotic arm. The developed printed inertial platform is an excellent candidate for the next-generation of wearables motion tracking platforms and soft human-machine interfaces.
Collapse
Affiliation(s)
- Wedyan Babatain
- Electrical and Computer Engineering, Computer Electrical Mathematical Science and Engineering Division, King Abdullah University of Science and Technology (KAUST), Thuwal23955-6900, Saudi Arabia
| | - Ulrich Buttner
- Electrical and Computer Engineering, Computer Electrical Mathematical Science and Engineering Division, King Abdullah University of Science and Technology (KAUST), Thuwal23955-6900, Saudi Arabia
| | - Nazek El-Atab
- Electrical and Computer Engineering, Computer Electrical Mathematical Science and Engineering Division, King Abdullah University of Science and Technology (KAUST), Thuwal23955-6900, Saudi Arabia
| | - Muhammad Mustafa Hussain
- Electrical and Computer Engineering, Computer Electrical Mathematical Science and Engineering Division, King Abdullah University of Science and Technology (KAUST), Thuwal23955-6900, Saudi Arabia
- Electrical and Computer Engineering, Purdue University, West Lafayette, Indiana47907, United States
| |
Collapse
|
8
|
Ahmed S, Lee Y, Lim YH, Cho SH, Park HK, Cho SH. Noncontact assessment for fatigue based on heart rate variability using IR-UWB radar. Sci Rep 2022; 12:14211. [PMID: 35987815 PMCID: PMC9392064 DOI: 10.1038/s41598-022-18498-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/22/2022] [Accepted: 08/12/2022] [Indexed: 11/16/2022] Open
Abstract
Physical fatigue can be assessed using heart rate variability (HRV). We measured HRV at rest and in a fatigued state using impulse-radio ultra wideband (IR-UWB) radar in a noncontact fashion and compared the measurements with those obtained using electrocardiography (ECG) to assess the reliability and validity of the radar measurements. HRV was measured in 15 subjects using radar and ECG simultaneously before (rest for 10 min before exercise) and after a 20-min exercise session (fatigue level 1 for 0–9 min; fatigue level 2 for 10–19 min; recovery for ≥ 20 min after exercise). HRV was analysed in the frequency domain, including the low-frequency component (LF), high-frequency component (HF) and LF/HF ratio. The LF/HF ratio measured using radar highly agreed with that measured using ECG during rest (ICC = 0.807), fatigue-1 (ICC = 0.712), fatigue-2 (ICC = 0.741) and recovery (ICC = 0.764) in analyses using intraclass correlation coefficients (ICCs). The change pattern in the LH/HF ratios during the experiment was similar between radar and ECG. The subject’s body fat percentage was linearly associated with the time to recovery from physical fatigue (R2 = 0.96, p < 0.001). Our results demonstrated that fatigue and rest states can be distinguished accurately based on HRV measurements using IR-UWB radar in a noncontact fashion.
Collapse
|
9
|
Non-Contact Breathing Monitoring Using Sleep Breathing Detection Algorithm (SBDA) Based on UWB Radar Sensors. SENSORS 2022; 22:s22145249. [PMID: 35890928 PMCID: PMC9321517 DOI: 10.3390/s22145249] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/03/2022] [Revised: 07/05/2022] [Accepted: 07/09/2022] [Indexed: 01/25/2023]
Abstract
Ultra-wideband radar application for sleep breathing monitoring is hampered by the difficulty of obtaining breathing signals for non-stationary subjects. This occurs due to imprecise signal clutter removal and poor body movement removal algorithms for extracting accurate breathing signals. Therefore, this paper proposed a Sleep Breathing Detection Algorithm (SBDA) to address this challenge. First, SBDA introduces the combination of variance feature with Discrete Wavelet Transform (DWT) to tackle the issue of clutter signals. This method used Daubechies wavelets with five levels of decomposition to satisfy the signal-to-noise ratio in the signal. Second, SBDA implements a curve fit based sinusoidal pattern algorithm for detecting periodic motion. The measurement was taken by comparing the R-square value to differentiate between chest and body movements. Last but not least, SBDA applied the Ensemble Empirical Mode Decomposition (EEMD) method for extracting breathing signals before transforming the signal to the frequency domain using Fast Fourier Transform (FFT) to obtain breathing rate. The analysis was conducted on 15 subjects with normal and abnormal ratings for sleep monitoring. All results were compared with two existing methods obtained from previous literature with Polysomnography (PSG) devices. The result found that SBDA effectively monitors breathing using IR-UWB as it has the lowest average percentage error with only 6.12% compared to the other two existing methods from past research implemented in this dataset.
Collapse
|
10
|
Contactless radar-based breathing monitoring of premature infants in the neonatal intensive care unit. Sci Rep 2022; 12:5150. [PMID: 35338172 PMCID: PMC8956695 DOI: 10.1038/s41598-022-08836-3] [Citation(s) in RCA: 8] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/08/2021] [Accepted: 03/03/2022] [Indexed: 01/18/2023] Open
Abstract
Vital sign monitoring systems are essential in the care of hospitalized neonates. Due to the immaturity of their organs and immune system, premature infants require continuous monitoring of their vital parameters and sensors need to be directly attached to their fragile skin. Besides mobility restrictions and stress, these sensors often cause skin irritation and may lead to pressure necrosis. In this work, we show that a contactless radar-based approach is viable for breathing monitoring in the Neonatal intensive care unit (NICU). For the first time, different scenarios common to the NICU daily routine are investigated, and the challenges of monitoring in a real clinical setup are addressed through different contributions in the signal processing framework. Rather than just discarding measurements under strong interference, we present a novel random body movement mitigation technique based on the time-frequency decomposition of the recovered signal. In addition, we propose a simple and accurate frequency estimator which explores the harmonic structure of the breathing signal. As a result, the proposed radar-based solution is able to provide reliable breathing frequency estimation, which is close to the reference cabled device values most of the time. Our findings shed light on the strengths and limitations of this technology and lay the foundation for future studies toward a completely contactless solution for vital signs monitoring.
Collapse
|
11
|
He S, Han Z, Iglesias C, Mehta V, Bolic M. A Real-Time Respiration Monitoring and Classification System Using a Depth Camera and Radars. Front Physiol 2022; 13:799621. [PMID: 35356082 PMCID: PMC8959759 DOI: 10.3389/fphys.2022.799621] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/21/2021] [Accepted: 02/08/2022] [Indexed: 11/13/2022] Open
Abstract
Respiration rate (RR) and respiration patterns (RP) are considered early indicators of physiological conditions and cardiorespiratory diseases. In this study, we addressed the problem of contactless estimation of RR and classification of RP of one person or two persons in a confined space under realistic conditions. We used three impulse radio ultrawideband (IR-UWB) radars and a 3D depth camera (Kinect) to avoid any blind spot in the room and to ensure that at least one of the radars covers the monitored subjects. This article proposes a subject localization and radar selection algorithm using a Kinect camera to allow the measurement of the respiration of multiple people placed at random locations. Several different experiments were conducted to verify the algorithms proposed in this work. The mean absolute error (MAE) between the estimated RR and reference RR of one-subject and two-subjects RR estimation are 0.61±0.53 breaths/min and 0.68±0.24 breaths/min, respectively. A respiratory pattern classification algorithm combining feature-based random forest classifier and pattern discrimination algorithm was developed to classify different respiration patterns including eupnea, Cheyne-Stokes respiration, Kussmaul respiration and apnea. The overall classification accuracy of 90% was achieved on a test dataset. Finally, a real-time system showing RR and RP classification on a graphical user interface (GUI) was implemented for monitoring two subjects.
Collapse
|
12
|
Contactless Simultaneous Breathing and Heart Rate Detections in Physical Activity Using IR-UWB Radars. SENSORS 2021; 21:s21165503. [PMID: 34450945 PMCID: PMC8402280 DOI: 10.3390/s21165503] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 07/20/2021] [Revised: 08/09/2021] [Accepted: 08/10/2021] [Indexed: 11/16/2022]
Abstract
Vital signs monitoring in physical activity (PA) is of great significance in daily healthcare. Impulse Radio Ultra-WideBand (IR-UWB) radar provides a contactless vital signs detection approach with advantages in range resolution and penetration. Several researches have verified the feasibility of IR-UWB radar monitoring when the target keeps still. However, various body movements are induced by PA, which lead to severe signal distortion and interfere vital signs extraction. To address this challenge, a novel joint chest-abdomen cardiopulmonary signal estimation approach is proposed to detect breath and heartbeat simultaneously using IR-UWB radars. The movements of target chest and abdomen are detected by two IR-UWB radars, respectively. Considering the signal overlapping of vital signs and body motion artifacts, Empirical Wavelet Transform (EWT) is applied on received radar signals to remove clutter and mitigate movement interference. Moreover, improved EWT with frequency segmentation refinement is applied on each radar to decompose vital signals of target chest and abdomen to vital sign-related sub-signals, respectively. After that, based on the thoracoabdominal movement correlation, cross-correlation functions are calculated among chest and abdomen sub-signals to estimate breath and heartbeat. The experiments are conducted under three kinds of PA situations and two general body movements, the results of which indicate the effectiveness and superiority of the proposed approach.
Collapse
|
13
|
Through-Wall Multi-Subject Localization and Vital Signs Monitoring Using UWB MIMO Imaging Radar. REMOTE SENSING 2021. [DOI: 10.3390/rs13152905] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
Radar-based non-contact vital signs monitoring has great value in through-wall detection applications. This paper presents the theoretical and experimental study of through-wall respiration and heartbeat pattern extraction from multiple subjects. To detect the vital signs of multiple subjects, we employ a low-frequency ultra-wideband (UWB) multiple-input multiple-output (MIMO) imaging radar and derive the relationship between radar images and vibrations caused by human cardiopulmonary movements. The derivation indicates that MIMO radar imaging with the stepped-frequency continuous-wave (SFCW) improves the signal-to-noise ratio (SNR) critically by the factor of radar channel number times frequency number compared with continuous-wave (CW) Doppler radars. We also apply the three-dimensional (3-D) higher-order cumulant (HOC) to locate multiple subjects and extract the phase sequence of the radar images as the vital signs signal. To monitor the cardiopulmonary activities, we further exploit the VMD algorithm with a proposed grouping criterion to adaptively separate the respiration and heartbeat patterns. A series of experiments have validated the localization and detection of multiple subjects behind a wall. The VMD algorithm is suitable for separating the weaker heartbeat pattern from the stronger respiration pattern by the grouping criterion. Moreover, the continuous monitoring of heart rate (HR) by the MIMO radar in real scenarios shows a strong consistency with the reference electrocardiogram (ECG).
Collapse
|
14
|
Non-Invasive Driver Drowsiness Detection System. SENSORS 2021; 21:s21144833. [PMID: 34300572 PMCID: PMC8309856 DOI: 10.3390/s21144833] [Citation(s) in RCA: 11] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 05/31/2021] [Revised: 07/12/2021] [Accepted: 07/13/2021] [Indexed: 11/16/2022]
Abstract
Drowsiness when in command of a vehicle leads to a decline in cognitive performance that affects driver behavior, potentially causing accidents. Drowsiness-related road accidents lead to severe trauma, economic consequences, impact on others, physical injury and/or even death. Real-time and accurate driver drowsiness detection and warnings systems are necessary schemes to reduce tiredness-related driving accident rates. The research presented here aims at the classification of drowsy and non-drowsy driver states based on respiration rate detection by non-invasive, non-touch, impulsive radio ultra-wideband (IR-UWB) radar. Chest movements of 40 subjects were acquired for 5 m using a lab-placed IR-UWB radar system, and respiration per minute was extracted from the resulting signals. A structured dataset was obtained comprising respiration per minute, age and label (drowsy/non-drowsy). Different machine learning models, namely, Support Vector Machine, Decision Tree, Logistic regression, Gradient Boosting Machine, Extra Tree Classifier and Multilayer Perceptron were trained on the dataset, amongst which the Support Vector Machine shows the best accuracy of 87%. This research provides a ground truth for verification and assessment of UWB to be used effectively for driver drowsiness detection based on respiration.
Collapse
|
15
|
A Novel Electrically Small Ground-Penetrating Radar Patch Antenna with a Parasitic Ring for Respiration Detection. SENSORS 2021; 21:s21061930. [PMID: 33801797 PMCID: PMC8000857 DOI: 10.3390/s21061930] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 01/25/2021] [Revised: 02/23/2021] [Accepted: 03/02/2021] [Indexed: 11/16/2022]
Abstract
An electrically small patch antenna with a low-cost high-permittivity ceramic substrate material for use in a ground-penetrating radar is proposed in this work. The antenna is based on a commercial ceramic 915 MHz patch antenna with a size of 25 × 25 × 4 mm3 and a weight of 12.9 g. The influences of the main geometric parameters on the antenna’s electromagnetic characteristics were comprehensively studied. Three bandwidth improvement techniques were sequentially applied to optimize the antenna: tuning the key geometric parameters, adding cuts on the edges, and adding parasitic radiators. The designed antenna operates at around 1.3 GHz and has more than 40 MHz continuous −3 dB bandwidth. In comparison to the original antenna, the −3 and −6 dB fractional bandwidth is improved by 1.8 times and 4 times, respectively. Two antennas of the proposed design together with a customized radar were installed on an unmanned aerial vehicle (UAV) for a quick search for survivors after earthquakes or gas explosions without exposing the rescue staff to the uncertain dangers of moving on the debris.
Collapse
|
16
|
Basjaruddin NC, Syahbarudin F, Sutjiredjeki E. Measurement Device for Stress Level and Vital Sign Based on Sensor Fusion. Healthc Inform Res 2021; 27:11-18. [PMID: 33611872 PMCID: PMC7921569 DOI: 10.4258/hir.2021.27.1.11] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/27/2020] [Accepted: 12/22/2020] [Indexed: 11/23/2022] Open
Abstract
Objectives Medical health monitoring generally refers to two important aspects of health, namely, physical and mental health. Physical health can be measured through the basic parameters of normal values of vital signs, while mental health can be known from the prevalence of mental and emotional disorders, such as stress. Currently, the medical devices that are generally used to measure these two aspects of health are still separate, so they are less effective than they might be otherwise. To overcome this problem, we designed and realized a device that can measure stress levels through vital signs of the body, namely, heart rate, oxygen saturation, body temperature, and galvanic skin response (GSR). Methods The sensor fusion method is used to process data from multiple sensors, so the output that shows the stress level and health status of vital signs can be more accurate and precise. Results Based on the results of testing, this device is able to show the health status of vital signs and stress levels within ±20 seconds, with the accuracies of body temperature measurements, oxygen saturation, and GSR of 97.227%, 99.4%, and 98.6%, respectively. Conclusions A device for the measurement of stress levels and vital signs based on sensor fusion has been successfully designed and realized in accordance with the expected functions and specifications.
Collapse
Affiliation(s)
| | - Febian Syahbarudin
- Department of Electrical Engineering, Politeknik Negeri Bandung, Bandung, Indonesia
| | - Ediana Sutjiredjeki
- Department of Electrical Engineering, Politeknik Negeri Bandung, Bandung, Indonesia
| |
Collapse
|
17
|
Yang D, Zhu Z, Zhang J, Liang B. The Overview of Human Localization and Vital Sign Signal Measurement Using Handheld IR-UWB Through-Wall Radar. SENSORS 2021; 21:s21020402. [PMID: 33430061 PMCID: PMC7827243 DOI: 10.3390/s21020402] [Citation(s) in RCA: 11] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/21/2020] [Revised: 01/01/2021] [Accepted: 01/05/2021] [Indexed: 11/20/2022]
Abstract
Obtaining information (e.g., position, respiration, and heartbeat rates) on humans located behind opaque and non-metallic obstacles (e.g., walls and wood) has prompted the development of non-invasive remote sensing technologies. Due to its excellent features like high penetration ability, short blind area, fine-range resolution, high environment adoption capabilities, low cost and power consumption, and simple hardware design, impulse radio ultra-wideband (IR-UWB) through-wall radar has become the mainstream primary application radar used for the non-invasive remote sensing. IR-UWB through-wall radar has been developed for nearly 40 years, and various hardware compositions, deployment methods, and signal processing algorithms have been introduced by many scholars. The purpose of these proposed approaches is to obtain human information more accurately and quickly. In this paper, we focus on IR-UWB through-wall radar and introduce the key advances in system design and deployment, human detection theory, and signal processing algorithms, such as human vital sign signal measurement methods and moving human localization. Meanwhile, we discuss the engineering pre-processing methods of IR-UWB through-wall radar. The lasts research progress in the field is also presented. Based on this progress, the conclusions and the development directions of the IR-UWB through-wall radar in the future are also preliminarily forecasted.
Collapse
Affiliation(s)
- Degui Yang
- School of Aeronautics and Astronautics, Central South University, Changsha 410083, China; (D.Y.); (J.Z.); (B.L.)
| | - Zhengliang Zhu
- Key Laboratory of Underwater Acoustic Communication and Marine Information Technology of the Ministry of Education, Xiamen University, Xiamen 361005, China
- College of Ocean and Earth Sciences, Xiamen University, Xiamen 361005, China
- Correspondence: ; Tel.: +86-1760-605-4231
| | - Junchao Zhang
- School of Aeronautics and Astronautics, Central South University, Changsha 410083, China; (D.Y.); (J.Z.); (B.L.)
| | - Buge Liang
- School of Aeronautics and Astronautics, Central South University, Changsha 410083, China; (D.Y.); (J.Z.); (B.L.)
| |
Collapse
|
18
|
Lee WH, Kim SH, Na JY, Lim YH, Cho SH, Cho SH, Park HK. Non-contact Sleep/Wake Monitoring Using Impulse-Radio Ultrawideband Radar in Neonates. Front Pediatr 2021; 9:782623. [PMID: 34993163 PMCID: PMC8724301 DOI: 10.3389/fped.2021.782623] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/24/2021] [Accepted: 11/22/2021] [Indexed: 11/22/2022] Open
Abstract
Background: The gold standard for sleep monitoring, polysomnography (PSG), is too obtrusive and limited for practical use with tiny infants or in neonatal intensive care unit (NICU) settings. The ability of impulse-radio ultrawideband (IR-UWB) radar, a non-contact sensing technology, to assess vital signs and fine movement asymmetry in neonates was recently demonstrated. The purpose of this study was to investigate the possibility of quantitatively distinguishing and measuring sleep/wake states in neonates using IR-UWB radar and to compare its accuracy with behavioral observation-based sleep/wake analyses using video recordings. Methods: One preterm and three term neonates in the NICU were enrolled, and voluntary movements and vital signs were measured by radar at ages ranging from 2 to 27 days. Data from a video camcorder, amplitude-integrated electroencephalography (aEEG), and actigraphy were simultaneously recorded for reference. Radar signals were processed using a sleep/wake decision algorithm integrated with breathing signals and movement features. Results: The average recording time for the analysis was 13.0 (7.0-20.5) h across neonates. Compared with video analyses, the sleep/wake decision algorithm for neonates correctly classified 72.2% of sleep epochs and 80.6% of wake epochs and achieved a final Cohen's kappa coefficient of 0.49 (0.41-0.59) and an overall accuracy of 75.2%. Conclusions: IR-UWB radar can provide considerable accuracy regarding sleep/wake decisions in neonates, and although current performance is not yet sufficient, this study demonstrated the feasibility of its possible use in the NICU for the first time. This unobtrusive, non-contact radar technology is a promising method for monitoring sleep/wake states with vital signs in neonates.
Collapse
Affiliation(s)
- Won Hyuk Lee
- Department of Electronics and Computer Engineering, Hanyang University, Seoul, South Korea
| | - Seung Hyun Kim
- Department of Pediatrics, Hanyang University College of Medicine, Seoul, South Korea
| | - Jae Yoon Na
- Department of Pediatrics, Hanyang University College of Medicine, Seoul, South Korea
| | - Young-Hyo Lim
- Division of Cardiology, Department of Internal Medicine, Hanyang University College of Medicine, Seoul, South Korea
| | - Seok Hyun Cho
- Department of Otorhinolaryngology, Hanyang University College of Medicine, Seoul, South Korea
| | - Sung Ho Cho
- Department of Electronics and Computer Engineering, Hanyang University, Seoul, South Korea
| | - Hyun-Kyung Park
- Department of Pediatrics, Hanyang University College of Medicine, Seoul, South Korea
| |
Collapse
|
19
|
Feasibility of non-contact cardiorespiratory monitoring using impulse-radio ultra-wideband radar in the neonatal intensive care unit. PLoS One 2020; 15:e0243939. [PMID: 33370375 PMCID: PMC7769476 DOI: 10.1371/journal.pone.0243939] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/30/2020] [Accepted: 11/26/2020] [Indexed: 11/23/2022] Open
Abstract
Background Current cardiorespiratory monitoring equipment can cause injuries and infections in neonates with fragile skin. Impulse-radio ultra-wideband (IR-UWB) radar was recently demonstrated to be an effective contactless vital sign monitor in adults. The purpose of this study was to assess heart rates (HRs) and respiratory rates (RRs) in the neonatal intensive care unit (NICU) using IR-UWB radar and to evaluate its accuracy and reliability compared to conventional electrocardiography (ECG)/impedance pneumography (IPG). Methods The HR and RR were recorded in 34 neonates between 3 and 72 days of age during minimal movement (51 measurements in total) using IR-UWB radar (HRRd, RRRd) and ECG/IPG (HRECG, RRIPG) simultaneously. The radar signals were processed in real time using algorithms for neonates. Radar and ECG/IPG measurements were compared using concordance correlation coefficients (CCCs) and Bland-Altman plots. Results From the 34 neonates, 12,530 HR samples and 3,504 RR samples were measured. Both the HR and RR measured using the two methods were highly concordant when the neonates had minimal movements (CCC = 0.95 between the RRRd and RRIPG, CCC = 0.97 between the HRRd and HRECG). In the Bland-Altman plot, the mean biases were 0.17 breaths/min (95% limit of agreement [LOA] -7.0–7.3) between the RRRd and RRIPG and -0.23 bpm (95% LOA -5.3–4.8) between the HRRd and HRECG. Moreover, the agreement for the HR and RR measurements between the two modalities was consistently high regardless of neonate weight. Conclusions A cardiorespiratory monitor using IR-UWB radar may provide accurate non-contact HR and RR estimates without wires and electrodes for neonates in the NICU.
Collapse
|
20
|
Continuous In-Bed Monitoring of Vital Signs Using a Multi Radar Setup for Freely Moving Patients. SENSORS 2020; 20:s20205827. [PMID: 33076283 PMCID: PMC7602469 DOI: 10.3390/s20205827] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 09/18/2020] [Revised: 10/08/2020] [Accepted: 10/09/2020] [Indexed: 01/31/2023]
Abstract
In hospitals, continuous monitoring of vital parameters can provide valuable information about the course of a patient’s illness and allows early warning of emergencies. To enable such monitoring without restricting the patient’s freedom of movement and comfort, a radar system is attached under the mattress which consists of four individual radar modules to cover the entire width of the bed. Using radar, heartbeat and respiration can be measured without contact and through clothing. By processing the raw radar data, the presence of a patient can be determined and movements are categorized into the classes “bed exit”, “bed entry”, and “on bed movement”. Using this information, the vital parameters can be assessed in sections where the patient lies calmly in bed. In the first step, the presence and movement classification is demonstrated using recorded training and test data. Next, the radar was modified to perform vital sign measurements synchronized to a gold standard device. The evaluation of the individual radar modules shows that, regardless of the lying position of the test person, at least one of the radar modules delivers accurate results for continuous monitoring.
Collapse
|
21
|
Yang X, Zhang X, Qian H, Ding Y, Zhang L. MMT-HEAR: Multiple Moving Targets Heartbeats Estimation and Recovery Using IR-UWB Radars. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2020; 2020:5733-5736. [PMID: 33019276 DOI: 10.1109/embc44109.2020.9175318] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/05/2022]
Abstract
Populations around the world are rapidly ageing. Age-friendly environments address the significance of continuous inhome vital sign monitoring. Impulse Radio Ultra-WideBand (IR-UWB) radar serves as a household healthcare assistance, providing non-contact vital sign monitoring without privacy issues and illumination limitation. However, the body movements bring difficulty in extracting heartbeat from radar signals, let alone obtaining complete information with body occlusions among multiple targets. This paper proposes a Multiple Moving Targets Heartbeat Estimation And Recovery (MMT-HEAR) approach to extract vital signs using IR-UWB radars. CLEAN and Joint Probability Data Association (JPDA) algorithms are firstly performed on each radar to estimate target-to-antenna distances of multiple targets. Considering signal obstruction and attenuation for targets occluded by others, the location-based distance optimization is proposed to refine these distances by combining information from all radars. Then the mapping from signal amplitudes to refined distances is introduced and combined with the Variational Nonlinear Chirp Mode Decomposition (VNCMD) to extract vital signs with body movements. To the best of our knowledge, this is the first attempt to monitor vital signs of multiple moving targets with radars. The averaging accuracy for two moving targets heartbeat monitoring during a 20-minutes observation is 85.93% with MMT-HEAR. Compared to two other conventional methods, the MMT-HEAR approach yields improvements of 16.11% and 10.16%, revealing the efficiency and robustness of this proposed approach.
Collapse
|
22
|
Yang C, Bruce B, Liu X, Gholami B, Tavassolian N. A Hybrid Radar-Camera Respiratory Monitoring System Based on an Impulse-Radio Ultrawideband Radar. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2020; 2020:2646-2649. [PMID: 33018550 DOI: 10.1109/embc44109.2020.9175267] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
This paper reports a pilot study of a hybrid radar-camera system that simultaneously monitors the respiration of two subjects. A prototype system was built involving a low-cost impulse-radio ultra-wideband (IR-UWB) radar module and an optical and depth-sensing camera module. The system detects subjects using the camera and utilizes the distance information acquired to guide the signal processing of the radar. This structure simplifies subject identification and tracking for the radar system, provides further context to the radar, and facilitates the extraction of respiration information. Experiments under different scenarios were conducted to evaluate the performance of the system at different distances and angles from subjects. The localization procedure has an average accuracy of 0.1 m. The respiration rates extracted from the radar are comparable with the values from the reference wearable sensor, reporting an average error of 0.79 respirations per minute (RPM) with a standard deviation of 0.71 RPM. The results suggest that the respiration signals from subjects could be accurately monitored with the presented framework. It is also feasible to monitor two subjects at the same time in most scenarios. The proposed framework shows promising potential to work as a ubiquitous monitoring system for multiple subjects.
Collapse
|
23
|
He S, Mehta V, Bolic M. A Joint Localization Assisted Respiratory Rate Estimation using IR-UWB Radars. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2020; 2020:489-493. [PMID: 33018034 DOI: 10.1109/embc44109.2020.9175754] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
Respiratory rate (RR) is one of the vital signs which is commonly measured by contact-based methods, such as using a breathing belt. Recently, significant research has been conducted related to contactless RR monitoring - however, the majority of experiments are performed in situations when the subject is oriented towards the radar. In this research, we are interested in monitoring the breathing of subjects who can be anywhere in the room. A system of three impulse radio ultrawideband (IR-UWB) radars is used to cover the whole room. A Kinect camera that can track subjects' joints 3D coordinates was employed to localize the subjects. The results of RR monitoring using IR-UWB radars and Kinect camera show good performance in single/multiple subject(s) tracking and RR estimation.
Collapse
|
24
|
Sidikova M, Martinek R, Kawala-Sterniuk A, Ladrova M, Jaros R, Danys L, Simonik P. Vital Sign Monitoring in Car Seats Based on Electrocardiography, Ballistocardiography and Seismocardiography: A Review. SENSORS 2020; 20:s20195699. [PMID: 33036313 PMCID: PMC7582509 DOI: 10.3390/s20195699] [Citation(s) in RCA: 14] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 08/21/2020] [Revised: 09/29/2020] [Accepted: 09/30/2020] [Indexed: 12/15/2022]
Abstract
This paper focuses on a thorough summary of vital function measuring methods in vehicles. The focus of this paper is to summarize and compare already existing methods integrated into car seats with the implementation of inter alia capacitive electrocardiogram (cECG), mechanical motion analysis Ballistocardiography (BCG) and Seismocardiography (SCG). In addition, a comprehensive overview of other methods of vital sign monitoring, such as camera-based systems or steering wheel sensors, is also presented in this article. Furthermore, this work contains a very thorough background study on advanced signal processing methods and their potential application for the purpose of vital sign monitoring in cars, which is prone to various disturbances and artifacts occurrence that have to be eliminated.
Collapse
Affiliation(s)
- Michaela Sidikova
- Faculty of Electrical Engineering and Computer Science, VSB-Technical University of Ostrava, 17 Listopadu 15, 70800 Ostrava, Czech Republic; (M.L.); (R.J.); (L.D.); (P.S.)
- Correspondence: (M.S.); (R.M.)
| | - Radek Martinek
- Faculty of Electrical Engineering and Computer Science, VSB-Technical University of Ostrava, 17 Listopadu 15, 70800 Ostrava, Czech Republic; (M.L.); (R.J.); (L.D.); (P.S.)
- Correspondence: (M.S.); (R.M.)
| | - Aleksandra Kawala-Sterniuk
- Faculty of Electrical Engineering, Automatic Control and Informatics, Opole University of Technology, Proszkowska 76, 45-758 Opole, Poland;
| | - Martina Ladrova
- Faculty of Electrical Engineering and Computer Science, VSB-Technical University of Ostrava, 17 Listopadu 15, 70800 Ostrava, Czech Republic; (M.L.); (R.J.); (L.D.); (P.S.)
| | - Rene Jaros
- Faculty of Electrical Engineering and Computer Science, VSB-Technical University of Ostrava, 17 Listopadu 15, 70800 Ostrava, Czech Republic; (M.L.); (R.J.); (L.D.); (P.S.)
| | - Lukas Danys
- Faculty of Electrical Engineering and Computer Science, VSB-Technical University of Ostrava, 17 Listopadu 15, 70800 Ostrava, Czech Republic; (M.L.); (R.J.); (L.D.); (P.S.)
| | - Petr Simonik
- Faculty of Electrical Engineering and Computer Science, VSB-Technical University of Ostrava, 17 Listopadu 15, 70800 Ostrava, Czech Republic; (M.L.); (R.J.); (L.D.); (P.S.)
| |
Collapse
|
25
|
Wireless Body Sensor Communication Systems Based on UWB and IBC Technologies: State-of-the-Art and Open Challenges. SENSORS 2020; 20:s20123587. [PMID: 32630376 PMCID: PMC7349302 DOI: 10.3390/s20123587] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 05/31/2020] [Revised: 06/18/2020] [Accepted: 06/22/2020] [Indexed: 11/21/2022]
Abstract
In recent years there has been an increasing need for miniature, low-cost, commercially accessible, and user-friendly sensor solutions for wireless body area networks (WBAN), which has led to the adoption of new physical communication interfaces providing distinctive advantages over traditional wireless technologies. Ultra-wideband (UWB) and intrabody communication (IBC) have been the subject of intensive research in recent years due to their promising characteristics as means for short-range, low-power, and low-data-rate wireless interfaces for interconnection of various sensors and devices placed on, inside, or in the close vicinity of the human body. The need for safe and standardized solutions has resulted in the development of two relevant standards, IEEE 802.15.4 (for UWB) and IEEE 802.15.6 (for UWB and IBC), respectively. This paper presents an in-depth overview of recent studies and advances in the field of application of UWB and IBC technologies for wireless body sensor communication systems.
Collapse
|
26
|
Sekak F, Zerhouni K, Elbahhar F, Haddad M, Loyez C, Haddadi K. Cyclostationary-Based Vital Signs Detection Using Microwave Radar at 2.5 GHz. SENSORS (BASEL, SWITZERLAND) 2020; 20:E3396. [PMID: 32560182 PMCID: PMC7349325 DOI: 10.3390/s20123396] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 04/22/2020] [Revised: 05/27/2020] [Accepted: 06/11/2020] [Indexed: 11/16/2022]
Abstract
Non-contact detection and estimation of vital signs such as respiratory and cardiac frequencies is a powerful tool for surveillance applications. In particular, the continuous wave bio-radar has been widely investigated to determine the physiological parameters in a non-contact manner. Since the RF-reflected signal from the human body is corrupted by noise and random body movements, traditional Fourier analysis fails to detect the heart and breathing frequencies. In this effort, cyclostationary analysis has been used to improve the radar performance for non-invasive measurement of respiratory rate and heart rate. However, the preliminary works focus only on one frequency and do not include the impact of attenuation and random movement of the body in the analysis. Hence in this paper, we evaluate the impact of distance and noise on the cyclic features of the reflected signal. Furthermore, we explore the assessment of second order cyclostationary signal processing performance by developing the cyclic mean, the conjugate cyclic autocorrelation and the cyclic cumulant. In addition, the analysis is carried out using a reduced number of samples to reduce the response time. Implementation of the cyclostationary technique using a bi-static radar configuration at 2.5 GHz is shown as an example to demonstrate the proposed approach.
Collapse
Affiliation(s)
- Fatima Sekak
- CNRS, UMR 8520–IEMN groupe CSAM (Systems Circuits Microwave Applications), University of Lille, F-59000 Lille, France; (C.L.); (K.H.)
- Groupe LEOST (Electronic Wave and Signal Laboratory for Transport), University of Gustave Eiffel, F-59666 Villeneuve d’ Ascq, France; (K.Z.); (F.E.)
- Segula Engineering France, 92500 Rueil-Malmaison, France;
| | - Kawtar Zerhouni
- Groupe LEOST (Electronic Wave and Signal Laboratory for Transport), University of Gustave Eiffel, F-59666 Villeneuve d’ Ascq, France; (K.Z.); (F.E.)
| | - Fouzia Elbahhar
- Groupe LEOST (Electronic Wave and Signal Laboratory for Transport), University of Gustave Eiffel, F-59666 Villeneuve d’ Ascq, France; (K.Z.); (F.E.)
| | - Madjid Haddad
- Segula Engineering France, 92500 Rueil-Malmaison, France;
| | - Christophe Loyez
- CNRS, UMR 8520–IEMN groupe CSAM (Systems Circuits Microwave Applications), University of Lille, F-59000 Lille, France; (C.L.); (K.H.)
| | - Kamel Haddadi
- CNRS, UMR 8520–IEMN groupe CSAM (Systems Circuits Microwave Applications), University of Lille, F-59000 Lille, France; (C.L.); (K.H.)
| |
Collapse
|
27
|
Khan F, Ghaffar A, Khan N, Cho SH. An Overview of Signal Processing Techniques for Remote Health Monitoring Using Impulse Radio UWB Transceiver. SENSORS 2020; 20:s20092479. [PMID: 32349382 PMCID: PMC7248922 DOI: 10.3390/s20092479] [Citation(s) in RCA: 36] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/25/2020] [Revised: 04/24/2020] [Accepted: 04/25/2020] [Indexed: 11/16/2022]
Abstract
Non-invasive remote health monitoring plays a vital role in epidemiological situations such as SARS outbreak (2003), MERS (2015) and the recently ongoing outbreak of COVID-19 because it is extremely risky to get close to the patient due to the spread of contagious infections. Non-invasive monitoring is also extremely necessary in situations where it is difficult to use complicated wired connections, such as ECG monitoring for infants, burn victims or during rescue missions when people are buried during building collapses/earthquakes. Due to the unique characteristics such as higher penetration capabilities, extremely precise ranging, low power requirement, low cost, simple hardware and robustness to multipath interferences, Impulse Radio Ultra Wideband (IR-UWB) technology is appropriate for non-invasive medical applications. IR-UWB sensors detect the macro as well as micro movement inside the human body due to its fine range resolution. The two vital signs, i.e., respiration rate and heart rate, can be measured by IR-UWB radar by measuring the change in the magnitude of signal due to displacement caused by human lungs, heart during respiration and heart beating. This paper reviews recent advances in IR- UWB radar sensor design for healthcare, such as vital signs measurements of a stationary human, vitals of a non-stationary human, vital signs of people in a vehicle, through the wall vitals measurement, neonate’s health monitoring, fall detection, sleep monitoring and medical imaging. Although we have covered many topics related to health monitoring using IR-UWB, this paper is mainly focused on signal processing techniques for measurement of vital signs, i.e., respiration and heart rate monitoring.
Collapse
Affiliation(s)
- Faheem Khan
- Department of Electronics and Computer Engineering, Hanyang University, 222 Wangsimni-ro, Seongdong-gu, Seoul 04763, Korea; (F.K.); (A.G.)
- Department of Electrical Engineering, Engineering University, Peshawar 25000, Pakistan;
| | - Asim Ghaffar
- Department of Electronics and Computer Engineering, Hanyang University, 222 Wangsimni-ro, Seongdong-gu, Seoul 04763, Korea; (F.K.); (A.G.)
| | - Naeem Khan
- Department of Electrical Engineering, Engineering University, Peshawar 25000, Pakistan;
| | - Sung Ho Cho
- Department of Electronics and Computer Engineering, Hanyang University, 222 Wangsimni-ro, Seongdong-gu, Seoul 04763, Korea; (F.K.); (A.G.)
- Correspondence:
| |
Collapse
|
28
|
Malešević N, Petrović V, Belić M, Antfolk C, Mihajlović V, Janković M. Contactless Real-Time Heartbeat Detection via 24 GHz Continuous-Wave Doppler Radar Using Artificial Neural Networks. SENSORS (BASEL, SWITZERLAND) 2020; 20:E2351. [PMID: 32326190 PMCID: PMC7219229 DOI: 10.3390/s20082351] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/06/2020] [Revised: 04/16/2020] [Accepted: 04/19/2020] [Indexed: 11/22/2022]
Abstract
The measurement of human vital signs is a highly important task in a variety of environments and applications. Most notably, the electrocardiogram (ECG) is a versatile signal that could indicate various physical and psychological conditions, from signs of life to complex mental states. The measurement of the ECG relies on electrodes attached to the skin to acquire the electrical activity of the heart, which imposes certain limitations. Recently, due to the advancement of wireless technology, it has become possible to pick up heart activity in a contactless manner. Among the possible ways to wirelessly obtain information related to heart activity, methods based on mm-wave radars proved to be the most accurate in detecting the small mechanical oscillations of the human chest resulting from heartbeats. In this paper, we presented a method based on a continuous-wave Doppler radar coupled with an artificial neural network (ANN) to detect heartbeats as individual events. To keep the method computationally simple, the ANN took the raw radar signal as input, while the output was minimally processed, ensuring low latency operation (<1 s). The performance of the proposed method was evaluated with respect to an ECG reference ("ground truth") in an experiment involving 21 healthy volunteers, who were sitting on a cushioned seat and were refrained from making excessive body movements. The results indicated that the presented approach is viable for the fast detection of individual heartbeats without heavy signal preprocessing.
Collapse
Affiliation(s)
- Nebojša Malešević
- Department of Biomedical Engineering, Faculty of Engineering, Lund University, Box 118, 221 00 Lund, Sweden;
| | - Vladimir Petrović
- School of Electrical Engineering, University of Belgrade, Bulevar kralja Aleksandra 73, 11120 Belgrade, Serbia
| | - Minja Belić
- Novelic, Veljka Dugoševića 54/A3, 11000 Belgrade, Serbia; (M.B.); (V.M.)
| | - Christian Antfolk
- Department of Biomedical Engineering, Faculty of Engineering, Lund University, Box 118, 221 00 Lund, Sweden;
| | - Veljko Mihajlović
- Novelic, Veljka Dugoševića 54/A3, 11000 Belgrade, Serbia; (M.B.); (V.M.)
| | - Milica Janković
- School of Electrical Engineering, University of Belgrade, Bulevar kralja Aleksandra 73, 11120 Belgrade, Serbia
| |
Collapse
|
29
|
Quan X, Choi JW, Cho SH. A New Thresholding Method for IR-UWB Radar-Based Detection Applications. SENSORS 2020; 20:s20082314. [PMID: 32325654 PMCID: PMC7219251 DOI: 10.3390/s20082314] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/05/2020] [Revised: 04/15/2020] [Accepted: 04/15/2020] [Indexed: 11/28/2022]
Abstract
In this paper, we proposed a new thresholding method for impulse radio ultra-wideband (IR-UWB) radar-based detection applications by taking both the false alarm and miss-detection rates into consideration. The thresholding algorithm is the key point of the detection application, and there have been numerous studies on these developments. Most of these studies were related to the occurrence of false alarms, such as the constant false alarm rate algorithm (CFAR). However, very few studies have considered miss-detection, which is another crucial issue in detection applications. To mitigate this issue, our proposed algorithm considered miss-detection as well as the false alarms occurring during thresholding. In the proposed algorithm, a threshold is determined by combining a noise signal-based threshold, in which the focus point is the false alarm, with a target signal-based threshold, in which the focus point is a miss-detection, at a designed ratio. Therefore, a threshold can be determined based on the focus point by adjusting the designed ratio. In addition, the proposed algorithm can estimate the false alarm and miss-detection rates for the determined threshold, and thus, the threshold can be objectively set. Moreover, the proposed algorithm is better in terms of understanding the target signal for a given environment. A target signal can be affected by the clutter, installation height, and the angle of the radar, which are factors that noise-oriented algorithms do not consider. As the proposed algorithm analyzed the target signal, these factors were all considered. We analyzed the false alarm and miss-detection rates for the thresholds, which were determined by different combination ratios at various distances, and we experimentally verified the validity of the proposed algorithm.
Collapse
Affiliation(s)
- Xuanjun Quan
- Department of Electronics and Computer Engineering, Hanyang University, 222 Wangsimini-ro, Seongdong-gu, Seoul 04763, Korea;
| | | | - Sung Ho Cho
- Department of Electronics and Computer Engineering, Hanyang University, 222 Wangsimini-ro, Seongdong-gu, Seoul 04763, Korea;
- Correspondence: ; Tel.: +82-2-2220-0390
| |
Collapse
|
30
|
Non-contact diagnosis of obstructive sleep apnea using impulse-radio ultra-wideband radar. Sci Rep 2020; 10:5261. [PMID: 32210266 PMCID: PMC7093464 DOI: 10.1038/s41598-020-62061-4] [Citation(s) in RCA: 21] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/12/2019] [Accepted: 03/04/2020] [Indexed: 11/24/2022] Open
Abstract
While full-night polysomnography is the gold standard for the diagnosis of obstructive sleep apnea, its limitations include a high cost and first-night effects. This study developed an algorithm for the detection of respiratory events based on impulse-radio ultra-wideband radar and verified its feasibility for the diagnosis of obstructive sleep apnea. A total of 94 subjects were enrolled in this study (23 controls and 24, 14, and 33 with mild, moderate, and severe obstructive sleep apnea, respectively). Abnormal breathing detected by impulse-radio ultra-wideband radar was defined as a drop in the peak radar signal by ≥30% from that in the pre-event baseline. We compared the abnormal breathing index obtained from impulse-radio ultra-wideband radar and apnea–hypopnea index (AHI) measured from polysomnography. There was an excellent agreement between the Abnormal Breathing Index and AHI (intraclass correlation coefficient = 0.927). The overall agreements of the impulse-radio ultra-wideband radar were 0.93 for Model 1 (AHI ≥ 5), 0.91 for Model 2 (AHI ≥ 15), and 1 for Model 3 (AHI ≥ 30). Impulse-radio ultra-wideband radar accurately detected respiratory events (apneas and hypopneas) during sleep without subject contact. Therefore, impulse-radio ultra-wideband radar may be used as a screening tool for obstructive sleep apnea.
Collapse
|
31
|
Kim DH. Lane Detection Method with Impulse Radio Ultra-Wideband Radar and Metal Lane Reflectors. SENSORS 2020; 20:s20010324. [PMID: 31935964 PMCID: PMC6982763 DOI: 10.3390/s20010324] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/03/2019] [Revised: 12/28/2019] [Accepted: 01/04/2020] [Indexed: 11/21/2022]
Abstract
An advanced driver-assistance system (ADAS), based on lane detection technology, detects dangerous situations through various sensors and either warns the driver or takes over direct control of the vehicle. At present, cameras are commonly used for lane detection; however, their performance varies widely depending on the lighting conditions. Consequently, many studies have focused on using radar for lane detection. However, when using radar, it is difficult to distinguish between the plain road surface and painted lane markers, necessitating the use of radar reflectors for guidance. Previous studies have used long-range radars which may receive interference signals from various objects, including other vehicles, pedestrians, and buildings, thereby hampering lane detection. Therefore, we propose a lane detection method that uses an impulse radio ultra-wideband radar with high-range resolution and metal lane markers installed at regular intervals on the road. Lane detection and departure is realized upon using the periodically reflected signals as well as vehicle speed data as inputs. For verification, a field test was conducted by attaching radar to a vehicle and installing metal lane markers on the road. Experimental scenarios were established by varying the position and movement of the vehicle, and it was demonstrated that the proposed method enables lane detection based on the data measured.
Collapse
Affiliation(s)
- Dae-Hyun Kim
- ICT Based Public Transportation Research Team, Korea Railroad Research Institute, Uiwang 16105, Korea
| |
Collapse
|
32
|
Method for Distinguishing Humans and Animals in Vital Signs Monitoring Using IR-UWB Radar. INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH 2019; 16:ijerph16224462. [PMID: 31766272 PMCID: PMC6888617 DOI: 10.3390/ijerph16224462] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 09/20/2019] [Revised: 11/09/2019] [Accepted: 11/11/2019] [Indexed: 11/17/2022]
Abstract
Radar has been widely applied in many scenarios as a critical remote sensing tool for non-contact vital sign monitoring, particularly for sleep monitoring and heart rate measurement within the home environment. For non-contact monitoring with radar, interference from house pets is an important issue that has been neglected in the past. Many animals have respiratory frequencies similar to those of humans, and they are easily mistaken for human targets in non-contact monitoring, which would trigger a false alarm because of incorrect physiological parameters from the animal. In this study, humans and common pets in families, such as dogs, cats, and rabbits, were detected using an impulse radio ultrawideband (IR-UWB) radar, and the echo signals were analyzed in the time and frequency domains. Subsequently, based on the distinct in-body structure between humans and animals, we propose a parameter, the respiratory and heartbeat energy ratio (RHER), which reflects the contribution rate of breathing and heartbeat in the detected vital signs. Combining this parameter with the energy index, we developed a novel scheme to distinguish between humans and animals. In the developed scheme, after background noise removal and direct-current component suppression, an energy indicator is used to initially identify the target. The signal is then decomposed using a variational mode decomposition algorithm, and the variational intrinsic mode functions that represent human respiration and heartbeat components are obtained and utilized to calculate the RHER parameter. Finally, the RHER index is applied to rapidly distinguish between humans and animals. Our experimental results demonstrate that the proposed approach more effectively distinguishes between humans and animals in terms of monitoring vital signs than the existing methods. Furthermore, its rapidity and need for only minimal calculation resources enable it to meet the needs of real-time monitoring.
Collapse
|
33
|
Park JY, Lee Y, Choi YW, Heo R, Park HK, Cho SH, Cho SH, Lim YH. Preclinical Evaluation of a Noncontact Simultaneous Monitoring Method for Respiration and Carotid Pulsation Using Impulse-Radio Ultra-Wideband Radar. Sci Rep 2019; 9:11892. [PMID: 31417149 PMCID: PMC6695386 DOI: 10.1038/s41598-019-48386-9] [Citation(s) in RCA: 18] [Impact Index Per Article: 3.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/06/2019] [Accepted: 08/05/2019] [Indexed: 11/09/2022] Open
Abstract
There has been the possibility for respiration and carotid pulsation to be simultaneously monitored from a distance using impulse-radio ultra-wideband (IR-UWB) radar. Therefore, we investigated the validity of simultaneous respiratory rates (RR), pulse rates (PR) and R-R interval measurement using IR-UWB radar. We included 19 patients with a normal sinus rhythm (NSR) and 14 patients with persistent atrial fibrillation (PeAF). The RR, PR, R-R interval and rhythm were obtained simultaneously from the right carotid artery area in a supine position and under normal breathing conditions using IR-UWB radar. There was excellent agreement between the RR obtained by IR-UWB radar and that manually counted by a physician (intraclass correlation coefficient [ICC] 0.852). In the NSR group, there was excellent agreement between the PR (ICC 0.985), average R-R interval (ICC 0.999), and individual R-R interval (ICC 0.910) measured by IR-UWB radar and electrocardiography. In the PeAF group, PR (ICC 0.930), average R-R interval (ICC 0.957) and individual R-R interval (ICC 0.701) also agreed well between the two methods. These results demonstrate that IR-UWB radar can simultaneously monitor respiration, carotid pulse and heart rhythm with high precision and may thus be utilized as a noncontact continuous vital sign monitoring in clinical practice.
Collapse
Affiliation(s)
- Jun-Young Park
- Department of Electronics and Computer Engineering, Hanyang University, Seoul, 04763, Republic of Korea
| | - Yonggu Lee
- Division of Cardiology, Department of Internal Medicine, College of Medicine, Hanyang University, Seoul, 04763, Republic of Korea
| | - Yeon-Woo Choi
- Division of Cardiology, Department of Internal Medicine, College of Medicine, Hanyang University, Seoul, 04763, Republic of Korea
| | - Ran Heo
- Division of Cardiology, Department of Internal Medicine, College of Medicine, Hanyang University, Seoul, 04763, Republic of Korea
| | - Hyun-Kyung Park
- Department of Pediatrics, College of Medicine, Hanyang University, Seoul, 04763, Republic of Korea
| | - Seok-Hyun Cho
- Department of Otorhinolaryngology, College of Medicine, Hanyang University, Seoul, 04763, Republic of Korea
| | - Sung Ho Cho
- Department of Electronics and Computer Engineering, Hanyang University, Seoul, 04763, Republic of Korea.
| | - Young-Hyo Lim
- Division of Cardiology, Department of Internal Medicine, College of Medicine, Hanyang University, Seoul, 04763, Republic of Korea.
| |
Collapse
|
34
|
Kang S, Lee Y, Lim YH, Park HK, Cho SH, Cho SH. Validation of noncontact cardiorespiratory monitoring using impulse-radio ultra-wideband radar against nocturnal polysomnography. Sleep Breath 2019; 24:841-848. [DOI: 10.1007/s11325-019-01908-1] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/03/2019] [Revised: 07/18/2019] [Accepted: 07/24/2019] [Indexed: 12/01/2022]
|
35
|
Kim JD, Lee WH, Lee Y, Lee HJ, Cha T, Kim SH, Song KM, Lim YH, Cho SH, Cho SH, Park HK. Non-contact respiration monitoring using impulse radio ultrawideband radar in neonates. ROYAL SOCIETY OPEN SCIENCE 2019; 6:190149. [PMID: 31312485 PMCID: PMC6599793 DOI: 10.1098/rsos.190149] [Citation(s) in RCA: 27] [Impact Index Per Article: 5.4] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/07/2019] [Accepted: 05/10/2019] [Indexed: 05/04/2023]
Abstract
Vital sign monitoring in neonates requires adhesive electrodes, which often damage fragile newborn skin. Because impulse radio ultrawideband (IR-UWB) radar has been reported to recognize chest movement without contact in adult humans, IR-UWB may be used to measure respiratory rates (RRs) in a non-contact fashion. We investigated the feasibility of radar sensors for respiration monitoring in neonates without any respiratory support to compare the accuracy and reliability of radar measurements with those of conventional impedance pneumography measurements. In the neonatal intensive care unit, RRs were measured using radar (RRRd) and impedance pneumography (RRIP) simultaneously. The neonatal voluntary movements were measured using the radar sensor and categorized into three levels (low [M0], intermediate [M1] and high [M2]). RRRd highly agreed with RRIP (r = 0.90; intraclass correlation coefficient [ICC] = 0.846 [0.835-0.856]). For the M0 movement, there was good agreement between RRRd and RRIP (ICC = 0.893; mean bias -0.15 [limits of agreement (LOA) -9.6 to 10.0]). However, the agreement was slightly lower for the M1 (ICC = 0.833; mean bias = 0.95 [LOA -11.4 to 13.3]) and M2 (ICC = 0.749; mean bias = 3.04 [LOA -9.30 to 15.4]) movements than for the M0 movement. In conclusion, IR-UWB radar can provide accurate and reliable estimates of RR in neonates in a non-contact fashion. The performance of radar measurements could be affected by neonate movement.
Collapse
Affiliation(s)
- Jong Deok Kim
- Department of Pediatrics, Hanyang University College of Medicine, Seoul, Republic of Korea
| | - Won Hyuk Lee
- Department of Electronics and Computer Engineering, Hanyang University, 222 Wangsimni-ro, Seongdong-gu, Seoul 04763, Republic of Korea
| | - Yonggu Lee
- Division of Cardiology, Department of Internal Medicine, Hanyang University College of Medicine, Seoul, Republic of Korea
| | - Hyun Ju Lee
- Division of Neonatology, Department of Pediatrics, Hanyang University College of Medicine, Seoul, Republic of Korea
| | - Teahyen Cha
- Department of Pediatrics, Hanyang University College of Medicine, Seoul, Republic of Korea
| | - Seung Hyun Kim
- Department of Pediatrics, Hanyang University College of Medicine, Seoul, Republic of Korea
| | - Ki-Min Song
- Department of Health Sciences, Graduate School, Hanyang University, Seoul, Republic of Korea
| | - Young-Hyo Lim
- Division of Cardiology, Department of Internal Medicine, Hanyang University College of Medicine, Seoul, Republic of Korea
| | - Seok Hyun Cho
- Department of Otorhinolaryngology, Hanyang University College of Medicine, Seoul, Republic of Korea
| | - Sung Ho Cho
- Department of Electronics and Computer Engineering, Hanyang University, 222 Wangsimni-ro, Seongdong-gu, Seoul 04763, Republic of Korea
- Authors for correspondence: Sung Ho Cho e-mail:
| | - Hyun-Kyung Park
- Division of Neonatology, Department of Pediatrics, Hanyang University College of Medicine, Seoul, Republic of Korea
- Authors for correspondence: Hyun-Kyung Park e-mail:
| |
Collapse
|
36
|
A Novel Vital-Sign Sensing Algorithm for Multiple Subjects Based on 24-GHz FMCW Doppler Radar. REMOTE SENSING 2019. [DOI: 10.3390/rs11101237] [Citation(s) in RCA: 53] [Impact Index Per Article: 10.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
A novel non-contact vital-sign sensing algorithm for use in cases of multiple subjects is proposed. The approach uses a 24 GHz frequency-modulated continuous-wave Doppler radar with the parametric spectral estimation method. Doppler processing and spectral estimation are concurrently implemented to detect vital signs from more than one subject, revealing excellent results. The parametric spectral estimation method is utilized to clearly identify multiple targets, making it possible to distinguish multiple targets located less than 40 cm apart, which is beyond the limit of the theoretical range resolution. Fourier transformation is used to extract phase information, and the result is combined with the spectral estimation result. To eliminate mutual interference, the range integration is performed when combining the range and phase information. By considering breathing and heartbeat periodicity, the proposed algorithm can accurately extract vital signs in real time by applying an auto-regressive algorithm. The capability of a contactless and unobtrusive vital sign measurement with a millimeter wave radar system has innumerable applications, such as remote patient monitoring, emergency surveillance, and personal health care.
Collapse
|
37
|
Yao Y, Sun G, Kirimoto T, Schiek M. Extracting Cardiac Information From Medical Radar Using Locally Projective Adaptive Signal Separation. Front Physiol 2019; 10:568. [PMID: 31164831 PMCID: PMC6536597 DOI: 10.3389/fphys.2019.00568] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/27/2018] [Accepted: 04/24/2019] [Indexed: 11/19/2022] Open
Abstract
Electrocardiography is the gold standard for electrical heartbeat activity, but offers no direct measurement of mechanical activity. Mechanical cardiac activity can be assessed non-invasively using, e.g., ballistocardiography and recently, medical radar has emerged as a contactless alternative modality. However, all modalities for measuring the mechanical cardiac activity are affected by respiratory movements, requiring a signal separation step before higher-level analysis can be performed. This paper adapts a non-linear filter for separating the respiratory and cardiac signal components of radar recordings. In addition, we present an adaptive algorithm for estimating the parameters for the non-linear filter. The novelty of our method lies in the combination of the non-linear signal separation method with a novel, adaptive parameter estimation method specifically designed for the non-linear signal separation method, eliminating the need for manual intervention and resulting in a fully adaptive algorithm. Using the two benchmark applications of (i) cardiac template extraction from radar and (ii) peak timing analysis, we demonstrate that the non-linear filter combined with adaptive parameter estimation delivers superior results compared to linear filtering. The results show that using locally projective adaptive signal separation (LoPASS), we are able to reduce the mean standard deviation of the cardiac template by at least a factor of 2 across all subjects. In addition, using LoPASS, 9 out of 10 subjects show significant (at a confidence level of 2.5%) correlation between the R-T-interval and the R-radar-interval, while using linear filters this ratio drops to 6 out of 10. Our analysis suggests that the improvement is due to better preservation of the cardiac signal morphology by the non-linear signal separation method. Hence, we expect that the non-linear signal separation method introduced in this paper will mostly benefit analysis methods investigating the cardiac radar signal morphology on a beat-to-beat basis.
Collapse
Affiliation(s)
- Yu Yao
- Translational Neuromodeling Unit, University of Zurich–ETH Zurich, Zurich, Switzerland
| | - Guanghao Sun
- Graduate School of Informatics and Engineering, The University of Electro-Communications, Tokyo, Japan
| | - Tetsuo Kirimoto
- Graduate School of Informatics and Engineering, The University of Electro-Communications, Tokyo, Japan
| | - Michael Schiek
- Central Institute ZEA-2—Electronic Systems, Research Center Jülich, Jülich, Germany
| |
Collapse
|
38
|
Liang Q, Xu L, Bao N, Qi L, Shi J, Yang Y, Yao Y. Research on Non-Contact Monitoring System for Human Physiological Signal and Body Movement. BIOSENSORS-BASEL 2019; 9:bios9020058. [PMID: 31010166 PMCID: PMC6627890 DOI: 10.3390/bios9020058] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/28/2019] [Revised: 04/12/2019] [Accepted: 04/16/2019] [Indexed: 11/16/2022]
Abstract
With the rapid increase in the development of miniaturized sensors and embedded devices for vital signs monitoring, personal physiological signal monitoring devices are becoming popular. However, physiological monitoring devices which are worn on the body normally affect the daily activities of people. This problem can be avoided by using a non-contact measuring device like the Doppler radar system, which is more convenient, is private compared to video monitoring, infrared monitoring and other non-contact methods. Additionally real-time physiological monitoring with the Doppler radar system can also obtain signal changes caused by motion changes. As a result, the Doppler radar system not only obtains the information of respiratory and cardiac signals, but also obtains information about body movement. The relevant RF technology could eliminate some interference from body motion with a small amplitude. However, the motion recognition method can also be used to classify related body motion signals. In this paper, a vital sign and body movement monitoring system worked at 2.4 GHz was proposed. It can measure various physiological signs of the human body in a non-contact manner. The accuracy of the non-contact physiological signal monitoring system was analyzed. First, the working distance of the system was tested. Then, the algorithm of mining collective motion signal was classified, and the accuracy was 88%, which could be further improved in the system. In addition, the mean absolute error values of heart rate and respiratory rate were 0.8 beats/min and 3.5 beats/min, respectively, and the reliability of the system was verified by comparing the respiratory waveforms with the contact equipment at different distances.
Collapse
Affiliation(s)
- Qiancheng Liang
- School of Sino-Dutch Biomedical and Information Engineering, Northeastern University, Shenyang 110819, China.
| | - Lisheng Xu
- School of Sino-Dutch Biomedical and Information Engineering, Northeastern University, Shenyang 110819, China.
- Neusoft Research of Intelligent Healthcare Technology, Co. Ltd., Shenyang 110167, China.
| | - Nan Bao
- School of Sino-Dutch Biomedical and Information Engineering, Northeastern University, Shenyang 110819, China.
| | - Lin Qi
- School of Sino-Dutch Biomedical and Information Engineering, Northeastern University, Shenyang 110819, China.
| | - Jingjing Shi
- School of Sino-Dutch Biomedical and Information Engineering, Northeastern University, Shenyang 110819, China.
| | - Yicheng Yang
- School of Sino-Dutch Biomedical and Information Engineering, Northeastern University, Shenyang 110819, China.
| | - Yudong Yao
- School of Sino-Dutch Biomedical and Information Engineering, Northeastern University, Shenyang 110819, China.
| |
Collapse
|
39
|
Finger-Counting-Based Gesture Recognition within Cars Using Impulse Radar with Convolutional Neural Network. SENSORS 2019; 19:s19061429. [PMID: 30909552 PMCID: PMC6470780 DOI: 10.3390/s19061429] [Citation(s) in RCA: 13] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/19/2019] [Revised: 03/13/2019] [Accepted: 03/20/2019] [Indexed: 11/17/2022]
Abstract
The diversion of a driver’s attention from driving can be catastrophic. Given that conventional button- and touch-based interfaces may distract the driver, developing novel distraction-free interfaces for the various devices present in cars has becomes necessary. Hand gesture recognition may provide an alternative interface inside cars. Given that cars are the targeted application area, we determined the optimal location for the radar sensor, so that the signal reflected from the driver’s hand during gesturing is unaffected by interference from the motion of the driver’s body or other motions within the car. We implemented a Convolutional Neural Network-based technique to recognize the finger-counting-based hand gestures using an Impulse Radio (IR) radar sensor. The accuracy of the proposed method was sufficiently high for real-world applications.
Collapse
|
40
|
Clutter Elimination and Harmonic Suppression of Non-Stationary Life Signs for Long-Range and Through-Wall Human Subject Detection Using Spectral Kurtosis Analysis (SKA)-Based Windowed Fourier Transform (WFT) Method. APPLIED SCIENCES-BASEL 2019. [DOI: 10.3390/app9020355] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
Life sign detection is important in many applications, such as locating disaster victims. This can be difficult in low signal to noise ratio (SNR) and through-wall conditions. This paper considers life sign detection using an impulse ultra-wideband (UWB) bio-radar with an improved sensing algorithm for clutter elimination, harmonic suppression and random-noise de-noising. To improve detection performance, two filters are used to improve SNR of these life signs. The automatic gain method is performed in fast time to improve the respiration signals. The spectral kurtosis analysis (SKA)-based windowed Fourier transform (WFT) method and an accumulator in the frequency domain are used to provide two distance estimates between the radar and human subject. Further, the accumulator can also provide the frequency estimate of the respiration signals. These estimates are used to determine if a human is present in the detection environment. Results are presented which show that the range and respiration frequency can be estimated accurately in low signal to noise and clutter ratio (SNCR) environments. In addition, the performance is better than with other techniques given in the literature.
Collapse
|
41
|
Random-Noise Denoising and Clutter Elimination of Human Respiration Movements Based on an Improved Time Window Selection Algorithm Using Wavelet Transform. SENSORS 2018; 19:s19010095. [PMID: 30597894 PMCID: PMC6338991 DOI: 10.3390/s19010095] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 11/19/2018] [Revised: 12/11/2018] [Accepted: 12/24/2018] [Indexed: 11/17/2022]
Abstract
This paper considers vital signs (VS) such as respiration movement detection of human subjects using an impulse ultra-wideband (UWB) through-wall radar with an improved sensing algorithm for random-noise de-noising and clutter elimination. One filter is used to improve the signal-to-noise ratio (SNR) of these VS signals. Using the wavelet packet decomposition, the standard deviation based spectral kurtosis is employed to analyze the signal characteristics to provide the distance estimate between the radar and human subject. The data size is reduced based on a defined region of interest (ROI), and this improves the system efficiency. The respiration frequency is estimated using a multiple time window selection algorithm. Experimental results are presented which illustrate the efficacy and reliability of this method. The proposed method is shown to provide better VS estimation than existing techniques in the literature.
Collapse
|
42
|
HEAR: Approach for Heartbeat Monitoring with Body Movement Compensation by IR-UWB Radar. SENSORS 2018; 18:s18093077. [PMID: 30217049 PMCID: PMC6165065 DOI: 10.3390/s18093077] [Citation(s) in RCA: 15] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 08/02/2018] [Revised: 09/01/2018] [Accepted: 09/07/2018] [Indexed: 11/16/2022]
Abstract
Further applications of impulse radio ultra-wideband radar in mobile health are hindered by the difficulty in extracting such vital signals as heartbeats from moving targets. Although the empirical mode decomposition based method is applied in recovering waveforms of heartbeats and estimating heart rates, the instantaneous heart rate is not achievable. This paper proposes a Heartbeat Estimation And Recovery (HEAR) approach to expand the application to mobile scenarios and extract instantaneous heartbeats. Firstly, the HEAR approach acquires vital signals by mapping maximum echo amplitudes to the fast time delay and compensating large body movements. Secondly, HEAR adopts the variational nonlinear chirp mode decomposition in extracting instantaneous frequencies of heartbeats. Thirdly, HEAR extends the clutter removal method based on the wavelet decomposition with a two-parameter exponential threshold. Compared to heart rates simultaneously collected by electrocardiograms (ECG), HEAR achieves a minimum error rate 4.6% in moving state and 2.25% in resting state. The Bland⁻Altman analysis verifies the consistency of beat-to-beat intervals in ECG and extracted heartbeat signals with the mean deviation smaller than 0.1 s. It indicates that HEAR is practical in offering clinical diagnoses such as the heart rate variability analysis in mobile monitoring.
Collapse
|
43
|
Schires E, Georgiou P, Lande TS. Vital Sign Monitoring Through the Back Using an UWB Impulse Radar With Body Coupled Antennas. IEEE TRANSACTIONS ON BIOMEDICAL CIRCUITS AND SYSTEMS 2018; 12:292-302. [PMID: 29570057 DOI: 10.1109/tbcas.2018.2799322] [Citation(s) in RCA: 23] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/08/2023]
Abstract
Radar devices can be used in nonintrusive situations to monitor vital sign, through clothes or behind walls. By detecting and extracting body motion linked to physiological activity, accurate simultaneous estimations of both heart rate (HR) and respiration rate (RR) is possible. However, most research to date has focused on front monitoring of superficial motion of the chest. In this paper, body penetration of electromagnetic (EM) wave is investigated to perform back monitoring of human subjects. Using body-coupled antennas and an ultra-wideband (UWB) pulsed radar, in-body monitoring of lungs and heart motion was achieved. An optimised location of measurement in the back of a subject is presented, to enhance signal-to-noise ratio and limit attenuation of reflected radar signals. Phase-based detection techniques are then investigated for back measurements of vital sign, in conjunction with frequency estimation methods that reduce the impact of parasite signals. Finally, an algorithm combining these techniques is presented to allow robust and real-time estimation of both HR and RR. Static and dynamic tests were conducted, and demonstrated the possibility of using this sensor in future health monitoring systems, especially in the form of a smart car seat for driver monitoring.
Collapse
|
44
|
Chen Z, Zhou X, Wang X, Dong L, Qian Y. Deployment of a Smart Structural Health Monitoring System for Long-Span Arch Bridges: A Review and a Case Study. SENSORS 2017; 17:s17092151. [PMID: 28925943 PMCID: PMC5621030 DOI: 10.3390/s17092151] [Citation(s) in RCA: 64] [Impact Index Per Article: 9.1] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 07/25/2017] [Revised: 09/09/2017] [Accepted: 09/11/2017] [Indexed: 11/16/2022]
Abstract
Structural health monitoring (SHM) technology for surveillance and evaluation of existing and newly built long-span bridges has been widely developed, and the significance of the technique has been recognized by many administrative authorities. The paper reviews the recent progress of the SHM technology that has been applied to long-span bridges. The deployment of a SHM system is introduced. Subsequently, the data analysis and condition assessment including techniques on modal identification, methods on signal processing, and damage identification were reviewed and summarized. A case study about a SHM system of a long-span arch bridge (the Jiubao bridge in China) was systematically incorporated in each part to advance our understanding of deployment and investigation of a SHM system for long-span arch bridges. The applications of SHM systems of long-span arch bridge were also introduced. From the illustrations, the challenges and future trends for development a SHM system were concluded.
Collapse
Affiliation(s)
- Zengshun Chen
- State Key Laboratory Breeding Base of Mountain Bridge and Tunnel Engineering, Chongqing Jiaotong University, Chongqing 400074, China.
- Department of Civil and Environmental Engineering, The Hong Kong University of Science and Technology, Hong Kong, China.
| | - Xiao Zhou
- State Key Laboratory Breeding Base of Mountain Bridge and Tunnel Engineering, Chongqing Jiaotong University, Chongqing 400074, China.
| | - Xu Wang
- State Key Laboratory Breeding Base of Mountain Bridge and Tunnel Engineering, Chongqing Jiaotong University, Chongqing 400074, China.
- The Key Laboratory for Health Monitoring and Control of Large Structures, Shijiazhuang 050043, China.
- Department of Civil and Environmental Engineering, University of Illinois Urbana-Champaign, Urbana, IL 61801, USA.
| | - Lili Dong
- State Key Laboratory Breeding Base of Mountain Bridge and Tunnel Engineering, Chongqing Jiaotong University, Chongqing 400074, China.
| | - Yuanhao Qian
- State Key Laboratory Breeding Base of Mountain Bridge and Tunnel Engineering, Chongqing Jiaotong University, Chongqing 400074, China.
| |
Collapse
|
45
|
Vital Sign Monitoring and Mobile Phone Usage Detection Using IR-UWB Radar for Intended Use in Car Crash Prevention. SENSORS 2017; 17:s17061240. [PMID: 28556818 PMCID: PMC5492499 DOI: 10.3390/s17061240] [Citation(s) in RCA: 61] [Impact Index Per Article: 8.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/23/2017] [Revised: 05/20/2017] [Accepted: 05/25/2017] [Indexed: 11/17/2022]
Abstract
In order to avoid car crashes, active safety systems are becoming more and more important. Many crashes are caused due to driver drowsiness or mobile phone usage. Detecting the drowsiness of the driver is very important for the safety of a car. Monitoring of vital signs such as respiration rate and heart rate is important to determine the occurrence of driver drowsiness. In this paper, robust vital signs monitoring through impulse radio ultra-wideband (IR-UWB) radar is discussed. We propose a new algorithm that can estimate the vital signs even if there is motion caused by the driving activities. We analyzed the whole fast time vital detection region and found the signals at those fast time locations that have useful information related to the vital signals. We segmented those signals into sub-signals and then constructed the desired vital signal using the correlation method. In this way, the vital signs of the driver can be monitored noninvasively, which can be used by researchers to detect the drowsiness of the driver which is related to the vital signs i.e., respiration and heart rate. In addition, texting on a mobile phone during driving may cause visual, manual or cognitive distraction of the driver. In order to reduce accidents caused by a distracted driver, we proposed an algorithm that can detect perfectly a driver's mobile phone usage even if there are various motions of the driver in the car or changes in background objects. These novel techniques, which monitor vital signs associated with drowsiness and detect phone usage before a driver makes a mistake, may be very helpful in developing techniques for preventing a car crash.
Collapse
|
46
|
Hand-Based Gesture Recognition for Vehicular Applications Using IR-UWB Radar. SENSORS 2017; 17:s17040833. [PMID: 28398267 PMCID: PMC5422194 DOI: 10.3390/s17040833] [Citation(s) in RCA: 17] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/26/2017] [Revised: 03/28/2017] [Accepted: 04/06/2017] [Indexed: 11/17/2022]
Abstract
Modern cars continue to offer more and more functionalities due to which they need a growing number of commands. As the driver tries to monitor the road and the graphic user interface simultaneously, his/her overall efficiency is reduced. In order to reduce the visual attention necessary for monitoring, a gesture-based user interface is very important. In this paper, gesture recognition for a vehicle through impulse radio ultra-wideband (IR-UWB) radar is discussed. The gestures can be used to control different electronic devices inside a vehicle. The gestures are based on human hand and finger motion. We have implemented a real-time version using only one radar sensor. Studies on gesture recognition using IR-UWB radar have rarely been carried out, and some studies are merely simple methods using the magnitude of the reflected signal or those whose performance deteriorates largely due to changes in distance or direction. In this study, we propose a new hand-based gesture recognition algorithm that works robustly against changes in distance or direction while responding only to defined gestures by ignoring meaningless motions. We used three independent features, i.e., variance of the probability density function (pdf) of the magnitude histogram, time of arrival (TOA) variation and the frequency of the reflected signal, to classify the gestures. A data fitting method is included to differentiate between gesture signals and unintended hand or body motions. We have used the clustering technique for the classification of the gestures. Moreover, the distance information is used as an additional input parameter to the clustering algorithm, such that the recognition technique will not be vulnerable to distance change. The hand-based gesture recognition proposed in this paper would be a key technology of future automobile user interfaces.
Collapse
|