1
|
Zhu Y, Hong H, Wang W. Privacy-Protected Contactless Sleep Parameters Measurement Using a Defocused Camera. IEEE J Biomed Health Inform 2024; 28:4660-4673. [PMID: 38696292 DOI: 10.1109/jbhi.2024.3396397] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 05/04/2024]
Abstract
Sleep monitoring plays a vital role in various scenarios such as hospitals and living-assisted homes, contributing to the prevention of sleep accidents as well as the assessment of sleep health. Contactless camera-based sleep monitoring is promising due to its user-friendly nature and rich visual semantics. However, the privacy concern of video cameras limits their applications in sleep monitoring. In this paper, we explored the opportunity of using a defocused camera that does not allow identification of the monitored subject when measuring sleep-related parameters, as face detection and recognition are impossible on optically blurred images. We proposed a novel privacy-protected sleep parameters measurement framework, including a physiological measurement branch and a semantic analysis branch based on ResNet-18. Four important sleep parameters are measured: heart rate (HR), respiration rate (RR), sleep posture, and movement. The results of HR, RR, and movement have strong correlations with the reference (HR: R = 0.9076; RR: R = 0.9734; Movement: R = 0.9946). The overall mean absolute errors (MAE) for HR and RR are 5.2 bpm and 1.5 bpm respectively. The measurement of HR and RR achieve reliable estimation coverage of 72.1% and 93.6%, respectively. The sleep posture detection achieves an overall accuracy of 94.5%. Experimental results show that the defocused camera is promising for sleep monitoring as it fundamentally eliminates the privacy issue while still allowing the measurement of multiple parameters that are essential for sleep health informatics.
Collapse
|
2
|
Liebetruth M, Kehe K, Steinritz D, Sammito S. Systematic Literature Review Regarding Heart Rate and Respiratory Rate Measurement by Means of Radar Technology. SENSORS (BASEL, SWITZERLAND) 2024; 24:1003. [PMID: 38339721 PMCID: PMC10857015 DOI: 10.3390/s24031003] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/18/2023] [Revised: 01/23/2024] [Accepted: 01/30/2024] [Indexed: 02/12/2024]
Abstract
The use of radar technology for non-contact measurement of vital parameters is increasingly being examined in scientific studies. Based on a systematic literature search in the PubMed, German National Library, Austrian Library Network (Union Catalog), Swiss National Library and Common Library Network databases, the accuracy of heart rate and/or respiratory rate measurements by means of radar technology was analyzed. In 37% of the included studies on the measurement of the respiratory rate and in 48% of those on the measurement of the heart rate, the maximum deviation was 5%. For a tolerated deviation of 10%, the corresponding percentages were 85% and 87%, respectively. However, the quantitative comparability of the results available in the current literature is very limited due to a variety of variables. The elimination of the problem of confounding variables and the continuation of the tendency to focus on the algorithm applied will continue to constitute a central topic of radar-based vital parameter measurement. Promising fields of application of research can be found in particular in areas that require non-contact measurements. This includes infection events, emergency medicine, disaster situations and major catastrophic incidents.
Collapse
Affiliation(s)
- Magdalena Liebetruth
- German Air Force Centre of Aerospace Medicine, 51147 Cologne, Germany
- Department of Occupational Medicine, Faculty of Medicine, Otto von Guericke University of Magdeburg, 39120 Magdeburg, Germany
| | - Kai Kehe
- Bundeswehr Medical Service Headquarter, Department A-VI Public Health, 56072 Koblenz, Germany
| | - Dirk Steinritz
- Bundeswehr Institute of Pharmacology and Toxicology, 80937 Munich, Germany
| | - Stefan Sammito
- German Air Force Centre of Aerospace Medicine, 51147 Cologne, Germany
- Department of Occupational Medicine, Faculty of Medicine, Otto von Guericke University of Magdeburg, 39120 Magdeburg, Germany
| |
Collapse
|
3
|
Zafar K, Siddiqui HUR, Majid A, Rustam F, Alfarhood S, Safran M, Ashraf I. Enhancing Diagnosis of Anterior and Inferior Myocardial Infarctions Using UWB Radar and AI-Driven Feature Fusion Approach. SENSORS (BASEL, SWITZERLAND) 2023; 23:7756. [PMID: 37765813 PMCID: PMC10537523 DOI: 10.3390/s23187756] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/28/2023] [Revised: 09/02/2023] [Accepted: 09/05/2023] [Indexed: 09/29/2023]
Abstract
Despite significant improvement in prognosis, myocardial infarction (MI) remains a major cause of morbidity and mortality around the globe. MI is a life-threatening cardiovascular condition that requires prompt diagnosis and appropriate treatment. The primary objective of this research is to identify instances of anterior and inferior myocardial infarction by utilizing data obtained from Ultra-wideband radar technology in a hospital for patients of anterior and inferior MI. The collected data is preprocessed to extract spectral features. A novel feature engineering approach is designed to fuse temporal features and class prediction probability features derived from the spectral feature dataset. Several well-known machine learning models are implemented and fine-tuned to obtain optimal performance in the detection of anterior and inferior MI. The results demonstrate that integration of the fused feature set with machine learning models results in a notable improvement in both the accuracy and precision of MI detection. Notably, random forest (RF) and k-nearest neighbor showed superb performance with an accuracy of 98.8%. For demonstrating the capacity of models to generalize, K-fold cross-validation is carried out, wherein RF exhibits a mean accuracy of 99.1%. Furthermore, the examination of computational complexity indicates a low computational complexity, thereby indicating computational efficiency.
Collapse
Affiliation(s)
- Kainat Zafar
- Institute of Computer Science, Khwaja Fareed University of Engineering and Information Technology, Abu Dhabi Road, Rahim Yar Khan 64200, Punjab, Pakistan; (K.Z.); (H.U.R.S.)
| | - Hafeez Ur Rehman Siddiqui
- Institute of Computer Science, Khwaja Fareed University of Engineering and Information Technology, Abu Dhabi Road, Rahim Yar Khan 64200, Punjab, Pakistan; (K.Z.); (H.U.R.S.)
| | - Abdul Majid
- Cardiology Department, Sheikh Zayed Medical College & Hospital, Rahim Yar Khan 64200, Punjab, Pakistan;
| | - Furqan Rustam
- School of Computer Science, University College Dublin, D04 V1W8 Dublin, Ireland;
| | - Sultan Alfarhood
- Department of Computer Science, College of Computer and Information Sciences, King Saud University, P.O. Box 51178, Riyadh 11543, Saudi Arabia;
| | - Mejdl Safran
- Department of Computer Science, College of Computer and Information Sciences, King Saud University, P.O. Box 51178, Riyadh 11543, Saudi Arabia;
| | - Imran Ashraf
- Department of Information and Communication Engineering, Yeungnam University, Gyeongsan 38541, Republic of Korea
| |
Collapse
|
4
|
Yuan Z, Lu S, He Y, Liu X, Fang J. Nmr-VSM: Non-Touch Motion-Robust Vital Sign Monitoring via UWB Radar Based on Deep Learning. MICROMACHINES 2023; 14:1479. [PMID: 37512790 PMCID: PMC10386750 DOI: 10.3390/mi14071479] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/30/2023] [Revised: 07/03/2023] [Accepted: 07/20/2023] [Indexed: 07/30/2023]
Abstract
In recent years, biometric radar has gained increasing attention in the field of non-touch vital sign monitoring due to its high accuracy and strong ability to detect fine-grained movements. However, most current research on biometric radar can only achieve heart rate or respiration rate monitoring in static environments, which have strict monitoring requirements and single monitoring parameters. Moreover, most studies have not applied the collected data despite their significant potential for applications. In this paper, we introduce a non-touch motion-robust vital sign monitoring system via ultra-wideband (UWB) radar based on deep learning. Nmr-VSM not only enables multi-dimensional vital sign monitoring under human motion environments but also implements cardiac anomaly detection. The design of Nmr-VSM includes three key components. Firstly, we design a UWB radar that can perform multi-dimensional vital sign monitoring, including heart rate, respiratory rate, distance, and motion status. Secondly, we collect real experimental data and analyze the impact of eight factors, such as motion status and distance, on heart rate monitoring. We then propose a deep neural network (DNN)-based heart rate data correction model that achieves high robustness in motion environments. Finally, we model the heart rate variability (HRV) of the human body and propose a convolutional neural network (CNN)-based anomaly detection model that achieves low-latency detection of heart diseases, such as ventricular tachycardia and ventricular fibrillation. Experimental results in a real environment demonstrate that Nmr-VSM can not only accurately monitor heart rate but also achieve anomaly detection with low latency.
Collapse
Affiliation(s)
- Zhonghang Yuan
- Faculty of Information Technology, Beijing University of Technology, Beijing 100124, China
| | - Shuaibing Lu
- Faculty of Information Technology, Beijing University of Technology, Beijing 100124, China
| | - Yi He
- School of Software Engineering, Beijing Jiaotong University, Beijing 100091, China
| | - Xuetao Liu
- Faculty of Information Technology, Beijing University of Technology, Beijing 100124, China
| | - Juan Fang
- Faculty of Information Technology, Beijing University of Technology, Beijing 100124, China
| |
Collapse
|
5
|
Boiko A, Martínez Madrid N, Seepold R. Contactless Technologies, Sensors, and Systems for Cardiac and Respiratory Measurement during Sleep: A Systematic Review. SENSORS (BASEL, SWITZERLAND) 2023; 23:s23115038. [PMID: 37299762 DOI: 10.3390/s23115038] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/12/2023] [Revised: 05/22/2023] [Accepted: 05/23/2023] [Indexed: 06/12/2023]
Abstract
Sleep is essential to physical and mental health. However, the traditional approach to sleep analysis-polysomnography (PSG)-is intrusive and expensive. Therefore, there is great interest in the development of non-contact, non-invasive, and non-intrusive sleep monitoring systems and technologies that can reliably and accurately measure cardiorespiratory parameters with minimal impact on the patient. This has led to the development of other relevant approaches, which are characterised, for example, by the fact that they allow greater freedom of movement and do not require direct contact with the body, i.e., they are non-contact. This systematic review discusses the relevant methods and technologies for non-contact monitoring of cardiorespiratory activity during sleep. Taking into account the current state of the art in non-intrusive technologies, we can identify the methods of non-intrusive monitoring of cardiac and respiratory activity, the technologies and types of sensors used, and the possible physiological parameters available for analysis. To do this, we conducted a literature review and summarised current research on the use of non-contact technologies for non-intrusive monitoring of cardiac and respiratory activity. The inclusion and exclusion criteria for the selection of publications were established prior to the start of the search. Publications were assessed using one main question and several specific questions. We obtained 3774 unique articles from four literature databases (Web of Science, IEEE Xplore, PubMed, and Scopus) and checked them for relevance, resulting in 54 articles that were analysed in a structured way using terminology. The result was 15 different types of sensors and devices (e.g., radar, temperature sensors, motion sensors, cameras) that can be installed in hospital wards and departments or in the environment. The ability to detect heart rate, respiratory rate, and sleep disorders such as apnoea was among the characteristics examined to investigate the overall effectiveness of the systems and technologies considered for cardiorespiratory monitoring. In addition, the advantages and disadvantages of the considered systems and technologies were identified by answering the identified research questions. The results obtained allow us to determine the current trends and the vector of development of medical technologies in sleep medicine for future researchers and research.
Collapse
Affiliation(s)
- Andrei Boiko
- Ubiquitous Computing Laboratory, Department of Computer Science, HTWG Konstanz-University of Applied Sciences, Alfred-Wachtel-Str. 8, 78462 Konstanz, Germany
| | - Natividad Martínez Madrid
- Internet of Things Laboratory, School of Informatics, Reutlingen University, Alteburgstr. 150, 72762 Reutlingen, Germany
| | - Ralf Seepold
- Ubiquitous Computing Laboratory, Department of Computer Science, HTWG Konstanz-University of Applied Sciences, Alfred-Wachtel-Str. 8, 78462 Konstanz, Germany
| |
Collapse
|
6
|
Savur C, Dautov R, Bukum K, Xia X, Couderc JP, Tsouri GR. Monitoring Pulse Rate in the Background Using Front Facing Cameras of Mobile Devices. IEEE J Biomed Health Inform 2023; 27:2208-2218. [PMID: 35939479 PMCID: PMC10244025 DOI: 10.1109/jbhi.2022.3197076] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
Abstract
We propose a novel framework to passively monitor pulse rate during the time spent by users on their personal mobile devices. Our framework is based on passively capturing the user's pulse signal using the front-facing camera. Signal capture is performed in the background, while the user is interacting with the device as he/she normally would, e.g., watch movies, read emails, text, and play games. The framework does not require subject participation with the monitoring procedure, thereby addressing the well-known problem of low adherence with such procedures. We investigate various techniques to suppress the impact of spontaneous user motion and fluctuations in ambient light conditions expected in non-participatory environments. Techniques include traditional signal processing, machine learning classifiers, and deep learning methods. Our performance evaluation is based on a clinical study encompassing 113 patients with a history of atrial fibrillation (Afib) who are passively monitored at home using a tablet for a period of two weeks. Our results show that the proposed framework accurately monitors pulse rate, thereby providing a gateway for long-term monitoring without relying on subject participation or the use of a dedicated wearable device.
Collapse
|
7
|
Lai DKH, Yu ZH, Leung TYN, Lim HJ, Tam AYC, So BPH, Mao YJ, Cheung DSK, Wong DWC, Cheung JCW. Vision Transformers (ViT) for Blanket-Penetrating Sleep Posture Recognition Using a Triple Ultra-Wideband (UWB) Radar System. SENSORS (BASEL, SWITZERLAND) 2023; 23:2475. [PMID: 36904678 PMCID: PMC10006965 DOI: 10.3390/s23052475] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 01/19/2023] [Revised: 02/16/2023] [Accepted: 02/20/2023] [Indexed: 06/18/2023]
Abstract
Sleep posture has a crucial impact on the incidence and severity of obstructive sleep apnea (OSA). Therefore, the surveillance and recognition of sleep postures could facilitate the assessment of OSA. The existing contact-based systems might interfere with sleeping, while camera-based systems introduce privacy concerns. Radar-based systems might overcome these challenges, especially when individuals are covered with blankets. The aim of this research is to develop a nonobstructive multiple ultra-wideband radar sleep posture recognition system based on machine learning models. We evaluated three single-radar configurations (top, side, and head), three dual-radar configurations (top + side, top + head, and side + head), and one tri-radar configuration (top + side + head), in addition to machine learning models, including CNN-based networks (ResNet50, DenseNet121, and EfficientNetV2) and vision transformer-based networks (traditional vision transformer and Swin Transformer V2). Thirty participants (n = 30) were invited to perform four recumbent postures (supine, left side-lying, right side-lying, and prone). Data from eighteen participants were randomly chosen for model training, another six participants' data (n = 6) for model validation, and the remaining six participants' data (n = 6) for model testing. The Swin Transformer with side and head radar configuration achieved the highest prediction accuracy (0.808). Future research may consider the application of the synthetic aperture radar technique.
Collapse
Affiliation(s)
- Derek Ka-Hei Lai
- Department of Biomedical Engineering, Faculty of Engineering, The Hong Kong Polytechnic University, Hong Kong 999077, China
| | - Zi-Han Yu
- School of Engineering Sciences, Huazhong University of Science and Technology, Wuhan 430074, China
| | - Tommy Yau-Nam Leung
- Department of Biomedical Engineering, Faculty of Engineering, The Hong Kong Polytechnic University, Hong Kong 999077, China
| | - Hyo-Jung Lim
- Department of Biomedical Engineering, Faculty of Engineering, The Hong Kong Polytechnic University, Hong Kong 999077, China
| | - Andy Yiu-Chau Tam
- Department of Biomedical Engineering, Faculty of Engineering, The Hong Kong Polytechnic University, Hong Kong 999077, China
| | - Bryan Pak-Hei So
- Department of Biomedical Engineering, Faculty of Engineering, The Hong Kong Polytechnic University, Hong Kong 999077, China
| | - Ye-Jiao Mao
- Department of Biomedical Engineering, Faculty of Engineering, The Hong Kong Polytechnic University, Hong Kong 999077, China
| | - Daphne Sze Ki Cheung
- School of Nursing, The Hong Kong Polytechnic University, Hong Kong 999077, China
| | - Duo Wai-Chi Wong
- Department of Biomedical Engineering, Faculty of Engineering, The Hong Kong Polytechnic University, Hong Kong 999077, China
| | - James Chung-Wai Cheung
- Department of Biomedical Engineering, Faculty of Engineering, The Hong Kong Polytechnic University, Hong Kong 999077, China
- Research Institute of Smart Ageing, The Hong Kong Polytechnic University, Hong Kong 999077, China
| |
Collapse
|
8
|
Lenz I, Rong Y, Bliss D. Contactless Stethoscope Enabled by Radar Technology. Bioengineering (Basel) 2023; 10:bioengineering10020169. [PMID: 36829662 PMCID: PMC9952308 DOI: 10.3390/bioengineering10020169] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/15/2022] [Revised: 01/21/2023] [Accepted: 01/24/2023] [Indexed: 01/31/2023] Open
Abstract
Contactless vital sign measurement technologies have the potential to greatly improve patient experiences and practitioner safety while creating the opportunity for comfortable continuous monitoring. We introduce a contactless alternative for measuring human heart sounds. We leverage millimeter wave frequency-modulated continuous wave radar and multi-input multi-output beamforming techniques to capture fine skin vibrations that result from the cardiac movements that cause heart sounds. We discuss contact-based heart sound measurement techniques and directly compare the radar heart sound technique with these contact-based approaches. We present experimental cases to test the strengths and limitations of both the contact-based measurement techniques and the contactless radar measurement. We demonstrate that the radar measurement technique is a viable and potentially superior method for capturing human heart sounds in many practical settings.
Collapse
Affiliation(s)
| | - Yu Rong
- Correspondence: (I.L.); (Y.R.)
| | | |
Collapse
|
9
|
Non-contact diagnosis of sleep breathing disorders using infrared optical gas imaging: a prospective observational study. Sci Rep 2022; 12:21052. [PMID: 36473950 PMCID: PMC9727032 DOI: 10.1038/s41598-022-25637-w] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/20/2022] [Accepted: 12/02/2022] [Indexed: 12/12/2022] Open
Abstract
Full-night polysomnography (PSG) is the gold standard for diagnosing obstructive sleep apnea (OSA). However, PSG requires several sensors to be attached to the patient's body, which can interfere with sleep. Moreover, non-contact devices that utilize impulse radio ultra-wideband radar have limitations as they cannot directly measure respiratory airflow. This study aimed to detect respiratory events through infrared optical gas imaging and verify its feasibility for the diagnosis of OSA. Data collection through PSG and infrared optical gas imaging was simultaneously conducted on 50 volunteers. Respiratory airflow signal was extracted from the infrared optical gas images using an automated algorithm. We compared the respiratory parameters obtained from infrared optical gas imaging with those from PSG. All respiratory events scored from the infrared optical gas imaging were strongly correlated with those identified with standard PSG sensors. Based on a receiver operating characteristic curve, infrared optical gas imaging was deemed appropriate for the diagnosis of OSA. Infrared optical gas imaging accurately detected respiratory events during sleep; therefore, it may be employed as a screening tool for OSA.
Collapse
|
10
|
Heglum HSA, Drews HJ, Kallestad H, Vethe D, Langsrud K, Sand T, Engstrøm M. Contact-free radar recordings of body movement can reflect ultradian dynamics of sleep. J Sleep Res 2022; 31:e13687. [PMID: 35794011 PMCID: PMC9786343 DOI: 10.1111/jsr.13687] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/05/2022] [Revised: 06/17/2022] [Accepted: 06/17/2022] [Indexed: 12/30/2022]
Abstract
This work aimed to evaluate if a contact-free radar sensor can be used to observe ultradian patterns in sleep physiology, by way of a data processing tool known as Locomotor Inactivity During Sleep (LIDS). LIDS was designed as a simple transformation of actigraphy recordings of wrist movement, meant to emphasise and enhance the contrast between movement and non-movement and to reveal patterns of low residual activity during sleep that correlate with ultradian REM/NREM cycles. We adapted the LIDS transformation for a radar that detects body movements without direct contact with the subject and applied it to a dataset of simultaneous recordings with polysomnography, actigraphy, and radar from healthy young adults (n = 12, four nights of polysomnography per participant). Radar and actigraphy-derived LIDS signals were highly correlated with each other (r > 0.84), and the LIDS signals were highly correlated with reduced-resolution polysomnographic hypnograms (rradars >0.80, ractigraph >0.76). Single-harmonic cosine models were fitted to LIDS signals and hypnograms; significant differences were not found between their amplitude, period, and phase parameters. Mixed model analysis revealed similar slopes of decline per cycle for radar-LIDS, actigraphy-LIDS, and hypnograms. Our results indicate that the LIDS technique can be adapted to work with contact-free radar measurements of body movement; it may also be generalisable to data from other body movement sensors. This novel metric could aid in improving sleep monitoring in clinical and real-life settings, by providing a simple and transparent way to study ultradian dynamics of sleep using nothing more than easily obtainable movement data.
Collapse
Affiliation(s)
- Hanne Siri Amdahl Heglum
- Department of Neuromedicine and Movement Science, Faculty of Medicine and Health SciencesNorwegian University of Science and Technology (NTNU)TrondheimNorway,Novelda ASTrondheimNorway
| | - Henning Johannes Drews
- Department of Mental HealthNorwegian University of Science and TechnologyTrondheimNorway,Department of Public HealthUniversity of CopenhagenCopenhagenDenmark
| | - Håvard Kallestad
- Department of Mental HealthNorwegian University of Science and TechnologyTrondheimNorway,Division of Mental Health CareSt Olavs University HospitalTrondheimNorway
| | - Daniel Vethe
- Department of Mental HealthNorwegian University of Science and TechnologyTrondheimNorway,Division of Mental Health CareSt Olavs University HospitalTrondheimNorway
| | - Knut Langsrud
- Department of Mental HealthNorwegian University of Science and TechnologyTrondheimNorway,Division of Mental Health CareSt Olavs University HospitalTrondheimNorway
| | - Trond Sand
- Department of Neuromedicine and Movement Science, Faculty of Medicine and Health SciencesNorwegian University of Science and Technology (NTNU)TrondheimNorway,Department of Neurology and Clinical NeurophysiologySt Olavs University HospitalTrondheimNorway
| | - Morten Engstrøm
- Department of Neuromedicine and Movement Science, Faculty of Medicine and Health SciencesNorwegian University of Science and Technology (NTNU)TrondheimNorway,Department of Neurology and Clinical NeurophysiologySt Olavs University HospitalTrondheimNorway
| |
Collapse
|
11
|
Lai DKH, Zha LW, Leung TYN, Tam AYC, So BPH, Lim HJ, Cheung DSK, Wong DWC, Cheung JCW. Dual ultra-wideband (UWB) radar-based sleep posture recognition system: Towards ubiquitous sleep monitoring. ENGINEERED REGENERATION 2022. [DOI: 10.1016/j.engreg.2022.11.003] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/27/2022] Open
|
12
|
Qi Q, Zhao Y, Zhang L, Yang Z, Sun L, Jia X. Research on Ultra-Wideband Radar Echo Signal Processing Method Based on P-Order Extraction and VMD. SENSORS (BASEL, SWITZERLAND) 2022; 22:6726. [PMID: 36146076 PMCID: PMC9503521 DOI: 10.3390/s22186726] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 07/21/2022] [Revised: 08/31/2022] [Accepted: 09/02/2022] [Indexed: 06/16/2023]
Abstract
As a new method to detect vital signs, Ultra-wideband (UWB) radar could continuously monitor human respiratory signs without contact. Aimed at addressing the problem of large interference and weak acquisition signal in radar echo signals from complex scenes, this paper adopts a UWB radar echo signal processing method that combines strong physical sign information extraction at P time and Variational Mode Decomposition (VMD) to carry out theoretical derivation. Using this novel processing scheme, respiration and heartbeat signals can be quickly reconstructed according to the selection of the appropriate intrinsic mode functions (IMFs), and the real-time detection accuracy of human respiratory signs is greatly improved. Based on an experimental platform, the data collected by the UWB radar module were first verified against the measured values obtained at the actual scene. The results of a validation test proved that our UWB radar echo signal processing method effectively eliminated the respiratory clutter signal and realized the accurate measurement of respiratory and heartbeat signals, which would prove the existence of life and further improve the quality of respiration and heartbeat signal and the robustness of detection.
Collapse
Affiliation(s)
- Qingjie Qi
- Emergency Science Research Academy, China Coal Research Institute, China Coal Technology & Engineering Group Co., Ltd., Beijing 100070, China
| | - Youxin Zhao
- Emergency Science Research Academy, China Coal Research Institute, China Coal Technology & Engineering Group Co., Ltd., Beijing 100070, China
| | - Liang Zhang
- Emergency Science Research Academy, China Coal Research Institute, China Coal Technology & Engineering Group Co., Ltd., Beijing 100070, China
| | - Zhen Yang
- Faculty of Electrical and Control Engineering, Liaoning Technical University, Huludao 125105, China
| | - Lifeng Sun
- Emergency Science Research Academy, China Coal Research Institute, China Coal Technology & Engineering Group Co., Ltd., Beijing 100070, China
| | - Xinlei Jia
- Emergency Science Research Academy, China Coal Research Institute, China Coal Technology & Engineering Group Co., Ltd., Beijing 100070, China
| |
Collapse
|
13
|
Ahmed S, Lee Y, Lim YH, Cho SH, Park HK, Cho SH. Noncontact assessment for fatigue based on heart rate variability using IR-UWB radar. Sci Rep 2022; 12:14211. [PMID: 35987815 PMCID: PMC9392064 DOI: 10.1038/s41598-022-18498-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/22/2022] [Accepted: 08/12/2022] [Indexed: 11/16/2022] Open
Abstract
Physical fatigue can be assessed using heart rate variability (HRV). We measured HRV at rest and in a fatigued state using impulse-radio ultra wideband (IR-UWB) radar in a noncontact fashion and compared the measurements with those obtained using electrocardiography (ECG) to assess the reliability and validity of the radar measurements. HRV was measured in 15 subjects using radar and ECG simultaneously before (rest for 10 min before exercise) and after a 20-min exercise session (fatigue level 1 for 0–9 min; fatigue level 2 for 10–19 min; recovery for ≥ 20 min after exercise). HRV was analysed in the frequency domain, including the low-frequency component (LF), high-frequency component (HF) and LF/HF ratio. The LF/HF ratio measured using radar highly agreed with that measured using ECG during rest (ICC = 0.807), fatigue-1 (ICC = 0.712), fatigue-2 (ICC = 0.741) and recovery (ICC = 0.764) in analyses using intraclass correlation coefficients (ICCs). The change pattern in the LH/HF ratios during the experiment was similar between radar and ECG. The subject’s body fat percentage was linearly associated with the time to recovery from physical fatigue (R2 = 0.96, p < 0.001). Our results demonstrated that fatigue and rest states can be distinguished accurately based on HRV measurements using IR-UWB radar in a noncontact fashion.
Collapse
|
14
|
Iyer S, Zhao L, Mohan MP, Jimeno J, Siyal MY, Alphones A, Karim MF. mm-Wave Radar-Based Vital Signs Monitoring and Arrhythmia Detection Using Machine Learning. SENSORS 2022; 22:s22093106. [PMID: 35590796 PMCID: PMC9104941 DOI: 10.3390/s22093106] [Citation(s) in RCA: 11] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/10/2022] [Revised: 03/25/2022] [Accepted: 04/13/2022] [Indexed: 11/16/2022]
Abstract
A non-contact, non-invasive monitoring system to measure and estimate the heart and breathing rate of humans using a frequency-modulated continuous wave (FMCW) mm-wave radar at 77 GHz is presented. A novel diagnostic system is proposed which extracts heartbeat phase signals from the FMCW radar (reconstructed using Fourier series analysis) to test a three-layer artificial neural network model to predict the presence of arrhythmia in individuals. The effect of person orientation, distance of measurement and movement was analyzed with respect to a reference device based on statistical measures that include number of outliers, mean, mean squared error (MSE), mean absolute error (MAE), median absolute error (medAE), skewness, standard deviation (SD) and R-squared values. The individual oriented in front of the radar outperformed almost all other orientations for most distances with an expected d = 90 cm and d = 120 cm. Furthermore, it was found that the heart rate that was measured while walking and the breathing rate which was measured for a motionless individual generated results with the lowest SD and MSE. An artificial neural network (ANN) was trained using the MIT-BIH database with a training accuracy of 93.9 % and an R2 value = 0.876. The diagnostic tool was tested on 15 subjects and achieved a mean test accuracy of 75%.
Collapse
Affiliation(s)
- Srikrishna Iyer
- School of Electrical and Electronic Engineering, Nanyang Technological University, Singapore 639798, Singapore; (S.I.); (M.P.M.); (M.Y.S.); (A.A.)
| | - Leo Zhao
- SCALE @ NTU Corp Lab, Nanyang Technological University, Singapore 639798, Singapore; (L.Z.); (J.J.)
- NCS Group, Singapore 469272, Singapore
| | - Manoj Prabhakar Mohan
- School of Electrical and Electronic Engineering, Nanyang Technological University, Singapore 639798, Singapore; (S.I.); (M.P.M.); (M.Y.S.); (A.A.)
| | - Joe Jimeno
- SCALE @ NTU Corp Lab, Nanyang Technological University, Singapore 639798, Singapore; (L.Z.); (J.J.)
- NCS Group, Singapore 469272, Singapore
| | - Mohammed Yakoob Siyal
- School of Electrical and Electronic Engineering, Nanyang Technological University, Singapore 639798, Singapore; (S.I.); (M.P.M.); (M.Y.S.); (A.A.)
- SCALE @ NTU Corp Lab, Nanyang Technological University, Singapore 639798, Singapore; (L.Z.); (J.J.)
| | - Arokiaswami Alphones
- School of Electrical and Electronic Engineering, Nanyang Technological University, Singapore 639798, Singapore; (S.I.); (M.P.M.); (M.Y.S.); (A.A.)
- SCALE @ NTU Corp Lab, Nanyang Technological University, Singapore 639798, Singapore; (L.Z.); (J.J.)
| | - Muhammad Faeyz Karim
- School of Electrical and Electronic Engineering, Nanyang Technological University, Singapore 639798, Singapore; (S.I.); (M.P.M.); (M.Y.S.); (A.A.)
- SCALE @ NTU Corp Lab, Nanyang Technological University, Singapore 639798, Singapore; (L.Z.); (J.J.)
- Correspondence:
| |
Collapse
|
15
|
Siddiqui HUR, Shahzad HF, Saleem AA, Khan Khakwani AB, Rustam F, Lee E, Ashraf I, Dudley S. Respiration Based Non-Invasive Approach for Emotion Recognition Using Impulse Radio Ultra Wide Band Radar and Machine Learning. SENSORS 2021; 21:s21248336. [PMID: 34960430 PMCID: PMC8707312 DOI: 10.3390/s21248336] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 11/02/2021] [Revised: 12/09/2021] [Accepted: 12/09/2021] [Indexed: 12/22/2022]
Abstract
Emotion recognition gained increasingly prominent attraction from a multitude of fields recently due to their wide use in human-computer interaction interface, therapy, and advanced robotics, etc. Human speech, gestures, facial expressions, and physiological signals can be used to recognize different emotions. Despite the discriminating properties to recognize emotions, the first three methods have been regarded as ineffective as the probability of human's voluntary and involuntary concealing the real emotions can not be ignored. Physiological signals, on the other hand, are capable of providing more objective, and reliable emotion recognition. Based on physiological signals, several methods have been introduced for emotion recognition, yet, predominantly such approaches are invasive involving the placement of on-body sensors. The efficacy and accuracy of these approaches are hindered by the sensor malfunctioning and erroneous data due to human limbs movement. This study presents a non-invasive approach where machine learning complements the impulse radio ultra-wideband (IR-UWB) signals for emotion recognition. First, the feasibility of using IR-UWB for emotion recognition is analyzed followed by determining the state of emotions into happiness, disgust, and fear. These emotions are triggered using carefully selected video clips to human subjects involving both males and females. The convincing evidence that different breathing patterns are linked with different emotions has been leveraged to discriminate between different emotions. Chest movement of thirty-five subjects is obtained using IR-UWB radar while watching the video clips in solitude. Extensive signal processing is applied to the obtained chest movement signals to estimate respiration rate per minute (RPM). The RPM estimated by the algorithm is validated by repeated measurements by a commercially available Pulse Oximeter. A dataset is maintained comprising gender, RPM, age, and associated emotions which are further used with several machine learning algorithms for automatic recognition of human emotions. Experiments reveal that IR-UWB possesses the potential to differentiate between different human emotions with a decent accuracy of 76% without placing any on-body sensors. Separate analysis for male and female participants reveals that males experience high arousal for happiness while females experience intense fear emotions. For disgust emotion, no large difference is found for male and female participants. To the best of the authors' knowledge, this study presents the first non-invasive approach using the IR-UWB radar for emotion recognition.
Collapse
Affiliation(s)
- Hafeez Ur Rehman Siddiqui
- Department of Computer Science, Khwaja Fareed University of Engineering and Information Technology, Rahim Yar Khan 64200, Pakistan; (H.U.R.S.); (H.F.S.); (A.A.S.); (F.R.)
| | - Hina Fatima Shahzad
- Department of Computer Science, Khwaja Fareed University of Engineering and Information Technology, Rahim Yar Khan 64200, Pakistan; (H.U.R.S.); (H.F.S.); (A.A.S.); (F.R.)
| | - Adil Ali Saleem
- Department of Computer Science, Khwaja Fareed University of Engineering and Information Technology, Rahim Yar Khan 64200, Pakistan; (H.U.R.S.); (H.F.S.); (A.A.S.); (F.R.)
| | - Abdul Baqi Khan Khakwani
- Management and Information Technology, Jubail Industrial College, Al Jubail 35718, Saudi Arabia;
| | - Furqan Rustam
- Department of Computer Science, Khwaja Fareed University of Engineering and Information Technology, Rahim Yar Khan 64200, Pakistan; (H.U.R.S.); (H.F.S.); (A.A.S.); (F.R.)
| | - Ernesto Lee
- Department of Computer Science, Broward College, Broward County, FL 33301, USA
- Correspondence: (E.L.); (I.A.)
| | - Imran Ashraf
- Department of Information and Communication Engineering, Yeungnam University, Gyeongsan 38541, Korea
- Correspondence: (E.L.); (I.A.)
| | - Sandra Dudley
- School of Engineering, London South Bank University, London SE1 0AA, UK;
| |
Collapse
|
16
|
Park JY, Lee Y, Heo R, Park HK, Cho SH, Cho SH, Lim YH. Preclinical evaluation of noncontact vital signs monitoring using real-time IR-UWB radar and factors affecting its accuracy. Sci Rep 2021; 11:23602. [PMID: 34880335 PMCID: PMC8655004 DOI: 10.1038/s41598-021-03069-2] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/04/2021] [Accepted: 11/24/2021] [Indexed: 12/03/2022] Open
Abstract
Recently, noncontact vital sign monitors have attracted attention because of issues related to the transmission of contagious diseases. We developed a real-time vital sign monitor using impulse-radio ultrawideband (IR-UWB) radar with embedded processors and software; we then evaluated its accuracy in measuring heart rate (HR) and respiratory rate (RR) and investigated the factors affecting the accuracy of the radar-based measurements. In 50 patients visiting a cardiology clinic, HR and RR were measured using IR-UWB radar simultaneously with electrocardiography and capnometry. All patients underwent HR and RR measurements in 2 postures—supine and sitting—for 2 min each. There was a high agreement between the RR measured using radar and capnometry (concordance correlation coefficient [CCC] 0.925 [0.919–0.926]; upper and lower limits of agreement [LOA], − 2.21 and 3.90 breaths/min). The HR measured using radar was also in close agreement with the value measured using electrocardiography (CCC 0.749 [0.738–0.760]; upper and lower LOA, − 12.78 and 15.04 beats/min). Linear mixed effect models showed that the sitting position and an HR < 70 bpm were associated with an increase in the absolute biases of the HR, whereas the sitting position and an RR < 18 breaths/min were associated with an increase in the absolute biases of the RR. The IR-UWB radar sensor with embedded processors and software can measure the RR and HR in real time with high precision. The sitting position and a low RR or HR were associated with the accuracy of RR and HR measurement, respectively, using IR-UWB radar.
Collapse
Affiliation(s)
- Jun-Young Park
- Department of Electronics and Computer Engineering, College of Engineering, Hanyang University, 222 Wangsimni-ro, Sungdong-gu, Seoul, 04763, Republic of Korea
| | - Yonggu Lee
- Division of Cardiology, Department of Internal Medicine, College of Medicine, Hanyang University, 222 Wangsimni-ro, Sungdong-gu, Seoul, 04763, Republic of Korea
| | - Ran Heo
- Division of Cardiology, Department of Internal Medicine, College of Medicine, Hanyang University, 222 Wangsimni-ro, Sungdong-gu, Seoul, 04763, Republic of Korea
| | - Hyun-Kyung Park
- Department of Pediatrics, College of Medicine, Hanyang University, Seoul, 04763, Republic of Korea
| | - Seok-Hyun Cho
- Department of Otorhinolaryngology, College of Medicine, Hanyang University, Seoul, 04763, Republic of Korea
| | - Sung Ho Cho
- Department of Electronics and Computer Engineering, College of Engineering, Hanyang University, 222 Wangsimni-ro, Sungdong-gu, Seoul, 04763, Republic of Korea.
| | - Young-Hyo Lim
- Division of Cardiology, Department of Internal Medicine, College of Medicine, Hanyang University, 222 Wangsimni-ro, Sungdong-gu, Seoul, 04763, Republic of Korea.
| |
Collapse
|
17
|
Contactless Simultaneous Breathing and Heart Rate Detections in Physical Activity Using IR-UWB Radars. SENSORS 2021; 21:s21165503. [PMID: 34450945 PMCID: PMC8402280 DOI: 10.3390/s21165503] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 07/20/2021] [Revised: 08/09/2021] [Accepted: 08/10/2021] [Indexed: 11/16/2022]
Abstract
Vital signs monitoring in physical activity (PA) is of great significance in daily healthcare. Impulse Radio Ultra-WideBand (IR-UWB) radar provides a contactless vital signs detection approach with advantages in range resolution and penetration. Several researches have verified the feasibility of IR-UWB radar monitoring when the target keeps still. However, various body movements are induced by PA, which lead to severe signal distortion and interfere vital signs extraction. To address this challenge, a novel joint chest-abdomen cardiopulmonary signal estimation approach is proposed to detect breath and heartbeat simultaneously using IR-UWB radars. The movements of target chest and abdomen are detected by two IR-UWB radars, respectively. Considering the signal overlapping of vital signs and body motion artifacts, Empirical Wavelet Transform (EWT) is applied on received radar signals to remove clutter and mitigate movement interference. Moreover, improved EWT with frequency segmentation refinement is applied on each radar to decompose vital signals of target chest and abdomen to vital sign-related sub-signals, respectively. After that, based on the thoracoabdominal movement correlation, cross-correlation functions are calculated among chest and abdomen sub-signals to estimate breath and heartbeat. The experiments are conducted under three kinds of PA situations and two general body movements, the results of which indicate the effectiveness and superiority of the proposed approach.
Collapse
|
18
|
Heglum HSA, Kallestad H, Vethe D, Langsrud K, Sand T, Engstrøm M. Distinguishing sleep from wake with a radar sensor: a contact-free real-time sleep monitor. Sleep 2021; 44:zsab060. [PMID: 33705555 PMCID: PMC8361351 DOI: 10.1093/sleep/zsab060] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/05/2020] [Revised: 02/07/2021] [Indexed: 11/17/2022] Open
Abstract
This work aimed to evaluate whether a radar sensor can distinguish sleep from wakefulness in real time. The sensor detects body movements without direct physical contact with the subject and can be embedded in the roof of a hospital room for completely unobtrusive monitoring. We conducted simultaneous recordings with polysomnography, actigraphy, and radar on two groups: healthy young adults (n = 12, four nights per participant) and patients referred to a sleep examination (n = 28, one night per participant). We developed models for sleep/wake classification based on principles commonly used by actigraphy, including real-time models, and tested them on both datasets. We estimated a set of commonly reported sleep parameters from these data, including total-sleep-time, sleep-onset-latency, sleep-efficiency, and wake-after-sleep-onset, and evaluated the inter-method reliability of these estimates. Classification results were on-par with, or exceeding, those often seen for actigraphy. For real-time models in healthy young adults, accuracies were above 92%, sensitivities above 95%, specificities above 83%, and all Cohen's kappa values were above 0.81 compared to polysomnography. For patients referred to a sleep examination, accuracies were above 81%, sensitivities about 89%, specificities above 53%, and Cohen's kappa values above 0.44. Sleep variable estimates showed no significant intermethod bias, but the limits of agreement were quite wide for the group of patients referred to a sleep examination. Our results indicate that the radar has the potential to offer the benefits of contact-free real-time monitoring of sleep, both for in-patients and for ambulatory home monitoring.
Collapse
Affiliation(s)
- Hanne Siri Amdahl Heglum
- Department of Neuromedicine and Movement Science, Norwegian University of Science and Technology, Trondheim, Norway
- Novelda AS, Trondheim, Norway
| | - Håvard Kallestad
- Department of Mental Health, Norwegian University of Science and Technology, Trondheim, Norway
- Division of Mental Health Care, St. Olavs University Hospital, Trondheim, Norway
| | - Daniel Vethe
- Department of Mental Health, Norwegian University of Science and Technology, Trondheim, Norway
- Division of Mental Health Care, St. Olavs University Hospital, Trondheim, Norway
| | - Knut Langsrud
- Department of Mental Health, Norwegian University of Science and Technology, Trondheim, Norway
- Division of Mental Health Care, St. Olavs University Hospital, Trondheim, Norway
| | - Trond Sand
- Department of Neuromedicine and Movement Science, Norwegian University of Science and Technology, Trondheim, Norway
- Department of Neurology and Clinical Neurophysiology, St. Olavs University Hospital, Trondheim, Norway
| | - Morten Engstrøm
- Department of Neuromedicine and Movement Science, Norwegian University of Science and Technology, Trondheim, Norway
- Department of Neurology and Clinical Neurophysiology, St. Olavs University Hospital, Trondheim, Norway
| |
Collapse
|
19
|
Piriyajitakonkij M, Warin P, Lakhan P, Leelaarporn P, Kumchaiseemak N, Suwajanakorn S, Pianpanit T, Niparnan N, Mukhopadhyay SC, Wilaiprasitporn T. SleepPoseNet: Multi-View Learning for Sleep Postural Transition Recognition Using UWB. IEEE J Biomed Health Inform 2021; 25:1305-1314. [PMID: 32960771 DOI: 10.1109/jbhi.2020.3025900] [Citation(s) in RCA: 15] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
Recognizing movements during sleep is crucial for the monitoring of patients with sleep disorders, and the utilization of ultra-wideband (UWB) radar for the classification of human sleep postures has not been explored widely. This study investigates the performance of an off-the-shelf single antenna UWB in a novel application of sleep postural transition (SPT) recognition. The proposed Multi-View Learning, entitled SleepPoseNet or SPN, with time series data augmentation aims to classify four standard SPTs. SPN exhibits an ability to capture both time and frequency features, including the movement and direction of sleeping positions. The data recorded from 38 volunteers displayed that SPN with a mean accuracy of 73.7 ±0.8 % significantly outperformed the mean accuracy of 59.9 ±0.7 % obtained from deep convolution neural network (DCNN) in recent state-of-the-art work on human activity recognition using UWB. Apart from UWB system, SPN with the data augmentation can ultimately be adopted to learn and classify time series data in various applications.
Collapse
|
20
|
Yoo S, Ahmed S, Kang S, Hwang D, Lee J, Son J, Cho SH. Radar Recorded Child Vital Sign Public Dataset and Deep Learning-Based Age Group Classification Framework for Vehicular Application. SENSORS 2021; 21:s21072412. [PMID: 33807429 PMCID: PMC8036835 DOI: 10.3390/s21072412] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/19/2021] [Revised: 03/26/2021] [Accepted: 03/29/2021] [Indexed: 11/16/2022]
Abstract
The ongoing intense development of short-range radar systems and their improved capability of measuring small movements make these systems reliable solutions for the extraction of human vital signs in a contactless fashion. The continuous contactless monitoring of vital signs can be considered in a wide range of applications, such as remote healthcare solutions and context-aware smart sensor development. Currently, the provision of radar-recorded datasets of human vital signs is still an open issue. In this paper, we present a new frequency-modulated continuous wave (FMCW) radar-recorded vital sign dataset for 50 children aged less than 13 years. A clinically approved vital sign monitoring sensor was also deployed as a reference, and data from both sensors were time-synchronized. With the presented dataset, a new child age-group classification system based on GoogLeNet is proposed to develop a child safety sensor for smart vehicles. The radar-recorded vital signs of children are divided into several age groups, and the GoogLeNet framework is trained to predict the age of unknown human test subjects.
Collapse
Affiliation(s)
- Sungwon Yoo
- Department of Electronic Engineering, Hanyang University, Seoul 04763, Korea; (S.Y.); (S.A.); (S.K.)
| | - Shahzad Ahmed
- Department of Electronic Engineering, Hanyang University, Seoul 04763, Korea; (S.Y.); (S.A.); (S.K.)
| | - Sun Kang
- Department of Electronic Engineering, Hanyang University, Seoul 04763, Korea; (S.Y.); (S.A.); (S.K.)
| | - Duhyun Hwang
- Electronics Convenience Control Evaluation Team, Hyundai Motor Company, Gyeonggi 18280, Korea; (D.H.); (J.L.); (J.S.)
| | - Jungjun Lee
- Electronics Convenience Control Evaluation Team, Hyundai Motor Company, Gyeonggi 18280, Korea; (D.H.); (J.L.); (J.S.)
| | - Jungduck Son
- Electronics Convenience Control Evaluation Team, Hyundai Motor Company, Gyeonggi 18280, Korea; (D.H.); (J.L.); (J.S.)
| | - Sung Ho Cho
- Department of Electronic Engineering, Hanyang University, Seoul 04763, Korea; (S.Y.); (S.A.); (S.K.)
- Correspondence:
| |
Collapse
|
21
|
Wang A, Nguyen D, Sridhar AR, Gollakota S. Using smart speakers to contactlessly monitor heart rhythms. Commun Biol 2021; 4:319. [PMID: 33750897 PMCID: PMC7943557 DOI: 10.1038/s42003-021-01824-9] [Citation(s) in RCA: 11] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/05/2020] [Accepted: 02/09/2021] [Indexed: 12/21/2022] Open
Abstract
Heart rhythm assessment is indispensable in diagnosis and management of many cardiac conditions and to study heart rate variability in healthy individuals. We present a proof-of-concept system for acquiring individual heart beats using smart speakers in a fully contact-free manner. Our algorithms transform the smart speaker into a short-range active sonar system and measure heart rate and inter-beat intervals (R-R intervals) for both regular and irregular rhythms. The smart speaker emits inaudible 18–22 kHz sound and receives echoes reflected from the human body that encode sub-mm displacements due to heart beats. We conducted a clinical study with both healthy participants and hospitalized cardiac patients with diverse structural and arrhythmic cardiac abnormalities including atrial fibrillation, flutter and congestive heart failure. Compared to electrocardiogram (ECG) data, our system computed R-R intervals for healthy participants with a median error of 28 ms over 12,280 heart beats and a correlation coefficient of 0.929. For hospitalized cardiac patients, the median error was 30 ms over 5639 heart beats with a correlation coefficient of 0.901. The increasing adoption of smart speakers in hospitals and homes may provide a means to realize the potential of our non-contact cardiac rhythm monitoring system for monitoring of contagious or quarantined patients, skin sensitive patients and in telemedicine settings. Anran Wang et al. present a contact-free method of monitoring individual heart beats by converting smart-speakers into active sonar systems. Their approach is capable of measuring heart rhythms with high accuracy in both healthy participants and hospitalized patients, and may be a useful healthcare tool for remote diagnosis or patient monitoring.
Collapse
Affiliation(s)
- Anran Wang
- Paul G. Allen School of Computer Science and Engineering, University of Washington, Seattle, WA, USA.
| | - Dan Nguyen
- Division of Cardiology, University of Washington, Seattle, WA, USA
| | - Arun R Sridhar
- Division of Cardiology, University of Washington, Seattle, WA, USA.
| | - Shyamnath Gollakota
- Paul G. Allen School of Computer Science and Engineering, University of Washington, Seattle, WA, USA.
| |
Collapse
|
22
|
Contactless analysis of heart rate variability during cold pressor test using radar interferometry and bidirectional LSTM networks. Sci Rep 2021; 11:3025. [PMID: 33542260 PMCID: PMC7862409 DOI: 10.1038/s41598-021-81101-1] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/13/2020] [Accepted: 01/04/2021] [Indexed: 11/08/2022] Open
Abstract
Contactless measurement of heart rate variability (HRV), which reflects changes of the autonomic nervous system (ANS) and provides crucial information on the health status of a person, would provide great benefits for both patients and doctors during prevention and aftercare. However, gold standard devices to record the HRV, such as the electrocardiograph, have the common disadvantage that they need permanent skin contact with the patient. Being connected to a monitoring device by cable reduces the mobility, comfort, and compliance by patients. Here, we present a contactless approach using a 24 GHz Six-Port-based radar system and an LSTM network for radar heart sound segmentation. The best scores are obtained using a two-layer bidirectional LSTM architecture. To verify the performance of the proposed system not only in a static measurement scenario but also during a dynamic change of HRV parameters, a stimulation of the ANS through a cold pressor test is integrated in the study design. A total of 638 minutes of data is gathered from 25 test subjects and is analysed extensively. High F-scores of over 95% are achieved for heartbeat detection. HRV indices such as HF norm are extracted with relative errors around 5%. Our proposed approach is capable to perform contactless and convenient HRV monitoring and is therefore suitable for long-term recordings in clinical environments and home-care scenarios.
Collapse
|
23
|
Feasibility of non-contact cardiorespiratory monitoring using impulse-radio ultra-wideband radar in the neonatal intensive care unit. PLoS One 2020; 15:e0243939. [PMID: 33370375 PMCID: PMC7769476 DOI: 10.1371/journal.pone.0243939] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/30/2020] [Accepted: 11/26/2020] [Indexed: 11/23/2022] Open
Abstract
Background Current cardiorespiratory monitoring equipment can cause injuries and infections in neonates with fragile skin. Impulse-radio ultra-wideband (IR-UWB) radar was recently demonstrated to be an effective contactless vital sign monitor in adults. The purpose of this study was to assess heart rates (HRs) and respiratory rates (RRs) in the neonatal intensive care unit (NICU) using IR-UWB radar and to evaluate its accuracy and reliability compared to conventional electrocardiography (ECG)/impedance pneumography (IPG). Methods The HR and RR were recorded in 34 neonates between 3 and 72 days of age during minimal movement (51 measurements in total) using IR-UWB radar (HRRd, RRRd) and ECG/IPG (HRECG, RRIPG) simultaneously. The radar signals were processed in real time using algorithms for neonates. Radar and ECG/IPG measurements were compared using concordance correlation coefficients (CCCs) and Bland-Altman plots. Results From the 34 neonates, 12,530 HR samples and 3,504 RR samples were measured. Both the HR and RR measured using the two methods were highly concordant when the neonates had minimal movements (CCC = 0.95 between the RRRd and RRIPG, CCC = 0.97 between the HRRd and HRECG). In the Bland-Altman plot, the mean biases were 0.17 breaths/min (95% limit of agreement [LOA] -7.0–7.3) between the RRRd and RRIPG and -0.23 bpm (95% LOA -5.3–4.8) between the HRRd and HRECG. Moreover, the agreement for the HR and RR measurements between the two modalities was consistently high regardless of neonate weight. Conclusions A cardiorespiratory monitor using IR-UWB radar may provide accurate non-contact HR and RR estimates without wires and electrodes for neonates in the NICU.
Collapse
|
24
|
冯 晨, 张 惠, 韩 莹, 金 霄, 杨 飞, 邹 娟, 王 岩, 李 延. [Application of impulse-radio ultra-wideband radar as a non-contact portable monitoring device for the diagnosis of obstructive sleep apnea]. LIN CHUANG ER BI YAN HOU TOU JING WAI KE ZA ZHI = JOURNAL OF CLINICAL OTORHINOLARYNGOLOGY, HEAD, AND NECK SURGERY 2020; 34:634-638. [PMID: 32791641 PMCID: PMC10133108 DOI: 10.13201/j.issn.2096-7993.2020.07.014] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Subscribe] [Scholar Register] [Received: 10/22/2019] [Indexed: 11/12/2022]
Abstract
Objective:To compare the effect of impulse-radio ultrawideband(IR-UWB) radar technology and polysomnography(PSG) in sleep assessment. Method:A total of 79 OSA patients were randomly divided into two groups: 40 patients in group A received PSG and IR-UWB, and 39 patients in group B received micromovement sensitive mattress(MSM) and IR-UWB. Pearson correlation and ROC curve were used for statistics. Result:AHI PSG and AHI MSM were significantly correlated with AHI IR-UWB(r=0.91, P=0.00; r=0.92, P=0.00). Bland-Altman analysis showed that AHI IR-UWB value was highly consistent with AHI PSG value(95.00%), and AHI IR-UWB value(97.44%). The sensitivity and specificity of AHI IR-UWB compared with PSG were 70.40% and 89.90%, respectively. The area under ROC curve was 0.915. Conclusion:IR-UWB has a high diagnostic value for adult OSA in terms of minimum blood oxygen saturation, average blood oxygen saturation, average number of central sleep apnea, average number of complex sleep apnea, average heart rate, sleep efficiency, REM sleep duration, average AHI, etc. It is an economic and practical sleep evaluation tool.
Collapse
Affiliation(s)
- 晨 冯
- 山东大学齐鲁医院耳鼻咽喉科 国家卫健委耳鼻咽喉重点实验室(济南,250014)Department of Otorhinolaryngology, Qilu Hospital of Shandong University, NHC Key Laboratory of Otorhinolaryngology, Shandong University, Jinan, 250014, China
| | - 惠栋 张
- 山东大学齐鲁医院耳鼻咽喉科 国家卫健委耳鼻咽喉重点实验室(济南,250014)Department of Otorhinolaryngology, Qilu Hospital of Shandong University, NHC Key Laboratory of Otorhinolaryngology, Shandong University, Jinan, 250014, China
| | - 莹莹 韩
- 山东大学齐鲁医院耳鼻咽喉科 国家卫健委耳鼻咽喉重点实验室(济南,250014)Department of Otorhinolaryngology, Qilu Hospital of Shandong University, NHC Key Laboratory of Otorhinolaryngology, Shandong University, Jinan, 250014, China
| | - 霄雪 金
- 山东大学齐鲁医院耳鼻咽喉科 国家卫健委耳鼻咽喉重点实验室(济南,250014)Department of Otorhinolaryngology, Qilu Hospital of Shandong University, NHC Key Laboratory of Otorhinolaryngology, Shandong University, Jinan, 250014, China
| | - 飞轮 杨
- 山东大学齐鲁医院耳鼻咽喉科 国家卫健委耳鼻咽喉重点实验室(济南,250014)Department of Otorhinolaryngology, Qilu Hospital of Shandong University, NHC Key Laboratory of Otorhinolaryngology, Shandong University, Jinan, 250014, China
| | - 娟娟 邹
- 山东大学齐鲁医院耳鼻咽喉科 国家卫健委耳鼻咽喉重点实验室(济南,250014)Department of Otorhinolaryngology, Qilu Hospital of Shandong University, NHC Key Laboratory of Otorhinolaryngology, Shandong University, Jinan, 250014, China
| | - 岩 王
- 山东大学齐鲁医院耳鼻咽喉科 国家卫健委耳鼻咽喉重点实验室(济南,250014)Department of Otorhinolaryngology, Qilu Hospital of Shandong University, NHC Key Laboratory of Otorhinolaryngology, Shandong University, Jinan, 250014, China
| | - 延忠 李
- 山东大学齐鲁医院耳鼻咽喉科 国家卫健委耳鼻咽喉重点实验室(济南,250014)Department of Otorhinolaryngology, Qilu Hospital of Shandong University, NHC Key Laboratory of Otorhinolaryngology, Shandong University, Jinan, 250014, China
| |
Collapse
|
25
|
di Biase L, Di Santo A, Caminiti ML, De Liso A, Shah SA, Ricci L, Di Lazzaro V. Gait Analysis in Parkinson's Disease: An Overview of the Most Accurate Markers for Diagnosis and Symptoms Monitoring. SENSORS (BASEL, SWITZERLAND) 2020; 20:E3529. [PMID: 32580330 PMCID: PMC7349580 DOI: 10.3390/s20123529] [Citation(s) in RCA: 72] [Impact Index Per Article: 18.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/10/2020] [Revised: 06/14/2020] [Accepted: 06/17/2020] [Indexed: 12/15/2022]
Abstract
The aim of this review is to summarize that most relevant technologies used to evaluate gait features and the associated algorithms that have shown promise to aid diagnosis and symptom monitoring in Parkinson's disease (PD) patients. We searched PubMed for studies published between 1 January 2005, and 30 August 2019 on gait analysis in PD. We selected studies that have either used technologies to distinguish PD patients from healthy subjects or stratified PD patients according to motor status or disease stages. Only those studies that reported at least 80% sensitivity and specificity were included. Gait analysis algorithms used for diagnosis showed a balanced accuracy range of 83.5-100%, sensitivity of 83.3-100% and specificity of 82-100%. For motor status discrimination the gait analysis algorithms showed a balanced accuracy range of 90.8-100%, sensitivity of 92.5-100% and specificity of 88-100%. Despite a large number of studies on the topic of objective gait analysis in PD, only a limited number of studies reported algorithms that were accurate enough deemed to be useful for diagnosis and symptoms monitoring. In addition, none of the reported algorithms and technologies has been validated in large scale, independent studies.
Collapse
Affiliation(s)
- Lazzaro di Biase
- Unit of Neurology, Neurophysiology, Neurobiology, Department of Medicine, Università Campus Bio-Medico di Roma, Via Álvaro del Portillo 21, 00128 Rome, Italy; (A.D.S.); (M.L.C.); (A.D.L.); (L.R.); (V.D.L.)
| | - Alessandro Di Santo
- Unit of Neurology, Neurophysiology, Neurobiology, Department of Medicine, Università Campus Bio-Medico di Roma, Via Álvaro del Portillo 21, 00128 Rome, Italy; (A.D.S.); (M.L.C.); (A.D.L.); (L.R.); (V.D.L.)
| | - Maria Letizia Caminiti
- Unit of Neurology, Neurophysiology, Neurobiology, Department of Medicine, Università Campus Bio-Medico di Roma, Via Álvaro del Portillo 21, 00128 Rome, Italy; (A.D.S.); (M.L.C.); (A.D.L.); (L.R.); (V.D.L.)
| | - Alfredo De Liso
- Unit of Neurology, Neurophysiology, Neurobiology, Department of Medicine, Università Campus Bio-Medico di Roma, Via Álvaro del Portillo 21, 00128 Rome, Italy; (A.D.S.); (M.L.C.); (A.D.L.); (L.R.); (V.D.L.)
| | - Syed Ahmar Shah
- Usher Institute, Edinburgh Medical School: Molecular, Genetic and Population Health Sciences, The University of Edinburgh, EH16 4UX Edinburgh, UK;
| | - Lorenzo Ricci
- Unit of Neurology, Neurophysiology, Neurobiology, Department of Medicine, Università Campus Bio-Medico di Roma, Via Álvaro del Portillo 21, 00128 Rome, Italy; (A.D.S.); (M.L.C.); (A.D.L.); (L.R.); (V.D.L.)
| | - Vincenzo Di Lazzaro
- Unit of Neurology, Neurophysiology, Neurobiology, Department of Medicine, Università Campus Bio-Medico di Roma, Via Álvaro del Portillo 21, 00128 Rome, Italy; (A.D.S.); (M.L.C.); (A.D.L.); (L.R.); (V.D.L.)
| |
Collapse
|
26
|
Khan F, Ghaffar A, Khan N, Cho SH. An Overview of Signal Processing Techniques for Remote Health Monitoring Using Impulse Radio UWB Transceiver. SENSORS 2020; 20:s20092479. [PMID: 32349382 PMCID: PMC7248922 DOI: 10.3390/s20092479] [Citation(s) in RCA: 24] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/25/2020] [Revised: 04/24/2020] [Accepted: 04/25/2020] [Indexed: 11/16/2022]
Abstract
Non-invasive remote health monitoring plays a vital role in epidemiological situations such as SARS outbreak (2003), MERS (2015) and the recently ongoing outbreak of COVID-19 because it is extremely risky to get close to the patient due to the spread of contagious infections. Non-invasive monitoring is also extremely necessary in situations where it is difficult to use complicated wired connections, such as ECG monitoring for infants, burn victims or during rescue missions when people are buried during building collapses/earthquakes. Due to the unique characteristics such as higher penetration capabilities, extremely precise ranging, low power requirement, low cost, simple hardware and robustness to multipath interferences, Impulse Radio Ultra Wideband (IR-UWB) technology is appropriate for non-invasive medical applications. IR-UWB sensors detect the macro as well as micro movement inside the human body due to its fine range resolution. The two vital signs, i.e., respiration rate and heart rate, can be measured by IR-UWB radar by measuring the change in the magnitude of signal due to displacement caused by human lungs, heart during respiration and heart beating. This paper reviews recent advances in IR- UWB radar sensor design for healthcare, such as vital signs measurements of a stationary human, vitals of a non-stationary human, vital signs of people in a vehicle, through the wall vitals measurement, neonate’s health monitoring, fall detection, sleep monitoring and medical imaging. Although we have covered many topics related to health monitoring using IR-UWB, this paper is mainly focused on signal processing techniques for measurement of vital signs, i.e., respiration and heart rate monitoring.
Collapse
Affiliation(s)
- Faheem Khan
- Department of Electronics and Computer Engineering, Hanyang University, 222 Wangsimni-ro, Seongdong-gu, Seoul 04763, Korea; (F.K.); (A.G.)
- Department of Electrical Engineering, Engineering University, Peshawar 25000, Pakistan;
| | - Asim Ghaffar
- Department of Electronics and Computer Engineering, Hanyang University, 222 Wangsimni-ro, Seongdong-gu, Seoul 04763, Korea; (F.K.); (A.G.)
| | - Naeem Khan
- Department of Electrical Engineering, Engineering University, Peshawar 25000, Pakistan;
| | - Sung Ho Cho
- Department of Electronics and Computer Engineering, Hanyang University, 222 Wangsimni-ro, Seongdong-gu, Seoul 04763, Korea; (F.K.); (A.G.)
- Correspondence:
| |
Collapse
|
27
|
Malešević N, Petrović V, Belić M, Antfolk C, Mihajlović V, Janković M. Contactless Real-Time Heartbeat Detection via 24 GHz Continuous-Wave Doppler Radar Using Artificial Neural Networks. SENSORS (BASEL, SWITZERLAND) 2020; 20:E2351. [PMID: 32326190 PMCID: PMC7219229 DOI: 10.3390/s20082351] [Citation(s) in RCA: 18] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/06/2020] [Revised: 04/16/2020] [Accepted: 04/19/2020] [Indexed: 11/22/2022]
Abstract
The measurement of human vital signs is a highly important task in a variety of environments and applications. Most notably, the electrocardiogram (ECG) is a versatile signal that could indicate various physical and psychological conditions, from signs of life to complex mental states. The measurement of the ECG relies on electrodes attached to the skin to acquire the electrical activity of the heart, which imposes certain limitations. Recently, due to the advancement of wireless technology, it has become possible to pick up heart activity in a contactless manner. Among the possible ways to wirelessly obtain information related to heart activity, methods based on mm-wave radars proved to be the most accurate in detecting the small mechanical oscillations of the human chest resulting from heartbeats. In this paper, we presented a method based on a continuous-wave Doppler radar coupled with an artificial neural network (ANN) to detect heartbeats as individual events. To keep the method computationally simple, the ANN took the raw radar signal as input, while the output was minimally processed, ensuring low latency operation (<1 s). The performance of the proposed method was evaluated with respect to an ECG reference ("ground truth") in an experiment involving 21 healthy volunteers, who were sitting on a cushioned seat and were refrained from making excessive body movements. The results indicated that the presented approach is viable for the fast detection of individual heartbeats without heavy signal preprocessing.
Collapse
Affiliation(s)
- Nebojša Malešević
- Department of Biomedical Engineering, Faculty of Engineering, Lund University, Box 118, 221 00 Lund, Sweden;
| | - Vladimir Petrović
- School of Electrical Engineering, University of Belgrade, Bulevar kralja Aleksandra 73, 11120 Belgrade, Serbia
| | - Minja Belić
- Novelic, Veljka Dugoševića 54/A3, 11000 Belgrade, Serbia; (M.B.); (V.M.)
| | - Christian Antfolk
- Department of Biomedical Engineering, Faculty of Engineering, Lund University, Box 118, 221 00 Lund, Sweden;
| | - Veljko Mihajlović
- Novelic, Veljka Dugoševića 54/A3, 11000 Belgrade, Serbia; (M.B.); (V.M.)
| | - Milica Janković
- School of Electrical Engineering, University of Belgrade, Bulevar kralja Aleksandra 73, 11120 Belgrade, Serbia
| |
Collapse
|
28
|
Guo K, Zhang Y, Fang X, Fan P, Shang S, Fan F, Wu H, Man M, Xie Y, Lu X. Effects of acute exposure to ultra-wideband pulsed electromagnetic fields on the liver and kidneys of mice. Electromagn Biol Med 2020; 39:109-122. [PMID: 32164469 DOI: 10.1080/15368378.2020.1737806] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/24/2022]
Abstract
The biosafety of ultra-wideband (UWB) pulses, which are characterized by simultaneously high power and a high bandwidth ratio, has gained increasing attention. Although there is substantial prior literature on the biological effects of UWB pulses on both cells and animals, an explicit, unequivocal and definite pattern of the corresponding biological responses remains elusive, and the systemic secondary consequences are also still not fully understood. In this study, we found that exposing mice to UWB pulses resulted in the alteration of several biochemical blood parameters, which further prompted us to investigate changes in the liver and kidneys of mice exposed to UWB pulses with different field intensities and different durations. The data demonstrated that exposure to UWB pulses significantly increased the levels of ALT and AST, increased oxidative stress, and could even induce the accumulation of lipid droplets in hepatocytes. The total number of pulses under the tested acute exposure regiment contributed most to the observed hepatic and rental dysfunction. Notably, the physiological and molecular changes recovered approximately 72 hours after exposure. These results imply the potential risk of acute exposure to UWB pulses, and highlight the meaningful targets for further long-term study of chronic exposure.
Collapse
Affiliation(s)
- Kaihong Guo
- State Key Laboratory of Intense Pulsed Radiation Simulation and Effect, Northwest Institute of Nuclear Technology, Xi'an, China.,Hybrid Rapeseed Research Center of Shaanxi Province, Shaanxi Rapeseed Branch of the National Centre for the Genetic Improvement of Oil Crops, Xi'an, China
| | - Yali Zhang
- Key Laboratory of Biomedical Information Engineering of the Ministry of Education, School of Life Science and Technology, Xi'an Jiaotong University, Xi'an, China
| | - Xinlei Fang
- Key Laboratory of Biomedical Information Engineering of the Ministry of Education, School of Life Science and Technology, Xi'an Jiaotong University, Xi'an, China
| | - Peiyao Fan
- Key Laboratory of Biomedical Information Engineering of the Ministry of Education, School of Life Science and Technology, Xi'an Jiaotong University, Xi'an, China
| | - Sen Shang
- Key Laboratory of Biomedical Information Engineering of the Ministry of Education, School of Life Science and Technology, Xi'an Jiaotong University, Xi'an, China
| | - Fan Fan
- Key Laboratory of Biomedical Information Engineering of the Ministry of Education, School of Life Science and Technology, Xi'an Jiaotong University, Xi'an, China
| | - Hongyan Wu
- Xi'an Jiaotong University Hospital, Xi'an, China
| | - Menghua Man
- Key Laboratory on Electromagnetic Effects, Shijiazhuang Campus of Army Engineering University, Shijiazhuang, China
| | - Yanzhao Xie
- State Key Laboratory of Electrical Insulation and Power Equipment, School of Electrical Engineering, Xi'an Jiaotong University, Xi'an, China
| | - Xiaoyun Lu
- Key Laboratory of Biomedical Information Engineering of the Ministry of Education, School of Life Science and Technology, Xi'an Jiaotong University, Xi'an, China
| |
Collapse
|
29
|
Non-contact diagnosis of obstructive sleep apnea using impulse-radio ultra-wideband radar. Sci Rep 2020; 10:5261. [PMID: 32210266 PMCID: PMC7093464 DOI: 10.1038/s41598-020-62061-4] [Citation(s) in RCA: 21] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/12/2019] [Accepted: 03/04/2020] [Indexed: 11/24/2022] Open
Abstract
While full-night polysomnography is the gold standard for the diagnosis of obstructive sleep apnea, its limitations include a high cost and first-night effects. This study developed an algorithm for the detection of respiratory events based on impulse-radio ultra-wideband radar and verified its feasibility for the diagnosis of obstructive sleep apnea. A total of 94 subjects were enrolled in this study (23 controls and 24, 14, and 33 with mild, moderate, and severe obstructive sleep apnea, respectively). Abnormal breathing detected by impulse-radio ultra-wideband radar was defined as a drop in the peak radar signal by ≥30% from that in the pre-event baseline. We compared the abnormal breathing index obtained from impulse-radio ultra-wideband radar and apnea–hypopnea index (AHI) measured from polysomnography. There was an excellent agreement between the Abnormal Breathing Index and AHI (intraclass correlation coefficient = 0.927). The overall agreements of the impulse-radio ultra-wideband radar were 0.93 for Model 1 (AHI ≥ 5), 0.91 for Model 2 (AHI ≥ 15), and 1 for Model 3 (AHI ≥ 30). Impulse-radio ultra-wideband radar accurately detected respiratory events (apneas and hypopneas) during sleep without subject contact. Therefore, impulse-radio ultra-wideband radar may be used as a screening tool for obstructive sleep apnea.
Collapse
|
30
|
Shi K, Schellenberger S, Will C, Steigleder T, Michler F, Fuchs J, Weigel R, Ostgathe C, Koelpin A. A dataset of radar-recorded heart sounds and vital signs including synchronised reference sensor signals. Sci Data 2020; 7:50. [PMID: 32054854 PMCID: PMC7018953 DOI: 10.1038/s41597-020-0390-1] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/23/2019] [Accepted: 01/24/2020] [Indexed: 11/10/2022] Open
Abstract
Radar systems allow for contactless measurements of vital signs such as heart sounds, the pulse signal, and respiration. This approach is able to tackle crucial disadvantages of state-of-the-art monitoring devices such as the need for permanent wiring and skin contact. Potential applications include the employment in a hospital environment but also in home care or passenger vehicles. This dataset consists of synchronised data which are acquired using a Six-Port-based radar system operating at 24 GHz, a digital stethoscope, an ECG, and a respiration sensor. 11 test subjects were measured in different defined scenarios and at several measurement positions such as at the carotid, the back, and several frontal positions on the thorax. Overall, around 223 minutes of data were acquired at scenarios such as breath-holding, post-exercise measurements, and while speaking. The presented dataset contains reference-labeled ECG signals and can therefore easily be used to either test algorithms for monitoring the heart rate, but also to gain insights about characteristic effects of radar-based vital sign monitoring. Measurement(s) | heart function measurement • heart rate • Respiration • heart sounds | Technology Type(s) | radar system | Factor Type(s) | sex • age • weight • height • BMI | Sample Characteristic - Organism | Homo sapiens |
Machine-accessible metadata file describing the reported data: 10.6084/m9.figshare.11778900
Collapse
Affiliation(s)
- Kilin Shi
- Institute for Electronics Engineering, Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU), 91058, Erlangen, Germany.
| | - Sven Schellenberger
- Chair of Electronics and Sensor Systems, Brandenburg University of Technology, 03046, Cottbus, Germany
| | - Christoph Will
- Institute for Electronics Engineering, Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU), 91058, Erlangen, Germany
| | - Tobias Steigleder
- Department of Palliative Medicine, Universitätsklinikum Erlangen, Comprehensive Cancer Center CCC Erlangen - EMN, Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU), 91054, Erlangen, Germany
| | - Fabian Michler
- Institute for Electronics Engineering, Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU), 91058, Erlangen, Germany
| | - Jonas Fuchs
- Institute for Electronics Engineering, Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU), 91058, Erlangen, Germany
| | - Robert Weigel
- Institute for Electronics Engineering, Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU), 91058, Erlangen, Germany
| | - Christoph Ostgathe
- Department of Palliative Medicine, Universitätsklinikum Erlangen, Comprehensive Cancer Center CCC Erlangen - EMN, Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU), 91054, Erlangen, Germany
| | - Alexander Koelpin
- Chair of Electronics and Sensor Systems, Brandenburg University of Technology, 03046, Cottbus, Germany
| |
Collapse
|
31
|
Blood Pressure Estimation Using On-body Continuous Wave Radar and Photoplethysmogram in Various Posture and Exercise Conditions. Sci Rep 2019; 9:16346. [PMID: 31705001 PMCID: PMC6841972 DOI: 10.1038/s41598-019-52710-8] [Citation(s) in RCA: 13] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/02/2019] [Accepted: 10/21/2019] [Indexed: 11/12/2022] Open
Abstract
The pulse arrival time (PAT), pre-ejection period (PEP) and pulse transit time (PTT) are calculated using on-body continuous wave radar (CWR), Photoplethysmogram (PPG) and Electrocardiogram (ECG) sensors for wearable continuous systolic blood pressure (SBP) measurements. The CWR and PPG sensors are placed on the sternum and left earlobe respectively. This paper presents a signal processing method based on wavelet transform and adaptive filtering to remove noise from CWR signals. Experimental data are collected from 43 subjects in various static postures and 26 subjects doing 6 different exercise tasks. Two mathematical models are used to calculate SBPs from PTTs/PATs. For 38 subjects participating in posture tasks, the best cumulative error percentage (CEP) is 92.28% and for 21 subjects participating in exercise tasks, the best CEP is 82.61%. The results show the proposed method is promising in estimating SBP using PTT. Additionally, removing PEP from PAT leads to improving results by around 9%. The CWR sensors present a low-power, continuous and potentially wearable system with minimal body contact to monitor aortic valve mechanical activities directly. Results of this study, of wearable radar sensors, demonstrate the potential superiority of CWR-based PEP extraction for various medical monitoring applications, including BP measurement.
Collapse
|
32
|
Park JY, Lee Y, Choi YW, Heo R, Park HK, Cho SH, Cho SH, Lim YH. Preclinical Evaluation of a Noncontact Simultaneous Monitoring Method for Respiration and Carotid Pulsation Using Impulse-Radio Ultra-Wideband Radar. Sci Rep 2019; 9:11892. [PMID: 31417149 PMCID: PMC6695386 DOI: 10.1038/s41598-019-48386-9] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/06/2019] [Accepted: 08/05/2019] [Indexed: 11/09/2022] Open
Abstract
There has been the possibility for respiration and carotid pulsation to be simultaneously monitored from a distance using impulse-radio ultra-wideband (IR-UWB) radar. Therefore, we investigated the validity of simultaneous respiratory rates (RR), pulse rates (PR) and R-R interval measurement using IR-UWB radar. We included 19 patients with a normal sinus rhythm (NSR) and 14 patients with persistent atrial fibrillation (PeAF). The RR, PR, R-R interval and rhythm were obtained simultaneously from the right carotid artery area in a supine position and under normal breathing conditions using IR-UWB radar. There was excellent agreement between the RR obtained by IR-UWB radar and that manually counted by a physician (intraclass correlation coefficient [ICC] 0.852). In the NSR group, there was excellent agreement between the PR (ICC 0.985), average R-R interval (ICC 0.999), and individual R-R interval (ICC 0.910) measured by IR-UWB radar and electrocardiography. In the PeAF group, PR (ICC 0.930), average R-R interval (ICC 0.957) and individual R-R interval (ICC 0.701) also agreed well between the two methods. These results demonstrate that IR-UWB radar can simultaneously monitor respiration, carotid pulse and heart rhythm with high precision and may thus be utilized as a noncontact continuous vital sign monitoring in clinical practice.
Collapse
Affiliation(s)
- Jun-Young Park
- Department of Electronics and Computer Engineering, Hanyang University, Seoul, 04763, Republic of Korea
| | - Yonggu Lee
- Division of Cardiology, Department of Internal Medicine, College of Medicine, Hanyang University, Seoul, 04763, Republic of Korea
| | - Yeon-Woo Choi
- Division of Cardiology, Department of Internal Medicine, College of Medicine, Hanyang University, Seoul, 04763, Republic of Korea
| | - Ran Heo
- Division of Cardiology, Department of Internal Medicine, College of Medicine, Hanyang University, Seoul, 04763, Republic of Korea
| | - Hyun-Kyung Park
- Department of Pediatrics, College of Medicine, Hanyang University, Seoul, 04763, Republic of Korea
| | - Seok-Hyun Cho
- Department of Otorhinolaryngology, College of Medicine, Hanyang University, Seoul, 04763, Republic of Korea
| | - Sung Ho Cho
- Department of Electronics and Computer Engineering, Hanyang University, Seoul, 04763, Republic of Korea.
| | - Young-Hyo Lim
- Division of Cardiology, Department of Internal Medicine, College of Medicine, Hanyang University, Seoul, 04763, Republic of Korea.
| |
Collapse
|
33
|
Kang S, Lee Y, Lim YH, Park HK, Cho SH, Cho SH. Validation of noncontact cardiorespiratory monitoring using impulse-radio ultra-wideband radar against nocturnal polysomnography. Sleep Breath 2019; 24:841-848. [DOI: 10.1007/s11325-019-01908-1] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/03/2019] [Revised: 07/18/2019] [Accepted: 07/24/2019] [Indexed: 12/01/2022]
|
34
|
Kim JD, Lee WH, Lee Y, Lee HJ, Cha T, Kim SH, Song KM, Lim YH, Cho SH, Cho SH, Park HK. Non-contact respiration monitoring using impulse radio ultrawideband radar in neonates. ROYAL SOCIETY OPEN SCIENCE 2019; 6:190149. [PMID: 31312485 PMCID: PMC6599793 DOI: 10.1098/rsos.190149] [Citation(s) in RCA: 27] [Impact Index Per Article: 5.4] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/07/2019] [Accepted: 05/10/2019] [Indexed: 05/04/2023]
Abstract
Vital sign monitoring in neonates requires adhesive electrodes, which often damage fragile newborn skin. Because impulse radio ultrawideband (IR-UWB) radar has been reported to recognize chest movement without contact in adult humans, IR-UWB may be used to measure respiratory rates (RRs) in a non-contact fashion. We investigated the feasibility of radar sensors for respiration monitoring in neonates without any respiratory support to compare the accuracy and reliability of radar measurements with those of conventional impedance pneumography measurements. In the neonatal intensive care unit, RRs were measured using radar (RRRd) and impedance pneumography (RRIP) simultaneously. The neonatal voluntary movements were measured using the radar sensor and categorized into three levels (low [M0], intermediate [M1] and high [M2]). RRRd highly agreed with RRIP (r = 0.90; intraclass correlation coefficient [ICC] = 0.846 [0.835-0.856]). For the M0 movement, there was good agreement between RRRd and RRIP (ICC = 0.893; mean bias -0.15 [limits of agreement (LOA) -9.6 to 10.0]). However, the agreement was slightly lower for the M1 (ICC = 0.833; mean bias = 0.95 [LOA -11.4 to 13.3]) and M2 (ICC = 0.749; mean bias = 3.04 [LOA -9.30 to 15.4]) movements than for the M0 movement. In conclusion, IR-UWB radar can provide accurate and reliable estimates of RR in neonates in a non-contact fashion. The performance of radar measurements could be affected by neonate movement.
Collapse
Affiliation(s)
- Jong Deok Kim
- Department of Pediatrics, Hanyang University College of Medicine, Seoul, Republic of Korea
| | - Won Hyuk Lee
- Department of Electronics and Computer Engineering, Hanyang University, 222 Wangsimni-ro, Seongdong-gu, Seoul 04763, Republic of Korea
| | - Yonggu Lee
- Division of Cardiology, Department of Internal Medicine, Hanyang University College of Medicine, Seoul, Republic of Korea
| | - Hyun Ju Lee
- Division of Neonatology, Department of Pediatrics, Hanyang University College of Medicine, Seoul, Republic of Korea
| | - Teahyen Cha
- Department of Pediatrics, Hanyang University College of Medicine, Seoul, Republic of Korea
| | - Seung Hyun Kim
- Department of Pediatrics, Hanyang University College of Medicine, Seoul, Republic of Korea
| | - Ki-Min Song
- Department of Health Sciences, Graduate School, Hanyang University, Seoul, Republic of Korea
| | - Young-Hyo Lim
- Division of Cardiology, Department of Internal Medicine, Hanyang University College of Medicine, Seoul, Republic of Korea
| | - Seok Hyun Cho
- Department of Otorhinolaryngology, Hanyang University College of Medicine, Seoul, Republic of Korea
| | - Sung Ho Cho
- Department of Electronics and Computer Engineering, Hanyang University, 222 Wangsimni-ro, Seongdong-gu, Seoul 04763, Republic of Korea
| | - Hyun-Kyung Park
- Division of Neonatology, Department of Pediatrics, Hanyang University College of Medicine, Seoul, Republic of Korea
| |
Collapse
|
35
|
Ye C, Toyoda K, Ohtsuki T. Blind Source Separation on Non-Contact Heartbeat Detection by Non-Negative Matrix Factorization Algorithms. IEEE Trans Biomed Eng 2019; 67:482-494. [PMID: 31071015 DOI: 10.1109/tbme.2019.2915762] [Citation(s) in RCA: 21] [Impact Index Per Article: 4.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
Abstract
In non-contact heart rate (HR) monitoring via Doppler radar, the disturbance from respiration and/or body motion is treated as a key problem on the estimation of HR. This paper proposes a blind source separation (BSS) approach to mitigate the noise effect in the received radar signal, and incorporates the sparse spectrum reconstruction to achieve a high-resolution of heartbeat spectrum. The proposed BSS decomposes the spectrogram of mixture signal into original sources, including heartbeat, using non-negative matrix factorization (NMF) algorithms, through learning the complete basis spectra (BS) by a hierarchical clustering. In particular, to exploit the temporal sparsity of heartbeat component, two variants of NMF algorithms with sparseness constraints are applied as well, namely sparse NMF and weighted sparse NMF. Compared with usual BSS, our proposed BSS has three advantages: 1) clustering-induced unsupervised manner; 2) compact demixing architecture; and 3) merely requiring single-channel input data. In addition, the HR estimation method using our proposal delivers more satisfactory precision and robustness over other existing methods, which is demonstrated through the measurements of distinguishing people's activities, gaining both smallest absolute errors of HR estimation for sitting still and typewriting.
Collapse
|