1
|
Wang Q, Cheng H, Wang W. Feasibility of Exploiting Physiological and Motion Features for Camera-based Sleep Staging: A Clinical Study. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2023; 2023:1-5. [PMID: 38082872 DOI: 10.1109/embc40787.2023.10340835] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/18/2023]
Abstract
Camera-based sleep monitoring is an emergent research topic in sleep medicine. The feasibility of using both the physiological features and motion features measured by a video camera for sleep staging was not thoroughly investigated. In this paper, we built a camera-based non-contact sleep monitoring setup in the Institute of Respiratory Diseases, Shenzhen People's Hospital, and created a clinical sleep dataset (nocturnal video data of 11 adults) including the expert-corrected PSG references synchronized with the video. The camera-based measurements have shown high correlations with the PSG. It obtains an overall Mean Absolute Error (MAE) of 1.5 bpm for heart-rate (HR), 0.7 bpm for breathing-rate (BR), 13.9 ms for heart-rate variability (HRV), and an accuracy of 93.5% for leg motion detection. The statistical analysis indicates that the averaged HR and variations of BR are distinct features for annotating four sleep stages (awake, REM, light sleep, and deep sleep). HRV parameter (SDNN) can clearly differentiate rapid-eye-movement (REM) and non-REM, while the leg movement is a distinctive feature for separating awake and sleep. The clinical trial demonstrated the feasibility of using physiological and motion features measured by a camera for joint sleep staging, and provides insights for sleep-related feature selection.
Collapse
|
2
|
Kamon M, Okada S, Furuta M, Yoshida K. Development of a non-contact sleep monitoring system for children. Front Digit Health 2022; 4:877234. [PMID: 36003190 PMCID: PMC9393414 DOI: 10.3389/fdgth.2022.877234] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/16/2022] [Accepted: 07/19/2022] [Indexed: 11/13/2022] Open
Abstract
Daily monitoring is important, even for healthy children, because sleep plays a critical role in their development and growth. Polysomnography is necessary for sleep monitoring. However, measuring sleep requires specialized equipment and knowledge and is difficult to do at home. In recent years, smartwatches and other devices have been developed to easily measure sleep. However, they cannot measure children's sleep, and contact devices may disturb their sleep.A non-contact method of measuring sleep is the use of video during sleep. This is most suitable for the daily monitoring of children’s sleep, as it is simple and inexpensive. However, the algorithms have been developed only based on adult sleep, whereas children’s sleep is known to differ considerably from that of adults.For this reason, we conducted a non-contact estimation of sleep stages for children using video. The participants were children between the ages of 0–6 years old. We estimated the four stages of sleep using the body movement information calculated from the videos recorded. Six parameters were calculated from body movement information. As children’s sleep is known to change significantly as they grow, estimation was divided into two groups (0–2 and 3–6 years).The results show average estimation accuracies of 46.7 ± 6.6 and 49.0 ± 4.8% and kappa coefficients of 0.24 ± 0.11 and 0.28 ± 0.06 in the age groups of 0–2 and 3–6 years, respectively. This performance is comparable to or better than that reported in previous adult studies.
Collapse
Affiliation(s)
- Masamitsu Kamon
- Department of Robotics, Ritsumeikan University, Shiga, Japan
- Correspondence: Masamitsu Kamon
| | - Shima Okada
- Department of Robotics, Ritsumeikan University, Shiga, Japan
| | - Masafumi Furuta
- Technology Research Laboratory, Shimadzu Corporation, Kyoto, Japan
| | - Koki Yoshida
- Technology Research Laboratory, Shimadzu Corporation, Kyoto, Japan
| |
Collapse
|
3
|
Wang Z, Zha S, Yu B, Chen P, Pang Z, Zhang H. Sleep Staging Using Noncontact-Measured Vital Signs. JOURNAL OF HEALTHCARE ENGINEERING 2022; 2022:2016598. [PMID: 35844670 PMCID: PMC9287107 DOI: 10.1155/2022/2016598] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 01/12/2022] [Revised: 05/20/2022] [Accepted: 06/13/2022] [Indexed: 11/25/2022]
Abstract
As a physiological phenomenon, sleep takes up approximately 30% of human life and significantly affects people's quality of life. To assess the quality of night sleep, polysomnography (PSG) has been recognized as the gold standard for sleep staging. The drawbacks of such a clinical device, however, are obvious, since PSG limits the patient's mobility during the night, which is inconvenient for in-home monitoring. In this paper, a noncontact vital signs monitoring system using the piezoelectric sensors is deployed. Using the so-designed noncontact sensing system, heartbeat interval (HI), respiratory interval (RI), and body movements (BM) are separated and recorded, from which a new dimension of vital signs, referred to as the coordination of heartbeat interval and respiratory interval (CHR), is obtained. By extracting both the independent features of HI, RI, and BM and the coordinated features of CHR in different timescales, Wake-REM-NREM sleep staging is performed, and a postprocessing of staging fusion algorithm is proposed to refine the accuracy of classification. A total of 17 all-night recordings of noncontact measurement simultaneous with PSG from 10 healthy subjects were examined, and the leave-one-out cross-validation was adopted to assess the performance of Wake-REM-NREM sleep staging. Taking the gold standard of PSG as reference, numerical results show that the proposed sleep staging achieves an averaged accuracy and Cohen's Kappa index of 82.42% and 0.63, respectively, and performs robust to subjects suffering from sleep-disordered breathing.
Collapse
Affiliation(s)
- Zixia Wang
- Department of Physics and Telecommunication Engineering, South China Normal University, Guangzhou 510006, China
| | - Shuai Zha
- Department of Physics and Telecommunication Engineering, South China Normal University, Guangzhou 510006, China
| | - Baoxian Yu
- Department of Electronic and Information Engineering, South China Normal University, Foshan 528000, China
- Guangdong Provincial Engineering Technology Research Center of Cardiovascular Individual Medicine & Big Data, South China Normal University, Guangzhou 510006, China
| | - Pengbin Chen
- Guangzhou SENVIV Technology Co.,Ltd., Guangzhou 510006, China
| | - Zhiqiang Pang
- Guangzhou SENVIV Technology Co.,Ltd., Guangzhou 510006, China
| | - Han Zhang
- Department of Electronic and Information Engineering, South China Normal University, Foshan 528000, China
- Guangdong Provincial Engineering Technology Research Center of Cardiovascular Individual Medicine & Big Data, South China Normal University, Guangzhou 510006, China
| |
Collapse
|
4
|
Imtiaz SA. A Systematic Review of Sensing Technologies for Wearable Sleep Staging. SENSORS (BASEL, SWITZERLAND) 2021; 21:1562. [PMID: 33668118 PMCID: PMC7956647 DOI: 10.3390/s21051562] [Citation(s) in RCA: 58] [Impact Index Per Article: 19.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 01/06/2021] [Revised: 02/13/2021] [Accepted: 02/20/2021] [Indexed: 12/15/2022]
Abstract
Designing wearable systems for sleep detection and staging is extremely challenging due to the numerous constraints associated with sensing, usability, accuracy, and regulatory requirements. Several researchers have explored the use of signals from a subset of sensors that are used in polysomnography (PSG), whereas others have demonstrated the feasibility of using alternative sensing modalities. In this paper, a systematic review of the different sensing modalities that have been used for wearable sleep staging is presented. Based on a review of 90 papers, 13 different sensing modalities are identified. Each sensing modality is explored to identify signals that can be obtained from it, the sleep stages that can be reliably identified, the classification accuracy of systems and methods using the sensing modality, as well as the usability constraints of the sensor in a wearable system. It concludes that the two most common sensing modalities in use are those based on electroencephalography (EEG) and photoplethysmography (PPG). EEG-based systems are the most accurate, with EEG being the only sensing modality capable of identifying all the stages of sleep. PPG-based systems are much simpler to use and better suited for wearable monitoring but are unable to identify all the sleep stages.
Collapse
Affiliation(s)
- Syed Anas Imtiaz
- Wearable Technologies Lab, Imperial College London, London SW7 2AZ, UK
| |
Collapse
|
5
|
Nochino T, Ohno Y, Kato T, Taniike M, Okada S. Sleep stage estimation method using a camera for home use. Biomed Eng Lett 2019; 9:257-265. [PMID: 31168430 PMCID: PMC6520421 DOI: 10.1007/s13534-019-00108-w] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/21/2018] [Revised: 03/29/2019] [Accepted: 04/01/2019] [Indexed: 10/26/2022] Open
Abstract
Recent studies have developed simple techniques for monitoring and assessing sleep. However, several issues remain to be solved for example high-cost sensor and algorithm as a home-use device. In this study, we aimed to develop an inexpensive and simple sleep monitoring system using a camera and video processing. Polysomnography (PSG) recordings were performed in six subjects for four consecutive nights. Subjects' body movements were simultaneously recorded by the web camera. Body movement was extracted by video processing from the video data and five parameters were calculated for machine learning. Four sleep stages (WAKE, LIGHT, DEEP and REM) were estimated by applying these five parameters to a support vector machine. The overall estimation accuracy was 70.3 ± 11.3% with the highest accuracy for DEEP (82.8 ± 4.7%) and the lowest for LIGHT (53.0 ± 4.0%) compared with correct sleep stages manually scored on PSG data by a sleep technician. Estimation accuracy for REM sleep was 68.0 ± 6.8%. The kappa was 0.19 ± 0.04 for all subjects. The present non-contact sleep monitoring system showed sufficient accuracy in sleep stage estimation with REM sleep detection being accomplished. Low-cost computing power of this system can be advantageous for mobile application and modularization into home-device.
Collapse
Affiliation(s)
- Teruaki Nochino
- Division of Health Sciences, Osaka University Graduation School of Medicine, 1-7, Yamadaoka, Suita, Osaka 565-0871 Japan
| | - Yuko Ohno
- Division of Health Sciences, Osaka University Graduation School of Medicine, 1-7, Yamadaoka, Suita, Osaka 565-0871 Japan
| | - Takafumi Kato
- Department of Oral Physiology, Osaka University Graduation School of Density, 1-8, Yamadaoka, Suita, Osaka 565-0871 Japan
| | - Masako Taniike
- United Graduate School of Child Development, Osaka University, 2-2 Yamadaoka, Suita, Osaka Japan
| | - Shima Okada
- Ritsumeikan University, College of Science Engineering, 1-1-1, Noji-higashi, Kusatsu, Shiga 525-8577 Japan
| |
Collapse
|
6
|
Tataraidze A, Korostovtseva L, Anishchenko L, Bochkarev M, Sviryaev Y, Ivashov S. Bioradiolocation-based sleep stage classification. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2017; 2016:2839-2842. [PMID: 28268908 DOI: 10.1109/embc.2016.7591321] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
Abstract
This paper presents a method for classifying wakefulness, REM, light and deep sleep based on the analysis of respiratory activity and body motions acquired by a bioradar. The method was validated using data of 32 subjects without sleep-disordered breathing, who underwent a polysomnography study in a sleep laboratory. We achieved Cohen's kappa of 0.49 in the wake-REM-light-deep sleep classification, 0.55 for the wake-REM-NREM classification and 0.57 for the sleep/wakefulness determination. The results might be useful for the development of unobtrusive sleep monitoring systems for diagnostics, prevention, and management of sleep disorders.
Collapse
|
7
|
Kagawa M, Suzumura K, Matsui T. Sleep stage classification by non-contact vital signs indices using Doppler radar sensors. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2017; 2016:4913-4916. [PMID: 28325016 DOI: 10.1109/embc.2016.7591829] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
Disturbed sleep has become more common in recent years. To improve the quality of sleep, undergoing sleep observation has gained interest as a means to resolve possible problems. In this paper, we evaluate a non-restrictive and non-contact method for classifying real-time sleep stages and report on its potential applications. The proposed system measures heart rate (HR), heart rate variability (HRV), body movements, and respiratory signals of a sleeping person using two 24-GHz microwave radars placed beneath the mattress. We introduce a method that dynamically selects the window width of the moving average filter to extract the pulse waves from the radar output signals. The Pearson correlation coefficient between two HR measurements derived from the radars overnight, and the reference polysomnography was the average of 88.3% and the correlation coefficient for HRV parameters was the average of 71.2%. For identifying wake and sleep periods, the body-movement index reached sensitivity of 76.0%, and a specificity of 77.0% with 10 participants. Low-frequency (LF) components of HRV and the LF/HF ratio had a high degree of contribution and differed significantly across the three sleep stages (REM, LIGHT, and DEEP; p <; 0.01). In contrast, high-frequency (HF) components of HRV were not significantly different across the three sleep stages (p > 0.05). We applied a canonical discriminant analysis to identify wake or sleep periods and to classify the three sleep stages with leave-one-out cross validation. Classification accuracy was 66.4% for simply identifying wake and sleep, 57.1% for three stages (wake, REM, and NREM) and 34% for four stages (wake, REM, LIGHT, and DEEP). This is a novel system for measuring HRs, HRV, body movements, and respiratory intervals and for measuring high sensitivity pulse waves using two radar signals. It simplifies measurement of sleep stages and may be employed at nursing care facilities or by the general public to improve sleep quality.
Collapse
|