Transfer Learning for Clinical Sleep Pose Detection Using a Single 2D IR Camera

Twistable and Stretchable Nasal Patch for Monitoring Sleep-Related Breathing Disorders Based on a Stacking Ensemble Learning Model

Obstructive sleep apnea syndrome disrupts sleep, destroys the homeostasis of biological systems such as metabolism and the immune system, and reduces learning ability and memory. The existing polysomnography used to measure sleep disorders is executed in an unfamiliar environment, which may result in sleep patterns that are different from usual, reducing accuracy. This study reports a machine learning-based personalized twistable patch system that can simply measure obstructive sleep apnea syndrome in daily life. The stretchable patch attaches directly to the nose in an integrated form factor, detecting sleep-disordered breathing by simultaneously sensing microscopic vibrations and airflow in the nasal cavity and paranasal sinuses. The highly sensitive multichannel patch, which can detect airflow at the level of 0.1 m/s, has flexibility via a unique slit pattern and fabric layer. It has linearity with an R2 of 0.992 in the case of the amount of change according to its curvature. The stacking ensemble learning model predicted the degree of sleep-disordered breathing with an accuracy of 92.9%. The approach demonstrates high sleep disorder detection capacity and proactive visual notification. It is expected to help as a diagnostic platform for the early detection of chronic diseases such as cerebrovascular disease and diabetes.

Privacy-Protected Contactless Sleep Parameters Measurement Using a Defocused Camera

Sleep monitoring plays a vital role in various scenarios such as hospitals and living-assisted homes, contributing to the prevention of sleep accidents as well as the assessment of sleep health. Contactless camera-based sleep monitoring is promising due to its user-friendly nature and rich visual semantics. However, the privacy concern of video cameras limits their applications in sleep monitoring. In this paper, we explored the opportunity of using a defocused camera that does not allow identification of the monitored subject when measuring sleep-related parameters, as face detection and recognition are impossible on optically blurred images. We proposed a novel privacy-protected sleep parameters measurement framework, including a physiological measurement branch and a semantic analysis branch based on ResNet-18. Four important sleep parameters are measured: heart rate (HR), respiration rate (RR), sleep posture, and movement. The results of HR, RR, and movement have strong correlations with the reference (HR: R = 0.9076; RR: R = 0.9734; Movement: R = 0.9946). The overall mean absolute errors (MAE) for HR and RR are 5.2 bpm and 1.5 bpm respectively. The measurement of HR and RR achieve reliable estimation coverage of 72.1% and 93.6%, respectively. The sleep posture detection achieves an overall accuracy of 94.5%. Experimental results show that the defocused camera is promising for sleep monitoring as it fundamentally eliminates the privacy issue while still allowing the measurement of multiple parameters that are essential for sleep health informatics.

A smart detection method for sleep posture based on a flexible sleep monitoring belt and vital sign signals

People spend approximately one-third of their lives in sleep, but more and more people are suffering from sleep disorders. Sleep posture is closely related to sleep quality, so related detection is very significant. In our previous work, a smart flexible sleep monitoring belt with MEMS triaxial accelerometer and pressure sensor has been developed to detect the vital signs, snore events and sleep stages. However, the method for sleep posture detection has not been studied. Therefore, to achieve high performance, low cost and comfortable experience, this paper proposes a smart detection method for sleep posture based on a flexible sleep monitoring belt and vital sign signals measured by a MEMS Inertial Measurement Unit (IMU). Statistical analysis and wavelet packet transform are applied for the feature extraction of the vital sign signals. Then the algorithm of recursive feature elimination with cross-validation is introduced to further extract the key features. Besides, machine learning models with 10-fold cross validation process, such as decision tree, random forest, support vector machine, extreme gradient boosting and adaptive boosting, were adopted to recognize the sleep posture. 15 subjects were recruited to participate the experiment. Experimental results demonstrate that the detection accuracy of the random forest algorithm is the highest among the five machine learning models, which reaches 96.02 %. Therefore, the proposed sleep posture detection method based on the flexible sleep monitoring belt is feasible and effective.

Computer Vision Technology for Monitoring of Indoor and Outdoor Environments and HVAC Equipment: A Review

Artificial intelligence technologies such as computer vision (CV), machine learning, Internet of Things (IoT), and robotics have advanced rapidly in recent years. The new technologies provide non-contact measurements in three areas: indoor environmental monitoring, outdoor environ-mental monitoring, and equipment monitoring. This paper summarizes the specific applications of non-contact measurement based on infrared images and visible images in the areas of personnel skin temperature, position posture, the urban physical environment, building construction safety, and equipment operation status. At the same time, the challenges and opportunities associated with the application of CV technology are anticipated.

Occlusion-robust Sleep Posture Detection using Body Rolling Motion in a Video

It has been reported that the monitoring of sleep postures is useful for the treatment and prevention of sleep diseases such as obstructive sleep apnea and heart failure. Camera-based sleep posture detection is attractive for the nature of comfort and convenience of use. However, the main challenge is to detect postures from images of the body that are occluded by bed sheets or covers. To address this issue, we propose a novel occlusion-robust sleep posture detection method exploiting the body rolling motion in a video. It uses the head orientation to indicate the posture direction (supine, left or right lateral), triggered by the full-body rolling motion (as a sign of posture change). The experimental results show that our proposed method, as compared with the state-of-the-art approaches such as skeleton-based (MediaPipe) and full-image ResNet based methods, obtained clear improvements on sleep posture detection with heavy body occlusions, with an averaged precision, recall and F1-score of 0.974, 0.993 and 0.983, respectively. The next step is to integrate the sleep posture detection algorithm into a camera-based sleep monitoring system for clinical validations.

Recent Progress in Long-Term Sleep Monitoring Technology

Sleep is an essential physiological activity, accounting for about one-third of our lives, which significantly impacts our memory, mood, health, and children's growth. Especially after the COVID-19 epidemic, sleep health issues have attracted more attention. In recent years, with the development of wearable electronic devices, there have been more and more studies, products, or solutions related to sleep monitoring. Many mature technologies, such as polysomnography, have been applied to clinical practice. However, it is urgent to develop wearable or non-contacting electronic devices suitable for household continuous sleep monitoring. This paper first introduces the basic knowledge of sleep and the significance of sleep monitoring. Then, according to the types of physiological signals monitored, this paper describes the research progress of bioelectrical signals, biomechanical signals, and biochemical signals used for sleep monitoring. However, it is not ideal to monitor the sleep quality for the whole night based on only one signal. Therefore, this paper reviews the research on multi-signal monitoring and introduces systematic sleep monitoring schemes. Finally, a conclusion and discussion of sleep monitoring are presented to propose potential future directions and prospects for sleep monitoring.

Contactless sleep posture measurements for demand-controlled sleep thermal comfort: A pilot study

Thermal comfort during sleep is essential for both sleep quality and human health while sleeping. There are currently few effective contactless methods for detecting the sleep thermal comfort at any time of day or night. In this paper, a vision-based detection approach for human thermal comfort while sleeping was proposed, which is intended to avoid overcooling/overheating supply, meet the thermal comfort needs of human sleep, and improve human sleep quality and health. Based on 438 valid questionnaire surveys, 10 types of thermal comfort sleep postures were summarized. By using a large number of data captured, a fundamental framework of detection algorithm was constructed to detect human sleeping postures, and corresponding weighting model was established. A total of 2.65 million frames of posture data in natural sleep status were collected, and thermal comfort-related sleep postures dataset was created. Finally, the robustness and effectiveness of the proposed algorithm were validated. The validation results show that the sleeping posture and human skeleton keypoints can be used for estimating sleeping thermal comfort, and the the quilt coverage area can be fused to improve the detection accuracy.

A Vision-Based System for In-Sleep Upper-Body and Head Pose Classification

Sleep quality is known to have a considerable impact on human health. Recent research shows that head and body pose play a vital role in affecting sleep quality. This paper presents a deep multi-task learning network to perform head and upper-body detection and pose classification during sleep. The proposed system has two major advantages: first, it detects and predicts upper-body pose and head pose simultaneously during sleep, and second, it is a contact-free home security camera-based monitoring system that can work on remote subjects, as it uses images captured by a home security camera. In addition, a synopsis of sleep postures is provided for analysis and diagnosis of sleep patterns. Experimental results show that our multi-task model achieves an average of 92.5% accuracy on challenging datasets, yields the best performance compared to the other methods, and obtains 91.7% accuracy on the real-life overnight sleep data. The proposed system can be applied reliably to extensive public sleep data with various covering conditions and is robust to real-life overnight sleep data.

Implementation of Thermal Camera for Non-Contact Physiological Measurement: A Systematic Review

Non-contact physiological measurements based on image sensors have developed rapidly in recent years. Among them, thermal cameras have the advantage of measuring temperature in the environment without light and have potential to develop physiological measurement applications. Various studies have used thermal camera to measure the physiological signals such as respiratory rate, heart rate, and body temperature. In this paper, we provided a general overview of the existing studies by examining the physiological signals of measurement, the used platforms, the thermal camera models and specifications, the use of camera fusion, the image and signal processing step (including the algorithms and tools used), and the performance evaluation. The advantages and challenges of thermal camera-based physiological measurement were also discussed. Several suggestions and prospects such as healthcare applications, machine learning, multi-parameter, and image fusion, have been proposed to improve the physiological measurement of thermal camera in the future.

An Overview on Analyzing Deep Learning and Transfer Learning Approaches for Health Monitoring

With the rise and advancement of technology, early detection and involvement in health-associated monitoring through home control are growing with population aging. The expansion of healthy life expectations is progressively significant due to the speedy aging of the world population. The patient requires early and home-based treatment to detect and prevent disease on time and with less effort. Home-based health monitoring has been considered the need of a smart home. The services of health monitoring can facilitate the patient by collecting and analyzing the data of health for tackling diverse complex issues of health at a large scale. Health monitoring is a sustainable progression of clinical trials for ensuring that health is monitored according to the defined protocol and standard operating procedures. Various scenarios can be considered for monitoring health and are performed through experts of the field. Healthcare systems are having large-scale infrastructure of electronic devices, medical information systems, wearable and smart devices, medical records, and handheld devices. The growth in medical infrastructure, combined with the development of computational approaches in healthcare, has empowered practitioners and researchers to devise a novel solution in the innovative spectra. A detailed report of the existing literature in terms of deep learning and transfer learning is the dire need and facilitating of modern healthcare. To overcome these limitations, therefore, the proposed study presents a comprehensive review of the existing approaches, techniques, and methods associated with deep learning and transfer learning for health monitoring. This review will help researchers to formulate new ideas for facilitating healthcare based on the existing evidence.