Sleep staging using nocturnal sound analysis

A perspective on automated rapid eye movement sleep assessment

Rapid eye movement sleep is associated with distinct changes in various biomedical signals that can be easily captured during sleep, lending themselves to automated sleep staging using machine learning systems. Here, we provide a perspective on the critical characteristics of biomedical signals associated with rapid eye movement sleep and how they can be exploited for automated sleep assessment. We summarise key historical developments in automated sleep staging systems, having now achieved classification accuracy on par with human expert scorers and their role in the clinical setting. We also discuss rapid eye movement sleep assessment with consumer sleep trackers and its potential for unprecedented sleep assessment on a global scale. We conclude by providing a future outlook of computerised rapid eye movement sleep assessment and the role AI systems may play.

Development of generalizable automatic sleep staging using heart rate and movement based on large databases

Purpose

With the advancement of deep neural networks in biosignals processing, the performance of automatic sleep staging algorithms has improved significantly. However, sleep staging using only non-electroencephalogram features has not been as successful, especially following the current American Association of Sleep Medicine (AASM) standards. This study presents a fine-tuning based approach to widely generalizable automatic sleep staging using heart rate and movement features trained and validated on large databases of polysomnography.

Methods

A deep neural network is used to predict sleep stages using heart rate and movement features. The model is optimized on a dataset of 8731 nights of polysomnography recordings labeled using the Rechtschaffen & Kales scoring system, and fine-tuned to a smaller dataset of 1641 AASM-labeled recordings. The model prior to and after fine-tuning is validated on two AASM-labeled external datasets totaling 1183 recordings. In order to measure the performance of the model, the output of the optimized model is compared to reference expert-labeled sleep stages using accuracy and Cohen's κ as key metrics.

Results

The fine-tuned model showed accuracy of 76.6% with Cohen's κ of 0.606 in one of the external validation datasets, outperforming a previously reported result, and showed accuracy of 81.0% with Cohen's κ of 0.673 in another external validation dataset.

Conclusion

These results indicate that the proposed model is generalizable and effective in predicting sleep stages using features which can be extracted from non-contact sleep monitors. This holds valuable implications for future development of home sleep evaluation systems.

Toward Personalized Medicine Approaches for Parkinson Disease Using Digital Technologies

Parkinson disease (PD) is a complex neurodegenerative disorder that afflicts over 10 million people worldwide, resulting in debilitating motor and cognitive impairment. In the United States alone (with approximately 1 million cases), the economic burden for treating and caring for persons with PD exceeds US $50 billion and myriad therapeutic approaches are under development, including both symptomatic- and disease-modifying agents. The challenges presented in addressing PD are compounded by observations that numerous, statistically distinct patient phenotypes present with a wide variety of motor and nonmotor symptomatic profiles, varying responses to current standard-of-care symptom-alleviating medications (L-DOPA and dopaminergic agonists), and different disease trajectories. The existence of these differing phenotypes highlights the opportunities in personalized approaches to symptom management and disease control. The prodromal period of PD can span across several decades, allowing the potential to leverage the unique array of composite symptoms presented to trigger early interventions. This may be especially beneficial as disease progression in PD (alongside Alzheimer disease and Huntington disease) may be influenced by biological processes such as oxidative stress, offering the potential for individual lifestyle factors to be tailored to delay disease onset. In this viewpoint, we offer potential scenarios where emerging diagnostic and monitoring strategies might be tailored to the individual patient under the tenets of P4 medicine (predict, prevent, personalize, and participate). These approaches may be especially relevant as the causative factors and biochemical pathways responsible for the observed neurodegeneration in patients with PD remain areas of fluid debate. The numerous observational patient cohorts established globally offer an excellent opportunity to test and refine approaches to detect, characterize, control, modify the course, and ultimately stop progression of this debilitating disease. Such approaches may also help development of parallel interventive strategies in other diseases such as Alzheimer disease and Huntington disease, which share common traits and etiologies with PD. In this overview, we highlight near-term opportunities to apply P4 medicine principles for patients with PD and introduce the concept of composite orthogonal patient monitoring.

Technologies for sleep monitoring at home: wearables and nearables

Sleep is an essential part of our lives and daily sleep monitoring is crucial for maintaining good health and well-being. Traditionally, the gold standard method for sleep monitoring is polysomnography using various sensors attached to the body; however, it is limited with regards to long-term sleep monitoring in a home environment. Recent advancements in wearable and nearable technology have made it possible to monitor sleep at home. In this review paper, the technologies that are currently available for sleep stages and sleep disorder monitoring at home are reviewed using wearable and nearable devices. Wearables are devices that are worn on the body, while nearables are placed near the body. These devices can accurately monitor sleep stages and sleep disorder in a home environment. In this study, the benefits and limitations of each technology are discussed, along with their potential to improve sleep quality.

Spotlight on Sleep Stage Classification Based on EEG

The recommendations for identifying sleep stages based on the interpretation of electrophysiological signals (electroencephalography [EEG], electro-oculography [EOG], and electromyography [EMG]), derived from the Rechtschaffen and Kales manual, were published in 2007 at the initiative of the American Academy of Sleep Medicine, and regularly updated over years. They offer an important tool to assess objective markers in different types of sleep/wake subjective complaints. With the aims and advantages of simplicity, reproducibility and standardization of practices in research and, most of all, in sleep medicine, they have overall changed little in the way they describe sleep. However, our knowledge on sleep/wake physiology and sleep disorders has evolved since then. High-density electroencephalography and intracranial electroencephalography studies have highlighted local regulation of sleep mechanisms, with spatio-temporal heterogeneity in vigilance states. Progress in the understanding of sleep disorders has allowed the identification of electrophysiological biomarkers better correlated with clinical symptoms and outcomes than standard sleep parameters. Finally, the huge development of sleep medicine, with a demand for explorations far exceeding the supply, has led to the development of alternative studies, which can be carried out at home, based on a smaller number of electrophysiological signals and on their automatic analysis. In this perspective article, we aim to examine how our description of sleep has been constructed, has evolved, and may still be reshaped in the light of advances in knowledge of sleep physiology and the development of technical recording and analysis tools. After presenting the strengths and limitations of the classification of sleep stages, we propose to challenge the "EEG-EOG-EMG" paradigm by discussing the physiological signals required for sleep stages identification, provide an overview of new tools and automatic analysis methods and propose avenues for the development of new approaches to describe and understand sleep/wake states.

Alternatives to Polysomnography for the Diagnosis of Pediatric Obstructive Sleep Apnea

Diagnosis of obstructive sleep apnea (OSA) in children with sleep-disordered breathing (SDB) requires hospital-based, overnight level I polysomnography (PSG). Obtaining a level I PSG can be challenging for children and their caregivers due to the costs, barriers to access, and associated discomfort. Less burdensome methods that approximate pediatric PSG data are needed. The goal of this review is to evaluate and discuss alternatives for evaluating pediatric SDB. To date, wearable devices, single-channel recordings, and home-based PSG have not been validated as suitable replacements for PSG. However, they may play a role in risk stratification or as screening tools for pediatric OSA. Further studies are needed to determine if the combined use of these metrics could predict OSA.

Multi-feature fusion and improved BO and IGWO metaheuristics based models for automatically diagnosing the sleep disorders from sleep sounds

A night of regular and quality sleep is vital in human life. Sleep quality has a great impact on the daily life of people and those around them. Sounds such as snoring reduce not only the sleep quality of the person but also reduce the sleep quality of the partner. Sleep disorders can be eliminated by examining the sounds that people make at night. It is a very difficult process to follow and treat this process by experts. Therefore, this study, it is aimed to diagnose sleep disorders using computer-aided systems. In the study, the used data set contains seven hundred sound data which has seven different sound class such as cough, farting, laugh, scream, sneeze, sniffle, and snore. In the model proposed in the study, firstly, the feature maps of the sound signals in the data set were extracted. Three different methods were used in the feature extraction process. These methods are MFCC, Mel-spectrogram, and Chroma. The features extracted in these three methods are combined. Thanks to this method, the features of the same sound signal extracted in three different methods are used. This increases the performance of the proposed model. Later, the combined feature maps were analyzed using the proposed New Improved Gray Wolf Optimization (NI-GWO), which is the improved version of the Improved Gray Wolf Optimization (I-GWO) algorithm, and the proposed Improved Bonobo Optimizer (IBO) algorithm, which is the improved version of the Bonobo Optimizer (BO). In this way, it is aimed to run the models faster, reduce the number of features, and obtain the most optimum result. Finally, Support Vector Machine (SVM) and k-nearest neighbors (KNN) supervised shallow machine learning methods were used to calculate the metaheuristic algorithms' fitness values. Different types of metrics such as accuracy, sensitivity, F1 etc., were used for the performance comparison. Using the feature maps optimized by the proposed NI-GWO and IBO algorithms, the highest accuracy value was obtained from the SVM classifier with 99.28% for both metaheuristic algorithms.

Validity and reliability of the Japanese version of the severity hierarchy score for pediatric obstructive sleep apnea screening

OBJECTIVE

This study aimed to evaluate the validity and reliability of the Japanese version of the severity hierarchy score (J-SHS) in the screening of pediatric obstructive sleep apnea (OSA) among Japanese community children.

METHODS

A total of 922 children from elementary schools in Tokyo were recruited. Their parents completed the J-SHS questionnaire, and the children underwent an overnight Tracheal Sound (TS) recording. The reliability of the J-SHS was assessed by Cronbach's alpha coefficients and Spearman's correlation. Construct validity was determined by factor analysis. The discriminative ability to diagnose OSA was evaluated by constructing ROC curves.

RESULTS

Five hundred and seventeen children (51.8% male, mean age 7.1 ± 0.7 years) were included. Cronbach's alpha coefficient was 0.80. Factor analysis resulted in a two-factor structure, with factor loadings all above 0.4. A J-SHS score of >1.88 exhibited a 60% sensitivity, 93% specificity, and an area under the curve (AUC) of 0.78 for detecting an apnea-hypopnea index (AHI) of ≥5/h; a J-SHS score of >2.06 exhibited a 75% sensitivity, 84% specificity and AUC of 0.84 for detecting an AHI of ≥3/h among the children with a snoring frequency above two nights/wk.

CONCLUSION

The J-SHS exhibits good performance as a screening tool providing a quick and straightforward approach for identifying Japanese children at risk for OSA.

Evaluating Prediction Models of Sleep Apnea From Smartphone-Recorded Sleep Breathing Sounds

Importance

Breathing sounds during sleep are an important characteristic feature of obstructive sleep apnea (OSA) and have been regarded as a potential biomarker. Breathing sounds during sleep can be easily recorded using a microphone, which is found in most smartphone devices. Therefore, it may be easy to implement an evaluation tool for prescreening purposes.

Objective

To evaluate OSA prediction models using smartphone-recorded sounds and identify optimal settings with regard to noise processing and sound feature selection.

Design, Setting, and Participants

A cross-sectional study was performed among patients who visited the sleep center of Seoul National University Bundang Hospital for snoring or sleep apnea from August 2015 to August 2019. Audio recordings during sleep were performed using a smartphone during routine, full-night, in-laboratory polysomnography. Using a random forest algorithm, binary classifications were separately conducted for 3 different threshold criteria according to an apnea hypopnea index (AHI) threshold of 5, 15, or 30 events/h. Four regression models were created according to noise reduction and feature selection from the input sound to predict actual AHI: (1) noise reduction without feature selection, (2) noise reduction with feature selection, (3) neither noise reduction nor feature selection, and (4) feature selection without noise reduction. Clinical and polysomnographic parameters that may have been associated with errors were assessed. Data were analyzed from September 2019 to September 2020.

Main Outcomes and Measures

Accuracy of OSA prediction models.

Results

A total of 423 patients (mean [SD] age, 48.1 [12.8] years; 356 [84.1%] male) were analyzed. Data were split into training (n = 256 [60.5%]) and test data sets (n = 167 [39.5%]). Accuracies were 88.2%, 82.3%, and 81.7%, and the areas under curve were 0.90, 0.89, and 0.90 for an AHI threshold of 5, 15, and 30 events/h, respectively. In the regression analysis, using recorded sounds that had not been denoised and had only selected attributes resulted in the highest correlation coefficient (r = 0.78; 95% CI, 0.69-0.88). The AHI (β = 0.33; 95% CI, 0.24-0.42) and sleep efficiency (β = -0.20; 95% CI, -0.35 to -0.05) were found to be associated with estimation error.

Conclusions and Relevance

In this cross-sectional study, recorded sleep breathing sounds using a smartphone were used to create reasonably accurate OSA prediction models. Future research should focus on real-life recordings using various smartphone devices.

Automatic sleep staging of EEG signals: recent development, challenges, and future directions

Modern deep learning holds a great potential to transform clinical practice on human sleep. Teaching a machine to carry out routine tasks would be a tremendous reduction in workload for clinicians. Sleep staging, a fundamental step in sleep practice, is a suitable task for this and will be the focus in this article. Recently, automatic sleep staging systems have been trained to mimic manual scoring, leading to similar performance to human sleep experts, at least on scoring of healthy subjects. Despite tremendous progress, we have not seen automatic sleep scoring adopted widely in clinical environments. This review aims to give a shared view of the authors on the most recent state-of-the-art development in automatic sleep staging, the challenges that still need to be addressed, and the future directions for automatic sleep scoring to achieve clinical value.

Smart Speakers: The Next Frontier in mHealth

The rapid dissemination and adoption of smart speakers has enabled substantial opportunities to improve human health. Just as the introduction of the mobile phone led to considerable health innovation, smart speaker computing systems carry several unique advantages that have the potential to catalyze new fields of health research, particularly in out-of-hospital environments. The recent rise and ubiquity of these smart computing systems holds significant potential for enhancing chronic disease management, enabling passive identification of unwitnessed medical emergencies, detecting subtle changes in human behavior and cognition, limiting isolation, and potentially allowing widespread, passive, remote monitoring of respiratory diseases that impact public health. There are 3 broad mechanisms for how a smart speaker can interact with a person to improve health. These include (1) as an intelligent conversational agent, (2) as a passive identifier of medically relevant diagnostic sounds, and (3) by active sensing using the device's internal hardware to measure physiologic parameters, such as with active sonar, radar, or computer vision. Each of these different modalities has specific clinical use cases, all of which need to be balanced against potential privacy concerns, equity concerns related to system access, and regulatory frameworks which have not yet been developed for this unique type of passive data collection.

Cough detection using a non-contact microphone: A nocturnal cough study

An automatic non-contact cough detector designed especially for night audio recordings that can distinguish coughs from snores and other sounds is presented. Two different classifiers were implemented and tested: a Gaussian Mixture Model (GMM) and a Deep Neural Network (DNN). The detected coughs were analyzed and compared in different sleep stages and in terms of severity of Obstructive Sleep Apnea (OSA), along with age, Body Mass Index (BMI), and gender. The database was composed of nocturnal audio signals from 89 subjects recorded during a polysomnography study. The DNN-based system outperformed the GMM-based system, at 99.8% accuracy, with a sensitivity and specificity of 86.1% and 99.9%, respectively (Positive Predictive Value (PPV) of 78.4%). Cough events were significantly more frequent during wakefulness than in the sleep stages (p < 0.0001) and were significantly less frequent during deep sleep than in other sleep stages (p < 0.0001). A positive correlation was found between BMI and the number of nocturnal coughs (R = 0.232, p < 0.05), and between the number of nocturnal coughs and OSA severity in men (R = 0.278, p < 0.05). This non-contact cough detection system may thus be implemented to track the progression of respiratory illnesses and test reactions to different medications even at night when a contact sensor is uncomfortable or infeasible.

End-to-End Sleep Staging Using Nocturnal Sounds from Microphone Chips for Mobile Devices

PURPOSE

Nocturnal sounds contain numerous information and are easily obtainable by a non-contact manner. Sleep staging using nocturnal sounds recorded from common mobile devices may allow daily at-home sleep tracking. The objective of this study is to introduce an end-to-end (sound-to-sleep stages) deep learning model for sound-based sleep staging designed to work with audio from microphone chips, which are essential in mobile devices such as modern smartphones.

PATIENTS AND METHODS

Two different audio datasets were used: audio data routinely recorded by a solitary microphone chip during polysomnography (PSG dataset, N=1154) and audio data recorded by a smartphone (smartphone dataset, N=327). The audio was converted into Mel spectrogram to detect latent temporal frequency patterns of breathing and body movement from ambient noise. The proposed neural network model learns to first extract features from each 30-second epoch and then analyze inter-epoch relationships of extracted features to finally classify the epochs into sleep stages.

RESULTS

Our model achieved 70% epoch-by-epoch agreement for 4-class (wake, light, deep, REM) sleep stage classification and robust performance across various signal-to-noise conditions. The model performance was not considerably affected by sleep apnea or periodic limb movement. External validation with smartphone dataset also showed 68% epoch-by-epoch agreement.

CONCLUSION

The proposed end-to-end deep learning model shows potential of low-quality sounds recorded from microphone chips to be utilized for sleep staging. Future study using nocturnal sounds recorded from mobile devices at home environment may further confirm the use of mobile device recording as an at-home sleep tracker.

Prediction of Oxygen Desaturation by Using Sound Data From a Noncontact Device: A Proof-of-Concept Study

OBJECTIVES/HYPOTHESIS

Prediction of the apnea-hypopnea index (AHI) from breathing sounds during sleep could be used to prescreen for obstructive sleep apnea (OSA). In addition, the oxygen desaturation index (ODI) is a known risk factor for developing cardiovascular disease in OSA patients. This study focused on estimation of ODI from a noncontact manner from sleep breathing sounds.

STUDY DESIGN

Retrospective study.

METHODS

Patients who visited the sleep center due to snoring or sleep apnea underwent polysomnography in lab overnight. Sound recordings were made during polysomnography using a microphone. After noise reduction, the sound data were segmented into 5 seconds windows and features were extracted. Binary classification and regression analyses were performed to estimate the ODI during sleep (model 1). This was re-tested after inclusion of body mass index (BMI) and age as additional features (model 2: BMI only, model 3: BMI and age).

RESULTS

We included 116 patients. The mean age and AHI of all patients were 50.4 ± 16.7 years and 23.0 ± 24.0 events/hr. In binary classification, for ODI cutoff values of 5, 15, and 30 events/hr, the areas under the curve were 0.88, 0.93, 0.91, respectively, and accuracies were 85.34, 86.21, and 87.07, respectively. In regression analysis, the correlation coefficient and mean absolute error were 0.80 and 9.60 events/hr, respectively. In models 2 and 3, the correlation coefficient and mean absolute error were 0.82, 9.44 events/hr and 0.81, 9.6 events/hr, respectively.

CONCLUSION

Prediction of ODI from sleep sound seems to be feasible. Additional clinical feature such as BMI may increase overall predictability.

LEVEL OF EVIDENCE

IV Laryngoscope, 2021.

A New Sleep Staging System for Type III Sleep Studies Equipped with a Tracheal Sound Sensor

Type III sleep studies record cardio-respiratory channels only. Compared with polysomnography, which also records electrophysiological channels, they present many advantages: they are less expensive, less time-consuming, and more likely to be performed at home. However, their accuracy is limited by missing sleep information. That is why many studies present specific cardio-respiratory parameters to assess the causal effects of sleep stages upon cardiac or respiratory activities. For this paper, we gathered many parameters proposed in literature, leading to 1,111 features. The pulse oximeter, the PneaVoX sensor (recording tracheal sounds), respiratory inductance plethysmography belts, the nasal cannula and the actimeter provided the 112 worthiest ones for automatic sleep scoring. Then, a 3-step model was implemented: classification with a multi-layer perceptron, sleep transition rules corrections (from the AASM guidelines), and sequence corrections using a Viterbi hidden Markov model. The whole process was trained and tested using 300 and 100 independent recordings provided from patients suspected of having sleep breathing disorders. Results indicated that the system achieves substantial agreement with manual scoring for classifications into 2 stages (wake vs. sleep: mean Cohen's Kappa of 0.63 and accuracy rate Acc of 87.8%) and 3 stages (wake vs. R stage vs. NREM stage: mean of 0.60 and Acc of 78.5%). It indicates that the method could provide information to help specialists while diagnosing sleep. The presented model had promising results and may enhance clinical diagnosis.

IoT snoring sound detector prototype as a model of future participatory healthcare

BACKGROUND

Traditional healthcare is centred around providing in-hospital services using hospital owned medical instruments. The COVID-19 pandemic has shown that this approach lacks flexibility to insure follow-up and treatment of common medical problems. In an alternative setting adapted to this problem, participatory healthcare can be considered centred around data provided by patients owning and operating medical data collection equipment in their homes.

OBJECTIVE

In order to trigger such a shift reliable and price attractive devices need to become available. Snoring, as a human sound production during sleep, can reflect sleeping behaviour and indicate sleep problems as an element of the overall health condition of a person.

METHODS

The use of off-the-shelf hardware from Internet of Things platforms and standard audio components allows the development of such devices. A prototype of a snoring sound detector with this purpose is developed.

RESULTS

The device, controlled by the patient and with specific snoring recording and analysing functions is demonstrated as a model for future participatory healthcare.

CONCLUSIONS

Design of monitoring devices following this model could allow market introduction of new equipment for participatory healthcare, bringing a care complementary to traditional healthcare to the reach of patients, and could result in benefits from enhanced patient participation.

Audio source separation to reduce sleeping partner sounds: a simulation study

Objective.When recording a subject in an at-home environment for sleep evaluation or for other breathing disorder diagnoses using non-contact microphones, the breathing recordings (audio signals) can be distorted by sounds such as TV, outside noise, or air-conditioners. If two people are sleeping together, both may produce breathing/snoring sounds that need to be separated. In this study, we present signal processing and source separation algorithms for the enhancement of individual breathing/snoring audio signals in a simulated environment.Approach.We developed a computer simulation of mixed signals derived from genuine nocturnal recordings of 110 subjects. Two main source separation approaches were tested: (1) changing the basis vectors for the mixtures in the time domain (principal and independent component analysis, PCA/ICA) and (2) converting the mixtures to their time-frequency representations (degenerate un-mixing estimation technique, DUET). In addition to these source separation techniques, a beamforming approach was tested.Main results.The separation results with a reverberation time of 0.15 s and zero SNR between signals showed good performance (mean source to interference ratio (SIR): DUET = 12.831 dB, ICA = 3.388 dB, PCA = 4.452 dB), and for beamforming (SIR = -0.304 dB). To evaluate our source separation results, we propose two new measures: an evaluation measure based on a spectral similarity score (mel-SID) between the target source and its estimation (after separation) and a breathing energy ratio measure (BER). The results with the new proposed measures yielded comparable conclusions (mel-SID: DUET = 1.320, ICA = 2.732, PCA = 1.927, and beamforming = 2.590, BER: DUET = 10.241 dB, ICA = 0.270 dB, PCA = -2.847 dB, and beamforming = -1.151 dB), but better differentiated the differences between the performance of the algorithms. The DUET is superior on all measures. Its main advantage is that it only uses two microphones for separation.Significance. The separated audio signal can thus contribute to a more informed diagnosis of sleep-related and non-sleep-related diseases. The Institutional Review Committee of Soroka University Medical Center approved this study protocol (protocol number 10141) and all methods were performed in accordance with the relevant guidelines and regulations.

Application of substitution box of present cipher for automated detection of snoring sounds

BACKGROUND AND PURPOSE

Snoring is one of the sleep disorders, and snoring sounds have been used to diagnose many sleep-related diseases. However, the snoring sound classification is done manually which is time-consuming and prone to human errors. An automated snoring sound classification model is proposed to overcome these problems.

MATERIAL AND METHOD

This work proposes an automated snoring sound classification method using three new methods. These methods are maximum absolute pooling (MAP), the nonlinear present pattern, and two-layered neighborhood component analysis, and iterative neighborhood component analysis (NCAINCA) selector. Using these methods, a new snoring sound classification (SSC) model is presented. The MAP decomposition model is applied to snoring sounds to extract both low and high-level features. The presented model aims to attain high performance for SSC problem. The developed present pattern (Present-Pat) uses substitution box (SBox) and statistical feature generator. By deploying these feature generators, both textural and statistical features are generated. NCAINCA chooses the most informative/valuable features, and these selected features are fed to k-nearest neighbor (kNN) classifier with leave-one-out cross-validation (LOOCV). The Present-Pat based SSC system is developed using Munich-Passau Snore Sound Corpus (MPSSC) dataset comprising of four categories.

RESULTS

Our model reached an accuracy and unweighted average recall (UAR) of 97.10 % and 97.60 %, respectively, using LOOCV. Moreover, a nocturnal sound dataset is used to show the universal success of the presented model. Our model attained an accuracy of 98.14 % using the used nocturnal sound dataset.

CONCLUSIONS

Our developed classification model is ready to be tested with more data and can be used by sleep specialists to diagnose the sleep disorders based on snoring sounds.

Photoplethysmography in Normal and Pathological Sleep

This article presents an overview of the advancements that have been made in the use of photoplethysmography (PPG) for unobtrusive sleep studies. PPG is included in the quickly evolving and very popular landscape of wearables but has specific interesting properties, particularly the ability to capture the modulation of the autonomic nervous system during sleep. Recent advances have been made in PPG signal acquisition and processing, including coupling it with accelerometry in order to construct hypnograms in normal and pathologic sleep and also to detect sleep-disordered breathing (SDB). The limitations of PPG (e.g., oxymetry signal failure, motion artefacts, signal processing) are reviewed as well as technical solutions to overcome these issues. The potential medical applications of PPG are numerous, including home-based detection of SDB (for triage purposes), and long-term monitoring of insomnia, circadian rhythm sleep disorders (to assess treatment effects), and treated SDB (to ensure disease control). New contact sensor combinations to improve future wearables seem promising, particularly tools that allow for the assessment of brain activity. In this way, in-ear EEG combined with PPG and actigraphy could be an interesting focus for future research.

An Unsupervised Behavioral Modeling and Alerting System Based on Passive Sensing for Elderly Care

Artificial Intelligence in combination with the Internet of Medical Things enables remote healthcare services through networks of environmental and/or personal sensors. We present a remote healthcare service system which collects real-life data through an environmental sensor package, including binary motion, contact, pressure, and proximity sensors, installed at households of elderly people. Its aim is to keep the caregivers informed of subjects’ health-status progressive trajectory, and alert them of health-related anomalies to enable objective on-demand healthcare service delivery at scale. The system was deployed in 19 households inhabited by an elderly person with post-stroke condition in the Emilia–Romagna region in Italy, with maximal and median observation durations of 98 and 55 weeks. Among these households, 17 were multi-occupancy residences, while the other 2 housed elderly patients living alone. Subjects’ daily behavioral diaries were extracted and registered from raw sensor signals, using rule-based data pre-processing and unsupervised algorithms. Personal behavioral habits were identified and compared to typical patterns reported in behavioral science, as a quality-of-life indicator. We consider the activity patterns extracted across all users as a dictionary, and represent each patient’s behavior as a ‘Bag of Words’, based on which patients can be categorized into sub-groups for precision cohort treatment. Longitudinal trends of the behavioral progressive trajectory and sudden abnormalities of a patient were detected and reported to care providers. Due to the sparse sensor setting and the multi-occupancy living condition, the sleep profile was used as the main indicator in our system. Experimental results demonstrate the ability to report on subjects’ daily activity pattern in terms of sleep, outing, visiting, and health-status trajectories, as well as predicting/detecting 75% hospitalization sessions up to 11 days in advance. 65% of the alerts were confirmed to be semantically meaningful by the users. Furthermore, reduced social interaction (outing and visiting), and lower sleep quality could be observed during the COVID-19 lockdown period across the cohort.

Sleep/Wakefulness Detection Using Tracheal Sounds and Movements

PURPOSE

The current gold standard to detect sleep/wakefulness is based on electroencephalogram, which is inconvenient if included in portable sleep screening devices. Therefore, a challenge in the portable devices is sleeping time estimation. Without sleeping time, sleep parameters such as apnea/hypopnea index (AHI), an index for quantifying sleep apnea severity, can be underestimated. Recent studies have used tracheal sounds and movements for sleep screening and calculating AHI without considering sleeping time. In this study, we investigated the detection of sleep/wakefulness states and estimation of sleep parameters using tracheal sounds and movements.

MATERIALS AND METHODS

Participants with suspected sleep apnea who were referred for sleep screening were included in this study. Simultaneously with polysomnography, tracheal sounds and movements were recorded with a small wearable device, called the Patch, attached over the trachea. Each 30-second epoch of tracheal data was scored as sleep or wakefulness using an automatic classification algorithm. The performance of the algorithm was compared to the sleep/wakefulness scored blindly based on the polysomnography.

RESULTS

Eighty-eight subjects were included in this study. The accuracy of sleep/wakefulness detection was 82.3±8.66% with a sensitivity of 87.8±10.8 % (sleep), specificity of 71.4±18.5% (awake), F1 of 88.1±9.3% and Cohen's kappa of 0.54. The correlations between the estimated and polysomnography-based measures for total sleep time and sleep efficiency were 0.78 (p<0.001) and 0.70 (p<0.001), respectively.

CONCLUSION

Sleep/wakefulness periods can be detected using tracheal sound and movements. The results of this study combined with our previous studies on screening sleep apnea with tracheal sounds provide strong evidence that respiratory sounds analysis can be used to develop robust, convenient and cost-effective portable devices for sleep apnea monitoring.

Sleep stage classification from heart-rate variability using long short-term memory neural networks

Automated sleep stage classification using heart rate variability (HRV) may provide an ergonomic and low-cost alternative to gold standard polysomnography, creating possibilities for unobtrusive home-based sleep monitoring. Current methods however are limited in their ability to take into account long-term sleep architectural patterns. A long short-term memory (LSTM) network is proposed as a solution to model long-term cardiac sleep architecture information and validated on a comprehensive data set (292 participants, 584 nights, 541.214 annotated 30 s sleep segments) comprising a wide range of ages and pathological profiles, annotated according to the Rechtschaffen and Kales (R&K) annotation standard. It is shown that the model outperforms state-of-the-art approaches which were often limited to non-temporal or short-term recurrent classifiers. The model achieves a Cohen's k of 0.61 ± 0.15 and accuracy of 77.00 ± 8.90% across the entire database. Further analysis revealed that the performance for individuals aged 50 years and older may decline. These results demonstrate the merit of deep temporal modelling using a diverse data set and advance the state-of-the-art for HRV-based sleep stage classification. Further research is warranted into individuals over the age of 50 as performance tends to worsen in this sub-population.

Non-Contact Sleep Stage Detection Using Canonical Correlation Analysis of Respiratory Sound

Respiratory sound is able to differentiate sleep stages and provide a non-contact and cost-effective solution for the diagnosis and treatment monitoring of sleep-related diseases. While most of the existing respiratory sound-based methods focus on a limited number of sleep stages such as sleep/wake and wake/rapid eye movement (REM)/non-REM, it is essential to detect sleep stages at a finer level for sleep quality evaluation. In this paper, we for the first time study a sleep stage detection method aiming at classifying sleep states into four sleep stages: wake, REM, light sleep, and deep sleep from the respiratory sound. In addition to extracting time-domain features, frequency-domain features of respiratory sound, non-linear features of snoring sound are devised to better characterize snoring-related signals of respiratory sound. To effectively fuse the three sets of features, a novel feature fusion technique combining the generalized canonical correlation analysis with the ReliefF algorithm is proposed for discriminative feature selection. Final stage detection is achieved with popular classifiers including decision tree, support vector machines, K-nearest neighbor, and the ensemble classifier. To evaluate our proposed method, we built an in-house dataset, which is comprised of 13 nights of sleep audio data from a sleep laboratory. Experimental results indicate that our proposed method outperforms the existing related ones and is promising for large-scale non-contact sleep monitoring.