Cardiorespiratory Sleep Stage Detection Using Conditional Random Fields

Cardiovascular disease detection from cardiac arrhythmia ECG signals using artificial intelligence models with hyperparameters tuning methodologies

Cardiovascular disease (CVD) is connected with irregular cardiac electrical activity, which can be seen in ECG alterations. Due to its convenience and non-invasive aspect, the ECG is routinely exploited to identify different arrhythmias and automatic ECG recognition is needed immediately. In this paper, enhancement for the detection of CVDs such as Ventricular Tachycardia (VT), Premature Ventricular Contraction (PVC) and ST Change (ST) arrhythmia using different dimensionality reduction techniques and multiple classifiers are presented. Three-dimensionality reduction methods, such as Local Linear Embedding (LLE), Diffusion Maps (DM), and Laplacian Eigen (LE), are employed. The dimensionally reduced ECG samples are further feature selected with Cuckoo Search (CS) and Harmonic Search Optimization (HSO) algorithms. A publicly available MIT-BIH (Physionet) - VT database, PVC database, ST Change database and NSR database were used in this work. The cardiac vascular disturbances are classified by using seven classifiers such as Gaussian Mixture Model (GMM), Expectation Maximization (EM), Non-linear Regression (NLR), Logistic Regression (LR), Bayesian Linear Discriminant Analysis (BDLC), Detrended Fluctuation Analysis (Detrended FA), and Firefly. For different classes, the average overall accuracy of the classification techniques is 55.65 % when without CS and HSO feature selection, 64.36 % when CS feature selection is used, and 75.39 % when HSO feature selection is used. Also, to improve the performance of classifiers, the hyperparameters of four classifiers (GMM, EM, BDLC and Firefly) are tuned with the Adam and Grid Search Optimization (GSO) approaches. The average accuracy of classification for the CS feature-based classifiers that used GSO and Adam hyperparameter tuning was 79.92 % and 85.78 %, respectively. The average accuracy of classification for the HSO feature-based classifiers that used GSO and Adam hyperparameter tuning was 86.87 % and 93.77 %, respectively. The performance of the classifier is analyzed based on the accuracy parameter for both with and without feature selection methods and with hyperparameter tuning techniques. In the case of ST vs. NSR, a higher accuracy of 98.92 % is achieved for the LLE dimensionality reduction with HSO feature selection for the GMM classifier with Adam's hyperparameter tuning approach. The GMM classifier with the Adam hyperparameter tuning approach with 98.92 % accuracy in detecting ST vs. NSR cardiac disease is outperforming all other classifiers and methodologies.

SleepGCN: A transition rule learning model based on Graph Convolutional Network for sleep staging

BACKGROUND AND OBJECTIVE

Automatic sleep staging is essential for assessing and diagnosing sleep disorders, serving millions of people who suffer from them. Numerous sleep staging models have been proposed recently, but most of them have not fully explored the sleep transition rules that are essential for sleep experts to identify sleep stages. Therefore, one objective of this paper is to develop an automatic sleep staging model to capture the transition rules between sleep stages.

METHODS

In this paper, we propose a novel sleep staging model named SleepGCN. It utilizes the deep features of electroencephalogram (EEG) and electrooculogram (EOG) signals extracted by the sleep representation learning (SRL) module, in conjunction with the transition rules learned by the sleep transition rule learning (STRL) module to identify sleep stages. Specifically, the SRL module utilizes the residual network (ResNet) and Long Short Term Memory (LSTM) structure to capture the deep time-invariant features and temporal information of each sleep stage from the two-channel EEG-EOG, and then applies a feature enhancement block to obtain the refined features. The STRL module employs a Graph Convolutional Network (GCN) and a transition rule matrix to capture transition rules between sleep stages based on the sequence labels of the input signals.

RESULTS

We evaluate SleepGCN on five public datasets: SleepEDF-20, SleepEDF-78, SHHS, DOD-H and DOD-O. Overall, SleepGCN achieves an accuracy of 89.70%, 87.70%, 86.16%, 82.07%, and 81.20%, alongside a macro-average F1-score of 85.20%, 82.70%, 77.69%, 72.44%, and 72.93% across these datasets, respectively.

CONCLUSIONS

The results achieved by our proposed model are much better than those of all other compared models. The ablation study validates the contributions of the SRL and STRL modules proposed in SleepGCN to the sleep staging tasks. Additionally, it shows that the sleep staging model using two-channel EEG-EOG outperforms the model using single-channel EEG or EOG. Overall, SleepGCN is an effective solution for sleep staging using two-channel EEG-EOG.

Sleep staging algorithm based on smartwatch sensors for healthy and sleep apnea populations

OBJECTIVE

Sleep stages can provide valuable insights into an individual's sleep quality. By leveraging movement and heart rate data collected by modern smartwatches, it is possible to enable the sleep staging feature and enhance users' understanding about their sleep and health conditions.

METHOD

In this paper, we present and validate a recurrent neural network based model with 23 input features extracted from accelerometer and photoplethysmography sensors data for both healthy and sleep apnea populations. We designed a lightweight and fast solution to enable the prediction of sleep stages for each 30-s epoch. This solution was developed using a large dataset of 1522 night recordings collected from a highly heterogeneous population and different versions of Samsung smartwatch.

RESULTS

In the classification of four sleep stages (wake, light, deep, and rapid eye movements sleep), the proposed solution achieved 71.6 % of balanced accuracy and a Cohen's kappa of 0.56 in a test set with 586 recordings.

CONCLUSION

The results presented in this paper validate our proposal as a competitive wearable solution for sleep staging. Additionally, the use of a large and diverse data set contributes to the robustness of our solution, and corroborates the validation of algorithm's performance. Some additional analysis performed for healthy and sleep apnea population demonstrated that algorithm's performance has low correlation with demographic variables.

A sleep staging model on wavelet-based adaptive spectrogram reconstruction and light weight CNN

Effective methods for automatic sleep staging are important for diagnosis and treatment of sleep disorders. EEG has weak signal properties and complex frequency components during the transition of sleep stages. Wavelet-based adaptive spectrogram reconstruction (WASR) by seed growth is utilized to capture dominant time-frequency patterns of sleep EEG. We introduced variant energy from Teager operator in WASR to capture hidden dynamic patterns of EEG, which produced additional spectrograms. These spectrograms enabled a light weight CNN to detect and extract finer details of different sleep stages, which improved the feature representation of EEG. With specially designed depthwise separable convolution, the light weight CNN achieved more robust sleep stage classification. Experimental results on Sleep-EDF 20 dataset showed that our proposed model yielded overall accuracy of 87.6%, F1-score of 82.1%, and Cohen kappa of 0.83, which is competitive compared with baselines with reduced computation cost.

Automatic neonatal sleep stage classification: A comparative study

Sleep is an essential feature of living beings. For neonates, it is vital for their mental and physical development. Sleep stage cycling is an important parameter to assess neonatal brain and physical development. Therefore, it is crucial to administer newborn's sleep in the neonatal intensive care unit (NICU). Currently, Polysomnography (PSG) is used as a gold standard method for classifying neonatal sleep patterns, but it is expensive and requires a lot of human involvement. Over the last two decades, multiple researchers are working on automatic sleep stage classification algorithms using electroencephalography (EEG), electrocardiography (ECG), and video. In this study, we present a comprehensive review of existing algorithms for neonatal sleep, their limitations and future recommendations. Additionally, a brief comparison of the extracted features, classification algorithms and evaluation parameters is reported in the proposed study.

Development of generalizable automatic sleep staging using heart rate and movement based on large databases

Purpose

With the advancement of deep neural networks in biosignals processing, the performance of automatic sleep staging algorithms has improved significantly. However, sleep staging using only non-electroencephalogram features has not been as successful, especially following the current American Association of Sleep Medicine (AASM) standards. This study presents a fine-tuning based approach to widely generalizable automatic sleep staging using heart rate and movement features trained and validated on large databases of polysomnography.

Methods

A deep neural network is used to predict sleep stages using heart rate and movement features. The model is optimized on a dataset of 8731 nights of polysomnography recordings labeled using the Rechtschaffen & Kales scoring system, and fine-tuned to a smaller dataset of 1641 AASM-labeled recordings. The model prior to and after fine-tuning is validated on two AASM-labeled external datasets totaling 1183 recordings. In order to measure the performance of the model, the output of the optimized model is compared to reference expert-labeled sleep stages using accuracy and Cohen's κ as key metrics.

Results

The fine-tuned model showed accuracy of 76.6% with Cohen's κ of 0.606 in one of the external validation datasets, outperforming a previously reported result, and showed accuracy of 81.0% with Cohen's κ of 0.673 in another external validation dataset.

Conclusion

These results indicate that the proposed model is generalizable and effective in predicting sleep stages using features which can be extracted from non-contact sleep monitors. This holds valuable implications for future development of home sleep evaluation systems.

Exploration and Enhancement of Classifiers in the Detection of Lung Cancer from Histopathological Images

Lung cancer is a prevalent malignancy that impacts individuals of all genders and is often diagnosed late due to delayed symptoms. To catch it early, researchers are developing algorithms to study lung cancer images. The primary objective of this work is to propose a novel approach for the detection of lung cancer using histopathological images. In this work, the histopathological images underwent preprocessing, followed by segmentation using a modified approach of KFCM-based segmentation and the segmented image intensity values were dimensionally reduced using Particle Swarm Optimization (PSO) and Grey Wolf Optimization (GWO). Algorithms such as KL Divergence and Invasive Weed Optimization (IWO) are used for feature selection. Seven different classifiers such as SVM, KNN, Random Forest, Decision Tree, Softmax Discriminant, Multilayer Perceptron, and BLDC were used to analyze and classify the images as benign or malignant. Results were compared using standard metrics, and kappa analysis assessed classifier agreement. The Decision Tree Classifier with GWO feature extraction achieved good accuracy of 85.01% without feature selection and hyperparameter tuning approaches. Furthermore, we present a methodology to enhance the accuracy of the classifiers by employing hyperparameter tuning algorithms based on Adam and RAdam. By combining features from GWO and IWO, and using the RAdam algorithm, the Decision Tree classifier achieves the commendable accuracy of 91.57%.

A convolutional neural network-based decision support system for neonatal quiet sleep detection

Sleep plays an important role in neonatal brain and physical development, making its detection and characterization important for assessing early-stage development. In this study, we propose an automatic and computationally efficient algorithm to detect neonatal quiet sleep (QS) using a convolutional neural network (CNN). Our study used 38-hours of electroencephalography (EEG) recordings, collected from 19 neonates at Fudan Children's Hospital in Shanghai, China (Approval No. (2020) 22). To train and test the CNN, we extracted 12 prominent time and frequency domain features from 9 bipolar EEG channels. The CNN architecture comprised two convolutional layers with pooling and rectified linear unit (ReLU) activation. Additionally, a smoothing filter was applied to hold the sleep stage for 3 minutes. Through performance testing, our proposed method achieved impressive results, with 94.07% accuracy, 89.70% sensitivity, 94.40% specificity, 79.82% F1-score and a 0.74 kappa coefficient when compared to human expert annotations. A notable advantage of our approach is its computational efficiency, with the entire training and testing process requiring only 7.97 seconds. The proposed algorithm has been validated using leave one subject out (LOSO) validation, which demonstrates its consistent performance across a diverse range of neonates. Our findings highlight the potential of our algorithm for real-time neonatal sleep stage classification, offering a fast and cost-effective solution. This research opens avenues for further investigations in early-stage development monitoring and the assessment of neonatal health.

Micro SleepNet: efficient deep learning model for mobile terminal real-time sleep staging

The real-time sleep staging algorithm that can perform inference on mobile devices without burden is a prerequisite for closed-loop sleep modulation. However, current deep learning sleep staging models have poor real-time efficiency and redundant parameters. We propose a lightweight and high-performance sleep staging model named Micro SleepNet, which takes a 30-s electroencephalography (EEG) epoch as input, without relying on contextual signals. The model features a one-dimensional group convolution with a kernel size of 1 × 3 and an Efficient Channel and Spatial Attention (ECSA) module for feature extraction and adaptive recalibration. Moreover, the model efficiently performs feature fusion using dilated convolution module and replaces the conventional fully connected layer with Global Average Pooling (GAP). These design choices significantly reduce the total number of model parameters to 48,226, with only approximately 48.95 Million Floating-point Operations per Second (MFLOPs) computation. The proposed model is conducted subject-independent cross-validation on three publicly available datasets, achieving an overall accuracy of up to 83.3%, and the Cohen Kappa is 0.77. Additionally, we introduce Class Activation Mapping (CAM) to visualize the model's attention to EEG waveforms, which demonstrate the model's ability to accurately capture feature waveforms of EEG at different sleep stages. This provides a strong interpretability foundation for practical applications. Furthermore, the Micro SleepNet model occupies approximately 100 KB of memory on the Android smartphone and takes only 2.8 ms to infer one EEG epoch, meeting the real-time requirements of sleep staging tasks on mobile devices. Consequently, our proposed model has the potential to serve as a foundation for accurate closed-loop sleep modulation.

Machine Learning Techniques for the Performance Enhancement of Multiple Classifiers in the Detection of Cardiovascular Disease from PPG Signals

Photoplethysmography (PPG) signals are widely used in clinical practice as a diagnostic tool since PPG is noninvasive and inexpensive. In this article, machine learning techniques were used to improve the performance of classifiers for the detection of cardiovascular disease (CVD) from PPG signals. PPG signals occupy a large amount of memory and, hence, the signals were dimensionally reduced in the initial stage. A total of 41 subjects from the Capno database were analyzed in this study, including 20 CVD cases and 21 normal subjects. PPG signals are sampled at 200 samples per second. Therefore, 144,000 samples per patient are available. Now, a one-second-long PPG signal is considered a segment. There are 720 PPG segments per patient. For a total of 41 subjects, 29,520 segments of PPG signals are analyzed in this study. Five dimensionality reduction techniques, such as heuristic- (ABC-PSO, cuckoo clusters, and dragonfly clusters) and transformation-based techniques (Hilbert transform and nonlinear regression) were used in this research. Twelve different classifiers, such as PCA, EM, logistic regression, GMM, BLDC, firefly clusters, harmonic search, detrend fluctuation analysis, PAC Bayesian learning, KNN-PAC Bayesian, softmax discriminant classifier, and detrend with SDC were utilized to detect CVD from dimensionally reduced PPG signals. The performance of the classifiers was assessed based on their metrics, such as accuracy, performance index, error rate, and a good detection rate. The Hilbert transform techniques with the harmonic search classifier outperformed all other classifiers, with an accuracy of 98.31% and a good detection rate of 96.55%.

The Effect of Coupled Electroencephalography Signals in Electrooculography Signals on Sleep Staging Based on Deep Learning Methods

The influence of the coupled electroencephalography (EEG) signal in electrooculography (EOG) on EOG-based automatic sleep staging has been ignored. Since the EOG and prefrontal EEG are collected at close range, it is not clear whether EEG couples in EOG or not, and whether or not the EOG signal can achieve good sleep staging results due to its intrinsic characteristics. In this paper, the effect of a coupled EEG signal in an EOG signal on automatic sleep staging is explored. The blind source separation algorithm was used to extract a clean prefrontal EEG signal. Then the raw EOG signal and clean prefrontal EEG signal were processed to obtain EOG signals coupled with different EEG signal contents. Afterwards, the coupled EOG signals were fed into a hierarchical neural network, including a convolutional neural network and recurrent neural network for automatic sleep staging. Finally, an exploration was performed using two public datasets and one clinical dataset. The results showed that using a coupled EOG signal could achieve an accuracy of 80.4%, 81.1%, and 78.9% for the three datasets, slightly better than the accuracy of sleep staging using the EOG signal without coupled EEG. Thus, an appropriate content of coupled EEG signal in an EOG signal improved the sleep staging results. This paper provides an experimental basis for sleep staging with EOG signals.

A Novel Approach for Sleep Arousal Disorder Detection Based on the Interaction of Physiological Signals and Metaheuristic Learning

The vast majority of sleep disturbances are caused by various types of sleep arousal. To diagnose sleep disorders and prevent health problems such as cardiovascular disease and cognitive impairment, sleep arousals must be accurately detected. Consequently, sleep specialists must spend considerable time and effort analyzing polysomnography (PSG) recordings to determine the level of arousal during sleep. The development of an automated sleep arousal detection system based on PSG would considerably benefit clinicians. We quantify the EEG-ECG by using Lyapunov exponents, fractals, and wavelet transforms to identify sleep stages and arousal disorders. In this paper, an efficient hybrid-learning method is introduced for the first time to detect and assess arousal incidents. Modified drone squadron optimization (mDSO) algorithm is used to optimize the support vector machine (SVM) with radial basis function (RBF) kernel. EEG-ECG signals are preprocessed samples from the SHHS sleep dataset and the PhysioBank challenge 2018. In comparison to other traditional methods for identifying sleep disorders, our physiological signals correlation innovation is much better than similar approaches. Based on the proposed model, the average error rate was less than 2%-7%, respectively, for two-class and four-class issues. Additionally, the proper classification of the five sleep stages is determined to be accurate 92.3% of the time. In clinical trials of sleep disorders, the hybrid-learning model technique based on EEG-ECG signal correlation features is effective in detecting arousals.

An automated heart rate-based algorithm for sleep stage classification: Validation using conventional polysomnography and an innovative wearable electrocardiogram device

Background

The rapid advancement in wearable solutions to monitor and score sleep staging has enabled monitoring outside of the conventional clinical settings. However, most of the devices and algorithms lack extensive and independent validation, a fundamental step to ensure robustness, stability, and replicability of the results beyond the training and testing phases. These systems are thought not to be feasible and reliable alternatives to the gold standard, polysomnography (PSG).

Materials and methods

This validation study highlights the accuracy and precision of the proposed heart rate (HR)-based deep-learning algorithm for sleep staging. The illustrated solution can perform classification at 2-levels (Wake; Sleep), 3-levels (Wake; NREM; REM) or 4- levels (Wake; Light; Deep; REM) in 30-s epochs. The algorithm was validated using an open-source dataset of PSG recordings (Physionet CinC dataset, n = 994 participants, 994 recordings) and a proprietary dataset of ECG recordings (Z3Pulse, n = 52 participants, 112 recordings) collected with a chest-worn, wireless sensor and simultaneous PSG collection using SOMNOtouch.

Results

We evaluated the performance of the models in both datasets in terms of Accuracy (A), Cohen's kappa (K), Sensitivity (SE), Specificity (SP), Positive Predictive Value (PPV), and Negative Predicted Value (NPV). In the CinC dataset, the highest value of accuracy was achieved by the 2-levels model (0.8797), while the 3-levels model obtained the best value of K (0.6025). The 4-levels model obtained the lowest SE (0.3812) and the highest SP (0.9744) for the classification of Deep sleep segments. AHI and biological sex did not affect scoring, while a significant decrease of performance by age was reported across the models. In the Z3Pulse dataset, the highest value of accuracy was achieved by the 2-levels model (0.8812), whereas the 3-levels model obtained the best value of K (0.611). For classification of the sleep states, the lowest SE (0.6163) and the highest SP (0.9606) were obtained for the classification of Deep sleep segment.

Conclusion

The results of the validation procedure demonstrated the feasibility of accurate HR-based sleep staging. The combination of the proposed sleep staging algorithm with an inexpensive HR device, provides a cost-effective and non-invasive solution deployable in the home environment and robust across age, sex, and AHI scores.

An Attention Based CNN-LSTM Approach for Sleep-Wake Detection With Heterogeneous Sensors

In this article, we propose an attention based convolutional neural network long short-term memory (CNN-LSTM) approach for sleep-wake detection with heterogeneous sensor data, i.e., acceleration and heart rate variability (HRV). Since the three-dimensional acceleration data was sampled with a high frequency, we firstly design a CNN-LSTM structure to effectively learn latent features from the acceleration. Meanwhile, considering the unique format of the HRV data, some effective features are extracted based on domain knowledge. Next, we design a unified architecture to efficiently merge the features learned by CNN-LSTM approach from the acceleration and the extracted features from the HRV, which enables us to make full use of all the available information from these two heterogeneous sources. Taking into consideration that these two heterogeneous sources may have distinct contributions for the sleep and wake states, we propose an attention network to dynamically adjust the importance of features from the two sources. Real-world experiments have been conducted to verify the effectiveness of the proposed approach for sleep-wake detection. The results demonstrate that the proposed method outperforms all existing approaches for sleep-wake classification. In the evaluation of leave-one-subject-out (LOSO) cross-validation which is more challenging and practical, the proposed method achieves remarkable improvements ranging from 5% to 46% over the benchmark approaches.

Automatic sleep staging by cardiorespiratory signals: a systematic review

BACKGROUND

Because of problems with the recording and analysis of the EEG signal, automatic sleep staging using cardiorespiratory signals has been employed as an alternative. This study reports on certain critical points which hold considerable promise for the improvement of the results of the automatic sleep staging using cardiorespiratory signals.

METHODS

A systematic review.

RESULTS

The review and analysis of the literature in this area revealed four outstanding points: (1) the feature extraction epoch length, denoting that the standard 30-s segments of cardiorespiratory signals do not carry enough information for automatic sleep staging and that a 4.5-min length segment centering on each 30-s segment is proper for staging, (2) the time delay between the EEG signal extracted from the central nervous system activity and the cardiorespiratory signals extracted from the autonomic nervous system activity should be considered in the automatic sleep staging using cardiorespiratory signals, (3) the information in the morphology of ECG signals can contribute to the improvement of sleep staging, and (4) applying convolutional neural network (CNN) and long short-term memory network (LSTM) deep structures simultaneously to a large PSG recording database can lead to more reliable automatic sleep staging results.

CONCLUSIONS

Considering the above-mentioned points simultaneously can improve automatic sleep staging by cardiorespiratory signals. It is hoped that by considering the points, staging sleep automatically using cardiorespiratory signals, which does not have problems with the recording and analysis of EEG signals, yields results acceptably close to the results of automatic sleep staging by EEG signals.

EOGNET: A Novel Deep Learning Model for Sleep Stage Classification Based on Single-Channel EOG Signal

In recent years, automatic sleep staging methods have achieved competitive performance using electroencephalography (EEG) signals. However, the acquisition of EEG signals is cumbersome and inconvenient. Therefore, we propose a novel sleep staging approach using electrooculogram (EOG) signals, which are more convenient to acquire than the EEG. A two-scale convolutional neural network first extracts epoch-wise temporary-equivalent features from raw EOG signals. A recurrent neural network then captures the long-term sequential information. The proposed method was validated on 101 full-night sleep data from two open-access databases, the montreal archive of sleep studies and Sleep-EDF, achieving an overall accuracy of 81.2 and 76.3%, respectively. The results are comparable to those models trained with EEG signals. In addition, comparisons with six state-of-the-art methods further demonstrate the effectiveness of the proposed approach. Overall, this study provides a new avenue for sleep monitoring.

Automatic Sleep Stage Classification Using Temporal Convolutional Neural Network and New Data Augmentation Technique from Raw Single-Channel EEG

BACKGROUND AND OBJECTIVE

This paper presents a new framework for automatic classification of sleep stages using a deep learning algorithm from single-channel EEG signals. Each segmented EEG signal appended with its label of stages is fed into a deep learning model to create an automatic sleep stage classification. This is one of the most important problems that is critical to the realization of monitoring patients with sleep disorder.

METHODS

In the present study, a neural network architecture is introduced utilizing Convolutional Neural Networks (CNNs) to extract features, followed by Temporal Convolutional Neural Network to extract the temporal features from the extracted features vector of CNN. Finally, the performance of our model is improved by a Conditional Random Field layer. We also employed a new data augmentation technique to enhance the CNNs training which has auxiliary effects.

RESULTS

We evaluated our model by two different single-channel EEG signals (i.e., Fpz-Cz and Pz-Oz EEG channels) from two public sleep datasets, named Sleep-EDF-2013 and Sleep-EDF-2018. The evaluation results on both datasets showed that our model obtains the best total accuracy and kappa score (EDF-2013: 85.39%- 0.80, EDF-2018: 82.46%- 0.76) compared to the state-of-the-art methods.

CONCLUSIONS

This study will possibly allow us to have a wearable sleep monitoring system with a single-channel EEG. Also, unlike hand-crafted features methods, our model finds its own patterns through training epochs, and therefore, it may minimize engineering bias.

An Attention-Based Deep Learning Approach for Sleep Stage Classification With Single-Channel EEG

Automatic sleep stage mymargin classification is of great importance to measure sleep quality. In this paper, we propose a novel attention-based deep learning architecture called AttnSleep to classify sleep stages using single channel EEG signals. This architecture starts with the feature extraction module based on multi-resolution convolutional neural network (MRCNN) and adaptive feature recalibration (AFR). The MRCNN can extract low and high frequency features and the AFR is able to improve the quality of the extracted features by modeling the inter-dependencies between the features. The second module is the temporal context encoder (TCE) that leverages a multi-head attention mechanism to capture the temporal dependencies among the extracted features. Particularly, the multi-head attention deploys causal convolutions to model the temporal relations in the input features. We evaluate the performance of our proposed AttnSleep model using three public datasets. The results show that our AttnSleep outperforms state-of-the-art techniques in terms of different evaluation metrics. Our source codes, experimental data, and supplementary materials are available at https://github.com/emadeldeen24/AttnSleep.

Automatic sleep staging using heart rate variability, body movements, and recurrent neural networks in a sleep disordered population

STUDY OBJECTIVES

To validate a previously developed sleep staging algorithm using heart rate variability (HRV) and body movements in an independent broad cohort of unselected sleep disordered patients.

METHODS

We applied a previously designed algorithm for automatic sleep staging using long short-term memory recurrent neural networks to model sleep architecture. The classifier uses 132 HRV features computed from electrocardiography and activity counts from accelerometry. We retrained our algorithm using two public datasets containing both healthy sleepers and sleep disordered patients. We then tested the performance of the algorithm on an independent hold-out validation set of sleep recordings from a wide range of sleep disorders collected in a tertiary sleep medicine center.

RESULTS

The classifier achieved substantial agreement on four-class sleep staging (wake/N1-N2/N3/rapid eye movement [REM]), with an average κ of 0.60 and accuracy of 75.9%. The performance of the sleep staging algorithm was significantly higher in insomnia patients (κ = 0.62, accuracy = 77.3%). Only in REM parasomnias, the performance was significantly lower (κ = 0.47, accuracy = 70.5%). For two-class wake/sleep classification, the classifier achieved a κ of 0.65, with a sensitivity (to wake) of 72.9% and specificity of 94.0%.

CONCLUSIONS

This study shows that the combination of HRV, body movements, and a state-of-the-art deep neural network can reach substantial agreement in automatic sleep staging compared with polysomnography, even in patients suffering from a multitude of sleep disorders. The physiological signals required can be obtained in various ways, including non-obtrusive wrist-worn sensors, opening up new avenues for clinical diagnostics.

A Systematic Review of Sensing Technologies for Wearable Sleep Staging

Designing wearable systems for sleep detection and staging is extremely challenging due to the numerous constraints associated with sensing, usability, accuracy, and regulatory requirements. Several researchers have explored the use of signals from a subset of sensors that are used in polysomnography (PSG), whereas others have demonstrated the feasibility of using alternative sensing modalities. In this paper, a systematic review of the different sensing modalities that have been used for wearable sleep staging is presented. Based on a review of 90 papers, 13 different sensing modalities are identified. Each sensing modality is explored to identify signals that can be obtained from it, the sleep stages that can be reliably identified, the classification accuracy of systems and methods using the sensing modality, as well as the usability constraints of the sensor in a wearable system. It concludes that the two most common sensing modalities in use are those based on electroencephalography (EEG) and photoplethysmography (PPG). EEG-based systems are the most accurate, with EEG being the only sensing modality capable of identifying all the stages of sleep. PPG-based systems are much simpler to use and better suited for wearable monitoring but are unable to identify all the sleep stages.

Sleep-wake stage detection with single channel ECG and hybrid machine learning model in patients with obstructive sleep apnea

Sleep staging is an important step in the diagnosis of obstructive sleep apnea (OSA) and this step is performed by a physician who visually scores the electroencephalography, electrooculography and electromyography signals taken by the polysomnography (PSG) device. The PSG records must be taken by a technician in a hospital environment, this may suggest a drawback. This study aims to develop a new method based on hybrid machine learning with single-channel ECG for sleep-wake detection, which is an alternative to the sleep staging procedure used in hospitals today. For this purpose, the heart rate variability signal was derived using electrocardiography (ECG) signals of 10 OSA patients. Then, QRS components in different frequency bands were obtained from the ECG signal by digital filtering. In this way, nine more signals were obtained in total. 25 features from each of the 9 signals, a total of 225 features have been extracted. Fisher feature selection algorithm and principal component analysis were used to reduce the number of features. Finally, features were classified with decision tree, support vector machines, k-nearest neighborhood algorithm and ensemble classifiers. In addition, the proposed model has been checked with the leave one out method. At the end of the study, it was shown that sleep-wake detection can be performed with 81.35% accuracy with only three features and 87.12% accuracy with 10 features. The sensitivity and specificity values for the 3 features were 0.85 and 0.77, and for 10 features the sensitivity and specificity values were 0.90 and 0.85 respectively. These results suggested that the proposed model could be used to detect sleep-wake stages during the OSA diagnostic process.

Direct application of an ECG-based sleep staging algorithm on reflective photoplethysmography data decreases performance

OBJECTIVE

The maturation of neural network-based techniques in combination with the availability of large sleep datasets has increased the interest in alternative methods of sleep monitoring. For unobtrusive sleep staging, the most promising algorithms are based on heart rate variability computed from inter-beat intervals (IBIs) derived from ECG-data. The practical application of these algorithms is even more promising when alternative ways of obtaining IBIs, such as wrist-worn photoplethysmography (PPG) can be used. However, studies validating sleep staging algorithms directly on PPG-based data are limited.

RESULTS

We applied an automatic sleep staging algorithm trained and validated on ECG-data directly on inter-beat intervals derived from a wrist-worn PPG sensor, in 389 polysomnographic recordings of patients with a variety of sleep disorders. While the algorithm reached moderate agreement with gold standard polysomnography, the performance was significantly lower when applied on PPG- versus ECG-derived heart rate variability data (kappa 0.56 versus 0.60, p < 0.001; accuracy 73.0% versus 75.9% p < 0.001). These results show that direct application of an algorithm on a different source of data may negatively affect performance. Algorithms need to be validated using each data source and re-training should be considered whenever possible.

A review on current trends in automatic sleep staging through bio-signal recordings and future challenges

Sleep staging is a vital process conducted in order to analyze polysomnographic data. To facilitate prompt interpretation of these recordings, many automatic sleep staging methods have been proposed. These methods rely on bio-signal recordings, which include electroencephalography, electrocardiography, electromyography, electrooculography, respiratory, pulse oximetry and others. However, advanced, uncomplicated and swift sleep-staging-evaluation is still needed in order to improve the existing polysomnographic data interpretation. The present review focuses on automatic sleep staging methods through bio-signal recording including current and future challenges.

Wearable monitoring of sleep-disordered breathing: estimation of the apnea-hypopnea index using wrist-worn reflective photoplethysmography

A large part of the worldwide population suffers from obstructive sleep apnea (OSA), a disorder impairing the restorative function of sleep and constituting a risk factor for several cardiovascular pathologies. The standard diagnostic metric to define OSA is the apnea-hypopnea index (AHI), typically obtained by manually annotating polysomnographic recordings. However, this clinical procedure cannot be employed for screening and for long-term monitoring of OSA due to its obtrusiveness and cost. Here, we propose an automatic unobtrusive AHI estimation method fully based on wrist-worn reflective photoplethysmography (rPPG), employing a deep learning model exploiting cardiorespiratory and sleep information extracted from the rPPG signal trained with 250 recordings. We tested our method with an independent set of 188 heterogeneously disordered clinical recordings and we found it estimates the AHI with a good agreement to the gold standard polysomnography reference (correlation = 0.61, estimation error = 3±10 events/h). The estimated AHI was shown to reliably assess OSA severity (weighted Cohen's kappa = 0.51) and screen for OSA (ROC-AUC = 0.84/0.86/0.85 for mild/moderate/severe OSA). These findings suggest that wrist-worn rPPG measurements that can be implemented in wearables such as smartwatches, have the potential to complement standard OSA diagnostic techniques by allowing unobtrusive sleep and respiratory monitoring.

A hierarchical sequential neural network with feature fusion for sleep staging based on EOG and RR signals

OBJECTIVE

Currently, the automatic sleep staging methods mainly face two problems: the first problem is that although the algorithms which use electroencephalogram (EEG) signals perform well, acquiring EEG signals is complicated and uncomfortable; the second problem is that if the methods utilize physiological signals collected by user-friendly devices, such as cardiorespiratory signals, whose accuracies are hard to be accepted by clinicians, although the employed signals are easy and comfortable to acquire.

APPROACH

To overcome the two issues, an automatic sleep staging method is proposed by developing a hierarchical sequential neural network to process only the electrooculogram (EOG) and R-R interval (RR) signals. The two signals are convenient and comfortable to acquire. The proposed network mainly contains two parts: comprehensive feature learning and sequence learning. The first part extracts hand-crafted features, and network trained features are simultaneously learned by a two-scale network. Then the two kinds of features are fused. The second part utilized a two-flow recurrent neural network (RNN) to learn temporal information between sleep epochs.

MAIN RESULTS

The proposed method was evaluated on 86 subjects from two public databases, the Montreal archive of sleep studies (MASS) and sleep apnea (SA). The proposed method can discriminate five sleep stages with the F1-score of 0.781 and 0.740 for MASS and SA, respectively. And discriminate four stages with the F1-score of 0.858 and 0.802 for MASS and SA, respectively.

SIGNIFICANCE

The proposed method can achieve comparable performance as using EEG signals for sleep staging and have better performance compared to five related state-of-the-art methods. Model analysis displayed that the network can learn effective features and sequence information from EOG and RR signals. In summary, the proposed method is promising to enable new sleep monitoring in a more convenient way while having a good performance on sleep staging.

Sleep stage classification from heart-rate variability using long short-term memory neural networks

Automated sleep stage classification using heart rate variability (HRV) may provide an ergonomic and low-cost alternative to gold standard polysomnography, creating possibilities for unobtrusive home-based sleep monitoring. Current methods however are limited in their ability to take into account long-term sleep architectural patterns. A long short-term memory (LSTM) network is proposed as a solution to model long-term cardiac sleep architecture information and validated on a comprehensive data set (292 participants, 584 nights, 541.214 annotated 30 s sleep segments) comprising a wide range of ages and pathological profiles, annotated according to the Rechtschaffen and Kales (R&K) annotation standard. It is shown that the model outperforms state-of-the-art approaches which were often limited to non-temporal or short-term recurrent classifiers. The model achieves a Cohen's k of 0.61 ± 0.15 and accuracy of 77.00 ± 8.90% across the entire database. Further analysis revealed that the performance for individuals aged 50 years and older may decline. These results demonstrate the merit of deep temporal modelling using a diverse data set and advance the state-of-the-art for HRV-based sleep stage classification. Further research is warranted into individuals over the age of 50 as performance tends to worsen in this sub-population.

Video-Based Actigraphy for Monitoring Wake and Sleep in Healthy Infants: A Laboratory Study

Prolonged monitoring of infant sleep is paramount for parents and healthcare professionals for interpreting and evaluating infants’ sleep quality. Wake-sleep patterns are often studied to assess this. Video cameras have received a lot of attention in infant sleep monitoring because they are unobtrusive and easy to use at home. In this paper, we propose a method using motion data detected from infrared video frames (video-based actigraphy) to identify wake and sleep states. The motion, mostly caused by infant body movement, is known to be substantially associated with infant wake and sleep states. Two features were calculated from the video-based actigraphy, and a Bayesian-based linear discriminant classification model was employed to classify the two states. Leave-one-subject-out cross validation was performed to validate our proposed wake and sleep classification model. From a total of 11.6 h of infrared video recordings of 10 healthy term infants in a laboratory pilot study, we achieved a reliable classification performance with a Cohen’s kappa coefficient of 0.733 ± 0.204 (mean ± standard deviation) and an overall accuracy of 92.0% ± 4.6%.

Deep learning in the cross-time frequency domain for sleep staging from a single-lead electrocardiogram

OBJECTIVE

This study classifies sleep stages from a single lead electrocardiogram (ECG) using beat detection, cardiorespiratory coupling in the time-frequency domain and a deep convolutional neural network (CNN).

APPROACH

An ECG-derived respiration (EDR) signal and synchronous beat-to-beat heart rate variability (HRV) time series were derived from the ECG using previously described robust algorithms. A measure of cardiorespiratory coupling (CRC) was extracted by calculating the coherence and cross-spectrogram of the EDR and HRV signal in 5 min windows. A CNN was then trained to classify the sleep stages (wake, rapid-eye-movement (REM) sleep, non-REM (NREM) light sleep and NREM deep sleep) from the corresponding CRC spectrograms. A support vector machine was then used to combine the output of CNN with the other features derived from the ECG, including phase-rectified signal averaging (PRSA), sample entropy, as well as standard spectral and temporal HRV measures. The MIT-BIH Polysomnographic Database (SLPDB), the PhysioNet/Computing in Cardiology Challenge 2018 database (CinC2018) and the Sleep Heart Health Study (SHHS) database, all expert-annotated for sleep stages, were used to train and validate the algorithm.

MAIN RESULTS

Ten-fold cross validation results showed that the proposed algorithm achieved an accuracy (Acc) of 75.4% and a Cohen's kappa coefficient of [Formula: see text]  =  0.54 on the out of sample validation data in the classification of Wake, REM, NREM light and deep sleep in SLPDB. This rose to Acc  =  81.6% and [Formula: see text]  =  0.63 for the classification of Wake, REM sleep and NREM sleep and Acc  =  85.1% and [Formula: see text]  =  0.68 for the classification of NREM sleep versus REM/wakefulness in SLPDB.

SIGNIFICANCE

The proposed ECG-based sleep stage classification approach that represents the highest reported results on non-electroencephalographic data and uses datasets over ten times larger than those in previous studies. By using a state-of-the-art QRS detector and deep learning model, the system does not require human annotation and can therefore be scaled for mass analysis.

A comparison of probabilistic classifiers for sleep stage classification

OBJECTIVE

To compare conditional random fields (CRF), hidden Markov models (HMMs) and Bayesian linear discriminants (LDs) for cardiorespiratory sleep stage classification on a five-class sleep staging task (wake/N1/N2/N3/REM), to explore the benefits of incorporating time information in the classification and to evaluate the feasibility of sleep staging on obstructive sleep apnea (OSA) patients.

APPROACH

The classifiers with and without time information were evaluated with 10-fold cross-validation on five-, four- (wake/N1  +  N2/N3/REM) and three-class (wake/NREM/REM) classification tasks using a data set comprising 443 night-time polysomnography (PSG) recordings of 231 participants (180 healthy participants, 100 of which had a 'regular' sleep architecture, and 51 participants previously diagnosed with OSA).

MAIN RESULTS

CRF with time information (CRFt) outperforms all other classifiers on all tasks, achieving a median accuracy and Cohen's κ for all participants of 62.8% and 0.44 for five classes, 68.8% and 0.47 for four classes, and 77.6% and 0.55 for three classes. An advantage was found in training classifiers, specifically for 'regular' and 'OSA' participants, achieving an improvement in classification performance for these groups. For 'regular' participants, CRFt achieved a median accuracy and Cohen's κ of 67.0% and 0.51, 70.8% and 0.53 and 81.3% and 0.62 for five-, four- and three-classes respectively, and for 'OSA' patients, of 59.9% and 0.40, 69.7% and 0.45, and 75.8% and 0.51 for five-, four- and three-classes respectively.

SIGNIFICANCE

The results suggest that CRFt is not only better at learning and predicting more complex and irregular sleep architectures, but that it also performs reasonably well in five-class classification-the standard for sleep scoring used in clinical PSG. Additionally, and albeit with a decrease in performance when compared with healthy participants, sleep stage classification in OSA patients using cardiorespiratory features and CRFt seems feasible with reasonable accuracy.

Wakefulness evaluation during sleep for healthy subjects and OSA patients using a patch-type device

OBJECTIVES

Obstructive sleep apnea (OSA) is a major sleep disorder that causes insufficient sleep, which is linked with daytime fatigue and accidents. Long-term sleep monitoring can provide meaningful information for patients with OSA to prevent and manage their symptoms. Even though various methods have been proposed to objectively measure sleep in ambulatory environments, less reliable information was provided in comparison with standard polysomnography (PSG). Therefore, this paper proposes an algorithm for distinguishing wakefulness from sleep using a patch-type device, which is applicable for both healthy individuals and patients with OSA.

METHODS

Electrocardiogram (ECG) and 3-axis accelerometer signals were gathered from the single device. Wakefulness was determined with six parallel methods based on information about movement and autonomic nervous activity. The performance evaluation was conducted with five-fold cross validation using the data from 15 subjects with a low respiratory disturbance index (RDI) and 10 subjects with high RDI. In addition, wakefulness information, including total sleep time (TST), sleep efficiency (SE), sleep onset latency (SOL), and wake after sleep onset (WASO), were extracted from the proposed algorithm and compared with those from PSG.

RESULTS

According to epoch-by-epoch (30 s) analysis, the performance results of detecting wakefulness were an average Cohen's kappa of 0.60, accuracy of 91.24%, sensitivity of 64.12%, and specificity of 95.73%. Moreover, significant correlations were observed in TST, SE, SOL, and WASO between the proposed algorithm and PSG (p < 0.001).

CONCLUSIONS

Wakefulness-related information was successfully provided using data from the patch-type device. In addition, the performance results of the proposed algorithm for wakefulness detection were competitive with those from previous studies. Therefore, the proposed system could be an appropriate solution for long-term objective sleep monitoring in both healthy individuals and patients with OSA.

Unobtrusive assessment of neonatal sleep state based on heart rate variability retrieved from electrocardiography used for regular patient monitoring

As an approach of unobtrusive assessment of neonatal sleep state we aimed at an automated sleep state coding based only on heart rate variability obtained from electrocardiography used for regular patient monitoring. We analyzed active and quiet sleep states of preterm infants between 30 and 37weeks postmenstrual age. To determine the sleep states we used a nonlinear kernel support vector machine for sleep state separation based on known heart rate variability features. We used unweighted and weighted misclassification penalties for the imbalanced distribution between sleep states. The validation was performed with leave-one-out-cross-validation based on the annotations of three independent observers. We analyzed the classifier performance with receiver operating curves leading to a maximum mean value for the area under the curve of 0.87. Using this sleep state separation methods, we show that automated active and quiet sleep state separation based on heart rate variability in preterm infants is feasible.