Sleep scoring using artificial neural networks

An open-source toolbox for standardized use of PhysioNet Sleep EDF Expanded Database

PhysioNet Sleep EDF database has been the most popular source of data used for developing and testing many automatic sleep staging algorithms. However, the recordings from this database has been used in an inconsistent fashion. For example, arbitrary selection of start and end times from long term recordings, data-hypnogram mismatches, different performance metrics and hypnogram conversion from R&K to AASM. All these differences result in different data sections and performance metrics being used by researchers thereby making any direct comparison between algorithms very difficult. Recently, a superset of this database has been made available on PhysioNet, known as the Sleep EDF Expanded Database which includes 61 recordings. This provides an opportunity to standardize the way in which signals from this database should be used. With this goal in mind, we present in this paper a toolbox for automatically downloading and extracting recordings from the Sleep EDF Expanded database and converting them to a suitable format for use in MATLAB. This toolbox contains functions for selecting appropriate data for sleep analysis (based on our previous recommendations for sleep staging), hypnogram conversion and computation of performance metrics. Its use makes it simpler to start using the new sleep database and also provides a foundation for much-needed standardization in this research field.

A decision support system for automatic sleep staging from EEG signals using tunable Q-factor wavelet transform and spectral features

BACKGROUND

Automatic sleep scoring is essential owing to the fact that conventionally a large volume of data have to be analyzed visually by the physicians which is onerous, time-consuming and error-prone. Therefore, there is a dire need of an automated sleep staging scheme.

NEW METHOD

In this work, we decompose sleep-EEG signal segments using tunable-Q factor wavelet transform (TQWT). Various spectral features are then computed from TQWT sub-bands. The performance of spectral features in the TQWT domain has been determined by intuitive and graphical analyses, statistical validation, and Fisher criteria. Random forest is used to perform classification. Optimal choices and the effects of TQWT and random forest parameters have been determined and expounded.

RESULTS

Experimental outcomes manifest the efficacy of our feature generation scheme in terms of p-values of ANOVA analysis and Fisher criteria. The proposed scheme yields 90.38%, 91.50%, 92.11%, 94.80%, 97.50% for 6-stage to 2-stage classification of sleep states on the benchmark Sleep-EDF data-set. In addition, its performance on DREAMS Subjects Data-set is also promising.

COMPARISON WITH EXISTING METHODS

The performance of the proposed method is significantly better than the existing ones in terms of accuracy and Cohen's kappa coefficient. Additionally, the proposed scheme gives high detection accuracy for sleep stages non-REM 1 and REM.

CONCLUSIONS

Spectral features in the TQWT domain can discriminate sleep-EEG signals corresponding to various sleep states efficaciously. The proposed scheme will alleviate the burden of the physicians, speed-up sleep disorder diagnosis, and expedite sleep research.

Recommendations for performance assessment of automatic sleep staging algorithms

A number of automatic sleep scoring algorithms have been published in the last few years. These can potentially help save time and reduce costs in sleep monitoring. However, the use of both R&K and AASM classification, different databases and varying performance metrics makes it extremely difficult to compare these algorithms. In this paper, we describe some readily available polysomnography databases and propose a set of recommendations and performance metrics to promote uniform testing and direct comparison of different algorithms. We use two different polysomnography databases with a simple sleep staging algorithm to demonstrate the usage of all recommendations and presentation of performance results. We also illustrate how seemingly similar results using two different databases can have contrasting accuracies in different sleep stages. Finally, we show how selection of different training and test subjects from the same database can alter the final performance results.

EEG Sleep Stages Classification Based on Time Domain Features and Structural Graph Similarity

The electroencephalogram (EEG) signals are commonly used in diagnosing and treating sleep disorders. Many existing methods for sleep stages classification mainly depend on the analysis of EEG signals in time or frequency domain to obtain a high classification accuracy. In this paper, the statistical features in time domain, the structural graph similarity and the K-means (SGSKM) are combined to identify six sleep stages using single channel EEG signals. Firstly, each EEG segment is partitioned into sub-segments. The size of a sub-segment is determined empirically. Secondly, statistical features are extracted, sorted into different sets of features and forwarded to the SGSKM to classify EEG sleep stages. We have also investigated the relationships between sleep stages and the time domain features of the EEG data used in this paper. The experimental results show that the proposed method yields better classification results than other four existing methods and the support vector machine (SVM) classifier. A 95.93% average classification accuracy is achieved by using the proposed method.

Automatic sleep stage classification based on sparse deep belief net and combination of multiple classifiers

This paper presents an automatic sleep stage method combining a sparse deep belief net and combination of multiple classifiers for electroencephalogram, electrooculogram and electromyogram. The sparse deep belief net was applied to extract features from these signals automatically, and the combination of multiple classifiers, utilizing the extracted features, assigned each 30-s epoch to one of the five possible sleep stages. More importantly, we proposed a new voting principle based on classification entropy to enhance the classification performance further by harnessing the complementary information provided by the individual classifier. Differently from existing methods, our method used unsupervised feature learning to extract features automatically from raw sleep data and classification based on the learned features. The results of automatic and manual scorings were compared on an epoch-by-epoch basis. The accuracies for wake, S1, S2, SWS and REM were 98.49%, 80.05%, 91.2%, 98.22% and 95.31%, respectively, and the total accuracy of sleep stage was 91.31%. The results demonstrated that the sparse deep belief net was an efficient feature extraction method for sleep data, and the combination of multiple classifiers based on classification entropy performed well on sleep stages.

ISRUC-Sleep: A comprehensive public dataset for sleep researchers

To facilitate the performance comparison of new methods for sleep patterns analysis, datasets with quality content, publicly-available, are very important and useful. We introduce an open-access comprehensive sleep dataset, called ISRUC-Sleep. The data were obtained from human adults, including healthy subjects, subjects with sleep disorders, and subjects under the effect of sleep medication. Each recording was randomly selected between PSG recordings that were acquired by the Sleep Medicine Centre of the Hospital of Coimbra University (CHUC). The dataset comprises three groups of data: (1) data concerning 100 subjects, with one recording session per subject; (2) data gathered from 8 subjects; two recording sessions were performed per subject, and (3) data collected from one recording session related to 10 healthy subjects. The polysomnography (PSG) recordings, associated with each subject, were visually scored by two human experts. Comparing the existing sleep-related public datasets, ISRUC-Sleep provides data of a reasonable number of subjects with different characteristics such as: data useful for studies involving changes in the PSG signals over time; and data of healthy subjects useful for studies involving comparison of healthy subjects with the patients, suffering from sleep disorders. This dataset was created aiming to complement existing datasets by providing easy-to-apply data collection with some characteristics not covered yet. ISRUC-Sleep can be useful for analysis of new contributions: (i) in biomedical signal processing; (ii) in development of ASSC methods; and (iii) on sleep physiology studies. To evaluate and compare new contributions, which use this dataset as a benchmark, results of applying a subject-independent automatic sleep stage classification (ASSC) method on ISRUC-Sleep dataset are presented.

EEG signal features extraction based on fractal dimension

The spread of electroencephalography (EEG) in countless applications has fostered the development of new techniques for extracting synthetic and informative features from EEG signals. However, the definition of an effective feature set depends on the specific problem to be addressed and is currently an active field of research. In this work, we investigated the application of features based on fractal dimension to a problem of sleep identification from EEG data. We demonstrated that features based on fractal dimension, including two novel indices defined in this work, add valuable information to standard EEG features and significantly improve sleep identification performance.

Analysis and classification of sleep stages based on difference visibility graphs from a single-channel EEG signal

The existing sleep stages classification methods are mainly based on time or frequency features. This paper classifies the sleep stages based on graph domain features from a single-channel electroencephalogram (EEG) signal. First, each epoch (30 s) EEG signal is mapped into a visibility graph (VG) and a horizontal VG (HVG). Second, a difference VG (DVG) is obtained by subtracting the edges set of the HVG from the edges set of the VG to extract essential degree sequences and to detect the gait-related movement artifact recordings. The mean degrees (MDs) and degree distributions (DDs) P (k) on HVGs and DVGs are analyzed epoch-by-epoch from 14,963 segments of EEG signals. Then, the MDs of each DVG and HVG and seven distinguishable DD values of P (k) from each DVG are extracted. Finally, nine extracted features are forwarded to a support vector machine to classify the sleep stages into two, three, four, five, and six states. The accuracy and kappa coefficients of six-state classification are 87.5% and 0.81, respectively. It was found that the MDs of the VGs on the deep sleep stage are higher than those on the awake and light sleep stages, and the MDs of the HVGs are just the reverse.

Odds ratio product of sleep EEG as a continuous measure of sleep state

STUDY OBJECTIVES

To develop and validate an algorithm that provides a continuous estimate of sleep depth from the electroencephalogram (EEG).

DESIGN

Retrospective analysis of polysomnograms.

SETTING

Research laboratory.

PARTICIPANTS

114 patients who underwent clinical polysomnography in sleep centers at the University of Manitoba (n = 58) and the University of Calgary (n = 56).

INTERVENTIONS

None.

MEASUREMENTS AND RESULTS

Power spectrum of EEG was determined in 3-second epochs and divided into delta, theta, alpha-sigma, and beta frequency bands. The range of powers in each band was divided into 10 aliquots. EEG patterns were assigned a 4-digit number that reflects the relative power in the 4 frequency ranges (10,000 possible patterns). Probability of each pattern occurring in 30-s epochs staged awake was determined, resulting in a continuous probability value from 0% to 100%. This was divided by 40 (% of epochs staged awake) producing the odds ratio product (ORP), with a range of 0-2.5. In validation testing, average ORP decreased progressively as EEG progressed from wakefulness (2.19 ± 0.29) to stage N3 (0.13 ± 0.05). ORP < 1.0 predicted sleep and ORP > 2.0 predicted wakefulness in > 95% of 30-s epochs. Epochs with intermediate ORP occurred in unstable sleep with a high arousal index (> 70/h) and were subject to much interrater scoring variability. There was an excellent correlation (r(2) = 0.98) between ORP in current 30-s epochs and the likelihood of arousal or awakening occurring in the next 30-s epoch.

CONCLUSIONS

Our results support the use of the odds ratio product (ORP) as a continuous measure of sleep depth.

A two-step automatic sleep stage classification method with dubious range detection

BACKGROUND

The limitations of the current systems of automatic sleep stage classification (ASSC) are essentially related to the similarities between epochs from different sleep stages and the subjects' variability. Several studies have already identified the situations with the highest likelihood of misclassification in sleep scoring. Here, we took advantage of such information to develop an ASSC system based on knowledge of subjects' variability of some indicators that characterize sleep stages and on the American Academy of Sleep Medicine (AASM) rules.

METHODS

An ASSC system consisting of a two-step classifier is proposed. In the first step, epochs are classified using support vector machines (SVMs) spread into different nodes of a decision tree. In the post-processing step, the epochs suspected of misclassification (dubious classification) are tagged, and a new classification is suggested. Identification and correction are based on the AASM rules, and on misclassifications most commonly found/reported in automatic sleep staging. Six electroencephalographic and two electrooculographic channels were used to classify wake, non-rapid eye movement (NREM) sleep--N1, N2 and N3, and rapid eye movement (REM) sleep.

RESULTS

The proposed system was tested in a dataset of 14 clinical polysomnographic records of subjects suspected of apnea disorders. Wake and REM epochs not falling in the dubious range, are classified with accuracy levels compatible with the requirements for clinical applications. The suggested correction assigned to the epochs that are tagged as dubious enhances the global results of all sleep stages.

CONCLUSIONS

This approach provides reliable sleep staging results for non-dubious epochs.

Learning machines and sleeping brains: Automatic sleep stage classification using decision-tree multi-class support vector machines

BACKGROUND

Sleep staging is a critical step in a range of electrophysiological signal processing pipelines used in clinical routine as well as in sleep research. Although the results currently achievable with automatic sleep staging methods are promising, there is need for improvement, especially given the time-consuming and tedious nature of visual sleep scoring.

NEW METHOD

Here we propose a sleep staging framework that consists of a multi-class support vector machine (SVM) classification based on a decision tree approach. The performance of the method was evaluated using polysomnographic data from 15 subjects (electroencephalogram (EEG), electrooculogram (EOG) and electromyogram (EMG) recordings). The decision tree, or dendrogram, was obtained using a hierarchical clustering technique and a wide range of time and frequency-domain features were extracted. Feature selection was carried out using forward sequential selection and classification was evaluated using k-fold cross-validation.

RESULTS

The dendrogram-based SVM (DSVM) achieved mean specificity, sensitivity and overall accuracy of 0.92, 0.74 and 0.88 respectively, compared to expert visual scoring. Restricting DSVM classification to data where both experts' scoring was consistent (76.73% of the data) led to a mean specificity, sensitivity and overall accuracy of 0.94, 0.82 and 0.92 respectively.

COMPARISON WITH EXISTING METHODS

The DSVM framework outperforms classification with more standard multi-class "one-against-all" SVM and linear-discriminant analysis.

CONCLUSION

The promising results of the proposed methodology suggest that it may be a valuable alternative to existing automatic methods and that it could accelerate visual scoring by providing a robust starting hypnogram that can be further fine-tuned by expert inspection.

A low computational cost algorithm for REM sleep detection using single channel EEG

The push towards low-power and wearable sleep systems requires using minimum number of recording channels to enhance battery life, keep processing load small and be more comfortable for the user. Since most sleep stages can be identified using EEG traces, enormous power savings could be achieved by using a single channel of EEG. However, detection of REM sleep from one channel EEG is challenging due to its electroencephalographic similarities with N1 and Wake stages. In this paper we investigate a novel feature in sleep EEG that demonstrates high discriminatory ability for detecting REM phases. We then use this feature, that is based on spectral edge frequency (SEF) in the 8–16 Hz frequency band, together with the absolute power and the relative power of the signal, to develop a simple REM detection algorithm. We evaluate the performance of this proposed algorithm with overnight single channel EEG recordings of 5 training and 15 independent test subjects. Our algorithm achieved sensitivity of 83%, specificity of 89% and selectivity of 61% on a test database consisting of 2221 REM epochs. It also achieved sensitivity and selectivity of 81 and 75% on PhysioNet Sleep-EDF database consisting of 8 subjects. These results demonstrate that SEF can be a useful feature for automatic detection of REM stages of sleep from a single channel EEG.

Inter-hemispheric oscillations in human sleep

Sleep is generally categorized into discrete stages based on characteristic electroencephalogram (EEG) patterns. This traditional approach represents sleep architecture in a static way, but it cannot reflect variations in sleep across time and across the cortex. To investigate these dynamic aspects of sleep, we analyzed sleep recordings in 14 healthy volunteers with a novel, frequency-based EEG analysis. This approach enabled comparison of sleep patterns with low inter-individual variability. We then implemented a new probability dependent, automatic classification of sleep states that agreed closely with conventional manual scoring during consolidated sleep. Furthermore, this analysis revealed a previously unrecognized, interhemispheric oscillation during rapid eye movement (REM) sleep. This quantitative approach provides a new way of examining the dynamic aspects of sleep, shedding new light on the physiology of human sleep.