Automatic sleep stage recurrent neural classifier using energy features of EEG signals

Sleep stages classification by fusing the time-related synchronization analysis and brain activations

Sleep staging plays an important role in the diagnosis and treatment of clinical sleep disorders. The sleep staging standard defines every 30seconds as a sleep period, which may mean that there exist similar brain activity patterns during the same sleep period. Thus, in this work, we propose a novel time-related synchronization analysis framework named time-related multimodal sleep scoring model (TRMSC) to explore the potential time-related patterns of sleeping. In the proposed TRMSC, the time-related synchronization analysis is first conducted on the single channel electrophysiological signal, i.e., Electroencephalogram (EEG) and Electrooculogram (EOG), to explore the time-related patterns, and the spectral activation features are also extracted by spectrum analysis to obtain the multimodal features. With the extracted multimodal features, the feature fusion and selection strategy is utilized to obtain the optimal feature set and achieve robust sleep staging. To verify the effectiveness of the proposed TRMSC, sleep staging experiments were conducted on the Sleep-EDF dataset, and the experimental results indicate that the proposed TRMSC has achieved better performance than other existing strategies, which proves that the time-related synchronization features can make up for the shortcomings of traditional spectrum-based strategies and achieve a higher classification accuracy. The proposed TRMSC model may be helpful for portable sleep analyzers and provide a new analytical method for clinical sleeping research.

A Novel Continuous Sleep State Artificial Neural Network Model Based on Multi-Feature Fusion of Polysomnographic Data

Purpose

Sleep structure is crucial in sleep research, characterized by its dynamic nature and temporal progression. Traditional 30-second epochs falter in capturing the intricate subtleties of various micro-sleep states. This paper introduces an innovative artificial neural network model to generate continuous sleep depth value (SDV), utilizing a novel multi-feature fusion approach with EEG data, seamlessly integrating temporal consistency.

Methods

The study involved 50 normal and 100 obstructive sleep apnea-hypopnea syndrome (OSAHS) participants. After segmenting the sleep data into 3-second intervals, a diverse array of 38 feature values were meticulously extracted, including power, spectrum entropy, frequency band duration and so on. The ensemble random forest model calculated the timing fitness value for all the features, from which the top 7 time-correlated features were selected to create detailed sleep sample values ranging from 0 to 1. Subsequently, an artificial neural network (ANN) model was trained to delineate sleep continuity details, unravel concealed patterns, and far surpassed the traditional 5-stage categorization (W, N1, N2, N3, and REM).

Results

The SDV changes from wakeful stage (mean 0.7021, standard deviation 0.2702) to stage N3 (mean 0.0396, standard deviation 0.0969). During the arousal epochs, the SDV increases from the range (0.1 to 0.3) to the range around 0.7, and decreases below 0.3. When in the deep sleep (≤0.1), the probability of arousal of normal individuals is less than 10%, while the average arousal probability of OSA patients is close to 30%.

Conclusion

A sleep continuity model is proposed based on multi-feature fusion, which generates SDV ranging from 0 to 1 (representing deep sleep to wakefulness). It can capture the nuances of the traditional five stages and subtle differences in microstates of sleep, considered as a complement or even an alternative to traditional sleep analysis.

Imagined speech classification exploiting EEG power spectrum features

Imagined speech recognition has developed as a significant topic of research in the field of brain-computer interfaces. This innovative technique has great promise as a communication tool, providing essential help to those with impairments. An imagined speech recognition model is proposed in this paper to identify the ten most frequently used English alphabets (e.g., A, D, E, H, I, N, O, R, S, T) and numerals (e.g., 0 to 9). A novel electroencephalogram (EEG) dataset was created by measuring the brain activity of 30 people while they imagined these alphabets and digits. As part of signal preprocessing, EEG signals are filtered before extracting delta, theta, alpha, and beta band power features. These features are used as input for classification using support vector machines, k-nearest neighbors, and random forest (RF) classifiers. It is identified that the RF classifier outperformed the others in terms of classification accuracy. Classification accuracies of 99.38% and 95.39% were achieved at the coarse-level and fine-level, respectively with the RF classifier. From our study, it is also revealed that the beta frequency band and the frontal lobe of the brain played crucial roles in imagined speech recognition. Furthermore, a comparative analysis against state-of-the-art techniques is conducted to demonstrate the efficacy of our proposed model.

Strength of ensemble learning in automatic sleep stages classification using single-channel EEG and ECG signals

Healthy sleep plays an essential role in human daily life. Classification of sleep stages is a crucial tool for assisting physicians in diagnosing and treating sleep disorders. In this study, a strong ensemble learning model is proposed to enhance the ability of classification models in accurate sleep staging, particularly in multi-class classification. We asserted that high-accuracy sleep classification is achievable using only single-channel electroencephalogram (EEG) and electrocardiogram (ECG) by combining their best-extractable features in the time and frequency domains we recommended. More importantly, the superiority of the recommended method, which is the simultaneous use of stacking and bagging, over conventional machine learning classifiers in sleep staging was demonstrated, using the MIT-BIH Polysomnographic and Sleep-EDF expanded databases. Finally, K-fold cross-validation was used to fairly estimate these models. The best mean test accuracy rates for distinguishing between two classes of "sleep vs. wake," "rapid vs. non-rapid eye movement," and "deep vs. light sleep," were obtained 99.93%, 99.64%, and 99.69%, respectively. Furthermore, our proposed method achieved accuracies of 97.14%, 95.18%, 92.7%, and 85.64% for separating three, four, five, and six sleep classes, respectively. Compared to recent studies, our method outperforms other sleep stage classification schemes, especially in multi-class staging.

Citizen neuroscience: Wearable technology and open software to study the human brain in its natural habitat

Citizen science allows the public to participate in various stages of scientific research, including study design, data acquisition, and data analysis. Citizen science has a long history in several fields of the natural sciences, and with recent developments in wearable technology, neuroscience has also become more accessible to citizen scientists. This development was largely driven by the influx of minimal sensing systems in the consumer market, allowing more do-it-yourself (DIY) and quantified-self (QS) investigations of the human brain. While most subfields of neuroscience require sophisticated monitoring devices and laboratories, the study of sleep characteristics can be performed at home with relevant noninvasive consumer devices. The strong influence of sleep quality on waking life and the accessibility of devices to measure sleep are two primary reasons citizen scientists have widely embraced sleep research. Their involvement has evolved from solely contributing to data collection to engaging in more collaborative or autonomous approaches, such as instigating ideas, formulating research inquiries, designing research protocols and methodology, acting upon their findings, and disseminating results. In this article, we introduce the emerging field of citizen neuroscience, illustrating examples of such projects in sleep research. We then provide overviews of the wearable technologies for tracking human neurophysiology and various open-source software used to analyse them. Finally, we discuss the opportunities and challenges in citizen neuroscience projects and suggest how to improve the study of the human brain outside the laboratory.

A simple and fast ANN-based method of studying slow-wave sleep microstructure in freely moving rats

Electroencephalography (EEG) is a common technique for measuring brain activity. Artificial Neuronal Networks (ANNs) can provide valuable insights into the brain dynamics of humans and animals. We built a simple and fast shallow ANN-based solution for sleep recognition in EEGs recorded in freely moving rats. The ANN was constructed using open-source software and truncated to one formula with empirically defined weight coefficients. The optimization of the ANN model's performance (i.e., post-processing) relied on a probability-related approach to sleep microstructure. This approach could be a good way to analyze large datasets. In the current dataset, the slow-wave sleep was recognized with the sensitivity of 0.91 and the specificity of 0.98. The optimal model performance achieved with minimum sleep duration of 80-90 s and sleep interruption of 14-18 s. Our results suggest the following fundamental issues. First, 14-18 s sleep interruptions might be the archetypal micro-arousals in rats. Second, slow-wave sleep in rats might be built up of a set of sleep "building blocks" lasting 80-90 s.

Spatial-Temporal EEG Fusion Based on Neural Network for Major Depressive Disorder Detection

In view of the major depressive disorder characteristics such as high mortality as well as high recurrence, it is important to explore an objective and effective detection method for major depressive disorder. Considering the advantages complementary of different machine learning algorithms in information mining process, as well as the fusion complementary of different information, in this study, the spatial-temporal electroencephalography fusion framework using neural network is proposed for major depressive disorder detection. Since electroencephalography is a typical time series signal, we introduce recurrent neural network embedded in long short-term memory unit for extract temporal domain features to solve the problem of long-distance information dependence. To reduce the volume conductor effect, the temporal electroencephalography data are mapping into a spatial brain functional network using phase lag index, then the spatial domain features were extracted from brain functional network using 2D convolutional neural networks. Considering the complementarity between different types of features, the spatial-temporal electroencephalography features are fused to achieve data diversity. The experimental results show that spatial-temporal features fusion can improve the detection accuracy of major depressive disorder with a highest of 96.33%. In addition, our research also found that theta, alpha, and full frequency band in brain regions of left frontal, left central, right temporal are closely related to MDD detection, especially theta frequency band in left frontal region. Only using single-dimension EEG data as decision basis, it is difficult to fully explore the valuable information hidden in the data, which affects the overall detection performance of MDD. Meanwhile, different algorithms have their own advantages for different application scenarios. Ideally, different algorithms should use their respective advantages to jointly address complex problems in engineering fields. To this end, we propose a computer-aided MDD detection framework based on spatial-temporal EEG fusion using neural network, as shown in Fig. 1. The simplified process is as follows: (1) Raw EEG data acquisition and preprocessing. (2) The time series EEG data of each channel are input as recurrent neural network (RNN), and RNN is used to process and extract temporal domain (TD) features. (3) The BFN among different EEG channels is constructed, and CNN is used to process and extract the spatial domain (SD) features of the BFN. (4) Based on the theory of information complementarity, the spatial-temporal information is fused to realize efficient MDD detection. Fig. 1 MDD detection framework based on spatial-temporal EEG fusion.

Automatic neonatal sleep stage classification: A comparative study

Sleep is an essential feature of living beings. For neonates, it is vital for their mental and physical development. Sleep stage cycling is an important parameter to assess neonatal brain and physical development. Therefore, it is crucial to administer newborn's sleep in the neonatal intensive care unit (NICU). Currently, Polysomnography (PSG) is used as a gold standard method for classifying neonatal sleep patterns, but it is expensive and requires a lot of human involvement. Over the last two decades, multiple researchers are working on automatic sleep stage classification algorithms using electroencephalography (EEG), electrocardiography (ECG), and video. In this study, we present a comprehensive review of existing algorithms for neonatal sleep, their limitations and future recommendations. Additionally, a brief comparison of the extracted features, classification algorithms and evaluation parameters is reported in the proposed study.

SeriesSleepNet: an EEG time series model with partial data augmentation for automatic sleep stage scoring

Introduction: We propose an automatic sleep stage scoring model, referred to as SeriesSleepNet, based on convolutional neural network (CNN) and bidirectional long short-term memory (bi-LSTM) with partial data augmentation. We used single-channel raw electroencephalography signals for automatic sleep stage scoring. Methods: Our framework was focused on time series information, so we applied partial data augmentation to learn the connected time information in small series. In specific, the CNN module learns the time information of one epoch (intra-epoch) whereas the bi-LSTM trains the sequential information between the adjacent epochs (inter-epoch). Note that the input of the bi-LSTM is the augmented CNN output. Moreover, the proposed loss function was used to fine-tune the model by providing additional weights. To validate the proposed framework, we conducted two experiments using the Sleep-EDF and SHHS datasets. Results and Discussion: The results achieved an overall accuracy of 0.87 and 0.84 and overall F1-score of 0.80 and 0.78 and kappa value of 0.81 and 0.78 for five-class classification, respectively. We showed that the SeriesSleepNet was superior to the baselines based on each component in the proposed framework. Our architecture also outperformed the state-of-the-art methods with overall F1-score, accuracy, and kappa value. Our framework could provide information on sleep disorders or quality of sleep to automatically classify sleep stages with high performance.

Age-integrated artificial intelligence framework for sleep stage classification and obstructive sleep apnea screening

Introduction

Sleep is an essential function to sustain a healthy life, and sleep dysfunction can cause various physical and mental issues. In particular, obstructive sleep apnea (OSA) is one of the most common sleep disorders and, if not treated in a timely manner, OSA can lead to critical problems such as hypertension or heart disease.

Methods

The first crucial step in evaluating individuals' quality of sleep and diagnosing sleep disorders is to classify sleep stages using polysomnographic (PSG) data including electroencephalography (EEG). To date, such sleep stage scoring has been mainly performed manually via visual inspection by experts, which is not only a time-consuming and laborious process but also may yield subjective results. Therefore, we have developed a computational framework that enables automatic sleep stage classification utilizing the power spectral density (PSD) features of sleep EEG based on three different learning algorithms: support vector machine, k-nearest neighbors, and multilayer perceptron (MLP). In particular, we propose an integrated artificial intelligence (AI) framework to further inform the risk of OSA based on the characteristics in automatically scored sleep stages. Given the previous finding that the characteristics of sleep EEG differ by age group, we employed a strategy of training age-specific models (younger and older groups) and a general model and comparing their performance.

Results

The performance of the younger age-specific group model was similar to that of the general model (and even higher than the general model at certain stages), but the performance of the older age-specific group model was rather low, suggesting that bias in individual variables, such as age bias, should be considered during model training. Our integrated model yielded an accuracy of 73% in sleep stage classification and 73% in OSA screening when MLP algorithm was applied, which indicates that patients with OSA could be screened with the corresponding accuracy level only with sleep EEG without respiration-related measures.

Discussion

The current outcomes demonstrate the feasibility of AI-based computational studies that when combined with advances in wearable devices and relevant technologies could contribute to personalized medicine by not only assessing an individuals' sleep status conveniently at home but also by alerting them to the risk of sleep disorders and enabling early intervention.

Sleep stage classification in EEG signals using the clustering approach based probability distribution features coupled with classification algorithms

Sleep scoring is one of the primary tasks for the classification of sleep stages in Electroencephalogram (EEG) signals. Manual visual scoring of sleep stages is time-consuming as well as being dependent on the experience of a highly qualified sleep expert. This paper aims to address these issues by developing a new method to automatically classify sleep stages in EEG signals. In this research, a robust method has been presented based on the clustering approach, coupled with probability distribution features, to identify six sleep stages with the use of EEG signals. Using this method, each 30-second EEG signal is firstly segmented into small epochs and then each epoch is divided into 60 sub-segments. Each sub-segment is decomposed into five levels by using a discrete wavelet transform (DWT) to obtain the approximation and detailed coefficient. The wavelet coefficient of each level is clustered using the k-means algorithm. Subsequently, features are extracted based on the probability distribution for each wavelet coefficient. The extracted features then are forwarded to the least squares support vector machine classifier (LS-SVM) to identify sleep stages. Comparisons with several existing methods are also made in this study. The proposed method for the classification of the sleep stages achieves an average accuracy rate of 97.4%. It can be an effective tool for sleep stages classification and can be useful for doctors and neurologists for diagnosing sleep disorders.

An intelligent model involving multi-channels spectrum patterns based features for automatic sleep stage classification

Effective sleep monitoring from electroencephalogram (EEG) signals is meaningful for the diagnosis of sleep disorders, such as sleep Apnea, Insomnia, Snoring, Sleep Hypoventilation, and restless legs syndrome. Hence, developing an automatic sleep stage scoring method based on EEGs has attracted extensive research attention in recent years. The existing methods of sleep stage classification are insufficient to investigate waveform patterns, texture patterns, and temporal transformation of EEG signals, which are most associated with sleep stages scoring. To address these issues, we proposed an intelligence model based on multi-channels texture colour analysis to automatically classify sleep staging. In the proposed model, a short-time Fourier transform is applied to each EEG 30 s segment to convert it into an image form. Then the resulted spectrum image is analysed using Multiple channels Information Local Binary Pattern (MILBP). The extracted information using MILBP is then deployed to differentiate EEG sleep stages. The extracted features are tested, and the most effective ones are used to the represented EEG sleep stages. The selected characteristics are fed to an ensemble classifier integrated with a genetic algorithm which is used to select the optimal weight for each classifier, to classify EEG signal into designated sleep stages. The experimental results on two benchmark sleep datasets showed that the proposed model obtained the best performance compared with several baseline methods, including accuracy of 0.96 and 0.95, and F1-score of 0.94 and 0.93, thus demonstrating the effectiveness of our proposed model.

Scoring sleep with artificial intelligence enables quantification of sleep stage ambiguity: hypnodensity based on multiple expert scorers and auto-scoring

STUDY OBJECTIVES

To quantify the amount of sleep stage ambiguity across expert scorers and to validate a new auto-scoring platform against sleep staging performed by multiple scorers.

METHODS

We applied a new auto-scoring system to three datasets containing 95 PSGs scored by 6-12 scorers, to compare sleep stage probabilities (hypnodensity; i.e. the probability of each sleep stage being assigned to a given epoch) as the primary output, as well as a single sleep stage per epoch assigned by hierarchical majority rule.

RESULTS

The percentage of epochs with 100% agreement across scorers was 46 ± 9%, 38 ± 10% and 32 ± 9% for the datasets with 6, 9, and 12 scorers, respectively. The mean intra-class correlation coefficient between sleep stage probabilities from auto- and manual-scoring was 0.91, representing excellent reliability. Within each dataset, agreement between auto-scoring and consensus manual-scoring was significantly higher than agreement between manual-scoring and consensus manual-scoring (0.78 vs. 0.69; 0.74 vs. 0.67; and 0.75 vs. 0.67; all p < 0.01).

CONCLUSIONS

Analysis of scoring performed by multiple scorers reveals that sleep stage ambiguity is the rule rather than the exception. Probabilities of the sleep stages determined by artificial intelligence auto-scoring provide an excellent estimate of this ambiguity. Compared to consensus manual-scoring, sleep staging derived from auto-scoring is for each individual PSG noninferior to manual-scoring meaning that auto-scoring output is ready for interpretation without the need for manual adjustment.

Fast Sleep Stage Classification Using Cascaded Support Vector Machines with Single-Channel EEG Signals

Long-term sleep stage monitoring is very important for the diagnosis and treatment of insomnia. With the development of wearable electroencephalogram (EEG) devices, we developed a fast and accurate sleep stage classification method in this study with single-channel EEG signals for practical applications. The original sleep recordings were collected from the Sleep-EDF database. The wavelet threshold denoising (WTD) method and wavelet packet transformation (WPT) method were applied as signal preprocessing to extract six kinds of characteristic waves. With a comprehensive feature system including time, frequency, and nonlinear dynamics, we obtained the sleep stage classification results with different Support Vector Machine (SVM) models. We proposed a novel classification method based on cascaded SVM models with various features extracted from denoised EEG signals. To enhance the accuracy and generalization performance of this method, nonlinear dynamics features were taken into consideration. With nonlinear dynamics features included, the average classification accuracy was up to 88.11% using this method. In addition, with cascaded SVM models, the classification accuracy of the non-rapid eye movement sleep stage 1 (N1) was enhanced from 41.5% to 55.65% compared with the single SVM model, and the overall classification time for each epoch was less than 1.7 s. Moreover, we demonstrated that it was possible to apply this method for long-term sleep stage monitor applications.

A novel approach to automatic sleep stage classification using forehead electrophysiological signals

Background

Sleep stage scoring is very important for the effective diagnosis and intervention of sleep disorders. However, the current automatic sleep staging methods generally have the problems of poor model generalization ability and non-portable acquisition equipment.

Method

In this paper, we propose a novel automatic sleep scoring system based on forehead electrophysiological signals that is more effective and convenient than other systems. We extract 3 channel signals from the forehead, named forehead electroencephalogram 1 (Fh1), forehead electroencephalogram 2 (Fh2), and forehead center electrooculogram (Fhz). Spectral features, statistical features, and entropy features are extracted using the discrete wavelet transform (DWT) method. Light gradient boosting machine (LGB), random forest (RF), and support vector machine (SVM) are employed to classify four stages: awake, light sleep (LS), deep sleep (DS), and rapid eye movement (REM).

Result

The performance of the proposed method is validated using databases of the Sleep-EDFX and our Own-data, which include polysomnograms (PSGs) and forehead signals of 28 subjects. The overall classification accuracy of using the combination of Fh1, Fh2, and Fhz can reach up to 90.25% accuracy with a kappa coefficient of 0.857.

Conclusions

The proposed method could provide state-of-art multichannel sleep stage scoring performance with higher portability. This will facilitate the application of long-term monitoring of sleep quality in the future.

A Deep Transfer Learning Framework for Sleep Stage Classification with Single-Channel EEG Signals

The polysomnogram (PSG) is the gold standard for evaluating sleep quality and disorders. Attempts to automate this process have been hampered by the complexity of the PSG signals and heterogeneity among subjects and recording hardwares. Most of the existing methods for automatic sleep stage scoring rely on hand-engineered features that require prior knowledge of sleep analysis. This paper presents an end-to-end deep transfer learning framework for automatic feature extraction and sleep stage scoring based on a single-channel EEG. The proposed framework was evaluated over the three primary signals recommended by the American Academy of Sleep Medicine (C4-M1, F4-M1, O2-M1) from two data sets that have different properties and are recorded with different hardware. Different Time-Frequency (TF) imaging approaches were evaluated to generate TF representations for the 30 s EEG sleep epochs, eliminating the need for complex EEG signal pre-processing or manual feature extraction. Several training and detection scenarios were investigated using transfer learning of convolutional neural networks (CNN) and combined with recurrent neural networks. Generating TF images from continuous wavelet transform along with a deep transfer architecture composed of a pre-trained GoogLeNet CNN followed by a bidirectional long short-term memory (BiLSTM) network showed the best scoring performance among all tested scenarios. Using 20-fold cross-validation applied on the C4-M1 channel, the proposed framework achieved an average per-class accuracy of 91.2%, sensitivity of 77%, specificity of 94.1%, and precision of 75.9%. Our results demonstrate that without changing the model architecture and the training algorithm, our model could be applied to different single-channel EEGs from different data sets. Most importantly, the proposed system receives a single EEG epoch as an input at a time and produces a single corresponding output label, making it suitable for real time monitoring outside sleep labs as well as to help sleep lab specialists arrive at a more accurate diagnoses.

Sleep State Trend (SST), a bedside measure of neonatal sleep state fluctuations based on single EEG channels

OBJECTIVE

To develop and validate an automated method for bedside monitoring of sleep state fluctuations in neonatal intensive care units.

METHODS

A deep learning-based algorithm was designed and trained using 53 EEG recordings from a long-term (a)EEG monitoring in 30 near-term neonates. The results were validated using an independent dataset from 30 polysomnography recordings. In addition, we constructed Sleep State Trend (SST), a bedside-ready means for visualizing classifier outputs.

RESULTS

The accuracy of quiet sleep detection in the training data was 90%, and the accuracy was comparable (85-86 %) in all bipolar derivations available from the 4-electrode recordings. The algorithm generalized well to a polysomnography dataset, showing 81% overall accuracy despite different signal derivations. SST allowed an intuitive, clear visualization of the classifier output.

CONCLUSIONS

Fluctuations in sleep states can be detected at high fidelity from a single EEG channel, and the results can be visualized as a transparent and intuitive trend in the bedside monitors.

SIGNIFICANCE

The Sleep State Trend (SST) may provide caregivers and clinical studies a real-time view of sleep state fluctuations and its cyclicity.

Automatic sleep stages classification using multi-level fusion

Sleep efficiency is a factor that can determine a person's healthy life. Sleep efficiency can be calculated by analyzing the results of the sleep stage classification. There have been many studies to classify sleep stages automatically using multiple signals to improve the accuracy of the sleep stage classification. The fusion method is used to process multi-signal data. Fusion methods include data-level fusion, feature-level fusion, and decision-level fusion methods. We propose a multi-level fusion method to increase the accuracy of the sleep stage classification when using multi-signal data consisting of electroencephalography and electromyography signals. First, we used feature-level fusion to fuse the extracted features using a convolutional neural network for multi-signal data. Then, after obtaining each classified result using the fused feature data, the sleep stage was derived using a decision-level fusion method that fused classified results. We used public datasets, Sleep-EDF, to measure performance; we confirmed that the proposed multi-level fusion method yielded a higher accuracy of 87.2%, respectively, compared to single-level fusion method and more existing methods. The proposed multi-level fusion method showed the most improved performance in classifying N1 stage, where existing methods had the lowest performance.

Automatic Detection of Driver Fatigue Based on EEG Signals Using a Developed Deep Neural Network

In recent years, detecting driver fatigue has been a significant practical necessity and issue. Even though several investigations have been undertaken to examine driver fatigue, there are relatively few standard datasets on identifying driver fatigue. For earlier investigations, conventional methods relying on manual characteristics were utilized to assess driver fatigue. In any case study, such approaches need previous information for feature extraction, which could raise computing complexity. The current work proposes a driver fatigue detection system, which is a fundamental necessity to minimize road accidents. Data from 11 people are gathered for this purpose, resulting in a comprehensive dataset. The dataset is prepared in accordance with previously published criteria. A deep convolutional neural network–long short-time memory (CNN–LSTM) network is conceived and evolved to extract characteristics from raw EEG data corresponding to the six active areas A, B, C, D, E (based on a single channel), and F. The study’s findings reveal that the suggested deep CNN–LSTM network could learn features hierarchically from raw EEG data and attain a greater precision rate than previous comparative approaches for two-stage driver fatigue categorization. The suggested approach may be utilized to construct automatic fatigue detection systems because of their precision and high speed.

A Deep Learning Method Approach for Sleep Stage Classification with EEG Spectrogram

The classification of sleep stages is an important process. However, this process is time-consuming, subjective, and error-prone. Many automated classification methods use electroencephalogram (EEG) signals for classification. These methods do not classify well enough and perform poorly in the N1 due to unbalanced data. In this paper, we propose a sleep stage classification method using EEG spectrogram. We have designed a deep learning model called EEGSNet based on multi-layer convolutional neural networks (CNNs) to extract time and frequency features from the EEG spectrogram, and two-layer bi-directional long short-term memory networks (Bi-LSTMs) to learn the transition rules between features from adjacent epochs and to perform the classification of sleep stages. In addition, to improve the generalization ability of the model, we have used Gaussian error linear units (GELUs) as the activation function of CNN. The proposed method was evaluated by four public databases, the Sleep-EDFX-8, Sleep-EDFX-20, Sleep-EDFX-78, and SHHS. The accuracy of the method is 94.17%, 86.82%, 83.02% and 85.12%, respectively, for the four datasets, the MF1 is 87.78%, 81.57%, 77.26% and 78.54%, respectively, and the Kappa is 0.91, 0.82, 0.77 and 0.79, respectively. In addition, our proposed method achieved better classification results on N1, with an F1-score of 70.16%, 52.41%, 50.03% and 47.26% for the four datasets.

A Holistic Strategy for Classification of Sleep Stages with EEG

Manual sleep stage scoring is usually implemented with the help of sleep specialists by means of visual inspection of the neurophysiological signals of the patient. As it is a very hectic task to perform, automated sleep stage classification systems were developed in the past, and advancements are being made consistently by researchers. The various stages of sleep are identified by these automated sleep stage classification systems, and it is quite an important step to assist doctors for the diagnosis of sleep-related disorders. In this work, a holistic strategy named as clustering and dimensionality reduction with feature extraction cum selection for classification along with deep learning (CDFCD) is proposed for the classification of sleep stages with EEG signals. Though the methodology follows a similar structural flow as proposed in the past works, many advanced and novel techniques are proposed under each category in this work flow. Initially, clustering is applied with the help of hierarchical clustering, spectral clustering, and the proposed principal component analysis (PCA)-based subspace clustering. Then the dimensionality of it is reduced with the help of the proposed singular value decomposition (SVD)-based spectral algorithm and the standard variational Bayesian matrix factorization (VBMF) technique. Then the features are extracted and selected with the two novel proposed techniques, such as the sparse group lasso technique with dual-level implementation (SGL-DLI) and the ridge regression technique with limiting weight scheme (RR-LWS). Finally, the classification happens with the less explored multiclass Gaussian process classification (MGC), the proposed random arbitrary collective classification (RACC), and the deep learning technique using long short-term memory (LSTM) along with other conventional machine learning techniques. This methodology is validated on the sleep EDF database, and the results obtained with this methodology have surpassed the results of the previous studies in terms of the obtained classification accuracy reporting a high accuracy of 93.51% even for the six-classes classification problem.

Automated Classification of Sleep Stages Using Single-Channel EEG A Machine Learning-Based Method

The main contribution of this paper is to present a novel approach for classifying the sleep stages based on optimal feature selection with ensemble learning stacking model using single-channel EEG signals.To find the suitable features from extracted feature vector, we obtained the ReliefF (ReF), Fisher Score (FS) and Online Stream Feature Selection (OSFS) selection algorithms.The proposed research work was performed on two different subgroups of sleep data of ISRUC-Sleep dataset. The experimental results of the proposed methodology signify that single-channel of EEG signal superior to other machine learning classification models with overall accuracies of 97.93%, 97%, and 95.96% using ISRUC-Sleep subgroup-I (SG-I) data and similarly the proposed model achieved an overall accuracies of 98.16%, 98.78%, and 95.26% using ISRUC-Sleep subgroup-III (SG-III) data with FS, ReF and OSFS respectively.

Evaluation of a Single-Channel EEG-Based Sleep Staging Algorithm

Sleep staging is the basis of sleep assessment and plays a crucial role in the early diagnosis and intervention of sleep disorders. Manual sleep staging by a specialist is time-consuming and is influenced by subjective factors. Moreover, some automatic sleep staging algorithms are complex and inaccurate. The paper proposes a single-channel EEG-based sleep staging method that provides reliable technical support for diagnosing sleep problems. In this study, 59 features were extracted from three aspects: time domain, frequency domain, and nonlinear indexes based on single-channel EEG data. Support vector machine, neural network, decision tree, and random forest classifier were used to classify sleep stages automatically. The results reveal that the random forest classifier has the best sleep staging performance among the four algorithms. The recognition rate of the Wake phase was the highest, at 92.13%, and that of the N1 phase was the lowest, at 73.46%, with an average accuracy of 83.61%. The embedded method was adopted for feature filtering. The results of sleep staging of the 11-dimensional features after filtering show that the random forest model achieved 83.51% staging accuracy under the condition of reduced feature dimensions, and the coincidence rate with the use of all features for sleep staging was 94.85%. Our study confirms the robustness of the random forest model in sleep staging, which also represents a high classification accuracy with appropriate classifier algorithms, even using single-channel EEG data. This study provides a new direction for the portability of clinical EEG monitoring.

Auto-annotating sleep stages based on polysomnographic data

Sleep disorders affect the quality of life, and the clinical diagnosis of sleep disorders is a time-consuming and tedious process requiring recording and annotating polysomnographic records. In this work, we developed an auto-annotation algorithm based on polysomnographic records and a deep learning architecture that predicts sleep stages at the millisecond level. The model improves the efficiency of the polysomnographic record annotation process by automatically annotating each record within 3.8 s of computation time and with high accuracy. Disease-related sleep stages, such as arousal and apnea, can also be identified by this model, which further expands the physiological insights that the model can potentially provide. Finally, we explored the applicability of the model to data collected from a different modality to demonstrate the robustness of the model.

•

Polysomnography enables accurate annotation of sleeping stages by machine learning

•

Apnea/arousal can be more accurately detected by full polysomnography than EEG

•

U-net achieved excellent performance in sequence-to-sequence prediction

•

Our deep learning model achieves human-level accuracy in sleep status annotations

Sleep quality is one of the top public health concerns. Disturbance during sleep will affect peoples' daily executive functions. In addition, some pathological sleeping conditions, such as arousal and apnea, are closely associated with severe health conditions such as cardiovascular diseases. Traditional sleeping surveillance requires laborious human effort while maintaining a limited reproducibility. In this study, we present a fast automatic sleep annotation deep learning model with excellent performances. Our model can annotate sleeping stages as well as sleeping arousal/apnea at the same time, which provides insight for clinical diagnosis of sleeping patients.

A lightweight automatic sleep staging method for children using single-channel EEG based on edge artificial intelligence

With the development of telemedicine and edge computing, edge artificial intelligence (AI) will become a new development trend for smart medicine. On the other hand, nearly one-third of children suffer from sleep disorders. However, all existing sleep staging methods are for adults. Therefore, we adapted edge AI to develop a lightweight automatic sleep staging method for children using single-channel EEG. The trained sleep staging model will be deployed to edge smart devices so that the sleep staging can be implemented on edge devices which will greatly save network resources and improving the performance and privacy of sleep staging application. Then the results and hypnogram will be uploaded to the cloud server for further analysis by the physicians to get sleep disease diagnosis reports and treatment opinions. We utilized 1D convolutional neural networks (1D-CNN) and long short term memory (LSTM) to build our sleep staging model, named CSleepNet. We tested the model on our childrens sleep (CS) dataset and sleep-EDFX dataset. For the CS dataset, we experimented with F4-M1 channel EEG using four different loss functions, and the logcosh performed best with overall accuracy of 83.06% and F1-score of 76.50%. We used Fpz-Cz and Pz-Oz channel EEG to train our model in Sleep-EDFX dataset, and achieved an accuracy of 86.41% without manual feature extraction. The experimental results show that our method has great potential. It not only plays an important role in sleep-related research, but also can be widely used in the classification of other time sequences physiological signals.

Home-Use and Real-Time Sleep-Staging System Based on Eye Masks and Mobile Devices with a Deep Learning Model

Purpose

Sleep is an important human activity. Comfortable sensing and accurate analysis in sleep monitoring is beneficial to many healthcare and medical applications. From 2020, owing to the COVID‑19 pandemic that spreads between people when they come into close physical contact with one another, the willingness to go to hospital for receiving care has reduced; care-at-home is the trend in modern healthcare. Therefore, a home-use and real-time sleep-staging system is developed in this paper.

Methods

We developed and implemented a real-time sleep staging system that integrates a wearable eye mask for high-quality electroencephalogram/electrooculogram measurement and a mobile device with MobileNETV2 deep learning model for sleep-stage identification. In the experiments, 25 all-night recordings were acquired, 17 of which were used for training, and the remaining eight were used for testing.

Results

The averaged scoring agreements for the wake, light sleep, deep sleep, and rapid eye movement stages were 85.20%, 87.17%, 82.87%, and 89.30%, respectively, for our system compared with the manual scoring of PSG recordings. In addition, the mean absolute errors of four objective sleep measurements, including sleep efficiency, total sleep time, sleep onset time, and wake after sleep onset time were 1.68%, 7.56 min, 5.50 min, and 3.94 min, respectively. No significant differences were observed between the proposed system and manual PSG scoring in terms of the percentage of each stage and the objective sleep measurements.

Conclusion

These experimental results demonstrate that our system provides high scoring agreements in sleep staging and unbiased sleep measurements owing to the use of EEG and EOG signals and powerful mobile computing based on deep learning networks. These results also suggest that our system is applicable for home-use real-time sleep monitoring.

Attention based convolutional network for automatic sleep stage classification

Sleep staging is an important basis for diagnosing sleep-related problems. In this paper, an attention based convolutional network for automatic sleep staging is proposed. The network takes time-frequency image as input and predict sleep stage for each 30-s epoch as output. For each CNN feature maps, our model generate attention maps along two separate dimensions, time and filter, and then multiplied to form the final attention map. Residual-like fusion structure is used to append the attention map to the input feature map for adaptive feature refinement. In addition, to get the global feature representation with less information loss, the generalized mean pooling is introduced. To prove the efficacy of the proposed method, we have compared with two baseline method on sleep-EDF data set with different setting of the framework and input channel type, the experimental results show that the paper model has achieved significant improvements in terms of overall accuracy, Cohen's kappa, MF1, sensitivity and specificity. The performance of the proposed network is compared with that of the state-of-the-art algorithms with an overall accuracy of 83.4%, a macro F1-score of 77.3%, κ = 0.77, sensitivity = 77.1% and specificity = 95.4%, respectively. The experimental results demonstrate the superiority of the proposed network.

Automatic Sleep Staging Algorithm Based on Time Attention Mechanism

The most important part of sleep quality assessment is the automatic classification of sleep stages. Sleep staging is helpful in the diagnosis of sleep-related diseases. This study proposes an automatic sleep staging algorithm based on the time attention mechanism. Time-frequency and non-linear features are extracted from the physiological signals of six channels and then normalized. The time attention mechanism combined with the two-way bi-directional gated recurrent unit (GRU) was used to reduce computing resources and time costs, and the conditional random field (CRF) was used to obtain information between tags. After five-fold cross-validation on the Sleep-EDF dataset, the values of accuracy, WF1, and Kappa were 0.9218, 0.9177, and 0.8751, respectively. After five-fold cross-validation on the our own dataset, the values of accuracy, WF1, and Kappa were 0.9006, 0.8991, and 0.8664, respectively, which is better than the result of the latest algorithm. In the study of sleep staging, the recognition rate of the N1 stage was low, and the imbalance has always been a problem. Therefore, this study introduces a type of balancing strategy. By adopting the proposed strategy, SEN-N1 and ACC of 0.7 and 0.86, respectively, can be achieved. The experimental results show that compared to the latest method, the proposed model can achieve significantly better performance and significantly improve the recognition rate of the N1 period. The performance comparison of different channels shows that even when the EEG channel was not used, considerable accuracy can be obtained.

Automatic Sleep Stage Classification Using Temporal Convolutional Neural Network and New Data Augmentation Technique from Raw Single-Channel EEG

BACKGROUND AND OBJECTIVE

This paper presents a new framework for automatic classification of sleep stages using a deep learning algorithm from single-channel EEG signals. Each segmented EEG signal appended with its label of stages is fed into a deep learning model to create an automatic sleep stage classification. This is one of the most important problems that is critical to the realization of monitoring patients with sleep disorder.

METHODS

In the present study, a neural network architecture is introduced utilizing Convolutional Neural Networks (CNNs) to extract features, followed by Temporal Convolutional Neural Network to extract the temporal features from the extracted features vector of CNN. Finally, the performance of our model is improved by a Conditional Random Field layer. We also employed a new data augmentation technique to enhance the CNNs training which has auxiliary effects.

RESULTS

We evaluated our model by two different single-channel EEG signals (i.e., Fpz-Cz and Pz-Oz EEG channels) from two public sleep datasets, named Sleep-EDF-2013 and Sleep-EDF-2018. The evaluation results on both datasets showed that our model obtains the best total accuracy and kappa score (EDF-2013: 85.39%- 0.80, EDF-2018: 82.46%- 0.76) compared to the state-of-the-art methods.

CONCLUSIONS

This study will possibly allow us to have a wearable sleep monitoring system with a single-channel EEG. Also, unlike hand-crafted features methods, our model finds its own patterns through training epochs, and therefore, it may minimize engineering bias.

Sleep Quality Detection Based on EEG Signals Using Transfer Support Vector Machine Algorithm

BACKGROUND

In recent years, with the acceleration of life rhythm and increased pressure, the problem of sleep disorders has become more and more serious. It affects people's quality of life and reduces work efficiency, so the monitoring and evaluation of sleep quality is of great significance. Sleep staging has an important reference value in sleep quality assessment. This article starts with the study of sleep staging to detect and analyze sleep quality. For the purpose of sleep quality detection, this article proposes a sleep quality detection method based on electroencephalography (EEG) signals.

MATERIALS AND METHODS

This method first preprocesses the EEG signals and then uses the discrete wavelet transform (DWT) for feature extraction. Finally, the transfer support vector machine (TSVM) algorithm is used to classify the feature data.

RESULTS

The proposed algorithm was tested using 60 pieces of data from the National Sleep Research Resource Library of the United States, and sleep quality was evaluated using three indicators: sensitivity, specificity, and accuracy. Experimental results show that the classification performance of the TSVM classifier is significantly higher than those of other comparison algorithms. This further validated the effectiveness of the proposed sleep quality detection method.

Expert-level automated sleep staging of long-term scalp electroencephalography recordings using deep learning

STUDY OBJECTIVES

Develop a high-performing, automated sleep scoring algorithm that can be applied to long-term scalp electroencephalography (EEG) recordings.

METHODS

Using a clinical dataset of polysomnograms from 6,431 patients (MGH-PSG dataset), we trained a deep neural network to classify sleep stages based on scalp EEG data. The algorithm consists of a convolutional neural network for feature extraction, followed by a recurrent neural network that extracts temporal dependencies of sleep stages. The algorithm's inputs are four scalp EEG bipolar channels (F3-C3, C3-O1, F4-C4, and C4-O2), which can be derived from any standard PSG or scalp EEG recording. We initially trained the algorithm on the MGH-PSG dataset and used transfer learning to fine-tune it on a dataset of long-term (24-72 h) scalp EEG recordings from 112 patients (scalpEEG dataset).

RESULTS

The algorithm achieved a Cohen's kappa of 0.74 on the MGH-PSG holdout testing set and cross-validated Cohen's kappa of 0.78 after optimization on the scalpEEG dataset. The algorithm also performed well on two publicly available PSG datasets, demonstrating high generalizability. Performance on all datasets was comparable to the inter-rater agreement of human sleep staging experts (Cohen's kappa ~ 0.75 ± 0.11). The algorithm's performance on long-term scalp EEGs was robust over a wide age range and across common EEG background abnormalities.

CONCLUSION

We developed a deep learning algorithm that achieves human expert level sleep staging performance on long-term scalp EEG recordings. This algorithm, which we have made publicly available, greatly facilitates the use of large long-term EEG clinical datasets for sleep-related research.

Automated Detection of Sleep Stages Using Deep Learning Techniques: A Systematic Review of the Last Decade (2010–2020)

Sleep is vital for one’s general well-being, but it is often neglected, which has led to an increase in sleep disorders worldwide. Indicators of sleep disorders, such as sleep interruptions, extreme daytime drowsiness, or snoring, can be detected with sleep analysis. However, sleep analysis relies on visuals conducted by experts, and is susceptible to inter- and intra-observer variabilities. One way to overcome these limitations is to support experts with a programmed diagnostic tool (PDT) based on artificial intelligence for timely detection of sleep disturbances. Artificial intelligence technology, such as deep learning (DL), ensures that data are fully utilized with low to no information loss during training. This paper provides a comprehensive review of 36 studies, published between March 2013 and August 2020, which employed DL models to analyze overnight polysomnogram (PSG) recordings for the classification of sleep stages. Our analysis shows that more than half of the studies employed convolutional neural networks (CNNs) on electroencephalography (EEG) recordings for sleep stage classification and achieved high performance. Our study also underscores that CNN models, particularly one-dimensional CNN models, are advantageous in yielding higher accuracies for classification. More importantly, we noticed that EEG alone is not sufficient to achieve robust classification results. Future automated detection systems should consider other PSG recordings, such as electroencephalogram (EEG), electrooculogram (EOG), and electromyogram (EMG) signals, along with input from human experts, to achieve the required sleep stage classification robustness. Hence, for DL methods to be fully realized as a practical PDT for sleep stage scoring in clinical applications, inclusion of other PSG recordings, besides EEG recordings, is necessary. In this respect, our report includes methods published in the last decade, underscoring the use of DL models with other PSG recordings, for scoring of sleep stages.

Ontology-Based Decision Support Tool for Automatic Sleep Staging Using Dual-Channel EEG Data

Sleep staging has attracted significant attention as a critical step in auxiliary diagnosis of sleep disease. To avoid subjectivity of doctor’s manual sleep staging, and to realize scientific management of massive physiological data, an ontology-based decision support tool is proposed. The tool implements an automated procedure for sleep staging using dual-channel electroencephalogram (EEG) signals. First of all, it encodes EEG features, sleep-related concepts and other contextual information to “EEG-Sleep ontology”. Secondly, a rule-set is constructed based on a data mining technique. Finally, the first two steps are processed in a reasoning engine which is automatically assign each 30 s epoch (segment) sleep stage to one of five possible sleep stages: WA, NREM1, NREM2, SWS and REM. The rule set is obtained using EEG data taken from the Sleep-EDF database [EXPANDED] according to the random forest algorithm (RF), we prove that the performance of the proposed method with 89.12% accuracy, and 0.81 Kappa statistics is superior to other algorithms such as Bayesian network, C4.5, support vector machine, and multilayer perceptron. Additionally, our proposed approach improved performance when compared to other studies using a small subset of the Sleep-EDF database [EXPANDED].