An Attention-Guided Spatiotemporal Graph Convolutional Network for Sleep Stage Classification

Spatiotemporal convolution sleep network based on graph attention mechanism with automatic feature extraction

BACKGROUND AND OBJECTIVE

Graph neural networks (GNNs) are widely used for automatic sleep staging. However, the majority of GNNs are based on spectral approaches, as far as we know, which heavily depend on the Laplacian eigenbasis determined by the graph structure with a large computing cost.

METHODS

We introduced a non-spectral approach named graph attention networks v2 (GATv2) as the core of our network to extract spatial information (S-GATv2 in our work), which is more flexible and intuitive than the routined spectral method. Meanwhile, to resolve the issue of weak generalization of using traditional feature extraction, the multi-convolutional layers are implemented to automatically extract features. In this work, the proposed spatiotemporal convolution sleep network (ST-GATv2) consists of multi-convolution layers and a GATv2 block. Of note, the graph attention technique to the time domain was applied to construct temporal GATv2 (T-GATv2), which intends to capture the connection between two channels in the adjacent sleep stages. Besides, the modified function is further proposed to capture the hidden changing trend information by the difference in the feature's value of the two adjacent stages.

RESULTS

In our experiment, we used the SS3 datasets in the MASS as our test datasets to compare with other advanced models. Our result reveals our model achieves the highest accuracy at 89.0 %. Besides, the proposed T-GATv2 block and modified function bring an approximate 0.5 % improvement in Kappa and F1-score.

CONCLUSIONS

Our results support the potential of graph attention mechanisms and creative blocks (T-GATv2 and modified function) in sleep classification. We suggest the proposed ST-GATv2 model as an effective tool in sleep staging in either healthy or diseased states.

Multi-Modal Sleep Stage Classification With Two-Stream Encoder-Decoder

Sleep staging serves as a fundamental assessment for sleep quality measurement and sleep disorder diagnosis. Although current deep learning approaches have successfully integrated multimodal sleep signals, enhancing the accuracy of automatic sleep staging, certain challenges remain, as follows: 1) optimizing the utilization of multi-modal information complementarity, 2) effectively extracting both long- and short-range temporal features of sleep information, and 3) addressing the class imbalance problem in sleep data. To address these challenges, this paper proposes a two-stream encode-decoder network, named TSEDSleepNet, which is inspired by the depth sensitive attention and automatic multi-modal fusion (DSA2F) framework. In TSEDSleepNet, a two-stream encoder is used to extract the multiscale features of electrooculogram (EOG) and electroencephalogram (EEG) signals. And a self-attention mechanism is utilized to fuse the multiscale features, generating multi-modal saliency features. Subsequently, the coarser-scale construction module (CSCM) is adopted to extract and construct multi-resolution features from the multiscale features and the salient features. Thereafter, a Transformer module is applied to capture both long- and short-range temporal features from the multi-resolution features. Finally, the long- and short-range temporal features are restored with low-layer details and mapped to the predicted classification results. Additionally, the Lovász loss function is applied to alleviate the class imbalance problem in sleep datasets. Our proposed method was tested on the Sleep-EDF-39 and Sleep-EDF-153 datasets, and it achieved classification accuracies of 88.9% and 85.2% and Macro-F1 scores of 84.8% and 79.7%, respectively, thus outperforming conventional traditional baseline models. These results highlight the efficacy of the proposed method in fusing multi-modal information. This method has potential for application as an adjunct tool for diagnosing sleep disorders.

Current status and prospects of automatic sleep stages scoring: Review

The scoring of sleep stages is one of the essential tasks in sleep analysis. Since a manual procedure requires considerable human and financial resources, and incorporates some subjectivity, an automated approach could result in several advantages. There have been many developments in this area, and in order to provide a comprehensive overview, it is essential to review relevant recent works and summarise the characteristics of the approaches, which is the main aim of this article. To achieve it, we examined articles published between 2018 and 2022 that dealt with the automated scoring of sleep stages. In the final selection for in-depth analysis, 125 articles were included after reviewing a total of 515 publications. The results revealed that automatic scoring demonstrates good quality (with Cohen's kappa up to over 0.80 and accuracy up to over 90%) in analysing EEG/EEG + EOG + EMG signals. At the same time, it should be noted that there has been no breakthrough in the quality of results using these signals in recent years. Systems involving other signals that could potentially be acquired more conveniently for the user (e.g. respiratory, cardiac or movement signals) remain more challenging in the implementation with a high level of reliability but have considerable innovation capability. In general, automatic sleep stage scoring has excellent potential to assist medical professionals while providing an objective assessment.

STDP-based adaptive graph convolutional networks for automatic sleep staging

Automatic sleep staging is important for improving diagnosis and treatment, and machine learning with neuroscience explainability of sleep staging is shown to be a suitable method to solve this problem. In this paper, an explainable model for automatic sleep staging is proposed. Inspired by the Spike-Timing-Dependent Plasticity (STDP), an adaptive Graph Convolutional Network (GCN) is established to extract features from the Polysomnography (PSG) signal, named STDP-GCN. In detail, the channel of the PSG signal can be regarded as a neuron, the synapse strength between neurons can be constructed by the STDP mechanism, and the connection between different channels of the PSG signal constitutes a graph structure. After utilizing GCN to extract spatial features, temporal convolution is used to extract transition rules between sleep stages, and a fully connected neural network is used for classification. To enhance the strength of the model and minimize the effect of individual physiological signal discrepancies on classification accuracy, STDP-GCN utilizes domain adversarial training. Experiments demonstrate that the performance of STDP-GCN is comparable to the current state-of-the-art models.