Multi-modality of polysomnography signals’ fusion for automatic sleep scoring

Machine learning-empowered sleep staging classification using multi-modality signals

The goal is to enhance an automated sleep staging system's performance by leveraging the diverse signals captured through multi-modal polysomnography recordings. Three modalities of PSG signals, namely electroencephalogram (EEG), electrooculogram (EOG), and electromyogram (EMG), were considered to obtain the optimal fusions of the PSG signals, where 63 features were extracted. These include frequency-based, time-based, statistical-based, entropy-based, and non-linear-based features. We adopted the ReliefF (ReF) feature selection algorithms to find the suitable parts for each signal and superposition of PSG signals. Twelve top features were selected while correlated with the extracted feature sets' sleep stages. The selected features were fed into the AdaBoost with Random Forest (ADB + RF) classifier to validate the chosen segments and classify the sleep stages. This study's experiments were investigated by obtaining two testing schemes: epoch-wise testing and subject-wise testing. The suggested research was conducted using three publicly available datasets: ISRUC-Sleep subgroup1 (ISRUC-SG1), sleep-EDF(S-EDF), Physio bank CAP sleep database (PB-CAPSDB), and S-EDF-78 respectively. This work demonstrated that the proposed fusion strategy overestimates the common individual usage of PSG signals.

MVF-SleepNet: Multi-View Fusion Network for Sleep Stage Classification

Sleep stage classification is of great importance in human health monitoring and disease diagnosing. Clinically, visual-inspected classifying sleep into different stages is quite time consuming and highly relies on the expertise of sleep specialists. Many automated models for sleep stage classification have been proposed in previous studies but their performances still exist a gap to the real clinical application. In this work, we propose a novel multi-view fusion network named MVF-SleepNet based on multi-modal physiological signals of electroencephalography (EEG), electrocardiography (ECG), electrooculography (EOG), and electromyography (EMG). To capture the relationship representation among multi-modal physiological signals, we construct two views of Time-frequency images (TF images) and Graph-learned graphs (GL graphs). To learn the spectral-temporal representation from sequentially timed TF images, the combination of VGG-16 and GRU networks is utilized. To learn the spatial-temporal representation from sequentially timed GL graphs, the combination of Chebyshev graph convolution and temporal convolution networks is employed. Fusing the spectral-temporal representation and spatial-temporal representation can further boost the performance of sleep stage classification. A large number of experiment results on the publicly available datasets of ISRUC-S1 and ISRUC-S3 show that the MVF-SleepNet achieves overall accuracy of 0.821, F1 score of 0.802 and Kappa of 0.768 on ISRUC-S1 dataset, and accuracy of 0.841, F1 score of 0.828 and Kappa of 0.795 on ISRUC-S3 dataset. The MVF-SleepNet achieves competitive results on both datasets of ISRUC-S1 and ISRUC-S3 for sleep stage classification compared to the state-of-the-art baselines. The source code of MVF-SleepNet is available on Github (https://github.com/YJPai65/MVF-SleepNet).

An effective hybrid feature selection using entropy weight method for automatic sleep staging

Objective. Sleep staging is the basis for sleep quality assessment and diagnosis of sleep-related disorders. In response to the inadequacy of traditional manual judgement of sleep stages, using machine learning techniques for automatic sleep staging has become a hot topic. To improve the performance of sleep staging, numerous studies have extracted a large number of sleep-related characteristics. However, there are redundant and irrelevant features in the high-dimensional features that reduce the classification accuracy. To address this issue, an effective hybrid feature selection method based on the entropy weight method is proposed in this paper for automatic sleep staging.Approach. Firstly, we preprocess the four modal polysomnography (PSG) signals, including electroencephalogram (EEG), electrooculogram (EOG), electrocardiogram (ECG) and electromyogram (EMG). Secondly, the time domain, frequency domain and nonlinear features are extracted from the preprocessed signals, with a total of 185 features. Then, in order to acquire characteristics of the multi-modal signals that are highly correlated with the sleep stages, the proposed hybrid feature selection method is applied to choose effective features. This method is divided into two stages. In stage I, the entropy weight method is employed to combine two filter methods to build a subset of features. This stage evaluates features based on information theory and distance metrics, which can quickly obtain a subset of features and retain the relevant features. In stage II, Sequential Forward Selection is used to evaluate the subset of features and eliminate redundant features. Further more, to achieve better performance of classification, an ensemble model based on support vector machine, K-nearest neighbor, random forest and multilayer perceptron is finally constructed for classifying sleep stages.Main results. The experiment using the Cyclic Alternating Pattern (CAP) sleep database is performed to assess the performance of the method proposed in this paper. The proposed hybrid feature selection method chooses only 30 features highly correlated to sleep stages. The accuracy, F1 score and Kappa coefficient of 6 class sleep staging reach 88.86%, 83.15% and 0.8531%, respectively.Significance. Experimental results show the effectiveness of the proposed method compared to the existing state-of-the-art studies. It greatly reduces the number of features required while achieving outstanding auto-sleep staging results.

Exploration of sleep function connection and classification strategies based on sub-period sleep stages

Background

As a medium for developing brain-computer interface systems, EEG signals are complex and difficult to identify due to their complexity, weakness, and differences between subjects. At present, most of the current research on sleep EEG signals are single-channel and dual-channel, ignoring the research on the relationship between different brain regions. Brain functional connectivity is considered to be closely related to brain activity and can be used to study the interaction relationship between brain areas.

Methods

Phase-locked value (PLV) is used to construct a functional connection network. The connection network is used to analyze the connection mechanism and brain interaction in different sleep stages. Firstly, the entire EEG signal is divided into multiple sub-periods. Secondly, Phase-locked value is used for feature extraction on the sub-periods. Thirdly, the PLV of multiple sub-periods is used for feature fusion. Fourthly, the classification performance optimization strategy is used to discuss the impact of different frequency bands on sleep stage classification performance and to find the optimal frequency band. Finally, the brain function network is constructed by using the average value of the fusion features to analyze the interaction of brain regions in different frequency bands during sleep stages.

Results

The experimental results have shown that when the number of sub-periods is 30, the α (8-13 Hz) frequency band has the best classification effect, The classification result after 10-fold cross-validation reaches 92.59%.

Conclusion

The proposed algorithm has good sleep staging performance, which can effectively promote the development and application of an EEG sleep staging system.

A large collection of real-world pediatric sleep studies

Despite being crucial to health and quality of life, sleep-especially pediatric sleep-is not yet well understood. This is exacerbated by lack of access to sufficient pediatric sleep data with clinical annotation. In order to accelerate research on pediatric sleep and its connection to health, we create the Nationwide Children's Hospital (NCH) Sleep DataBank and publish it at Physionet and the National Sleep Research Resource (NSRR), which is a large sleep data common with physiological data, clinical data, and tools for analyses. The NCH Sleep DataBank consists of 3,984 polysomnography studies and over 5.6 million clinical observations on 3,673 unique patients between 2017 and 2019 at NCH. The novelties of this dataset include: (1) large-scale sleep dataset suitable for discovering new insights via data mining, (2) explicit focus on pediatric patients, (3) gathered in a real-world clinical setting, and (4) the accompanying rich set of clinical data. The NCH Sleep DataBank is a valuable resource for advancing automatic sleep scoring and real-time sleep disorder prediction, among many other potential scientific discoveries.

Automatic sleep staging by cardiorespiratory signals: a systematic review

BACKGROUND

Because of problems with the recording and analysis of the EEG signal, automatic sleep staging using cardiorespiratory signals has been employed as an alternative. This study reports on certain critical points which hold considerable promise for the improvement of the results of the automatic sleep staging using cardiorespiratory signals.

METHODS

A systematic review.

RESULTS

The review and analysis of the literature in this area revealed four outstanding points: (1) the feature extraction epoch length, denoting that the standard 30-s segments of cardiorespiratory signals do not carry enough information for automatic sleep staging and that a 4.5-min length segment centering on each 30-s segment is proper for staging, (2) the time delay between the EEG signal extracted from the central nervous system activity and the cardiorespiratory signals extracted from the autonomic nervous system activity should be considered in the automatic sleep staging using cardiorespiratory signals, (3) the information in the morphology of ECG signals can contribute to the improvement of sleep staging, and (4) applying convolutional neural network (CNN) and long short-term memory network (LSTM) deep structures simultaneously to a large PSG recording database can lead to more reliable automatic sleep staging results.

CONCLUSIONS

Considering the above-mentioned points simultaneously can improve automatic sleep staging by cardiorespiratory signals. It is hoped that by considering the points, staging sleep automatically using cardiorespiratory signals, which does not have problems with the recording and analysis of EEG signals, yields results acceptably close to the results of automatic sleep staging by EEG signals.

Automatic sleep scoring: A deep learning architecture for multi-modality time series

BACKGROUND

Sleep scoring is an essential but time-consuming process, and therefore automatic sleep scoring is crucial and urgent to help address the growing unmet needs for sleep research. This paper aims to develop a versatile deep-learning architecture to automate sleep scoring using raw polysomnography recordings.

METHOD

The model adopts a linear function to address different numbers of inputs, thereby extending model applications. Two-dimensional convolution neural networks are used to learn features from multi-modality polysomnographic signals, a "squeeze and excitation" block to recalibrate channel-wise features, together with a long short-term memory module to exploit long-range contextual relation. The learnt features are finally fed to the decision layer to generate predictions for sleep stages.

RESULT

Model performance is evaluated on three public datasets. For all tasks with different available channels, our model achieves outstanding performance not only on healthy subjects but even on patients with sleep disorders (SHHS: Acc-0.87, K-0.81; ISRUC: Acc-0.86, K-0.82; Sleep-EDF: Acc-0.86, K-0.81). The highest classification accuracy is achieved by a fusion of multiple polysomnographic signals.

COMPARISON

Compared to state-of-the-art methods that use the same dataset, the proposed model achieves a comparable or better performance, and exhibits low computational cost.

CONCLUSIONS

The model demonstrates its transferability among different datasets, without changing model architecture or hyper-parameters across tasks. Good model transferability promotes the application of transfer learning on small group studies with mismatched channels. Due to demonstrated availability and versatility, the proposed method can be integrated with diverse polysomnography systems, thereby facilitating sleep monitoring in clinical or routine care.

Functional connectivity of major depression disorder using ongoing EEG during music perception

OBJECTIVE

The functional connectivity (FC) of major depression disorder (MDD) has not been well studied under naturalistic and continuous stimuli conditions. In this study, we investigated the frequency-specific FC of MDD patients exposed to conditions of music perception using ongoing electroencephalogram (EEG).

METHODS

First, we applied the phase lag index (PLI) method to calculate the connectivity matrices and graph theory-based methods to measure the topology of brain networks across different frequency bands. Then, classification methods were adopted to identify the most discriminate frequency band for the diagnosis of MDD.

RESULTS

During music perception, MDD patients exhibited a decreased connectivity pattern in the delta band but an increased connectivity pattern in the beta band. Healthy people showed a left hemisphere-dominant phenomenon, but MDD patients did not show such a lateralized effect. Support vector machine (SVM) achieved the best classification performance in the beta frequency band with an accuracy of 89.7%, sensitivity of 89.4% and specificity of 89.9%.

CONCLUSIONS

MDD patients exhibited an altered FC in delta and beta bands, and the beta band showed a superiority in the diagnosis of MDD.

SIGNIFICANCE

Our study provided a promising reference for the diagnosis of MDD, and revealed a new perspective for understanding the topology of MDD brain networks during music perception.

The future of sleep health: a data-driven revolution in sleep science and medicine

In recent years, there has been a significant expansion in the development and use of multi-modal sensors and technologies to monitor physical activity, sleep and circadian rhythms. These developments make accurate sleep monitoring at scale a possibility for the first time. Vast amounts of multi-sensor data are being generated with potential applications ranging from large-scale epidemiological research linking sleep patterns to disease, to wellness applications, including the sleep coaching of individuals with chronic conditions. However, in order to realise the full potential of these technologies for individuals, medicine and research, several significant challenges must be overcome. There are important outstanding questions regarding performance evaluation, as well as data storage, curation, processing, integration, modelling and interpretation. Here, we leverage expertise across neuroscience, clinical medicine, bioengineering, electrical engineering, epidemiology, computer science, mHealth and human-computer interaction to discuss the digitisation of sleep from a inter-disciplinary perspective. We introduce the state-of-the-art in sleep-monitoring technologies, and discuss the opportunities and challenges from data acquisition to the eventual application of insights in clinical and consumer settings. Further, we explore the strengths and limitations of current and emerging sensing methods with a particular focus on novel data-driven technologies, such as Artificial Intelligence.

Detection of Myocardial Infarction from Multi-lead ECG using Dual-Q Tunable Q-Factor Wavelet Transform

Electrocardiography (ECG) signal analysis is an effective method for diagnosis of heart disease. However, the quality of ECG, corrupted by artifacts, limits the automatic ECG classification. In order to extract good quality ECG, we proposed a new ECG enhancement method based on tunable Q-factor wavelet transform (TQWT). In the proposed method, the original ECG signal was decomposed into high Q-factor component and low Q-factor component with dual-Q TQWT. According to the morphological of P, QRS, T waves in ECG, low Q-factor component was chosen for the representation of ECG. The proposed method was tested on 52 healthy volunteers and 52 myocardial infarction patients from the openly dataset of PTB diagnostic ECG. A total of 288 features, covering time, frequency, nonlinear, and entropy domains, were extracted from R-R interval and ECG (in a window of 5s) across 12 leads. The features were selected by Relief method, and 22 discriminative features were fed into five different classifiers. The classification accuracy for dual-Q TQWT was 86.3%, which was 4.7% higher than the filtered data based on k-nearest neighbors (KNN) algorithm. The comparison results verified that the proposed dual-Q TQWT method provides good feasibility for ECG de-noising.

Blind Source Separation on Non-Contact Heartbeat Detection by Non-Negative Matrix Factorization Algorithms

In non-contact heart rate (HR) monitoring via Doppler radar, the disturbance from respiration and/or body motion is treated as a key problem on the estimation of HR. This paper proposes a blind source separation (BSS) approach to mitigate the noise effect in the received radar signal, and incorporates the sparse spectrum reconstruction to achieve a high-resolution of heartbeat spectrum. The proposed BSS decomposes the spectrogram of mixture signal into original sources, including heartbeat, using non-negative matrix factorization (NMF) algorithms, through learning the complete basis spectra (BS) by a hierarchical clustering. In particular, to exploit the temporal sparsity of heartbeat component, two variants of NMF algorithms with sparseness constraints are applied as well, namely sparse NMF and weighted sparse NMF. Compared with usual BSS, our proposed BSS has three advantages: 1) clustering-induced unsupervised manner; 2) compact demixing architecture; and 3) merely requiring single-channel input data. In addition, the HR estimation method using our proposal delivers more satisfactory precision and robustness over other existing methods, which is demonstrated through the measurements of distinguishing people's activities, gaining both smallest absolute errors of HR estimation for sitting still and typewriting.