A review of automated sleep stage scoring based on physiological signals for the new millennia

ADHD/CD-NET: automated EEG-based characterization of ADHD and CD using explainable deep neural network technique

In this study, attention deficit hyperactivity disorder (ADHD), a childhood neurodevelopmental disorder, is being studied alongside its comorbidity, conduct disorder (CD), a behavioral disorder. Because ADHD and CD share commonalities, distinguishing them is difficult, thus increasing the risk of misdiagnosis. It is crucial that these two conditions are not mistakenly identified as the same because the treatment plan varies depending on whether the patient has CD or ADHD. Hence, this study proposes an electroencephalogram (EEG)-based deep learning system known as ADHD/CD-NET that is capable of objectively distinguishing ADHD, ADHD + CD, and CD. The 12-channel EEG signals were first segmented and converted into channel-wise continuous wavelet transform (CWT) correlation matrices. The resulting matrices were then used to train the convolutional neural network (CNN) model, and the model's performance was evaluated using 10-fold cross-validation. Gradient-weighted class activation mapping (Grad-CAM) was also used to provide explanations for the prediction result made by the 'black box' CNN model. Internal private dataset (45 ADHD, 62 ADHD + CD and 16 CD) and external public dataset (61 ADHD and 60 healthy controls) were used to evaluate ADHD/CD-NET. As a result, ADHD/CD-NET achieved classification accuracy, sensitivity, specificity, and precision of 93.70%, 90.83%, 95.35% and 91.85% for the internal evaluation, and 98.19%, 98.36%, 98.03% and 98.06% for the external evaluation. Grad-CAM also identified significant channels that contributed to the diagnosis outcome. Therefore, ADHD/CD-NET can perform temporal localization and choose significant EEG channels for diagnosis, thus providing objective analysis for mental health professionals and clinicians to consider when making a diagnosis.

Supplementary Information

The online version contains supplementary material available at 10.1007/s11571-023-10028-2.

Generalized sleep decoding with basal ganglia signals in multiple movement disorders

Sleep disturbances profoundly affect the quality of life in individuals with neurological disorders. Closed-loop deep brain stimulation (DBS) holds promise for alleviating sleep symptoms, however, this technique necessitates automated sleep stage decoding from intracranial signals. We leveraged overnight data from 121 patients with movement disorders (Parkinson's disease, Essential Tremor, Dystonia, Essential Tremor, Huntington's disease, and Tourette's syndrome) in whom synchronized polysomnograms and basal ganglia local field potentials were recorded, to develop a generalized, multi-class, sleep specific decoder - BGOOSE. This generalized model achieved 85% average accuracy across patients and across disease conditions, even in the presence of recordings from different basal ganglia targets. Furthermore, we also investigated the role of electrocorticography on decoding performances and proposed an optimal decoding map, which was shown to facilitate channel selection for optimal model performances. BGOOSE emerges as a powerful tool for generalized sleep decoding, offering exciting potentials for the precision stimulation delivery of DBS and better management of sleep disturbances in movement disorders.

MVF-SleepNet: Multi-View Fusion Network for Sleep Stage Classification

Sleep stage classification is of great importance in human health monitoring and disease diagnosing. Clinically, visual-inspected classifying sleep into different stages is quite time consuming and highly relies on the expertise of sleep specialists. Many automated models for sleep stage classification have been proposed in previous studies but their performances still exist a gap to the real clinical application. In this work, we propose a novel multi-view fusion network named MVF-SleepNet based on multi-modal physiological signals of electroencephalography (EEG), electrocardiography (ECG), electrooculography (EOG), and electromyography (EMG). To capture the relationship representation among multi-modal physiological signals, we construct two views of Time-frequency images (TF images) and Graph-learned graphs (GL graphs). To learn the spectral-temporal representation from sequentially timed TF images, the combination of VGG-16 and GRU networks is utilized. To learn the spatial-temporal representation from sequentially timed GL graphs, the combination of Chebyshev graph convolution and temporal convolution networks is employed. Fusing the spectral-temporal representation and spatial-temporal representation can further boost the performance of sleep stage classification. A large number of experiment results on the publicly available datasets of ISRUC-S1 and ISRUC-S3 show that the MVF-SleepNet achieves overall accuracy of 0.821, F1 score of 0.802 and Kappa of 0.768 on ISRUC-S1 dataset, and accuracy of 0.841, F1 score of 0.828 and Kappa of 0.795 on ISRUC-S3 dataset. The MVF-SleepNet achieves competitive results on both datasets of ISRUC-S1 and ISRUC-S3 for sleep stage classification compared to the state-of-the-art baselines. The source code of MVF-SleepNet is available on Github (https://github.com/YJPai65/MVF-SleepNet).

Strength of ensemble learning in automatic sleep stages classification using single-channel EEG and ECG signals

Healthy sleep plays an essential role in human daily life. Classification of sleep stages is a crucial tool for assisting physicians in diagnosing and treating sleep disorders. In this study, a strong ensemble learning model is proposed to enhance the ability of classification models in accurate sleep staging, particularly in multi-class classification. We asserted that high-accuracy sleep classification is achievable using only single-channel electroencephalogram (EEG) and electrocardiogram (ECG) by combining their best-extractable features in the time and frequency domains we recommended. More importantly, the superiority of the recommended method, which is the simultaneous use of stacking and bagging, over conventional machine learning classifiers in sleep staging was demonstrated, using the MIT-BIH Polysomnographic and Sleep-EDF expanded databases. Finally, K-fold cross-validation was used to fairly estimate these models. The best mean test accuracy rates for distinguishing between two classes of "sleep vs. wake," "rapid vs. non-rapid eye movement," and "deep vs. light sleep," were obtained 99.93%, 99.64%, and 99.69%, respectively. Furthermore, our proposed method achieved accuracies of 97.14%, 95.18%, 92.7%, and 85.64% for separating three, four, five, and six sleep classes, respectively. Compared to recent studies, our method outperforms other sleep stage classification schemes, especially in multi-class staging.

MixSleepNet: A Multi-Type Convolution Combined Sleep Stage Classification Model

BACKGROUND AND OBJECTIVE

Sleep staging is an essential step for sleep disorder diagnosis, which is time-intensive and laborious for experts to perform this work manually. Automatic sleep stage classification methods not only alleviate experts from these demanding tasks but also enhance the accuracy and efficiency of the classification process.

METHODS

A novel multi-channel biosignal-based model constructed by the combination of a 3D convolutional operation and a graph convolutional operation is proposed for the automated sleep stages using various physiological signals. Both the 3D convolution and graph convolution can aggregate information from neighboring brain areas, which helps to learn intrinsic connections from the biosignals. Electroencephalogram (EEG), electromyogram (EMG), electrooculogram (EOG) and electrocardiogram (ECG) signals are employed to extract time domain and frequency domain features. Subsequently, these signals are input to the 3D convolutional and graph convolutional branches, respectively. The 3D convolution branch can explore the correlations between multi-channel signals and multi-band waves in each channel in the time series, while the graph convolution branch can explore the connections between each channel and each frequency band. In this work, we have developed the proposed multi-channel convolution combined sleep stage classification model (MixSleepNet) using ISRUC datasets (Subgroup 3 and 50 random samples from Subgroup 1).

RESULTS

Based on the first expert's label, our generated MixSleepNet yielded an accuracy, F1-score and Cohen kappa scores of 0.830, 0.821 and 0.782, respectively for ISRUC-S3. It obtained accuracy, F1-score and Cohen kappa scores of 0.812, 0.786, and 0.756, respectively for the ISRUC-S1 dataset. In accordance with the evaluations conducted by the second expert, the comprehensive accuracies, F1-scores, and Cohen kappa coefficients for the ISRUC-S3 and ISRUC-S1 datasets are determined to be 0.837, 0.820, 0.789, and 0.829, 0.791, 0.775, respectively.

CONCLUSION

The results of the performance metrics by the proposed method are much better than those from all the compared models. Additional experiments were carried out on the ISRUC-S3 sub-dataset to evaluate the contributions of each module towards the classification performance.

Evaluating Accuracy in Five Commercial Sleep-Tracking Devices Compared to Research-Grade Actigraphy and Polysomnography

The development of consumer sleep-tracking technologies has outpaced the scientific evaluation of their accuracy. In this study, five consumer sleep-tracking devices, research-grade actigraphy, and polysomnography were used simultaneously to monitor the overnight sleep of fifty-three young adults in the lab for one night. Biases and limits of agreement were assessed to determine how sleep stage estimates for each device and research-grade actigraphy differed from polysomnography-derived measures. Every device, except the Garmin Vivosmart, was able to estimate total sleep time comparably to research-grade actigraphy. All devices overestimated nights with shorter wake times and underestimated nights with longer wake times. For light sleep, absolute bias was low for the Fitbit Inspire and Fitbit Versa. The Withings Mat and Garmin Vivosmart overestimated shorter light sleep and underestimated longer light sleep. The Oura Ring underestimated light sleep of any duration. For deep sleep, bias was low for the Withings Mat and Garmin Vivosmart while other devices overestimated shorter and underestimated longer times. For REM sleep, bias was low for all devices. Taken together, these results suggest that proportional bias patterns in consumer sleep-tracking technologies are prevalent and could have important implications for their overall accuracy.

Standardized image-based polysomnography database and deep learning algorithm for sleep-stage classification

STUDY OBJECTIVES

Polysomnography (PSG) scoring is labor-intensive, subjective, and often ambiguous. Recently several deep learning (DL) models for automated sleep scoring have been developed, they are tied to a fixed amount of input channels and resolution. In this study, we constructed a standardized image-based PSG dataset in order to overcome the heterogeneity of raw signal data obtained from various PSG devices and various sleep laboratory environments.

METHODS

All individually exported European data format files containing raw signals were converted into images with an annotation file, which contained the demographics, diagnoses, and sleep statistics. An image-based DL model for automatic sleep staging was developed, compared with a signal-based model, and validated in an external dataset.

RESULTS

We constructed 10253 image-based PSG datasets using a standardized format. Among these, 7745 diagnostic PSG data were used to develop our DL model. The DL model using the image dataset showed similar performance to the signal-based dataset for the same subject. The overall DL accuracy was greater than 80%, even with severe obstructive sleep apnea. Moreover, for the first time, we showed explainable DL in the field of sleep medicine as visualized key inference regions using Eigen-class activation maps. Furthermore, when a DL model for sleep scoring performs external validation, we achieved a relatively good performance.

CONCLUSIONS

Our main contribution demonstrates the availability of a standardized image-based dataset, and highlights that changing the data sampling rate or number of sensors may not require retraining, although performance decreases slightly as the number of sensors decreases.

Enhanced sleep staging with artificial intelligence: a validation study of new software for sleep scoring

Manual sleep staging (MSS) using polysomnography is a time-consuming task, requires significant training, and can lead to significant variability among scorers. STAGER is a software program based on machine learning algorithms that has been developed by Medibio Limited (Savage, MN, USA) to perform automatic sleep staging using only EEG signals from polysomnography. This study aimed to extensively investigate its agreement with MSS performed during clinical practice and by three additional expert sleep technicians. Forty consecutive polysomnographic recordings of patients referred to three US sleep clinics for sleep evaluation were retrospectively collected and analyzed. Three experienced technicians independently staged the recording using the electroencephalography, electromyography, and electrooculography signals according to the American Academy of Sleep Medicine guidelines. The staging initially performed during clinical practice was also considered. Several agreement statistics between the automatic sleep staging (ASS) and MSS, among the different MSSs, and their differences were calculated. Bootstrap resampling was used to calculate 95% confidence intervals and the statistical significance of the differences. STAGER's ASS was most comparable with, or statistically significantly better than the MSS, except for a partial reduction in the positive percent agreement in the wake stage. These promising results indicate that STAGER software can perform ASS of inpatient polysomnographic recordings accurately in comparison with MSS.

DenSleepNet: DenseNet based model for sleep staging with two-frequency feature fusion and coordinate attention

Sleep staging is often applied to assess the quality of sleep and also be used to prevent and monitor psychiatric disorders caused by sleep. However, it remains a challenge to extract the discriminative features of salient waveforms in sleep EEG and enable the network to effectively classify sleep stages by emphasizing these crucial features, thus achieving higher accuracy. In this study, an end-to-end deep learning model based on DenseNet for automatic sleep staging is designed and constructed. In the framework, two convolutional branches are devised to extract the underlying features (Two-Frequency Feature) at various frequencies, which are then fused and input into the DenseNet module to extract salient waveform features. After that, the Coordinate Attention mechanism is employed to enhance the localization of salient waveform features by emphasizing the position of salient waveforms and the spatial relationship across the entire frequency spectrum. Finally, the obtained features are accessed to the fully connected for sleep staging. The model was validated with a 20-fold cross-validation procedure on two public available datasets, and the overall accuracy, kappa coefficient, and MF1 score reached 92.9%, 78.7, 0.86 and 90.0%, 75.8, 0.80 on Sleep-EDF-20 and Sleep-EDFx, respectively. Experimental results show that the proposed model achieves competitive performance for sleep staging compared with the reported approaches under the identical conditions.

An explainable deep-learning model to stage sleep states in children and propose novel EEG-related patterns in sleep apnea

Automatic deep-learning models used for sleep scoring in children with obstructive sleep apnea (OSA) are perceived as black boxes, limiting their implementation in clinical settings. Accordingly, we aimed to develop an accurate and interpretable deep-learning model for sleep staging in children using single-channel electroencephalogram (EEG) recordings. We used EEG signals from the Childhood Adenotonsillectomy Trial (CHAT) dataset (n = 1637) and a clinical sleep database (n = 980). Three distinct deep-learning architectures were explored to automatically classify sleep stages from a single-channel EEG data. Gradient-weighted Class Activation Mapping (Grad-CAM), an explainable artificial intelligence (XAI) algorithm, was then applied to provide an interpretation of the singular EEG patterns contributing to each predicted sleep stage. Among the tested architectures, a standard convolutional neural network (CNN) demonstrated the highest performance for automated sleep stage detection in the CHAT test set (accuracy = 86.9% and five-class kappa = 0.827). Furthermore, the CNN-based estimation of total sleep time exhibited strong agreement in the clinical dataset (intra-class correlation coefficient = 0.772). Our XAI approach using Grad-CAM effectively highlighted the EEG features associated with each sleep stage, emphasizing their influence on the CNN's decision-making process in both datasets. Grad-CAM heatmaps also allowed to identify and analyze epochs within a recording with a highly likelihood to be misclassified, revealing mixed features from different sleep stages within these epochs. Finally, Grad-CAM heatmaps unveiled novel features contributing to sleep scoring using a single EEG channel. Consequently, integrating an explainable CNN-based deep-learning model in the clinical environment could enable automatic sleep staging in pediatric sleep apnea tests.

Automatic sleep-stage classification of heart rate and actigraphy data using deep and transfer learning approaches

Manual sleep-stage scoring based on full-night polysomnography data recorded in a sleep lab has been the gold standard of clinical sleep medicine. This costly and time-consuming approach is unfit for long-term studies as well as assessment of sleep on a population level. With the vast amount of physiological data becoming available from wrist-worn devices, deep learning techniques provide an opportunity for fast and reliable automatic sleep-stage classification tasks. However, training a deep neural network requires large annotated sleep databases, which are not available for long-term epidemiological studies. In this paper, we introduce an end-to-end temporal convolutional neural network able to automatically score sleep stages from raw heartbeat RR interval (RRI) and wrist actigraphy data. Moreover, a transfer learning approach enables the training of the network on a large public database (Sleep Heart Health Study, SHHS) and its subsequent application to a much smaller database recorded by a wristband device. The transfer learning significantly shortens training time and improves sleep-scoring accuracy from 68.9% to 73.8% and inter-rater reliability (Cohen's kappa) from 0.51 to 0.59. We also found that for the SHHS database, automatic sleep-scoring accuracy using deep learning shows a logarithmic relationship with the training size. Although deep learning approaches for automatic sleep scoring are not yet comparable to the inter-rater reliability among sleep technicians, performance is expected to significantly improve in the near future when more large public databases become available. We anticipate those deep learning techniques, when combined with our transfer learning approach, will leverage automatic sleep scoring of physiological data from wearable devices and enable the investigation of sleep in large cohort studies.

Current status and prospects of automatic sleep stages scoring: Review

The scoring of sleep stages is one of the essential tasks in sleep analysis. Since a manual procedure requires considerable human and financial resources, and incorporates some subjectivity, an automated approach could result in several advantages. There have been many developments in this area, and in order to provide a comprehensive overview, it is essential to review relevant recent works and summarise the characteristics of the approaches, which is the main aim of this article. To achieve it, we examined articles published between 2018 and 2022 that dealt with the automated scoring of sleep stages. In the final selection for in-depth analysis, 125 articles were included after reviewing a total of 515 publications. The results revealed that automatic scoring demonstrates good quality (with Cohen's kappa up to over 0.80 and accuracy up to over 90%) in analysing EEG/EEG + EOG + EMG signals. At the same time, it should be noted that there has been no breakthrough in the quality of results using these signals in recent years. Systems involving other signals that could potentially be acquired more conveniently for the user (e.g. respiratory, cardiac or movement signals) remain more challenging in the implementation with a high level of reliability but have considerable innovation capability. In general, automatic sleep stage scoring has excellent potential to assist medical professionals while providing an objective assessment.

A deep learning model based on the combination of convolutional and recurrent neural networks to enhance pulse oximetry ability to classify sleep stages in children with sleep apnea

Characterization of sleep stages is essential in the diagnosis of sleep-related disorders but relies on manual scoring of overnight polysomnography (PSG) recordings, which is onerous and labor-intensive. Accordingly, we aimed to develop an accurate deep-learning model for sleep staging in children suffering from pediatric obstructive sleep apnea (OSA) using pulse oximetry signals. For this purpose, pulse rate (PR) and blood oxygen saturation (SpO2) from 429 childhood OSA patients were analyzed. A CNN-RNN architecture fed with PR and SpO2 signals was developed to automatically classify wake (W), non-Rapid Eye Movement (NREM), and REM sleep stages. This architecture was composed of: (i) a convolutional neural network (CNN), which learns stage-related features from raw PR and SpO2 data; and (ii) a recurrent neural network (RNN), which models the temporal distribution of the sleep stages. The proposed CNN-RNN model showed a high performance for the automated detection of W/NREM/REM sleep stages (86.0% accuracy and 0.743 Cohen's kappa). Furthermore, the total sleep time estimated for each children using the CNN-RNN model showed high agreement with the manually derived from PSG (intra-class correlation coefficient = 0.747). These results were superior to previous works using CNN-based deep-learning models for automatic sleep staging in pediatric OSA patients from pulse oximetry signals. Therefore, the combination of CNN and RNN allows to obtain additional information from raw PR and SpO2 data related to sleep stages, thus being useful to automatically score sleep stages in pulse oximetry tests for children evaluated for suspected OSA.Clinical Relevance-This research establishes the usefulness of a CNN-RNN architecture to automatically score sleep stages in pulse oximetry tests for pediatric OSA diagnosis.

Feasibility of Exploiting Physiological and Motion Features for Camera-based Sleep Staging: A Clinical Study

Camera-based sleep monitoring is an emergent research topic in sleep medicine. The feasibility of using both the physiological features and motion features measured by a video camera for sleep staging was not thoroughly investigated. In this paper, we built a camera-based non-contact sleep monitoring setup in the Institute of Respiratory Diseases, Shenzhen People's Hospital, and created a clinical sleep dataset (nocturnal video data of 11 adults) including the expert-corrected PSG references synchronized with the video. The camera-based measurements have shown high correlations with the PSG. It obtains an overall Mean Absolute Error (MAE) of 1.5 bpm for heart-rate (HR), 0.7 bpm for breathing-rate (BR), 13.9 ms for heart-rate variability (HRV), and an accuracy of 93.5% for leg motion detection. The statistical analysis indicates that the averaged HR and variations of BR are distinct features for annotating four sleep stages (awake, REM, light sleep, and deep sleep). HRV parameter (SDNN) can clearly differentiate rapid-eye-movement (REM) and non-REM, while the leg movement is a distinctive feature for separating awake and sleep. The clinical trial demonstrated the feasibility of using physiological and motion features measured by a camera for joint sleep staging, and provides insights for sleep-related feature selection.

Extracting continuous sleep depth from EEG data without machine learning

The human sleep-cycle has been divided into discrete sleep stages that can be recognized in electroencephalographic (EEG) and other bio-signals by trained specialists or machine learning systems. It is however unclear whether these human-defined stages can be re-discovered with unsupervised methods of data analysis, using only a minimal amount of generic pre-processing. Based on EEG data, recorded overnight from sleeping human subjects, we investigate the degree of clustering of the sleep stages using the General Discrimination Value as a quantitative measure of class separability. Virtually no clustering is found in the raw data, even after transforming the EEG signals of each 30-s epoch from the time domain into the more informative frequency domain. However, a Principal Component Analysis (PCA) of these epoch-wise frequency spectra reveals that the sleep stages separate significantly better in the low-dimensional sub-space of certain PCA components. In particular the component C₁(t) can serve as a robust, continuous 'master variable' that encodes the depth of sleep and therefore correlates strongly with the 'hypnogram', a common plot of the discrete sleep stages over time. Moreover, C₁(t) shows persistent trends during extended time periods where the sleep stage is constant, suggesting that sleep may be better understood as a continuum. These intriguing properties of C₁(t) are not only relevant for understanding brain dynamics during sleep, but might also be exploited in low-cost single-channel sleep tracking devices for private and clinical use.

The past, present, and future of sleep quality assessment and monitoring

Sleep quality is considered to be an individual's self-satisfaction with all aspects of the sleep experience. Good sleep not only improves a person's physical, mental and daily functional health, but also improves the quality-of-life level to some extent. In contrast, chronic sleep deprivation can increase the risk of diseases such as cardiovascular diseases, metabolic dysfunction and cognitive and emotional dysfunction, and can even lead to increased mortality. The scientific evaluation and monitoring of sleep quality is an important prerequisite for safeguarding and promoting the physiological health of the body. Therefore, we have compiled and reviewed the existing methods and emerging technologies commonly used for subjective and objective evaluation and monitoring of sleep quality, and found that subjective sleep evaluation is suitable for clinical screening and large-scale studies, while objective evaluation results are more intuitive and scientific, and in the comprehensive evaluation of sleep, if we want to get more scientific monitoring results, we should combine subjective and objective monitoring and dynamic monitoring.

An intelligent model involving multi-channels spectrum patterns based features for automatic sleep stage classification

Effective sleep monitoring from electroencephalogram (EEG) signals is meaningful for the diagnosis of sleep disorders, such as sleep Apnea, Insomnia, Snoring, Sleep Hypoventilation, and restless legs syndrome. Hence, developing an automatic sleep stage scoring method based on EEGs has attracted extensive research attention in recent years. The existing methods of sleep stage classification are insufficient to investigate waveform patterns, texture patterns, and temporal transformation of EEG signals, which are most associated with sleep stages scoring. To address these issues, we proposed an intelligence model based on multi-channels texture colour analysis to automatically classify sleep staging. In the proposed model, a short-time Fourier transform is applied to each EEG 30 s segment to convert it into an image form. Then the resulted spectrum image is analysed using Multiple channels Information Local Binary Pattern (MILBP). The extracted information using MILBP is then deployed to differentiate EEG sleep stages. The extracted features are tested, and the most effective ones are used to the represented EEG sleep stages. The selected characteristics are fed to an ensemble classifier integrated with a genetic algorithm which is used to select the optimal weight for each classifier, to classify EEG signal into designated sleep stages. The experimental results on two benchmark sleep datasets showed that the proposed model obtained the best performance compared with several baseline methods, including accuracy of 0.96 and 0.95, and F1-score of 0.94 and 0.93, thus demonstrating the effectiveness of our proposed model.

An automatic sleep-scoring system in elderly women with osteoporosis fractures using frequency localized finite orthogonal quadrature Fejer Korovkin kernels

Healthy sleep signifies a good physical and mental state of the body. However, factors such as inappropriate work schedules, medical complications, and others can make it difficult to get enough sleep, leading to various sleep disorders. The identification of these disorders requires sleep stage classification. Visual evaluation of sleep stages is time intensive, placing a significant strain on sleep experts and prone to human errors. As a result, it is crucial to develop machine learning algorithms to score sleep stages to acquire an accurate diagnosis. Hence, a new methodology for automated sleep stage classification is suggested using machine learning and filtering electroencephalogram (EEG) signals. The national sleep research resource's (NSRR) study of osteoporotic fractures (SOF) dataset comprising 453 subjects' polysomnograph (PSG) data is used in this study. Only two unipolar EEG derivations C4-A1 and C3-A2 are employed individually and jointly in this work. The EEG signals are decomposed into sub-bands using a frequency-localized finite orthogonal quadrature Fejer Korovkin wavelet filter bank. The wavelet-based entropy features are extracted from sub-bands. Subsequently, extracted features are classified using machine learning techniques. Our developed model obtained the highest classification accuracy of 81.3%, using an ensembled bagged trees classifier with a 10-fold cross-validation method and Cohen's Kappa coefficient of 0.72. The proposed model is accurate, dependable, and easy to implement and can be employed as an alternative to a PSG-based system at home with minimal resources. It is also ready to be tested on other EEG data to evaluate the sleep stages of healthy and unhealthy subjects.

Automation of classification of sleep stages and estimation of sleep efficiency using actigraphy

Introduction

Sleep is a fundamental and essential physiological process for recovering physiological function. Sleep disturbance or deprivation has been known to be a causative factor of various physiological and psychological disorders. Therefore, sleep evaluation is vital for diagnosing or monitoring those disorders. Although PSG (polysomnography) has been the gold standard for assessing sleep quality and classifying sleep stages, PSG has various limitations for common uses. In substitution for PSG, there has been vigorous research using actigraphy.

Methods

For classifying sleep stages automatically, we propose machine learning models with HRV (heart rate variability)-related features and acceleration features, which were processed from the actigraphy (Maxim band) data. Those classification results were transformed into a binary classification for estimating sleep efficiency. With 30 subjects, we conducted PSG, and they slept overnight with wrist-type actigraphy. We assessed the performance of four proposed machine learning models.

Results

With HRV-related and raw features of actigraphy, Cohen's kappa was 0.974 (p < 0.001) for classifying sleep stages into five stages: wake (W), REM (Rapid Eye Movement) (R), Sleep N1 (Non-Rapid Eye Movement Stage 1, S1), Sleep N2 (Non-Rapid Eye Movement Stage 2, S2), Sleep N3 (Non-Rapid Eye Movement Stage 3, S3). In addition, our machine learning model for the estimation of sleep efficiency showed an accuracy of 0.86.

Discussion

Our model demonstrated that automated sleep classification results could perfectly match the PSG results. Since models with acceleration features showed modest performance in differentiating some sleep stages, further research on acceleration features must be done. In addition, the sleep efficiency model demonstrated modest results. However, an investigation into the effects of HRV-derived and acceleration features is required.

Deep learning-based algorithm accurately classifies sleep stages in preadolescent children with sleep-disordered breathing symptoms and age-matched controls

Introduction

Visual sleep scoring has several shortcomings, including inter-scorer inconsistency, which may adversely affect diagnostic decision-making. Although automatic sleep staging in adults has been extensively studied, it is uncertain whether such sophisticated algorithms generalize well to different pediatric age groups due to distinctive EEG characteristics. The preadolescent age group (10-13-year-olds) is relatively understudied, and thus, we aimed to develop an automatic deep learning-based sleep stage classifier specifically targeting this cohort.

Methods

A dataset (n = 115) containing polysomnographic recordings of Icelandic preadolescent children with sleep-disordered breathing (SDB) symptoms, and age and sex-matched controls was utilized. We developed a combined convolutional and long short-term memory neural network architecture relying on electroencephalography (F4-M1), electrooculography (E1-M2), and chin electromyography signals. Performance relative to human scoring was further evaluated by analyzing intra- and inter-rater agreements in a subset (n = 10) of data with repeat scoring from two manual scorers.

Results

The deep learning-based model achieved an overall cross-validated accuracy of 84.1% (Cohen's kappa κ = 0.78). There was no meaningful performance difference between SDB-symptomatic (n = 53) and control subgroups (n = 52) [83.9% (κ = 0.78) vs. 84.2% (κ = 0.78)]. The inter-rater reliability between manual scorers was 84.6% (κ = 0.78), and the automatic method reached similar agreements with scorers, 83.4% (κ = 0.76) and 82.7% (κ = 0.75).

Conclusion

The developed algorithm achieved high classification accuracy and substantial agreements with two manual scorers; the performance metrics compared favorably with typical inter-rater reliability between manual scorers and performance reported in previous studies. These suggest that our algorithm may facilitate less labor-intensive and reliable automatic sleep scoring in preadolescent children.

A novel approach to automatic sleep stage classification using forehead electrophysiological signals

Background

Sleep stage scoring is very important for the effective diagnosis and intervention of sleep disorders. However, the current automatic sleep staging methods generally have the problems of poor model generalization ability and non-portable acquisition equipment.

Method

In this paper, we propose a novel automatic sleep scoring system based on forehead electrophysiological signals that is more effective and convenient than other systems. We extract 3 channel signals from the forehead, named forehead electroencephalogram 1 (Fh1), forehead electroencephalogram 2 (Fh2), and forehead center electrooculogram (Fhz). Spectral features, statistical features, and entropy features are extracted using the discrete wavelet transform (DWT) method. Light gradient boosting machine (LGB), random forest (RF), and support vector machine (SVM) are employed to classify four stages: awake, light sleep (LS), deep sleep (DS), and rapid eye movement (REM).

Result

The performance of the proposed method is validated using databases of the Sleep-EDFX and our Own-data, which include polysomnograms (PSGs) and forehead signals of 28 subjects. The overall classification accuracy of using the combination of Fh1, Fh2, and Fhz can reach up to 90.25% accuracy with a kappa coefficient of 0.857.

Conclusions

The proposed method could provide state-of-art multichannel sleep stage scoring performance with higher portability. This will facilitate the application of long-term monitoring of sleep quality in the future.

Usability of the REHOME Solution for the Telerehabilitation in Neurological Diseases: Preliminary Results on Motor and Cognitive Platforms

The progressive aging of the population and the consequent growth of individuals with neurological diseases and related chronic disabilities, will lead to a general increase in the costs and resources needed to ensure treatment and care services. In this scenario, telemedicine and e-health solutions, including remote monitoring and rehabilitation, are attracting increasing interest as tools to ensure the sustainability of the healthcare system or, at least, to support the burden for health care facilities. Technological advances in recent decades have fostered the development of dedicated and innovative Information and Communication Technology (ICT) based solutions, with the aim of complementing traditional care and treatment services through telemedicine applications that support new patient and disease management strategies. This is the background for the REHOME project, whose technological solution, presented in this paper, integrates innovative methodologies and devices for remote monitoring and rehabilitation of cognitive, motor, and sleep disorders associated with neurological diseases. One of the primary goals of the project is to meet the needs of patients and clinicians, by ensuring continuity of treatment from healthcare facilities to the patient's home. To this end, it is important to ensure the usability of the solution by elderly and pathological individuals. Preliminary results of usability and user experience questionnaires on 70 subjects recruited in three experimental trials are presented here.

Improving memory via automated targeted memory reactivation during sleep

A widely accepted view in memory research is that previously acquired information can be reactivated during sleep, leading to persistent memory storage. Targeted memory reactivation (TMR) was developed as a technique whereby specific memories can be reactivated during sleep using a sensory stimulus linked to prior learning. As a research tool, TMR can improve memory, raising the possibility that it may be useful for cognitive enhancement and clinical therapy. A major challenge for the expanded use of TMR is that a skilled operator must manually control stimulation, which is impractical in many settings. To address this limitation, we developed the SleepStim system for automated TMR in the home. SleepStim includes a smartwatch to collect movement and heart-rate data, plus a smartphone to emit auditory cues. A machine-learning model identifies periods of deep sleep and triggers TMR sounds within these periods. We tested whether this system could replicate the spatial-memory benefit of in-laboratory TMR. Participants learned locations of objects on a grid, and then half of the object locations were reactivated during sleep over 3 nights. Recall was tested each morning. In an experiment with 61 participants, the TMR effect was not significant but varied systematically with stimulus intensity; low-intensity but not high-intensity stimuli produced memory benefits. In a second experiment with 24 participants, we limited stimulus intensity and found that TMR reliably improved spatial memory, consistent with effects observed in laboratory studies. We conclude that SleepStim can effectively accomplish automated TMR, and that avoiding sleep disruption is critical for TMR benefits.

A review of automated sleep disorder detection

Automated sleep disorder detection is challenging because physiological symptoms can vary widely. These variations make it difficult to create effective sleep disorder detection models which support hu-man experts during diagnosis and treatment monitoring. From 2010 to 2021, authors of 95 scientific papers have taken up the challenge of automating sleep disorder detection. This paper provides an expert review of this work. We investigated whether digital technology and Artificial Intelligence (AI) can provide automated diagnosis support for sleep disorders. We followed the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines during the content discovery phase. We compared the performance of proposed sleep disorder detection methods, involving differ-ent datasets or signals. During the review, we found eight sleep disorders, of which sleep apnea and insomnia were the most studied. These disorders can be diagnosed using several kinds of biomedical signals, such as Electrocardiogram (ECG), Polysomnography (PSG), Electroencephalogram (EEG), Electromyogram (EMG), and snore sound. Subsequently, we established areas of commonality and distinctiveness. Common to all reviewed papers was that AI models were trained and tested with labelled physiological signals. Looking deeper, we discovered that 24 distinct algorithms were used for the detection task. The nature of these algorithms evolved, before 2017 only traditional Machine Learning (ML) was used. From 2018 onward, both ML and Deep Learning (DL) methods were used for sleep disorder detection. The strong emergence of DL algorithms has considerable implications for future detection systems because these algorithms demand significantly more data for training and testing when compared with ML. Based on our review results, we suggest that both type and amount of labelled data is crucial for the design of future sleep disorder detection systems because this will steer the choice of AI algorithm which establishes the desired decision support. As a guiding principle, more labelled data will help to represent the variations in symptoms. DL algorithms can extract information from these larger data quantities more effectively, therefore; we predict that the role of these algorithms will continue to expand.

L-Tetrolet Pattern-Based Sleep Stage Classification Model Using Balanced EEG Datasets

Background: Sleep stage classification is a crucial process for the diagnosis of sleep or sleep-related diseases. Currently, this process is based on manual electroencephalogram (EEG) analysis, which is resource-intensive and error-prone. Various machine learning models have been recommended to standardize and automate the analysis process to address these problems. Materials and methods: The well-known cyclic alternating pattern (CAP) sleep dataset is used to train and test an L-tetrolet pattern-based sleep stage classification model in this research. By using this dataset, the following three cases are created, and they are: Insomnia, Normal, and Fused cases. For each of these cases, the machine learning model is tasked with identifying six sleep stages. The model is structured in terms of feature generation, feature selection, and classification. Feature generation is established with a new L-tetrolet (Tetris letter) function and multiple pooling decomposition for level creation. We fuse ReliefF and iterative neighborhood component analysis (INCA) feature selection using a threshold value. The hybrid and iterative feature selectors are named threshold selection-based ReliefF and INCA (TSRFINCA). The selected features are classified using a cubic support vector machine. Results: The presented L-tetrolet pattern and TSRFINCA-based sleep stage classification model yield 95.43%, 91.05%, and 92.31% accuracies for Insomnia, Normal dataset, and Fused cases, respectively. Conclusion: The recommended L-tetrolet pattern and TSRFINCA-based model push the envelope of current knowledge engineering by accurately classifying sleep stages even in the presence of sleep disorders.

A Multilevel Temporal Context Network for Sleep Stage Classification

Sleep stage classification is essential in diagnosing and treating sleep disorders. Many deep learning models have been proposed to classify sleep stages by automatic learning features and temporal context information. These temporal context features come from the intra-epoch temporal features, which represent the overall morphology of an epoch, and temporal features of adjacent epochs and long epochs, which represent the influence between epochs. However, most existing methods do not fully use the complementarity of the three-level temporal features, resulting in incomplete extracted temporal features. To solve this problem, we propose a multilevel temporal context network (MLTCN) to learn the temporal features from intra-epoch, adjacent epochs, and long epochs, which utilizes the complete temporal features to improve classification accuracy. We evaluate the performance of the proposed model on the Sleep-EDF datasets published in 2013 and 2018. The experimental results show that our MLTCN can achieve an overall accuracy of 84.2% and a kappa coefficient of 0.78 on the Sleep-EDF-2013 dataset. On the larger Sleep-EDF-2018 dataset, the overall accuracy is 81.0%, and a kappa coefficient is 0.74. Our model can better assist sleep experts in diagnosing sleep disorders.

Environmental Benefits of Sleep Apnoea Detection in the Home Environment

Sleep Apnoea (SA) is a common chronic illness that affects nearly 1 billion people around the world, and the number of patients is rising. SA causes a wide range of psychological and physiological ailments that have detrimental effects on a patient’s wellbeing. The high prevalence and negative health effects make SA a public health problem. Whilst the current gold standard diagnostic procedure, polysomnography (PSG), is reliable, it is resource-expensive and can have a negative impact on sleep quality, as well as the environment. With this study, we focus on the environmental impact that arises from resource utilisation during SA detection, and we propose remote monitoring (RM) as a potential solution that can improve the resource efficiency and reduce travel. By reusing infrastructure technology, such as mobile communication, cloud computing, and artificial intelligence (AI), RM establishes SA detection and diagnosis support services in the home environment. However, there are considerable barriers to a widespread adoption of this technology. To gain a better understanding of the available technology and its associated strength, as well as weaknesses, we reviewed scientific papers that used various strategies for RM-based SA detection. Our review focused on 113 studies that were conducted between 2018 and 2022 and that were listed in Google Scholar. We found that just over 50% of the proposed RM systems incorporated real time signal processing and around 20% of the studies did not report on this important aspect. From an environmental perspective, this is a significant shortcoming, because 30% of the studies were based on measurement devices that must travel whenever the internal buffer is full. The environmental impact of that travel might constitute an additional need for changing from offline to online SA detection in the home environment.

Methodologies and Wearable Devices to Monitor Biophysical Parameters Related to Sleep Dysfunctions: An Overview

Sleep is crucial for human health from metabolic, mental, emotional, and social points of view; obtaining good sleep in terms of quality and duration is fundamental for maintaining a good life quality. Over the years, several systems have been proposed in the scientific literature and on the market to derive metrics used to quantify sleep quality as well as detect sleep disturbances and disorders. In this field, wearable systems have an important role in the discreet, accurate, and long-term detection of biophysical markers useful to determine sleep quality. This paper presents the current state-of-the-art wearable systems and software tools for sleep staging and detecting sleep disorders and dysfunctions. At first, the paper discusses sleep's functions and the importance of monitoring sleep to detect eventual sleep disturbance and disorders. Afterward, an overview of prototype and commercial headband-like wearable devices to monitor sleep is presented, both reported in the scientific literature and on the market, allowing unobtrusive and accurate detection of sleep quality markers. Furthermore, a survey of scientific works related the effect of the COVID-19 pandemic on sleep functions, attributable to both infection and lifestyle changes. In addition, a survey of algorithms for sleep staging and detecting sleep disorders is introduced based on an analysis of single or multiple biosignals (EEG-electroencephalography, ECG-electrocardiography, EMG-electromyography, EOG-electrooculography, etc.). Lastly, comparative analyses and insights are provided to determine the future trends related to sleep monitoring systems.

A-PASS: An automated pipeline to analyze simultaneously acquired EEG-fMRI data for studying brain activities during sleep

OBJECTIVE

Concurrent electroencephalography and functional magnetic resonance imaging (EEG-fMRI) signals can be used to uncover the nature of brain activities during sleep. However, analyzing simultaneously acquired EEG-fMRI data is extremely time consuming and experience dependent. Thus, we developed a pipeline, which we named A-PASS, to automatically analyze simultaneously acquired EEG-fMRI data for studying brain activities during sleep.

APPROACH

A deep learning model was trained on a sleep EEG-fMRI dataset from 45 subjects and used to perform sleep stage scoring. Various fMRI indices can be calculated with A-PASS to depict the neurophysiological characteristics across different sleep stages. We tested the performance of A-PASS on an independent sleep EEG-fMRI dataset from 28 subjects. Statistical maps regarding the main effect of sleep stages and differences between each pair of stages of fMRI indices were generated and compared using both A-PASS and manual processing methods.

MAIN RESULTS

The deep learning model implemented in A-PASS achieved both an accuracy and F1-score higher than 70% for sleep stage classification on EEG data acquired during fMRI scanning. The statistical maps generated from A-PASS largely resembled those produced from manually scored stages plus a combination of multiple software programs.

SIGNIFICANCE

A-PASS allowed efficient EEG-fMRI data processing without manual operation and could serve as a reliable and powerful tool for simultaneous EEG-fMRI studies on sleep.

A systematic review of deep learning methods for modeling electrocardiograms during sleep

Sleep is one of the most important human physiological activities and plays an essential role in human health. Polysomnography (PSG) is the gold standard for measuring sleep quality and disorders, but it is time-consuming, labor-intensive, and prone to errors. Current research has confirmed the correlations between sleep and the respiratory/circulatory system. Electrocardiography (ECG) is convenient to perform, and ECG data are rich in breathing information. Therefore, sleep research based on ECG data has become popular. Currently, deep learning (DL) methods have achieved promising results on predictive health care tasks using ECG signals. Therefore, in this review, we systematically identify recent research studies and analyze them from the perspectives of data, model, and task. We discuss the shortcomings, summarize the findings, and highlight the potential opportunities. For sleep-related tasks, many ECG-based DL methods produce more accurate results than traditional approaches by combining multiple signal features and model structures. Methods that are more interpretable, scalable, and transferable will become ubiquitous in the daily practice of medicine and ambient-assisted-living applications. This paper is the first systematic review of ECG-based DL methods for sleep tasks.

Towards precision sleep medicine: Self-attention GAN as an innovative data augmentation technique for developing personalized automatic sleep scoring classification

It is very important to have good quality sleep, which can affect aspects such as memory consolidation, emotional regulation, learning, physical development, and quality of life. Diagnosing human sleep quality and problems quickly and accurately is an important issue for human well-being. Therefore, many automatic sleep scoring methods have been proposed. However, the methods have been developed using sleep data from different individuals or groups. The accuracies of these proposed methods might decrease, due to existing individual differences. In this study, the self-attention generative adversarial network (SAGAN) was applied as an advanced data augmentation technique to propose an improved personalized automatic sleep scoring classification. First, the spectrograms were converted from electroencephalography (EEG). Then, SAGAN was used to generate synthesized spectrograms for each subject. Finally, the real and synthesized spectrograms of each subject were utilized to train a personalized classifier. The averaged accuracy and standard deviation of the proposed method are 95.74% and 3.78%, respectively. Compared to the classifier trained with all subjects' training data, the average accuracy increased by 8.08%. The results proved that the generated spectrograms significantly improved the performance of the personalized automatic sleep scoring classification. The contributions of the proposed method were that made the medical staff and subjects save massive medical resources and time for manual recording and scoring.

Contactless remote monitoring of sleep: evaluating the feasibility of an under-mattress sensor mat in a real-life deployment

Sleep is so important, particularly for the elderly. The lack of sleep may increase the risk of cognitive decline. Similarly, it may also increase the risk of Alzheimer's disease. Nonetheless, many people underestimate the importance of getting enough rest and sleep. In-laboratory polysomnography is the gold-standard method for assessing the quality of sleep. This method is considered impractical in the clinical environment, seen as labour-intensive and expensive owing to its specialised equipment, leading to long waiting lists. Hence, user-friendly (remote and non-intrusive) devices are being developed to help patients monitor their sleep at home. In this paper, we first discuss commercially-available non-wearable devices that measure sleep, in which we highlight the features associated with each device, including sensor type, interface, outputs, dimensions, power supply, and connectivity. Second, we evaluate the feasibility of a non-wearable device in a free-living environment. The deployed device comprises a sensor mat with an integrated micro-bending multimode fibre. Raw sensor data were gathered from five senior participants living in a senior activity centre over a few to several weeks. We were able to analyse the participants' sleep quality using various sleep parameters deduced from the sensor mat. These parameters include the wake-up time, bedtime, the time in bed, nap time. Vital signs, namely heart rate, respiratory rate, and body movements, were also reported to detect abnormal sleep patterns. We have employed pre-and post-surveys reporting each volunteer's sleep hygiene to confirm the proposed system's outcomes for detecting the various sleep parameters. The results of the system were strongly correlated with the surveys for reporting each sleep parameter. Furthermore, the system proved to be highly effective in detecting irregular patterns that occurred during sleep.

Detection of Sleep Apnea from Electrocardiogram and Pulse Oximetry Signals Using Random Forest

Sleep apnea (SA) is a common sleep disorder which could impair the human physiological system. Therefore, early diagnosis of SA is of great interest. The traditional method of diagnosing SA is an overnight polysomnography (PSG) evaluation. When PSG has limited availability, automatic SA screening with a fewer number of signals should be considered. The primary purpose of this study is to develop and evaluate a SA detection model based on electrocardiogram (ECG) and blood oxygen saturation (SpO2). We adopted a multimodal approach to fuse ECG and SpO2 signals at the feature level. Then, feature selection was conducted using the recursive feature elimination with cross-validation (RFECV) algorithm and random forest (RF) classifier used to discriminate between apnea and normal events. Experiments were conducted on the Apnea-ECG database. The introduced algorithm obtained an accuracy of 97.5%, a sensitivity of 95.9%, a specificity of 98.4% and an AUC of 0.992 in per-segment classification, and outperformed previous works. The results showed that ECG and SpO2 are complementary in detecting SA, and that the combination of ECG and SpO2 enhances the ability to diagnose SA. Therefore, the proposed method has the potential to be an alternative to conventional detection methods.

Automatic sleep staging of EEG signals: recent development, challenges, and future directions

Modern deep learning holds a great potential to transform clinical practice on human sleep. Teaching a machine to carry out routine tasks would be a tremendous reduction in workload for clinicians. Sleep staging, a fundamental step in sleep practice, is a suitable task for this and will be the focus in this article. Recently, automatic sleep staging systems have been trained to mimic manual scoring, leading to similar performance to human sleep experts, at least on scoring of healthy subjects. Despite tremendous progress, we have not seen automatic sleep scoring adopted widely in clinical environments. This review aims to give a shared view of the authors on the most recent state-of-the-art development in automatic sleep staging, the challenges that still need to be addressed, and the future directions for automatic sleep scoring to achieve clinical value.

Deep Learning Application to Clinical Decision Support System in Sleep Stage Classification

Recently, deep learning for automated sleep stage classification has been introduced with promising results. However, as many challenges impede their routine application, automatic sleep scoring algorithms are not widely used. Typically, polysomnography (PSG) uses multiple channels for higher accuracy; however, the disadvantages include a requirement for a patient to stay one or more nights in the lab wearing uncomfortable sensors and wires. To avoid the inconvenience caused by the multiple channels, we aimed to develop a deep learning model for use in clinical decision support systems (CDSSs) and combined convolutional neural networks and a transformer for the supervised learning of three classes of sleep stages only with single-channel EEG data (C4-M1). The data for training, validation, and test were derived from 1590, 341, and 343 polysomnography recordings, respectively. The developed model yielded an overall accuracy of 91.4%, comparable with that of human experts. Based on the severity of obstructive sleep apnea, the model’s accuracy was 94.3%, 91.9%, 91.9%, and 90.6% in normal, mild, moderate, and severe cases, respectively. Our deep learning model enables accurate and rapid delineation of three-class sleep staging and could be useful as a CDSS for application in real-world clinical practice.

Deep-Learning Model Based on Convolutional Neural Networks to Classify Apnea–Hypopnea Events from the Oximetry Signal

Automated analysis of the blood oxygen saturation (SpO₂) signal from nocturnal oximetry has shown usefulness to simplify the diagnosis of obstructive sleep apnea (OSA), including the detection of respiratory events. However, the few preceding studies using SpO₂ recordings have focused on the automated detection of respiratory events versus normal respiration, without making any distinction between apneas and hypopneas. In this sense, the characteristics of oxygen desaturations differ between obstructive apnea and hypopnea episodes. In this chapter, we use the SpO₂ signal along with a convolutional neural network (CNN)-based deep-learning architecture for the automatic identification of apnea and hypopnea events. A total of 398 SpO₂ signals from adult OSA patients were used for this purpose. A CNN architecture was trained using 30-s epochs from the SpO₂ signal for the automatic classification of three classes: normal respiration, apnea, and hypopnea. Then, the apnea index (AI), the hypopnea index (HI), and the apnea-hypopnea index (AHI) were obtained by aggregating the outputs of the CNN for each subject (AI_CNN, HI_CNN, and AHI_CNN). This model showed a promising diagnostic performance in an independent test set, with 80.3% 3-class accuracy and 0.539 3-class Cohen's kappa for the classification of respiratory events. Furthermore, AI_CNN, HI_CNN, and AHI_CNN showed a high agreement with the values obtained from the standard PSG: 0.8023, 0.6774, and 0.8466 intra-class correlation coefficients (ICCs), respectively. This suggests that CNN can be used to analyze SpO₂ recordings for the automated diagnosis of OSA in at-home oximetry tests.

Dear reviewers: Responses to common reviewer critiques about infant neuroimaging studies

The field of adult neuroimaging relies on well-established principles in research design, imaging sequences, processing pipelines, as well as safety and data collection protocols. The field of infant magnetic resonance imaging, by comparison, is a young field with tremendous scientific potential but continuously evolving standards. The present article aims to initiate a constructive dialog between researchers who grapple with the challenges and inherent limitations of a nascent field and reviewers who evaluate their work. We address 20 questions that researchers commonly receive from research ethics boards, grant, and manuscript reviewers related to infant neuroimaging data collection, safety protocols, study planning, imaging sequences, decisions related to software and hardware, and data processing and sharing, while acknowledging both the accomplishments of the field and areas of much needed future advancements. This article reflects the cumulative knowledge of experts in the FIT’NG community and can act as a resource for both researchers and reviewers alike seeking a deeper understanding of the standards and tradeoffs involved in infant neuroimaging.

•

The field of infant MRI is young with evolving standards.

•

We address 20 questions that researchers commonly receive reviewers.

•

These come from research ethics boards, grant, and manuscript reviewers.

•

This article reflects the cumulative knowledge of experts in the FIT’NG community.

Sleep as a random walk: a super-statistical analysis of EEG data across sleep stages

In clinical practice, human sleep is classified into stages, each associated with different levels of muscular activity and marked by characteristic patterns in the EEG signals. It is however unclear whether this subdivision into discrete stages with sharply defined boundaries is truly reflecting the dynamics of human sleep. To address this question, we consider one-channel EEG signals as heterogeneous random walks: stochastic processes controlled by hyper-parameters that are themselves time-dependent. We first demonstrate the heterogeneity of the random process by showing that each sleep stage has a characteristic distribution and temporal correlation function of the raw EEG signals. Next, we perform a super-statistical analysis by computing hyper-parameters, such as the standard deviation, kurtosis, and skewness of the raw signal distributions, within subsequent 30-second epochs. It turns out that also the hyper-parameters have characteristic, sleep-stage-dependent distributions, which can be exploited for a simple Bayesian sleep stage detection. Moreover, we find that the hyper-parameters are not piece-wise constant, as the traditional hypnograms would suggest, but show rising or falling trends within and across sleep stages, pointing to an underlying continuous rather than sub-divided process that controls human sleep. Based on the hyper-parameters, we finally perform a pairwise similarity analysis between the different sleep stages, using a quantitative measure for the separability of data clusters in multi-dimensional spaces.

To improve our understand of how EEG activity reflects the dynamics of human sleep, Metzner et al. use human EEG data and superstatistical analysis to demonstrate that each sleep stage has a characteristic distribution and temporal correlation function of raw EEG signals. They also show that the hyper-parameters controlling the EEG signals have characteristic, sleep-stage-dependent distributions, which can be exploited for a simple Bayesian sleep stage detection.

Automatic Sleep Staging in Children with Sleep Apnea using Photoplethysmography and Convolutional Neural Networks

Sleep staging is of paramount importance in children with suspicion of pediatric obstructive sleep apnea (OSA). Complexity, cost, and intrusiveness of overnight polysomnography (PSG), the gold standard, have led to the search for alternative tests. In this sense, the photoplethysmography signal (PPG) carries useful information about the autonomous nervous activity associated to sleep stages and can be easily acquired in pediatric sleep apnea home tests with a pulse oximeter. In this study, we use the PPG signal along with convolutional neural networks (CNN), a deep-learning technique, for the automatic identification of the three main levels of sleep: wake (W), rapid eye movement (REM), and non-REM sleep. A database of 366 PPG recordings from pediatric OSA patients is involved in the study. A CNN architecture was trained using 30-s epochs from the PPG signal for three-stage sleep classification. This model showed a promising diagnostic performance in an independent test set, with 78.2% accuracy and 0.57 Cohen's kappa for W/NREM/REM classification. Furthermore, the percentage of time in wake stage obtained for each subject showed no statistically significant differences with the manually scored from PSG. These results were superior to the only state-of-the-art study focused on the analysis of the PPG signal in the automated detection of sleep stages in children suffering from OSA. This suggests that CNN can be used along with PPG recordings for sleep stages scoring in pediatric home sleep apnea tests.

Evaluation of Automated Hypnogram Analysis on Multi-Scored Polysomnographies

A new method for automated sleep stage scoring of polysomnographies is proposed that uses a random forest approach to model feature interactions and temporal effects. The model mostly relies on features based on the rules from the American Academy of Sleep Medicine, which allows medical experts to gain insights into the model. A common way to evaluate automated approaches to constructing hypnograms is to compare the one produced by the algorithm to an expert's hypnogram. However, given the same data, two expert annotators will construct (slightly) different hypnograms due to differing interpretations of the data or individual mistakes. A thorough evaluation of our method is performed on a multi-labeled dataset in which both the inter-rater variability as well as the prediction uncertainties are taken into account, leading to a new standard for the evaluation of automated sleep stage scoring algorithms. On all epochs, our model achieves an accuracy of 82.7%, which is only slightly lower than the inter-rater disagreement. When only considering the 63.3% of the epochs where both the experts and algorithm are certain, the model achieves an accuracy of 97.8%. Transition periods between sleep stages are identified and studied for the first time. Scoring guidelines for medical experts are provided to complement the certain predictions by scoring only a few epochs manually. This makes the proposed method highly time-efficient while guaranteeing a highly accurate final hypnogram.

Application of Deep Learning Models for Automated Identification of Parkinson's Disease: A Review (2011-2021)

Parkinson’s disease (PD) is the second most common neurodegenerative disorder affecting over 6 million people globally. Although there are symptomatic treatments that can increase the survivability of the disease, there are no curative treatments. The prevalence of PD and disability-adjusted life years continue to increase steadily, leading to a growing burden on patients, their families, society and the economy. Dopaminergic medications can significantly slow down the progression of PD when applied during the early stages. However, these treatments often become less effective with the disease progression. Early diagnosis of PD is crucial for immediate interventions so that the patients can remain self-sufficient for the longest period of time possible. Unfortunately, diagnoses are often late, due to factors such as a global shortage of neurologists skilled in early PD diagnosis. Computer-aided diagnostic (CAD) tools, based on artificial intelligence methods, that can perform automated diagnosis of PD, are gaining attention from healthcare services. In this review, we have identified 63 studies published between January 2011 and July 2021, that proposed deep learning models for an automated diagnosis of PD, using various types of modalities like brain analysis (SPECT, PET, MRI and EEG), and motion symptoms (gait, handwriting, speech and EMG). From these studies, we identify the best performing deep learning model reported for each modality and highlight the current limitations that are hindering the adoption of such CAD tools in healthcare. Finally, we propose new directions to further the studies on deep learning in the automated detection of PD, in the hopes of improving the utility, applicability and impact of such tools to improve early detection of PD globally.