1
|
Loh HW, Ooi CP, Oh SL, Barua PD, Tan YR, Acharya UR, Fung DSS. ADHD/CD-NET: automated EEG-based characterization of ADHD and CD using explainable deep neural network technique. Cogn Neurodyn 2024; 18:1609-1625. [PMID: 39104684 PMCID: PMC11297883 DOI: 10.1007/s11571-023-10028-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/08/2023] [Revised: 10/04/2023] [Accepted: 10/23/2023] [Indexed: 08/07/2024] Open
Abstract
In this study, attention deficit hyperactivity disorder (ADHD), a childhood neurodevelopmental disorder, is being studied alongside its comorbidity, conduct disorder (CD), a behavioral disorder. Because ADHD and CD share commonalities, distinguishing them is difficult, thus increasing the risk of misdiagnosis. It is crucial that these two conditions are not mistakenly identified as the same because the treatment plan varies depending on whether the patient has CD or ADHD. Hence, this study proposes an electroencephalogram (EEG)-based deep learning system known as ADHD/CD-NET that is capable of objectively distinguishing ADHD, ADHD + CD, and CD. The 12-channel EEG signals were first segmented and converted into channel-wise continuous wavelet transform (CWT) correlation matrices. The resulting matrices were then used to train the convolutional neural network (CNN) model, and the model's performance was evaluated using 10-fold cross-validation. Gradient-weighted class activation mapping (Grad-CAM) was also used to provide explanations for the prediction result made by the 'black box' CNN model. Internal private dataset (45 ADHD, 62 ADHD + CD and 16 CD) and external public dataset (61 ADHD and 60 healthy controls) were used to evaluate ADHD/CD-NET. As a result, ADHD/CD-NET achieved classification accuracy, sensitivity, specificity, and precision of 93.70%, 90.83%, 95.35% and 91.85% for the internal evaluation, and 98.19%, 98.36%, 98.03% and 98.06% for the external evaluation. Grad-CAM also identified significant channels that contributed to the diagnosis outcome. Therefore, ADHD/CD-NET can perform temporal localization and choose significant EEG channels for diagnosis, thus providing objective analysis for mental health professionals and clinicians to consider when making a diagnosis. Supplementary Information The online version contains supplementary material available at 10.1007/s11571-023-10028-2.
Collapse
Affiliation(s)
- Hui Wen Loh
- School of Science and Technology, Singapore University of Social Sciences, Singapore, Singapore
| | - Chui Ping Ooi
- School of Science and Technology, Singapore University of Social Sciences, Singapore, Singapore
| | - Shu Lih Oh
- Cogninet Australia, Sydney, NSW 2010 Australia
| | - Prabal Datta Barua
- Cogninet Australia, Sydney, NSW 2010 Australia
- Faculty of Engineering and Information Technology, University of Technology Sydney, Sydney, NSW 2007 Australia
- School of Business (Information System), University of Southern Queensland, Darling Heights, Australia
- Australian International Institute of Higher Education, Sydney, NSW 2000 Australia
- School of Science & Technology, University of New England, Armidale, Australia
- School of Biosciences, Taylor’s University, Selangor, Malaysia
- School of Computing, SRM Institute of Science and Technology, Kattankulathur, India
- School of Science and Technology, Kumamoto University, Kumamoto, Japan
- Sydney School of Education and Social work, University of Sydney, Camperdown, Australia
| | - Yi Ren Tan
- Developmental Psychiatry, Institute of Mental Health, Singapore, Singapore
| | - U. Rajendra Acharya
- School of Business (Information Systems), Faculty of Business, Education, Law & Arts, University of Southern Queensland, Darling Heights, Australia
- School of Mathematics, Physics and Computing, University of Southern Queensland, Springfield, Australia
- Centre for Health Research, University of Southern Queensland, Springfield, Australia
| | - Daniel Shuen Sheng Fung
- Developmental Psychiatry, Institute of Mental Health, Singapore, Singapore
- Lee Kong Chian School of Medicine, DUKE NUS Medical School, Yong Loo Lin School of Medicine, Nanyang Technological University, National University of Singapore, Singapore, Singapore
| |
Collapse
|
2
|
Fernández-Caballero A, Le Van Quyen M. Editorial: Innovative methods for sleep staging using neuroinformatics. Front Neuroinform 2024; 18:1448591. [PMID: 39040838 PMCID: PMC11262009 DOI: 10.3389/fninf.2024.1448591] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/13/2024] [Accepted: 06/25/2024] [Indexed: 07/24/2024] Open
Affiliation(s)
- Antonio Fernández-Caballero
- Departamento de Sistemas Informáticos, Escuela Técnica Superior de Ingenieros Industriales, Universidad de Castilla-La Mancha, Albacete, Spain
- Neurocognition and Emotion Unit, Instituto de Investigación en Informática de Albacete, Universidad de Castilla-La Mancha, Albacete, Spain
- Cognition and Psychosis Group, CIBERSAM (Biomedical Research Networking Centre in Mental Health), Madrid, Spain
| | - Michel Le Van Quyen
- Laboratoire d'imagerie médicale, Institut National de la Santé et de la Recherche Médicale (INSERM), Paris, France
- Cortex and Epilepsy Group, Institut du Cerveau et de la Moelle épiniére (ICM), Paris, France
| |
Collapse
|
3
|
Yin Z, Yu H, Yuan T, Smyth C, Anjum MF, Zhu G, Ma R, Xu Y, An Q, Gan Y, Merk T, Qin G, Xie H, Zhang N, Wang C, Jiang Y, Meng F, Yang A, Neumann WJ, Starr P, Little S, Li L, Zhang J. Generalized sleep decoding with basal ganglia signals in multiple movement disorders. NPJ Digit Med 2024; 7:122. [PMID: 38729977 PMCID: PMC11087561 DOI: 10.1038/s41746-024-01115-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/23/2023] [Accepted: 04/23/2024] [Indexed: 05/12/2024] Open
Abstract
Sleep disturbances profoundly affect the quality of life in individuals with neurological disorders. Closed-loop deep brain stimulation (DBS) holds promise for alleviating sleep symptoms, however, this technique necessitates automated sleep stage decoding from intracranial signals. We leveraged overnight data from 121 patients with movement disorders (Parkinson's disease, Essential Tremor, Dystonia, Essential Tremor, Huntington's disease, and Tourette's syndrome) in whom synchronized polysomnograms and basal ganglia local field potentials were recorded, to develop a generalized, multi-class, sleep specific decoder - BGOOSE. This generalized model achieved 85% average accuracy across patients and across disease conditions, even in the presence of recordings from different basal ganglia targets. Furthermore, we also investigated the role of electrocorticography on decoding performances and proposed an optimal decoding map, which was shown to facilitate channel selection for optimal model performances. BGOOSE emerges as a powerful tool for generalized sleep decoding, offering exciting potentials for the precision stimulation delivery of DBS and better management of sleep disturbances in movement disorders.
Collapse
Affiliation(s)
- Zixiao Yin
- Department of Neurosurgery, Beijing Tiantan Hospital, Capital Medical University, Beijing, China.
- Movement Disorder and Neuromodulation Unit, Department of Neurology, Charité-Campus Mitte, Charite-Universitatsmedizin Berlin, Chariteplatz 1, 10117, Berlin, Germany.
| | - Huiling Yu
- National Engineering Research Center of Neuromodulation, School of Aerospace Engineering, Tsinghua University, 100084, Beijing, China
| | - Tianshuo Yuan
- Department of Neurosurgery, Beijing Tiantan Hospital, Capital Medical University, Beijing, China
| | - Clay Smyth
- Department of Bioengineering, University of California, San Francisco, UCSF Byers Hall Box 2520, 1700 Fourth St Ste 203, San Francisco, CA, 94143, USA
| | - Md Fahim Anjum
- Department of Neurology, University of California, San Francisco, 1651 4th Street, San Francisco, CA, 94158, USA
| | - Guanyu Zhu
- Department of Neurosurgery, Beijing Tiantan Hospital, Capital Medical University, Beijing, China
- Movement Disorder and Neuromodulation Unit, Department of Neurology, Charité-Campus Mitte, Charite-Universitatsmedizin Berlin, Chariteplatz 1, 10117, Berlin, Germany
| | - Ruoyu Ma
- Department of Neurosurgery, Beijing Tiantan Hospital, Capital Medical University, Beijing, China
| | - Yichen Xu
- Department of Neurosurgery, Beijing Tiantan Hospital, Capital Medical University, Beijing, China
| | - Qi An
- Department of Neurosurgery, Beijing Tiantan Hospital, Capital Medical University, Beijing, China
| | - Yifei Gan
- Department of Neurosurgery, Beijing Tiantan Hospital, Capital Medical University, Beijing, China
| | - Timon Merk
- Movement Disorder and Neuromodulation Unit, Department of Neurology, Charité-Campus Mitte, Charite-Universitatsmedizin Berlin, Chariteplatz 1, 10117, Berlin, Germany
| | - Guofan Qin
- Department of Neurosurgery, Beijing Tiantan Hospital, Capital Medical University, Beijing, China
| | - Hutao Xie
- Department of Neurosurgery, Beijing Tiantan Hospital, Capital Medical University, Beijing, China
| | - Ning Zhang
- Department of Neuropsychiatry, Behavioral Neurology and Sleep Center, Beijing Tiantan Hospital, Capital Medical University, Beijing, China
| | - Chunxue Wang
- Department of Neuropsychiatry, Behavioral Neurology and Sleep Center, Beijing Tiantan Hospital, Capital Medical University, Beijing, China
| | - Yin Jiang
- Department of Functional Neurosurgery, Beijing Neurosurgical Institute, Capital Medical University, Beijing, China
| | - Fangang Meng
- Department of Functional Neurosurgery, Beijing Neurosurgical Institute, Capital Medical University, Beijing, China
| | - Anchao Yang
- Department of Neurosurgery, Beijing Tiantan Hospital, Capital Medical University, Beijing, China
| | - Wolf-Julian Neumann
- Movement Disorder and Neuromodulation Unit, Department of Neurology, Charité-Campus Mitte, Charite-Universitatsmedizin Berlin, Chariteplatz 1, 10117, Berlin, Germany
| | - Philip Starr
- Department of Neurosurgery, University of California, San Francisco, Eighth Floor, 400 Parnassus Ave, San Francisco, CA, 94143, USA
| | - Simon Little
- Department of Neurology, University of California, San Francisco, 1651 4th Street, San Francisco, CA, 94158, USA.
| | - Luming Li
- National Engineering Research Center of Neuromodulation, School of Aerospace Engineering, Tsinghua University, 100084, Beijing, China
- IDG/McGovern Institute for Brain Research, Tsinghua University, 100084, Beijing, China
| | - Jianguo Zhang
- Department of Neurosurgery, Beijing Tiantan Hospital, Capital Medical University, Beijing, China.
- Department of Functional Neurosurgery, Beijing Neurosurgical Institute, Capital Medical University, Beijing, China.
- Beijing Key Laboratory of Neurostimulation, Beijing, China.
| |
Collapse
|
4
|
Li Y, Chen J, Ma W, Zhao G, Fan X. MVF-SleepNet: Multi-View Fusion Network for Sleep Stage Classification. IEEE J Biomed Health Inform 2024; 28:2485-2495. [PMID: 36129857 DOI: 10.1109/jbhi.2022.3208314] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
Abstract
Sleep stage classification is of great importance in human health monitoring and disease diagnosing. Clinically, visual-inspected classifying sleep into different stages is quite time consuming and highly relies on the expertise of sleep specialists. Many automated models for sleep stage classification have been proposed in previous studies but their performances still exist a gap to the real clinical application. In this work, we propose a novel multi-view fusion network named MVF-SleepNet based on multi-modal physiological signals of electroencephalography (EEG), electrocardiography (ECG), electrooculography (EOG), and electromyography (EMG). To capture the relationship representation among multi-modal physiological signals, we construct two views of Time-frequency images (TF images) and Graph-learned graphs (GL graphs). To learn the spectral-temporal representation from sequentially timed TF images, the combination of VGG-16 and GRU networks is utilized. To learn the spatial-temporal representation from sequentially timed GL graphs, the combination of Chebyshev graph convolution and temporal convolution networks is employed. Fusing the spectral-temporal representation and spatial-temporal representation can further boost the performance of sleep stage classification. A large number of experiment results on the publicly available datasets of ISRUC-S1 and ISRUC-S3 show that the MVF-SleepNet achieves overall accuracy of 0.821, F1 score of 0.802 and Kappa of 0.768 on ISRUC-S1 dataset, and accuracy of 0.841, F1 score of 0.828 and Kappa of 0.795 on ISRUC-S3 dataset. The MVF-SleepNet achieves competitive results on both datasets of ISRUC-S1 and ISRUC-S3 for sleep stage classification compared to the state-of-the-art baselines. The source code of MVF-SleepNet is available on Github (https://github.com/YJPai65/MVF-SleepNet).
Collapse
|
5
|
Rashidi S, Asl BM. Strength of ensemble learning in automatic sleep stages classification using single-channel EEG and ECG signals. Med Biol Eng Comput 2024; 62:997-1015. [PMID: 38114690 DOI: 10.1007/s11517-023-02980-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/08/2023] [Accepted: 11/26/2023] [Indexed: 12/21/2023]
Abstract
Healthy sleep plays an essential role in human daily life. Classification of sleep stages is a crucial tool for assisting physicians in diagnosing and treating sleep disorders. In this study, a strong ensemble learning model is proposed to enhance the ability of classification models in accurate sleep staging, particularly in multi-class classification. We asserted that high-accuracy sleep classification is achievable using only single-channel electroencephalogram (EEG) and electrocardiogram (ECG) by combining their best-extractable features in the time and frequency domains we recommended. More importantly, the superiority of the recommended method, which is the simultaneous use of stacking and bagging, over conventional machine learning classifiers in sleep staging was demonstrated, using the MIT-BIH Polysomnographic and Sleep-EDF expanded databases. Finally, K-fold cross-validation was used to fairly estimate these models. The best mean test accuracy rates for distinguishing between two classes of "sleep vs. wake," "rapid vs. non-rapid eye movement," and "deep vs. light sleep," were obtained 99.93%, 99.64%, and 99.69%, respectively. Furthermore, our proposed method achieved accuracies of 97.14%, 95.18%, 92.7%, and 85.64% for separating three, four, five, and six sleep classes, respectively. Compared to recent studies, our method outperforms other sleep stage classification schemes, especially in multi-class staging.
Collapse
Affiliation(s)
- Samandokht Rashidi
- Department of Electrical and Computer Engineering, Tarbiat Modares University, Tehran, Iran
| | - Babak Mohammadzadeh Asl
- Department of Electrical and Computer Engineering, Tarbiat Modares University, Tehran, Iran.
| |
Collapse
|
6
|
Ji X, Li Y, Wen P, Barua P, Acharya UR. MixSleepNet: A Multi-Type Convolution Combined Sleep Stage Classification Model. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2024; 244:107992. [PMID: 38218118 DOI: 10.1016/j.cmpb.2023.107992] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/05/2023] [Revised: 12/09/2023] [Accepted: 12/19/2023] [Indexed: 01/15/2024]
Abstract
BACKGROUND AND OBJECTIVE Sleep staging is an essential step for sleep disorder diagnosis, which is time-intensive and laborious for experts to perform this work manually. Automatic sleep stage classification methods not only alleviate experts from these demanding tasks but also enhance the accuracy and efficiency of the classification process. METHODS A novel multi-channel biosignal-based model constructed by the combination of a 3D convolutional operation and a graph convolutional operation is proposed for the automated sleep stages using various physiological signals. Both the 3D convolution and graph convolution can aggregate information from neighboring brain areas, which helps to learn intrinsic connections from the biosignals. Electroencephalogram (EEG), electromyogram (EMG), electrooculogram (EOG) and electrocardiogram (ECG) signals are employed to extract time domain and frequency domain features. Subsequently, these signals are input to the 3D convolutional and graph convolutional branches, respectively. The 3D convolution branch can explore the correlations between multi-channel signals and multi-band waves in each channel in the time series, while the graph convolution branch can explore the connections between each channel and each frequency band. In this work, we have developed the proposed multi-channel convolution combined sleep stage classification model (MixSleepNet) using ISRUC datasets (Subgroup 3 and 50 random samples from Subgroup 1). RESULTS Based on the first expert's label, our generated MixSleepNet yielded an accuracy, F1-score and Cohen kappa scores of 0.830, 0.821 and 0.782, respectively for ISRUC-S3. It obtained accuracy, F1-score and Cohen kappa scores of 0.812, 0.786, and 0.756, respectively for the ISRUC-S1 dataset. In accordance with the evaluations conducted by the second expert, the comprehensive accuracies, F1-scores, and Cohen kappa coefficients for the ISRUC-S3 and ISRUC-S1 datasets are determined to be 0.837, 0.820, 0.789, and 0.829, 0.791, 0.775, respectively. CONCLUSION The results of the performance metrics by the proposed method are much better than those from all the compared models. Additional experiments were carried out on the ISRUC-S3 sub-dataset to evaluate the contributions of each module towards the classification performance.
Collapse
Affiliation(s)
- Xiaopeng Ji
- School of Mathematics, Physics and Computing, University of Southern Queensland, Toowoomba, QLD 4350, Australia.
| | - Yan Li
- School of Mathematics, Physics and Computing, University of Southern Queensland, Toowoomba, QLD 4350, Australia.
| | - Peng Wen
- School of Engineering, University of Southern Queensland, Toowoomba, QLD 4350, Australia.
| | - Prabal Barua
- Cogninet Brain Team, Sydney, NSW 2010, Australia.
| | - U Rajendra Acharya
- School of Mathematics, Physics and Computing, University of Southern Queensland, Toowoomba, QLD 4350, Australia.
| |
Collapse
|
7
|
Kainec KA, Caccavaro J, Barnes M, Hoff C, Berlin A, Spencer RMC. Evaluating Accuracy in Five Commercial Sleep-Tracking Devices Compared to Research-Grade Actigraphy and Polysomnography. SENSORS (BASEL, SWITZERLAND) 2024; 24:635. [PMID: 38276327 PMCID: PMC10820351 DOI: 10.3390/s24020635] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/27/2023] [Revised: 01/12/2024] [Accepted: 01/16/2024] [Indexed: 01/27/2024]
Abstract
The development of consumer sleep-tracking technologies has outpaced the scientific evaluation of their accuracy. In this study, five consumer sleep-tracking devices, research-grade actigraphy, and polysomnography were used simultaneously to monitor the overnight sleep of fifty-three young adults in the lab for one night. Biases and limits of agreement were assessed to determine how sleep stage estimates for each device and research-grade actigraphy differed from polysomnography-derived measures. Every device, except the Garmin Vivosmart, was able to estimate total sleep time comparably to research-grade actigraphy. All devices overestimated nights with shorter wake times and underestimated nights with longer wake times. For light sleep, absolute bias was low for the Fitbit Inspire and Fitbit Versa. The Withings Mat and Garmin Vivosmart overestimated shorter light sleep and underestimated longer light sleep. The Oura Ring underestimated light sleep of any duration. For deep sleep, bias was low for the Withings Mat and Garmin Vivosmart while other devices overestimated shorter and underestimated longer times. For REM sleep, bias was low for all devices. Taken together, these results suggest that proportional bias patterns in consumer sleep-tracking technologies are prevalent and could have important implications for their overall accuracy.
Collapse
Affiliation(s)
- Kyle A. Kainec
- Neuroscience & Behavior Program, French Hall, University of Massachusetts Amherst, 230 Stockbridge Road, Amherst, MA 01003, USA;
- Institute for Applied Life Sciences, Life Science Laboratories, University of Massachusetts Amherst, 240 Thatcher Road, Amherst, MA 01003, USA; (M.B.); (C.H.)
| | - Jamie Caccavaro
- Department of Psychological and Brain Sciences, Tobin Hall, University of Massachusetts Amherst, 135 Hicks Way, Amherst, MA 01003, USA
| | - Morgan Barnes
- Institute for Applied Life Sciences, Life Science Laboratories, University of Massachusetts Amherst, 240 Thatcher Road, Amherst, MA 01003, USA; (M.B.); (C.H.)
- Department of Psychological and Brain Sciences, Tobin Hall, University of Massachusetts Amherst, 135 Hicks Way, Amherst, MA 01003, USA
| | - Chloe Hoff
- Institute for Applied Life Sciences, Life Science Laboratories, University of Massachusetts Amherst, 240 Thatcher Road, Amherst, MA 01003, USA; (M.B.); (C.H.)
- Department of Psychological and Brain Sciences, Tobin Hall, University of Massachusetts Amherst, 135 Hicks Way, Amherst, MA 01003, USA
| | - Annika Berlin
- Institute for Applied Life Sciences, Life Science Laboratories, University of Massachusetts Amherst, 240 Thatcher Road, Amherst, MA 01003, USA; (M.B.); (C.H.)
- Department of Psychological and Brain Sciences, Tobin Hall, University of Massachusetts Amherst, 135 Hicks Way, Amherst, MA 01003, USA
| | - Rebecca M. C. Spencer
- Neuroscience & Behavior Program, French Hall, University of Massachusetts Amherst, 230 Stockbridge Road, Amherst, MA 01003, USA;
- Institute for Applied Life Sciences, Life Science Laboratories, University of Massachusetts Amherst, 240 Thatcher Road, Amherst, MA 01003, USA; (M.B.); (C.H.)
- Department of Psychological and Brain Sciences, Tobin Hall, University of Massachusetts Amherst, 135 Hicks Way, Amherst, MA 01003, USA
| |
Collapse
|
8
|
Jeong J, Yoon W, Lee JG, Kim D, Woo Y, Kim DK, Shin HW. Standardized image-based polysomnography database and deep learning algorithm for sleep-stage classification. Sleep 2023; 46:zsad242. [PMID: 37703391 DOI: 10.1093/sleep/zsad242] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/10/2022] [Revised: 08/11/2023] [Indexed: 09/15/2023] Open
Abstract
STUDY OBJECTIVES Polysomnography (PSG) scoring is labor-intensive, subjective, and often ambiguous. Recently several deep learning (DL) models for automated sleep scoring have been developed, they are tied to a fixed amount of input channels and resolution. In this study, we constructed a standardized image-based PSG dataset in order to overcome the heterogeneity of raw signal data obtained from various PSG devices and various sleep laboratory environments. METHODS All individually exported European data format files containing raw signals were converted into images with an annotation file, which contained the demographics, diagnoses, and sleep statistics. An image-based DL model for automatic sleep staging was developed, compared with a signal-based model, and validated in an external dataset. RESULTS We constructed 10253 image-based PSG datasets using a standardized format. Among these, 7745 diagnostic PSG data were used to develop our DL model. The DL model using the image dataset showed similar performance to the signal-based dataset for the same subject. The overall DL accuracy was greater than 80%, even with severe obstructive sleep apnea. Moreover, for the first time, we showed explainable DL in the field of sleep medicine as visualized key inference regions using Eigen-class activation maps. Furthermore, when a DL model for sleep scoring performs external validation, we achieved a relatively good performance. CONCLUSIONS Our main contribution demonstrates the availability of a standardized image-based dataset, and highlights that changing the data sampling rate or number of sensors may not require retraining, although performance decreases slightly as the number of sensors decreases.
Collapse
Affiliation(s)
- Jaemin Jeong
- Department of Computer Engineering, School of Software, Hallym University, Chuncheon, Republic of Korea
| | | | - Jeong-Gun Lee
- Department of Computer Engineering, School of Software, Hallym University, Chuncheon, Republic of Korea
| | - Dongyoung Kim
- Department of Computer Engineering, School of Software, Hallym University, Chuncheon, Republic of Korea
| | - Yunhee Woo
- Institute of New Frontier Research, Division of Big Data and Artificial Intelligence, Chuncheon Sacred Heart Hospital, Hallym University College of Medicine, Chuncheon, Republic of Korea
| | - Dong-Kyu Kim
- OUaR LaB, Inc, Seoul, Republic of Korea
- Institute of New Frontier Research, Division of Big Data and Artificial Intelligence, Chuncheon Sacred Heart Hospital, Hallym University College of Medicine, Chuncheon, Republic of Korea
- Department of Otorhinolaryngology-Head and Neck Surgery, Chuncheon Sacred Heart Hospital, Hallym University College of Medicine, Chuncheon, Republic of Korea¸
| | - Hyun-Woo Shin
- OUaR LaB, Inc, Seoul, Republic of Korea
- Obstructive Upper Airway Research (OUaR) Laboratory, Department of Pharmacology, Seoul National University College of Medicine, Seoul, Republic of Korea
- Department of Biomedical Sciences, Seoul National University Graduate School, Seoul, Republic of Korea
- Cancer Research Institute, Seoul National University College of Medicine, Seoul, Republic of Korea
- Sensory Organ Research Institute, Seoul National University College of Medicine, Seoul, Republic of Korea
- Department of Otorhinolaryngology-Head and Neck Surgery, Seoul National University Hospital, Seoul, Republic of Korea
| |
Collapse
|
9
|
Grassi M, Daccò S, Caldirola D, Perna G, Schruers K, Defillo A. Enhanced sleep staging with artificial intelligence: a validation study of new software for sleep scoring. Front Artif Intell 2023; 6:1278593. [PMID: 38145233 PMCID: PMC10739507 DOI: 10.3389/frai.2023.1278593] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/16/2023] [Accepted: 11/14/2023] [Indexed: 12/26/2023] Open
Abstract
Manual sleep staging (MSS) using polysomnography is a time-consuming task, requires significant training, and can lead to significant variability among scorers. STAGER is a software program based on machine learning algorithms that has been developed by Medibio Limited (Savage, MN, USA) to perform automatic sleep staging using only EEG signals from polysomnography. This study aimed to extensively investigate its agreement with MSS performed during clinical practice and by three additional expert sleep technicians. Forty consecutive polysomnographic recordings of patients referred to three US sleep clinics for sleep evaluation were retrospectively collected and analyzed. Three experienced technicians independently staged the recording using the electroencephalography, electromyography, and electrooculography signals according to the American Academy of Sleep Medicine guidelines. The staging initially performed during clinical practice was also considered. Several agreement statistics between the automatic sleep staging (ASS) and MSS, among the different MSSs, and their differences were calculated. Bootstrap resampling was used to calculate 95% confidence intervals and the statistical significance of the differences. STAGER's ASS was most comparable with, or statistically significantly better than the MSS, except for a partial reduction in the positive percent agreement in the wake stage. These promising results indicate that STAGER software can perform ASS of inpatient polysomnographic recordings accurately in comparison with MSS.
Collapse
Affiliation(s)
- Massimiliano Grassi
- Medibio Limited, Savage, MN, United States
- Department of Biomedical Sciences, Humanitas University, Pieve Emanuele, Italy
- Department of Clinical Neurosciences, Villa San Benedetto Menni Hospital, Hermanas Hospitalarias, Albese con Cassano, Italy
| | - Silvia Daccò
- Medibio Limited, Savage, MN, United States
- Department of Biomedical Sciences, Humanitas University, Pieve Emanuele, Italy
- Department of Clinical Neurosciences, Villa San Benedetto Menni Hospital, Hermanas Hospitalarias, Albese con Cassano, Italy
- Humanitas San Pio X, Personalized Medicine Center for Anxiety and Panic Disorders, Milan, Italy
| | - Daniela Caldirola
- Department of Biomedical Sciences, Humanitas University, Pieve Emanuele, Italy
- Department of Clinical Neurosciences, Villa San Benedetto Menni Hospital, Hermanas Hospitalarias, Albese con Cassano, Italy
- Humanitas San Pio X, Personalized Medicine Center for Anxiety and Panic Disorders, Milan, Italy
| | - Giampaolo Perna
- Medibio Limited, Savage, MN, United States
- Department of Biomedical Sciences, Humanitas University, Pieve Emanuele, Italy
- Department of Clinical Neurosciences, Villa San Benedetto Menni Hospital, Hermanas Hospitalarias, Albese con Cassano, Italy
- Humanitas San Pio X, Personalized Medicine Center for Anxiety and Panic Disorders, Milan, Italy
- Department of Psychiatry and Neuropsychology, Faculty of Health, Medicine, and Life Sciences, Research Institute of Mental Health and Neuroscience, Maastricht University, Maastricht, Netherlands
| | - Koen Schruers
- Department of Psychiatry and Neuropsychology, Faculty of Health, Medicine, and Life Sciences, Research Institute of Mental Health and Neuroscience, Maastricht University, Maastricht, Netherlands
| | | |
Collapse
|
10
|
Liu Z, Qin M, Lu Y, Luo S, Zhang Q. DenSleepNet: DenseNet based model for sleep staging with two-frequency feature fusion and coordinate attention. Biomed Eng Lett 2023; 13:751-761. [PMID: 37872995 PMCID: PMC10590351 DOI: 10.1007/s13534-023-00301-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/16/2023] [Revised: 06/15/2023] [Accepted: 06/23/2023] [Indexed: 10/25/2023] Open
Abstract
Sleep staging is often applied to assess the quality of sleep and also be used to prevent and monitor psychiatric disorders caused by sleep. However, it remains a challenge to extract the discriminative features of salient waveforms in sleep EEG and enable the network to effectively classify sleep stages by emphasizing these crucial features, thus achieving higher accuracy. In this study, an end-to-end deep learning model based on DenseNet for automatic sleep staging is designed and constructed. In the framework, two convolutional branches are devised to extract the underlying features (Two-Frequency Feature) at various frequencies, which are then fused and input into the DenseNet module to extract salient waveform features. After that, the Coordinate Attention mechanism is employed to enhance the localization of salient waveform features by emphasizing the position of salient waveforms and the spatial relationship across the entire frequency spectrum. Finally, the obtained features are accessed to the fully connected for sleep staging. The model was validated with a 20-fold cross-validation procedure on two public available datasets, and the overall accuracy, kappa coefficient, and MF1 score reached 92.9%, 78.7, 0.86 and 90.0%, 75.8, 0.80 on Sleep-EDF-20 and Sleep-EDFx, respectively. Experimental results show that the proposed model achieves competitive performance for sleep staging compared with the reported approaches under the identical conditions.
Collapse
Affiliation(s)
- Zhi Liu
- School of Artificial Intelligence, Chongqing University of Technology, Chongqing, China
| | - Meiqiao Qin
- School of Artificial Intelligence, Chongqing University of Technology, Chongqing, China
| | - Yunhua Lu
- School of Artificial Intelligence, Chongqing University of Technology, Chongqing, China
| | - Sixin Luo
- School of Artificial Intelligence, Chongqing University of Technology, Chongqing, China
| | - Qinhan Zhang
- School of Artificial Intelligence, Chongqing University of Technology, Chongqing, China
| |
Collapse
|
11
|
Vaquerizo-Villar F, Gutiérrez-Tobal GC, Calvo E, Álvarez D, Kheirandish-Gozal L, Del Campo F, Gozal D, Hornero R. An explainable deep-learning model to stage sleep states in children and propose novel EEG-related patterns in sleep apnea. Comput Biol Med 2023; 165:107419. [PMID: 37703716 DOI: 10.1016/j.compbiomed.2023.107419] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/06/2023] [Revised: 07/26/2023] [Accepted: 08/28/2023] [Indexed: 09/15/2023]
Abstract
Automatic deep-learning models used for sleep scoring in children with obstructive sleep apnea (OSA) are perceived as black boxes, limiting their implementation in clinical settings. Accordingly, we aimed to develop an accurate and interpretable deep-learning model for sleep staging in children using single-channel electroencephalogram (EEG) recordings. We used EEG signals from the Childhood Adenotonsillectomy Trial (CHAT) dataset (n = 1637) and a clinical sleep database (n = 980). Three distinct deep-learning architectures were explored to automatically classify sleep stages from a single-channel EEG data. Gradient-weighted Class Activation Mapping (Grad-CAM), an explainable artificial intelligence (XAI) algorithm, was then applied to provide an interpretation of the singular EEG patterns contributing to each predicted sleep stage. Among the tested architectures, a standard convolutional neural network (CNN) demonstrated the highest performance for automated sleep stage detection in the CHAT test set (accuracy = 86.9% and five-class kappa = 0.827). Furthermore, the CNN-based estimation of total sleep time exhibited strong agreement in the clinical dataset (intra-class correlation coefficient = 0.772). Our XAI approach using Grad-CAM effectively highlighted the EEG features associated with each sleep stage, emphasizing their influence on the CNN's decision-making process in both datasets. Grad-CAM heatmaps also allowed to identify and analyze epochs within a recording with a highly likelihood to be misclassified, revealing mixed features from different sleep stages within these epochs. Finally, Grad-CAM heatmaps unveiled novel features contributing to sleep scoring using a single EEG channel. Consequently, integrating an explainable CNN-based deep-learning model in the clinical environment could enable automatic sleep staging in pediatric sleep apnea tests.
Collapse
Affiliation(s)
- Fernando Vaquerizo-Villar
- Biomedical Engineering Group, University of Valladolid, Valladolid, Spain; CIBER de Bioingeniería, Biomateriales y Nanomedicina, Instituto de Salud Carlos III, Valladolid, Spain.
| | - Gonzalo C Gutiérrez-Tobal
- Biomedical Engineering Group, University of Valladolid, Valladolid, Spain; CIBER de Bioingeniería, Biomateriales y Nanomedicina, Instituto de Salud Carlos III, Valladolid, Spain
| | - Eva Calvo
- Biomedical Engineering Group, University of Valladolid, Valladolid, Spain
| | - Daniel Álvarez
- Biomedical Engineering Group, University of Valladolid, Valladolid, Spain; CIBER de Bioingeniería, Biomateriales y Nanomedicina, Instituto de Salud Carlos III, Valladolid, Spain; Sleep-Ventilation Unit, Pneumology Department, Río Hortega University Hospital, Valladolid, Spain
| | - Leila Kheirandish-Gozal
- Departments of Neurology and Child Health and Child Health Research Institute, The University of Missouri School of Medicine, Columbia, MO, USA
| | - Félix Del Campo
- Biomedical Engineering Group, University of Valladolid, Valladolid, Spain; CIBER de Bioingeniería, Biomateriales y Nanomedicina, Instituto de Salud Carlos III, Valladolid, Spain; Sleep-Ventilation Unit, Pneumology Department, Río Hortega University Hospital, Valladolid, Spain
| | - David Gozal
- Office of The Dean, Joan C. Edwards School of Medicine, Marshall University, 1600 Medical Center Dr, Huntington, WV, 25701, USA
| | - Roberto Hornero
- Biomedical Engineering Group, University of Valladolid, Valladolid, Spain; CIBER de Bioingeniería, Biomateriales y Nanomedicina, Instituto de Salud Carlos III, Valladolid, Spain
| |
Collapse
|
12
|
Ma YJX, Zschocke J, Glos M, Kluge M, Penzel T, Kantelhardt JW, Bartsch RP. Automatic sleep-stage classification of heart rate and actigraphy data using deep and transfer learning approaches. Comput Biol Med 2023; 163:107193. [PMID: 37421734 DOI: 10.1016/j.compbiomed.2023.107193] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/22/2023] [Revised: 06/01/2023] [Accepted: 06/19/2023] [Indexed: 07/10/2023]
Abstract
Manual sleep-stage scoring based on full-night polysomnography data recorded in a sleep lab has been the gold standard of clinical sleep medicine. This costly and time-consuming approach is unfit for long-term studies as well as assessment of sleep on a population level. With the vast amount of physiological data becoming available from wrist-worn devices, deep learning techniques provide an opportunity for fast and reliable automatic sleep-stage classification tasks. However, training a deep neural network requires large annotated sleep databases, which are not available for long-term epidemiological studies. In this paper, we introduce an end-to-end temporal convolutional neural network able to automatically score sleep stages from raw heartbeat RR interval (RRI) and wrist actigraphy data. Moreover, a transfer learning approach enables the training of the network on a large public database (Sleep Heart Health Study, SHHS) and its subsequent application to a much smaller database recorded by a wristband device. The transfer learning significantly shortens training time and improves sleep-scoring accuracy from 68.9% to 73.8% and inter-rater reliability (Cohen's kappa) from 0.51 to 0.59. We also found that for the SHHS database, automatic sleep-scoring accuracy using deep learning shows a logarithmic relationship with the training size. Although deep learning approaches for automatic sleep scoring are not yet comparable to the inter-rater reliability among sleep technicians, performance is expected to significantly improve in the near future when more large public databases become available. We anticipate those deep learning techniques, when combined with our transfer learning approach, will leverage automatic sleep scoring of physiological data from wearable devices and enable the investigation of sleep in large cohort studies.
Collapse
Affiliation(s)
- Yaopeng J X Ma
- Department of Physics, Bar-Ilan University, Ramat Gan, Israel.
| | - Johannes Zschocke
- Institute of Medical Epidemiology, Biometrics and Informatics (IMEBI), Interdisciplinary Center for Health Sciences, Martin-Luther-University Halle-Wittenberg, Halle (Saale), Germany; Institute of Physics, Martin-Luther University Halle-Wittenberg, Halle (Saale), Germany
| | - Martin Glos
- Interdisciplinary Sleep Medicine Center, Charité - Universitätsmedizin Berlin, Berlin, Germany
| | - Maria Kluge
- Interdisciplinary Sleep Medicine Center, Charité - Universitätsmedizin Berlin, Berlin, Germany
| | - Thomas Penzel
- Interdisciplinary Sleep Medicine Center, Charité - Universitätsmedizin Berlin, Berlin, Germany
| | - Jan W Kantelhardt
- Institute of Physics, Martin-Luther University Halle-Wittenberg, Halle (Saale), Germany
| | - Ronny P Bartsch
- Department of Physics, Bar-Ilan University, Ramat Gan, Israel.
| |
Collapse
|
13
|
Gaiduk M, Serrano Alarcón Á, Seepold R, Martínez Madrid N. Current status and prospects of automatic sleep stages scoring: Review. Biomed Eng Lett 2023; 13:247-272. [PMID: 37519865 PMCID: PMC10382458 DOI: 10.1007/s13534-023-00299-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/31/2023] [Revised: 06/07/2023] [Accepted: 06/18/2023] [Indexed: 08/01/2023] Open
Abstract
The scoring of sleep stages is one of the essential tasks in sleep analysis. Since a manual procedure requires considerable human and financial resources, and incorporates some subjectivity, an automated approach could result in several advantages. There have been many developments in this area, and in order to provide a comprehensive overview, it is essential to review relevant recent works and summarise the characteristics of the approaches, which is the main aim of this article. To achieve it, we examined articles published between 2018 and 2022 that dealt with the automated scoring of sleep stages. In the final selection for in-depth analysis, 125 articles were included after reviewing a total of 515 publications. The results revealed that automatic scoring demonstrates good quality (with Cohen's kappa up to over 0.80 and accuracy up to over 90%) in analysing EEG/EEG + EOG + EMG signals. At the same time, it should be noted that there has been no breakthrough in the quality of results using these signals in recent years. Systems involving other signals that could potentially be acquired more conveniently for the user (e.g. respiratory, cardiac or movement signals) remain more challenging in the implementation with a high level of reliability but have considerable innovation capability. In general, automatic sleep stage scoring has excellent potential to assist medical professionals while providing an objective assessment.
Collapse
Affiliation(s)
- Maksym Gaiduk
- HTWG Konstanz – University of Applied Sciences, Alfred-Wachtel-Str.8, 78462 Konstanz, Germany
| | | | - Ralf Seepold
- HTWG Konstanz – University of Applied Sciences, Alfred-Wachtel-Str.8, 78462 Konstanz, Germany
| | | |
Collapse
|
14
|
Vaquerizo-Villar F, Alvarez D, Gutierrez-Tobal GC, Del Campo F, Gozal D, Kheirandish-Gozal L, Penzel T, Hornero R. A deep learning model based on the combination of convolutional and recurrent neural networks to enhance pulse oximetry ability to classify sleep stages in children with sleep apnea. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2023; 2023:1-4. [PMID: 38082822 DOI: 10.1109/embc40787.2023.10341100] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/18/2023]
Abstract
Characterization of sleep stages is essential in the diagnosis of sleep-related disorders but relies on manual scoring of overnight polysomnography (PSG) recordings, which is onerous and labor-intensive. Accordingly, we aimed to develop an accurate deep-learning model for sleep staging in children suffering from pediatric obstructive sleep apnea (OSA) using pulse oximetry signals. For this purpose, pulse rate (PR) and blood oxygen saturation (SpO2) from 429 childhood OSA patients were analyzed. A CNN-RNN architecture fed with PR and SpO2 signals was developed to automatically classify wake (W), non-Rapid Eye Movement (NREM), and REM sleep stages. This architecture was composed of: (i) a convolutional neural network (CNN), which learns stage-related features from raw PR and SpO2 data; and (ii) a recurrent neural network (RNN), which models the temporal distribution of the sleep stages. The proposed CNN-RNN model showed a high performance for the automated detection of W/NREM/REM sleep stages (86.0% accuracy and 0.743 Cohen's kappa). Furthermore, the total sleep time estimated for each children using the CNN-RNN model showed high agreement with the manually derived from PSG (intra-class correlation coefficient = 0.747). These results were superior to previous works using CNN-based deep-learning models for automatic sleep staging in pediatric OSA patients from pulse oximetry signals. Therefore, the combination of CNN and RNN allows to obtain additional information from raw PR and SpO2 data related to sleep stages, thus being useful to automatically score sleep stages in pulse oximetry tests for children evaluated for suspected OSA.Clinical Relevance-This research establishes the usefulness of a CNN-RNN architecture to automatically score sleep stages in pulse oximetry tests for pediatric OSA diagnosis.
Collapse
|
15
|
Wang Q, Cheng H, Wang W. Feasibility of Exploiting Physiological and Motion Features for Camera-based Sleep Staging: A Clinical Study. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2023; 2023:1-5. [PMID: 38082872 DOI: 10.1109/embc40787.2023.10340835] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/18/2023]
Abstract
Camera-based sleep monitoring is an emergent research topic in sleep medicine. The feasibility of using both the physiological features and motion features measured by a video camera for sleep staging was not thoroughly investigated. In this paper, we built a camera-based non-contact sleep monitoring setup in the Institute of Respiratory Diseases, Shenzhen People's Hospital, and created a clinical sleep dataset (nocturnal video data of 11 adults) including the expert-corrected PSG references synchronized with the video. The camera-based measurements have shown high correlations with the PSG. It obtains an overall Mean Absolute Error (MAE) of 1.5 bpm for heart-rate (HR), 0.7 bpm for breathing-rate (BR), 13.9 ms for heart-rate variability (HRV), and an accuracy of 93.5% for leg motion detection. The statistical analysis indicates that the averaged HR and variations of BR are distinct features for annotating four sleep stages (awake, REM, light sleep, and deep sleep). HRV parameter (SDNN) can clearly differentiate rapid-eye-movement (REM) and non-REM, while the leg movement is a distinctive feature for separating awake and sleep. The clinical trial demonstrated the feasibility of using physiological and motion features measured by a camera for joint sleep staging, and provides insights for sleep-related feature selection.
Collapse
|
16
|
Metzner C, Schilling A, Traxdorf M, Schulze H, Tziridis K, Krauss P. Extracting continuous sleep depth from EEG data without machine learning. Neurobiol Sleep Circadian Rhythms 2023; 14:100097. [PMID: 37275555 PMCID: PMC10238579 DOI: 10.1016/j.nbscr.2023.100097] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/02/2023] [Revised: 04/28/2023] [Accepted: 05/02/2023] [Indexed: 06/07/2023] Open
Abstract
The human sleep-cycle has been divided into discrete sleep stages that can be recognized in electroencephalographic (EEG) and other bio-signals by trained specialists or machine learning systems. It is however unclear whether these human-defined stages can be re-discovered with unsupervised methods of data analysis, using only a minimal amount of generic pre-processing. Based on EEG data, recorded overnight from sleeping human subjects, we investigate the degree of clustering of the sleep stages using the General Discrimination Value as a quantitative measure of class separability. Virtually no clustering is found in the raw data, even after transforming the EEG signals of each 30-s epoch from the time domain into the more informative frequency domain. However, a Principal Component Analysis (PCA) of these epoch-wise frequency spectra reveals that the sleep stages separate significantly better in the low-dimensional sub-space of certain PCA components. In particular the component C1(t) can serve as a robust, continuous 'master variable' that encodes the depth of sleep and therefore correlates strongly with the 'hypnogram', a common plot of the discrete sleep stages over time. Moreover, C1(t) shows persistent trends during extended time periods where the sleep stage is constant, suggesting that sleep may be better understood as a continuum. These intriguing properties of C1(t) are not only relevant for understanding brain dynamics during sleep, but might also be exploited in low-cost single-channel sleep tracking devices for private and clinical use.
Collapse
Affiliation(s)
- Claus Metzner
- Neuroscience Lab, Experimental Otolaryngology, University Hospital, Erlangen, Germany
| | - Achim Schilling
- Neuroscience Lab, Experimental Otolaryngology, University Hospital, Erlangen, Germany
- Cognitive Computational Neuroscience Group, Friedrich-Alexander-Universität Erlangen, Nürnberg, Germany
| | - Maximilian Traxdorf
- Department of Otorhinolaryngology, Head and Neck Surgery, Paracelsus Medical University, Nürnberg, Germany
| | - Holger Schulze
- Neuroscience Lab, Experimental Otolaryngology, University Hospital, Erlangen, Germany
| | - Konstantin Tziridis
- Neuroscience Lab, Experimental Otolaryngology, University Hospital, Erlangen, Germany
| | - Patrick Krauss
- Neuroscience Lab, Experimental Otolaryngology, University Hospital, Erlangen, Germany
- Cognitive Computational Neuroscience Group, Friedrich-Alexander-Universität Erlangen, Nürnberg, Germany
- Pattern Recognition Lab, Friedrich-Alexander-Universität Erlangen, Nürnberg, Germany
| |
Collapse
|
17
|
Chen Y, Zhou E, Wang Y, Wu Y, Xu G, Chen L. The past, present, and future of sleep quality assessment and monitoring. Brain Res 2023; 1810:148333. [PMID: 36931581 DOI: 10.1016/j.brainres.2023.148333] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/05/2023] [Revised: 03/09/2023] [Accepted: 03/12/2023] [Indexed: 03/17/2023]
Abstract
Sleep quality is considered to be an individual's self-satisfaction with all aspects of the sleep experience. Good sleep not only improves a person's physical, mental and daily functional health, but also improves the quality-of-life level to some extent. In contrast, chronic sleep deprivation can increase the risk of diseases such as cardiovascular diseases, metabolic dysfunction and cognitive and emotional dysfunction, and can even lead to increased mortality. The scientific evaluation and monitoring of sleep quality is an important prerequisite for safeguarding and promoting the physiological health of the body. Therefore, we have compiled and reviewed the existing methods and emerging technologies commonly used for subjective and objective evaluation and monitoring of sleep quality, and found that subjective sleep evaluation is suitable for clinical screening and large-scale studies, while objective evaluation results are more intuitive and scientific, and in the comprehensive evaluation of sleep, if we want to get more scientific monitoring results, we should combine subjective and objective monitoring and dynamic monitoring.
Collapse
Affiliation(s)
- Yanyan Chen
- School of Physical Education, Jianghan University, Wuhan Hubei, 430056, China
| | - Enyuan Zhou
- School of Physical Education, Jianghan University, Wuhan Hubei, 430056, China
| | - Yu Wang
- School of Physical Education, Jianghan University, Wuhan Hubei, 430056, China
| | - Yuxiang Wu
- School of Physical Education, Jianghan University, Wuhan Hubei, 430056, China
| | - Guodong Xu
- School of Physical Education, Jianghan University, Wuhan Hubei, 430056, China
| | - Lin Chen
- School of Physical Education, Jianghan University, Wuhan Hubei, 430056, China.
| |
Collapse
|
18
|
He Z, Tang M, Wang P, Du L, Chen X, Cheng G, Fang Z. Cross-scenario automatic sleep stage classification using transfer learning and single-channel EEG. Biomed Signal Process Control 2023. [DOI: 10.1016/j.bspc.2022.104501] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/14/2022]
|
19
|
Abdulla S, Diykh M, Siuly S, Ali M. An intelligent model involving multi-channels spectrum patterns based features for automatic sleep stage classification. Int J Med Inform 2023; 171:105001. [PMID: 36708665 DOI: 10.1016/j.ijmedinf.2023.105001] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/07/2022] [Revised: 01/05/2023] [Accepted: 01/14/2023] [Indexed: 01/21/2023]
Abstract
Effective sleep monitoring from electroencephalogram (EEG) signals is meaningful for the diagnosis of sleep disorders, such as sleep Apnea, Insomnia, Snoring, Sleep Hypoventilation, and restless legs syndrome. Hence, developing an automatic sleep stage scoring method based on EEGs has attracted extensive research attention in recent years. The existing methods of sleep stage classification are insufficient to investigate waveform patterns, texture patterns, and temporal transformation of EEG signals, which are most associated with sleep stages scoring. To address these issues, we proposed an intelligence model based on multi-channels texture colour analysis to automatically classify sleep staging. In the proposed model, a short-time Fourier transform is applied to each EEG 30 s segment to convert it into an image form. Then the resulted spectrum image is analysed using Multiple channels Information Local Binary Pattern (MILBP). The extracted information using MILBP is then deployed to differentiate EEG sleep stages. The extracted features are tested, and the most effective ones are used to the represented EEG sleep stages. The selected characteristics are fed to an ensemble classifier integrated with a genetic algorithm which is used to select the optimal weight for each classifier, to classify EEG signal into designated sleep stages. The experimental results on two benchmark sleep datasets showed that the proposed model obtained the best performance compared with several baseline methods, including accuracy of 0.96 and 0.95, and F1-score of 0.94 and 0.93, thus demonstrating the effectiveness of our proposed model.
Collapse
Affiliation(s)
- Shahab Abdulla
- UinSQ College, University of Southern Queensland, QLD, Australia; Information and Communication Technology Research Group, Scientific Research Centre, Al-Ayen University, Iraq.
| | - Mohammed Diykh
- University of Thi-Qar, College of Education for Pure Science, Iraq; Information and Communication Technology Research Group, Scientific Research Centre, Al-Ayen University, Iraq.
| | - Siuly Siuly
- Institute for Sustainable Industries & Liveable Cities, Victoria University, Australia.
| | - Mumtaz Ali
- UinSQ College, University of Southern Queensland, QLD, Australia.
| |
Collapse
|
20
|
Dakhale BJ, Sharma M, Arif M, Asthana K, Bhurane AA, Kothari AG, Rajendra Acharya U. An automatic sleep-scoring system in elderly women with osteoporosis fractures using frequency localized finite orthogonal quadrature Fejer Korovkin kernels. Med Eng Phys 2023; 112:103956. [PMID: 36842776 DOI: 10.1016/j.medengphy.2023.103956] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/19/2022] [Revised: 01/04/2023] [Accepted: 02/04/2023] [Indexed: 02/10/2023]
Abstract
Healthy sleep signifies a good physical and mental state of the body. However, factors such as inappropriate work schedules, medical complications, and others can make it difficult to get enough sleep, leading to various sleep disorders. The identification of these disorders requires sleep stage classification. Visual evaluation of sleep stages is time intensive, placing a significant strain on sleep experts and prone to human errors. As a result, it is crucial to develop machine learning algorithms to score sleep stages to acquire an accurate diagnosis. Hence, a new methodology for automated sleep stage classification is suggested using machine learning and filtering electroencephalogram (EEG) signals. The national sleep research resource's (NSRR) study of osteoporotic fractures (SOF) dataset comprising 453 subjects' polysomnograph (PSG) data is used in this study. Only two unipolar EEG derivations C4-A1 and C3-A2 are employed individually and jointly in this work. The EEG signals are decomposed into sub-bands using a frequency-localized finite orthogonal quadrature Fejer Korovkin wavelet filter bank. The wavelet-based entropy features are extracted from sub-bands. Subsequently, extracted features are classified using machine learning techniques. Our developed model obtained the highest classification accuracy of 81.3%, using an ensembled bagged trees classifier with a 10-fold cross-validation method and Cohen's Kappa coefficient of 0.72. The proposed model is accurate, dependable, and easy to implement and can be employed as an alternative to a PSG-based system at home with minimal resources. It is also ready to be tested on other EEG data to evaluate the sleep stages of healthy and unhealthy subjects.
Collapse
Affiliation(s)
- Bharti Jogi Dakhale
- Department of Electonics and Communication, Indian Institute of Information Technology Nagpur, Maharashtra, India.
| | - Manish Sharma
- Department of Electrical and Computer Science Engineering, Institute of Infrastructure, Technology, Research and Management (IITRAM), Ahmedabad, India.
| | - Mohammad Arif
- Department of Electrical and Computer Science Engineering, Institute of Infrastructure, Technology, Research and Management (IITRAM), Ahmedabad, India.
| | - Kushagra Asthana
- Department of Electrical and Computer Science Engineering, Institute of Infrastructure, Technology, Research and Management (IITRAM), Ahmedabad, India.
| | - Ankit A Bhurane
- Department of Electronics and Communication, Visvesvaraya National Institute of Technology Nagpur, Maharashtra, India.
| | - Ashwin G Kothari
- Department of Electronics and Communication, Visvesvaraya National Institute of Technology Nagpur, Maharashtra, India.
| | - U Rajendra Acharya
- Department of Electronics and Computer Engineering, Ngee Ann Polytechnic, Singapore 639798, Singapore; Department of Bioinformatics and Medical Engineering, Asia University, Taichung 41354, Taiwan; Department of Biomedical Engineering, School of Science and Technology, Singapore 639798, Singapore.
| |
Collapse
|
21
|
Kim H, Kim D, Oh J. Automation of classification of sleep stages and estimation of sleep efficiency using actigraphy. Front Public Health 2023; 10:1092222. [PMID: 36699913 PMCID: PMC9869419 DOI: 10.3389/fpubh.2022.1092222] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/07/2022] [Accepted: 12/12/2022] [Indexed: 01/11/2023] Open
Abstract
Introduction Sleep is a fundamental and essential physiological process for recovering physiological function. Sleep disturbance or deprivation has been known to be a causative factor of various physiological and psychological disorders. Therefore, sleep evaluation is vital for diagnosing or monitoring those disorders. Although PSG (polysomnography) has been the gold standard for assessing sleep quality and classifying sleep stages, PSG has various limitations for common uses. In substitution for PSG, there has been vigorous research using actigraphy. Methods For classifying sleep stages automatically, we propose machine learning models with HRV (heart rate variability)-related features and acceleration features, which were processed from the actigraphy (Maxim band) data. Those classification results were transformed into a binary classification for estimating sleep efficiency. With 30 subjects, we conducted PSG, and they slept overnight with wrist-type actigraphy. We assessed the performance of four proposed machine learning models. Results With HRV-related and raw features of actigraphy, Cohen's kappa was 0.974 (p < 0.001) for classifying sleep stages into five stages: wake (W), REM (Rapid Eye Movement) (R), Sleep N1 (Non-Rapid Eye Movement Stage 1, S1), Sleep N2 (Non-Rapid Eye Movement Stage 2, S2), Sleep N3 (Non-Rapid Eye Movement Stage 3, S3). In addition, our machine learning model for the estimation of sleep efficiency showed an accuracy of 0.86. Discussion Our model demonstrated that automated sleep classification results could perfectly match the PSG results. Since models with acceleration features showed modest performance in differentiating some sleep stages, further research on acceleration features must be done. In addition, the sleep efficiency model demonstrated modest results. However, an investigation into the effects of HRV-derived and acceleration features is required.
Collapse
Affiliation(s)
- Hyejin Kim
- College of Pharmacy, Sookmyung Women's University, Seoul, Republic of Korea
| | | | - Junhyoung Oh
- Center for Information Security Technologies, International Center for Conversing Technology Building, Anam Campus (Science), Korea University, Seoul, Republic of Korea,*Correspondence: Junhyoung Oh ✉
| |
Collapse
|
22
|
Somaskandhan P, Leppänen T, Terrill PI, Sigurdardottir S, Arnardottir ES, Ólafsdóttir KA, Serwatko M, Sigurðardóttir SÞ, Clausen M, Töyräs J, Korkalainen H. Deep learning-based algorithm accurately classifies sleep stages in preadolescent children with sleep-disordered breathing symptoms and age-matched controls. Front Neurol 2023; 14:1162998. [PMID: 37122306 PMCID: PMC10140398 DOI: 10.3389/fneur.2023.1162998] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/10/2023] [Accepted: 03/23/2023] [Indexed: 05/02/2023] Open
Abstract
Introduction Visual sleep scoring has several shortcomings, including inter-scorer inconsistency, which may adversely affect diagnostic decision-making. Although automatic sleep staging in adults has been extensively studied, it is uncertain whether such sophisticated algorithms generalize well to different pediatric age groups due to distinctive EEG characteristics. The preadolescent age group (10-13-year-olds) is relatively understudied, and thus, we aimed to develop an automatic deep learning-based sleep stage classifier specifically targeting this cohort. Methods A dataset (n = 115) containing polysomnographic recordings of Icelandic preadolescent children with sleep-disordered breathing (SDB) symptoms, and age and sex-matched controls was utilized. We developed a combined convolutional and long short-term memory neural network architecture relying on electroencephalography (F4-M1), electrooculography (E1-M2), and chin electromyography signals. Performance relative to human scoring was further evaluated by analyzing intra- and inter-rater agreements in a subset (n = 10) of data with repeat scoring from two manual scorers. Results The deep learning-based model achieved an overall cross-validated accuracy of 84.1% (Cohen's kappa κ = 0.78). There was no meaningful performance difference between SDB-symptomatic (n = 53) and control subgroups (n = 52) [83.9% (κ = 0.78) vs. 84.2% (κ = 0.78)]. The inter-rater reliability between manual scorers was 84.6% (κ = 0.78), and the automatic method reached similar agreements with scorers, 83.4% (κ = 0.76) and 82.7% (κ = 0.75). Conclusion The developed algorithm achieved high classification accuracy and substantial agreements with two manual scorers; the performance metrics compared favorably with typical inter-rater reliability between manual scorers and performance reported in previous studies. These suggest that our algorithm may facilitate less labor-intensive and reliable automatic sleep scoring in preadolescent children.
Collapse
Affiliation(s)
- Pranavan Somaskandhan
- School of Information Technology and Electrical Engineering, The University of Queensland, Brisbane, QLD, Australia
- *Correspondence: Pranavan Somaskandhan,
| | - Timo Leppänen
- School of Information Technology and Electrical Engineering, The University of Queensland, Brisbane, QLD, Australia
- Department of Technical Physics, University of Eastern Finland, Kuopio, Finland
- Diagnostic Imaging Center, Kuopio University Hospital, Kuopio, Finland
| | - Philip I. Terrill
- School of Information Technology and Electrical Engineering, The University of Queensland, Brisbane, QLD, Australia
| | - Sigridur Sigurdardottir
- Reykjavik University Sleep Institute, School of Technology, Reykjavik University, Reykjavik, Iceland
| | - Erna Sif Arnardottir
- Reykjavik University Sleep Institute, School of Technology, Reykjavik University, Reykjavik, Iceland
- Internal Medicine Services, Landspitali–The National University Hospital of Iceland, Reykjavik, Iceland
| | - Kristín A. Ólafsdóttir
- Reykjavik University Sleep Institute, School of Technology, Reykjavik University, Reykjavik, Iceland
| | - Marta Serwatko
- Department of Clinical Engineering, Landspitali University Hospital, Reykjavik, Iceland
| | - Sigurveig Þ. Sigurðardóttir
- Department of Immunology, Landspitali University Hospital, Reykjavik, Iceland
- Faculty of Medicine, University of Iceland, Reykjavik, Iceland
| | - Michael Clausen
- Department of Allergy, Landspitali University Hospital, Reykjavik, Iceland
- Children's Hospital Reykjavik, Reykjavik, Iceland
| | - Juha Töyräs
- School of Information Technology and Electrical Engineering, The University of Queensland, Brisbane, QLD, Australia
- Department of Technical Physics, University of Eastern Finland, Kuopio, Finland
- Science Service Center, Kuopio University Hospital, Kuopio, Finland
| | - Henri Korkalainen
- Department of Technical Physics, University of Eastern Finland, Kuopio, Finland
- Diagnostic Imaging Center, Kuopio University Hospital, Kuopio, Finland
| |
Collapse
|
23
|
A novel approach to automatic sleep stage classification using forehead electrophysiological signals. Heliyon 2022; 8:e12136. [PMID: 36590566 PMCID: PMC9798185 DOI: 10.1016/j.heliyon.2022.e12136] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/17/2022] [Revised: 06/29/2022] [Accepted: 11/28/2022] [Indexed: 12/23/2022] Open
Abstract
Background Sleep stage scoring is very important for the effective diagnosis and intervention of sleep disorders. However, the current automatic sleep staging methods generally have the problems of poor model generalization ability and non-portable acquisition equipment. Method In this paper, we propose a novel automatic sleep scoring system based on forehead electrophysiological signals that is more effective and convenient than other systems. We extract 3 channel signals from the forehead, named forehead electroencephalogram 1 (Fh1), forehead electroencephalogram 2 (Fh2), and forehead center electrooculogram (Fhz). Spectral features, statistical features, and entropy features are extracted using the discrete wavelet transform (DWT) method. Light gradient boosting machine (LGB), random forest (RF), and support vector machine (SVM) are employed to classify four stages: awake, light sleep (LS), deep sleep (DS), and rapid eye movement (REM). Result The performance of the proposed method is validated using databases of the Sleep-EDFX and our Own-data, which include polysomnograms (PSGs) and forehead signals of 28 subjects. The overall classification accuracy of using the combination of Fh1, Fh2, and Fhz can reach up to 90.25% accuracy with a kappa coefficient of 0.857. Conclusions The proposed method could provide state-of-art multichannel sleep stage scoring performance with higher portability. This will facilitate the application of long-term monitoring of sleep quality in the future.
Collapse
|
24
|
Ferraris C, Ronga I, Pratola R, Coppo G, Bosso T, Falco S, Amprimo G, Pettiti G, Lo Priore S, Priano L, Mauro A, Desideri D. Usability of the REHOME Solution for the Telerehabilitation in Neurological Diseases: Preliminary Results on Motor and Cognitive Platforms. SENSORS (BASEL, SWITZERLAND) 2022; 22:9467. [PMID: 36502170 PMCID: PMC9740672 DOI: 10.3390/s22239467] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 10/28/2022] [Revised: 11/30/2022] [Accepted: 12/01/2022] [Indexed: 06/17/2023]
Abstract
The progressive aging of the population and the consequent growth of individuals with neurological diseases and related chronic disabilities, will lead to a general increase in the costs and resources needed to ensure treatment and care services. In this scenario, telemedicine and e-health solutions, including remote monitoring and rehabilitation, are attracting increasing interest as tools to ensure the sustainability of the healthcare system or, at least, to support the burden for health care facilities. Technological advances in recent decades have fostered the development of dedicated and innovative Information and Communication Technology (ICT) based solutions, with the aim of complementing traditional care and treatment services through telemedicine applications that support new patient and disease management strategies. This is the background for the REHOME project, whose technological solution, presented in this paper, integrates innovative methodologies and devices for remote monitoring and rehabilitation of cognitive, motor, and sleep disorders associated with neurological diseases. One of the primary goals of the project is to meet the needs of patients and clinicians, by ensuring continuity of treatment from healthcare facilities to the patient's home. To this end, it is important to ensure the usability of the solution by elderly and pathological individuals. Preliminary results of usability and user experience questionnaires on 70 subjects recruited in three experimental trials are presented here.
Collapse
Affiliation(s)
- Claudia Ferraris
- Institute of Electronics, Computer and Telecommunication Engineering, National Research Council, 10129 Turin, Italy
| | - Irene Ronga
- BraIn Plasticity and Behaviour Changes Research Group, Department of Psychology, University of Turin, 10124 Turin, Italy
| | - Roberto Pratola
- Engineering Ingegneria Informatica S.p.A., 00144 Rome, Italy
| | - Guido Coppo
- Synarea Consultants s.r.l., 10153 Turin, Italy
| | - Tea Bosso
- BraIn Plasticity and Behaviour Changes Research Group, Department of Psychology, University of Turin, 10124 Turin, Italy
- Geriatrics Unit, Città della Salute e della Scienza Hospital, 10126 Turin, Italy
| | - Sara Falco
- BraIn Plasticity and Behaviour Changes Research Group, Department of Psychology, University of Turin, 10124 Turin, Italy
- Clinical Pyschology Unit, Città della Salute e della Scienza Hospital, 10126 Turin, Italy
| | - Gianluca Amprimo
- Institute of Electronics, Computer and Telecommunication Engineering, National Research Council, 10129 Turin, Italy
- Department of Control and Computer Engineering, Politecnico di Torino, 10129 Turin, Italy
| | - Giuseppe Pettiti
- Institute of Electronics, Computer and Telecommunication Engineering, National Research Council, 10129 Turin, Italy
| | | | - Lorenzo Priano
- Istituto Auxologico Italiano, IRCCS, Department of Neurology and Neurorehabilitation, S. Giuseppe Hospital, 20123 Milan, Italy
- Department of Neurosciences, University of Turin, 10126 Turin, Italy
| | - Alessandro Mauro
- Istituto Auxologico Italiano, IRCCS, Department of Neurology and Neurorehabilitation, S. Giuseppe Hospital, 20123 Milan, Italy
- Department of Neurosciences, University of Turin, 10126 Turin, Italy
| | - Debora Desideri
- Engineering Ingegneria Informatica S.p.A., 00144 Rome, Italy
| |
Collapse
|
25
|
Whitmore NW, Harris JC, Kovach T, Paller KA. Improving memory via automated targeted memory reactivation during sleep. J Sleep Res 2022; 31:e13731. [PMID: 36129154 PMCID: PMC9649863 DOI: 10.1111/jsr.13731] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/28/2022] [Revised: 08/26/2022] [Accepted: 08/31/2022] [Indexed: 12/30/2022]
Abstract
A widely accepted view in memory research is that previously acquired information can be reactivated during sleep, leading to persistent memory storage. Targeted memory reactivation (TMR) was developed as a technique whereby specific memories can be reactivated during sleep using a sensory stimulus linked to prior learning. As a research tool, TMR can improve memory, raising the possibility that it may be useful for cognitive enhancement and clinical therapy. A major challenge for the expanded use of TMR is that a skilled operator must manually control stimulation, which is impractical in many settings. To address this limitation, we developed the SleepStim system for automated TMR in the home. SleepStim includes a smartwatch to collect movement and heart-rate data, plus a smartphone to emit auditory cues. A machine-learning model identifies periods of deep sleep and triggers TMR sounds within these periods. We tested whether this system could replicate the spatial-memory benefit of in-laboratory TMR. Participants learned locations of objects on a grid, and then half of the object locations were reactivated during sleep over 3 nights. Recall was tested each morning. In an experiment with 61 participants, the TMR effect was not significant but varied systematically with stimulus intensity; low-intensity but not high-intensity stimuli produced memory benefits. In a second experiment with 24 participants, we limited stimulus intensity and found that TMR reliably improved spatial memory, consistent with effects observed in laboratory studies. We conclude that SleepStim can effectively accomplish automated TMR, and that avoiding sleep disruption is critical for TMR benefits.
Collapse
Affiliation(s)
- Nathan W. Whitmore
- Department of Psychology and Interdepartmental Neuroscience ProgramNorthwestern UniversityEvanstonIllinoisUSA
| | - Jasmine C. Harris
- Department of Psychology and Interdepartmental Neuroscience ProgramNorthwestern UniversityEvanstonIllinoisUSA
| | - Torin Kovach
- Department of Computer ScienceCarnegie Mellon UniversityPittsburghPennsylvaniaUSA
| | - Ken A. Paller
- Department of Psychology and Interdepartmental Neuroscience ProgramNorthwestern UniversityEvanstonIllinoisUSA
| |
Collapse
|
26
|
Xu S, Faust O, Seoni S, Chakraborty S, Barua PD, Loh HW, Elphick H, Molinari F, Acharya UR. A review of automated sleep disorder detection. Comput Biol Med 2022; 150:106100. [PMID: 36182761 DOI: 10.1016/j.compbiomed.2022.106100] [Citation(s) in RCA: 10] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/17/2022] [Revised: 09/04/2022] [Accepted: 09/12/2022] [Indexed: 12/22/2022]
Abstract
Automated sleep disorder detection is challenging because physiological symptoms can vary widely. These variations make it difficult to create effective sleep disorder detection models which support hu-man experts during diagnosis and treatment monitoring. From 2010 to 2021, authors of 95 scientific papers have taken up the challenge of automating sleep disorder detection. This paper provides an expert review of this work. We investigated whether digital technology and Artificial Intelligence (AI) can provide automated diagnosis support for sleep disorders. We followed the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines during the content discovery phase. We compared the performance of proposed sleep disorder detection methods, involving differ-ent datasets or signals. During the review, we found eight sleep disorders, of which sleep apnea and insomnia were the most studied. These disorders can be diagnosed using several kinds of biomedical signals, such as Electrocardiogram (ECG), Polysomnography (PSG), Electroencephalogram (EEG), Electromyogram (EMG), and snore sound. Subsequently, we established areas of commonality and distinctiveness. Common to all reviewed papers was that AI models were trained and tested with labelled physiological signals. Looking deeper, we discovered that 24 distinct algorithms were used for the detection task. The nature of these algorithms evolved, before 2017 only traditional Machine Learning (ML) was used. From 2018 onward, both ML and Deep Learning (DL) methods were used for sleep disorder detection. The strong emergence of DL algorithms has considerable implications for future detection systems because these algorithms demand significantly more data for training and testing when compared with ML. Based on our review results, we suggest that both type and amount of labelled data is crucial for the design of future sleep disorder detection systems because this will steer the choice of AI algorithm which establishes the desired decision support. As a guiding principle, more labelled data will help to represent the variations in symptoms. DL algorithms can extract information from these larger data quantities more effectively, therefore; we predict that the role of these algorithms will continue to expand.
Collapse
Affiliation(s)
- Shuting Xu
- Cogninet Brain Team, Sydney, NSW, 2010, Australia
| | - Oliver Faust
- Anglia Ruskin University, East Rd, Cambridge CB1 1PT, UK.
| | - Silvia Seoni
- Department of Electronics and Telecommunications, Politecnico di Torino, Torino, Italy
| | - Subrata Chakraborty
- School of Science and Technology, Faculty of Science, Agriculture, Business and Law, University of New England, Armidale, NSW, 2351, Australia; Centre for Advanced Modelling and Geospatial Lnformation Systems (CAMGIS), Faculty of Engineer and Information Technology, University of Technology Sydney, Sydney, NSW, 2007, Australia
| | - Prabal Datta Barua
- Cogninet Brain Team, Sydney, NSW, 2010, Australia; Faculty of Engineering and Information Technology, University of Technology Sydney, Sydney, NSW, 2007, Australia; School of Business (Information System), University of Southern Queensland, Australia
| | - Hui Wen Loh
- School of Science and Technology, Singapore University of Social Sciences, 463 Clementi Road, 599494, Singapore
| | | | - Filippo Molinari
- Department of Electronics and Telecommunications, Politecnico di Torino, Torino, Italy
| | - U Rajendra Acharya
- School of Business (Information System), University of Southern Queensland, Australia; School of Science and Technology, Singapore University of Social Sciences, 463 Clementi Road, 599494, Singapore; Department of Computer Engineering, Ngee Ann Polytechnic, Singapore, Singapore; Department of Bioinformatics and Medical Engineering, Asia University, Taichung, Taiwan.
| |
Collapse
|
27
|
L-Tetrolet Pattern-Based Sleep Stage Classification Model Using Balanced EEG Datasets. Diagnostics (Basel) 2022; 12:diagnostics12102510. [PMID: 36292199 PMCID: PMC9600064 DOI: 10.3390/diagnostics12102510] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/09/2022] [Revised: 10/10/2022] [Accepted: 10/13/2022] [Indexed: 11/24/2022] Open
Abstract
Background: Sleep stage classification is a crucial process for the diagnosis of sleep or sleep-related diseases. Currently, this process is based on manual electroencephalogram (EEG) analysis, which is resource-intensive and error-prone. Various machine learning models have been recommended to standardize and automate the analysis process to address these problems. Materials and methods: The well-known cyclic alternating pattern (CAP) sleep dataset is used to train and test an L-tetrolet pattern-based sleep stage classification model in this research. By using this dataset, the following three cases are created, and they are: Insomnia, Normal, and Fused cases. For each of these cases, the machine learning model is tasked with identifying six sleep stages. The model is structured in terms of feature generation, feature selection, and classification. Feature generation is established with a new L-tetrolet (Tetris letter) function and multiple pooling decomposition for level creation. We fuse ReliefF and iterative neighborhood component analysis (INCA) feature selection using a threshold value. The hybrid and iterative feature selectors are named threshold selection-based ReliefF and INCA (TSRFINCA). The selected features are classified using a cubic support vector machine. Results: The presented L-tetrolet pattern and TSRFINCA-based sleep stage classification model yield 95.43%, 91.05%, and 92.31% accuracies for Insomnia, Normal dataset, and Fused cases, respectively. Conclusion: The recommended L-tetrolet pattern and TSRFINCA-based model push the envelope of current knowledge engineering by accurately classifying sleep stages even in the presence of sleep disorders.
Collapse
|
28
|
A Multilevel Temporal Context Network for Sleep Stage Classification. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE 2022; 2022:6104736. [PMID: 36188714 PMCID: PMC9522503 DOI: 10.1155/2022/6104736] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/17/2022] [Revised: 08/18/2022] [Accepted: 09/01/2022] [Indexed: 11/25/2022]
Abstract
Sleep stage classification is essential in diagnosing and treating sleep disorders. Many deep learning models have been proposed to classify sleep stages by automatic learning features and temporal context information. These temporal context features come from the intra-epoch temporal features, which represent the overall morphology of an epoch, and temporal features of adjacent epochs and long epochs, which represent the influence between epochs. However, most existing methods do not fully use the complementarity of the three-level temporal features, resulting in incomplete extracted temporal features. To solve this problem, we propose a multilevel temporal context network (MLTCN) to learn the temporal features from intra-epoch, adjacent epochs, and long epochs, which utilizes the complete temporal features to improve classification accuracy. We evaluate the performance of the proposed model on the Sleep-EDF datasets published in 2013 and 2018. The experimental results show that our MLTCN can achieve an overall accuracy of 84.2% and a kappa coefficient of 0.78 on the Sleep-EDF-2013 dataset. On the larger Sleep-EDF-2018 dataset, the overall accuracy is 81.0%, and a kappa coefficient is 0.74. Our model can better assist sleep experts in diagnosing sleep disorders.
Collapse
|
29
|
Abstract
Sleep Apnoea (SA) is a common chronic illness that affects nearly 1 billion people around the world, and the number of patients is rising. SA causes a wide range of psychological and physiological ailments that have detrimental effects on a patient’s wellbeing. The high prevalence and negative health effects make SA a public health problem. Whilst the current gold standard diagnostic procedure, polysomnography (PSG), is reliable, it is resource-expensive and can have a negative impact on sleep quality, as well as the environment. With this study, we focus on the environmental impact that arises from resource utilisation during SA detection, and we propose remote monitoring (RM) as a potential solution that can improve the resource efficiency and reduce travel. By reusing infrastructure technology, such as mobile communication, cloud computing, and artificial intelligence (AI), RM establishes SA detection and diagnosis support services in the home environment. However, there are considerable barriers to a widespread adoption of this technology. To gain a better understanding of the available technology and its associated strength, as well as weaknesses, we reviewed scientific papers that used various strategies for RM-based SA detection. Our review focused on 113 studies that were conducted between 2018 and 2022 and that were listed in Google Scholar. We found that just over 50% of the proposed RM systems incorporated real time signal processing and around 20% of the studies did not report on this important aspect. From an environmental perspective, this is a significant shortcoming, because 30% of the studies were based on measurement devices that must travel whenever the internal buffer is full. The environmental impact of that travel might constitute an additional need for changing from offline to online SA detection in the home environment.
Collapse
|
30
|
De Fazio R, Mattei V, Al-Naami B, De Vittorio M, Visconti P. Methodologies and Wearable Devices to Monitor Biophysical Parameters Related to Sleep Dysfunctions: An Overview. MICROMACHINES 2022; 13:mi13081335. [PMID: 36014257 PMCID: PMC9412310 DOI: 10.3390/mi13081335] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/16/2022] [Revised: 08/15/2022] [Accepted: 08/16/2022] [Indexed: 06/13/2023]
Abstract
Sleep is crucial for human health from metabolic, mental, emotional, and social points of view; obtaining good sleep in terms of quality and duration is fundamental for maintaining a good life quality. Over the years, several systems have been proposed in the scientific literature and on the market to derive metrics used to quantify sleep quality as well as detect sleep disturbances and disorders. In this field, wearable systems have an important role in the discreet, accurate, and long-term detection of biophysical markers useful to determine sleep quality. This paper presents the current state-of-the-art wearable systems and software tools for sleep staging and detecting sleep disorders and dysfunctions. At first, the paper discusses sleep's functions and the importance of monitoring sleep to detect eventual sleep disturbance and disorders. Afterward, an overview of prototype and commercial headband-like wearable devices to monitor sleep is presented, both reported in the scientific literature and on the market, allowing unobtrusive and accurate detection of sleep quality markers. Furthermore, a survey of scientific works related the effect of the COVID-19 pandemic on sleep functions, attributable to both infection and lifestyle changes. In addition, a survey of algorithms for sleep staging and detecting sleep disorders is introduced based on an analysis of single or multiple biosignals (EEG-electroencephalography, ECG-electrocardiography, EMG-electromyography, EOG-electrooculography, etc.). Lastly, comparative analyses and insights are provided to determine the future trends related to sleep monitoring systems.
Collapse
Affiliation(s)
- Roberto De Fazio
- Department of Innovation Engineering, University of Salento, 73100 Lecce, Italy
| | - Veronica Mattei
- Department of Innovation Engineering, University of Salento, 73100 Lecce, Italy
| | - Bassam Al-Naami
- Department of Biomedical Engineering, Faculty of Engineering, The Hashemite University, Zarqa 13133, Jordan
| | - Massimo De Vittorio
- Department of Innovation Engineering, University of Salento, 73100 Lecce, Italy
- Center for Biomolecular Nanotechnologies, Italian Technology Institute IIT, 73010 Arnesano, Italy
| | - Paolo Visconti
- Department of Innovation Engineering, University of Salento, 73100 Lecce, Italy
| |
Collapse
|
31
|
Zou G, Liu J, Zou Q, Gao JH. A-PASS: An automated pipeline to analyze simultaneously acquired EEG-fMRI data for studying brain activities during sleep. J Neural Eng 2022; 19. [PMID: 35878599 DOI: 10.1088/1741-2552/ac83f2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/12/2022] [Accepted: 07/25/2022] [Indexed: 11/11/2022]
Abstract
OBJECTIVE Concurrent electroencephalography and functional magnetic resonance imaging (EEG-fMRI) signals can be used to uncover the nature of brain activities during sleep. However, analyzing simultaneously acquired EEG-fMRI data is extremely time consuming and experience dependent. Thus, we developed a pipeline, which we named A-PASS, to automatically analyze simultaneously acquired EEG-fMRI data for studying brain activities during sleep. APPROACH A deep learning model was trained on a sleep EEG-fMRI dataset from 45 subjects and used to perform sleep stage scoring. Various fMRI indices can be calculated with A-PASS to depict the neurophysiological characteristics across different sleep stages. We tested the performance of A-PASS on an independent sleep EEG-fMRI dataset from 28 subjects. Statistical maps regarding the main effect of sleep stages and differences between each pair of stages of fMRI indices were generated and compared using both A-PASS and manual processing methods. MAIN RESULTS The deep learning model implemented in A-PASS achieved both an accuracy and F1-score higher than 70% for sleep stage classification on EEG data acquired during fMRI scanning. The statistical maps generated from A-PASS largely resembled those produced from manually scored stages plus a combination of multiple software programs. SIGNIFICANCE A-PASS allowed efficient EEG-fMRI data processing without manual operation and could serve as a reliable and powerful tool for simultaneous EEG-fMRI studies on sleep.
Collapse
Affiliation(s)
- Guangyuan Zou
- Peking University, 5 Yiheyuan Road, Haidian District, Beijing, China, Beijing, 100871, CHINA
| | - Jiayi Liu
- Peking University, 5 Yiheyuan Road, Haidian District, Beijing, China, Beijing, 100871, CHINA
| | - Qihong Zou
- Peking University, 5 Yiheyuan Road, Haidian District, Beijing, China, Beijing, 100871, CHINA
| | - Jia-Hong Gao
- Peking University, 5 Yiheyuan Road, Haidian District, Beijing, China, Beijing, 100871, CHINA
| |
Collapse
|
32
|
Sun C, Hong S, Wang J, Dong X, Han F, Li H. A systematic review of deep learning methods for modeling electrocardiograms during sleep. Physiol Meas 2022; 43. [PMID: 35853448 DOI: 10.1088/1361-6579/ac826e] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/25/2022] [Accepted: 07/19/2022] [Indexed: 11/11/2022]
Abstract
Sleep is one of the most important human physiological activities and plays an essential role in human health. Polysomnography (PSG) is the gold standard for measuring sleep quality and disorders, but it is time-consuming, labor-intensive, and prone to errors. Current research has confirmed the correlations between sleep and the respiratory/circulatory system. Electrocardiography (ECG) is convenient to perform, and ECG data are rich in breathing information. Therefore, sleep research based on ECG data has become popular. Currently, deep learning (DL) methods have achieved promising results on predictive health care tasks using ECG signals. Therefore, in this review, we systematically identify recent research studies and analyze them from the perspectives of data, model, and task. We discuss the shortcomings, summarize the findings, and highlight the potential opportunities. For sleep-related tasks, many ECG-based DL methods produce more accurate results than traditional approaches by combining multiple signal features and model structures. Methods that are more interpretable, scalable, and transferable will become ubiquitous in the daily practice of medicine and ambient-assisted-living applications. This paper is the first systematic review of ECG-based DL methods for sleep tasks.
Collapse
Affiliation(s)
- Chenxi Sun
- School of Artificial Intelligence, Peking University, No. 5, Yiheyuan Road, Haidian District, Beijing, 100871, CHINA
| | - Shenda Hong
- National Institute of Health Data Science, Peking University, No. 5, Yiheyuan Road, Haidian District, Beijing, Beijing, 100871, CHINA
| | - Jingyu Wang
- Sleep Center, Department of Respiratory and Critical Care Medicine, Peking University People's Hospital, No. 11, Xizhimen South Street, Xicheng District, Beijing, 100044, CHINA
| | - Xiaosong Dong
- Sleep Center, Department of Respiratory and Critical Care Medicine, Peking University People's Hospital, No. 11, Xizhimen South Street, Xicheng District, Beijing, 100044, CHINA
| | - Fang Han
- Sleep Center, Department of Respiratory and Critical Care Medicine, Peking University People's Hospital, No. 11, Xizhimen South Street, Xicheng District, Beijing, 100044, CHINA
| | - Hongyan Li
- School of Artificial Intelligence, Peking University, No. 5, Yiheyuan Road, Haidian District, Beijing, Beijing, 100871, CHINA
| |
Collapse
|
33
|
Towards precision sleep medicine: Self-attention GAN as an innovative data augmentation technique for developing personalized automatic sleep scoring classification. Comput Biol Med 2022; 148:105828. [PMID: 35816855 DOI: 10.1016/j.compbiomed.2022.105828] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/16/2022] [Revised: 05/07/2022] [Accepted: 07/03/2022] [Indexed: 11/03/2022]
Abstract
It is very important to have good quality sleep, which can affect aspects such as memory consolidation, emotional regulation, learning, physical development, and quality of life. Diagnosing human sleep quality and problems quickly and accurately is an important issue for human well-being. Therefore, many automatic sleep scoring methods have been proposed. However, the methods have been developed using sleep data from different individuals or groups. The accuracies of these proposed methods might decrease, due to existing individual differences. In this study, the self-attention generative adversarial network (SAGAN) was applied as an advanced data augmentation technique to propose an improved personalized automatic sleep scoring classification. First, the spectrograms were converted from electroencephalography (EEG). Then, SAGAN was used to generate synthesized spectrograms for each subject. Finally, the real and synthesized spectrograms of each subject were utilized to train a personalized classifier. The averaged accuracy and standard deviation of the proposed method are 95.74% and 3.78%, respectively. Compared to the classifier trained with all subjects' training data, the average accuracy increased by 8.08%. The results proved that the generated spectrograms significantly improved the performance of the personalized automatic sleep scoring classification. The contributions of the proposed method were that made the medical staff and subjects save massive medical resources and time for manual recording and scoring.
Collapse
|
34
|
Wang H, Guo H, Zhang K, Gao L, Zheng J. Automatic sleep staging method of EEG signal based on transfer learning and fusion network. Neurocomputing 2022. [DOI: 10.1016/j.neucom.2022.02.049] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/19/2022]
|
35
|
Sadek I, Abdulrazak B. Contactless remote monitoring of sleep: evaluating the feasibility of an under-mattress sensor mat in a real-life deployment. Health Syst (Basingstoke) 2022; 12:264-280. [PMID: 37860595 PMCID: PMC10583615 DOI: 10.1080/20476965.2022.2072777] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/14/2021] [Accepted: 04/21/2022] [Indexed: 10/18/2022] Open
Abstract
Sleep is so important, particularly for the elderly. The lack of sleep may increase the risk of cognitive decline. Similarly, it may also increase the risk of Alzheimer's disease. Nonetheless, many people underestimate the importance of getting enough rest and sleep. In-laboratory polysomnography is the gold-standard method for assessing the quality of sleep. This method is considered impractical in the clinical environment, seen as labour-intensive and expensive owing to its specialised equipment, leading to long waiting lists. Hence, user-friendly (remote and non-intrusive) devices are being developed to help patients monitor their sleep at home. In this paper, we first discuss commercially-available non-wearable devices that measure sleep, in which we highlight the features associated with each device, including sensor type, interface, outputs, dimensions, power supply, and connectivity. Second, we evaluate the feasibility of a non-wearable device in a free-living environment. The deployed device comprises a sensor mat with an integrated micro-bending multimode fibre. Raw sensor data were gathered from five senior participants living in a senior activity centre over a few to several weeks. We were able to analyse the participants' sleep quality using various sleep parameters deduced from the sensor mat. These parameters include the wake-up time, bedtime, the time in bed, nap time. Vital signs, namely heart rate, respiratory rate, and body movements, were also reported to detect abnormal sleep patterns. We have employed pre-and post-surveys reporting each volunteer's sleep hygiene to confirm the proposed system's outcomes for detecting the various sleep parameters. The results of the system were strongly correlated with the surveys for reporting each sleep parameter. Furthermore, the system proved to be highly effective in detecting irregular patterns that occurred during sleep.
Collapse
Affiliation(s)
- Ibrahim Sadek
- Ambient Intelligence Laboratory (AMI-Lab), Computer Science Department, Faculty of Science, University of Sherbrooke, Sherbrooke, Canada
- Biomedical Engineering Department, Faculty of Engineering, Helwan University, Helwan, Egypt
| | - Bessam Abdulrazak
- Ambient Intelligence Laboratory (AMI-Lab), Computer Science Department, Faculty of Science, University of Sherbrooke, Sherbrooke, Canada
| |
Collapse
|
36
|
Kazemi A, McKeown MJ, Mirian MS. Sleep staging using semi-unsupervised clustering of EEG: Application to REM sleep behavior disorder. Biomed Signal Process Control 2022. [DOI: 10.1016/j.bspc.2022.103539] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/02/2022]
|
37
|
Automated classification of cyclic alternating pattern sleep phases in healthy and sleep-disordered subjects using convolutional neural network. Comput Biol Med 2022; 146:105594. [DOI: 10.1016/j.compbiomed.2022.105594] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/22/2022] [Revised: 05/01/2022] [Accepted: 05/04/2022] [Indexed: 01/26/2023]
|
38
|
Detection of Sleep Apnea from Electrocardiogram and Pulse Oximetry Signals Using Random Forest. APPLIED SCIENCES-BASEL 2022. [DOI: 10.3390/app12094218] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/08/2023]
Abstract
Sleep apnea (SA) is a common sleep disorder which could impair the human physiological system. Therefore, early diagnosis of SA is of great interest. The traditional method of diagnosing SA is an overnight polysomnography (PSG) evaluation. When PSG has limited availability, automatic SA screening with a fewer number of signals should be considered. The primary purpose of this study is to develop and evaluate a SA detection model based on electrocardiogram (ECG) and blood oxygen saturation (SpO2). We adopted a multimodal approach to fuse ECG and SpO2 signals at the feature level. Then, feature selection was conducted using the recursive feature elimination with cross-validation (RFECV) algorithm and random forest (RF) classifier used to discriminate between apnea and normal events. Experiments were conducted on the Apnea-ECG database. The introduced algorithm obtained an accuracy of 97.5%, a sensitivity of 95.9%, a specificity of 98.4% and an AUC of 0.992 in per-segment classification, and outperformed previous works. The results showed that ECG and SpO2 are complementary in detecting SA, and that the combination of ECG and SpO2 enhances the ability to diagnose SA. Therefore, the proposed method has the potential to be an alternative to conventional detection methods.
Collapse
|
39
|
Loh HW, Ooi CP, Barua PD, Palmer EE, Molinari F, Acharya UR. Automated detection of ADHD: Current trends and future perspective. Comput Biol Med 2022; 146:105525. [DOI: 10.1016/j.compbiomed.2022.105525] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/03/2022] [Revised: 03/31/2022] [Accepted: 04/04/2022] [Indexed: 12/25/2022]
|
40
|
Phan H, Mikkelsen K. Automatic sleep staging of EEG signals: recent development, challenges, and future directions. Physiol Meas 2022; 43. [PMID: 35320788 DOI: 10.1088/1361-6579/ac6049] [Citation(s) in RCA: 34] [Impact Index Per Article: 17.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/01/2021] [Accepted: 03/23/2022] [Indexed: 11/11/2022]
Abstract
Modern deep learning holds a great potential to transform clinical practice on human sleep. Teaching a machine to carry out routine tasks would be a tremendous reduction in workload for clinicians. Sleep staging, a fundamental step in sleep practice, is a suitable task for this and will be the focus in this article. Recently, automatic sleep staging systems have been trained to mimic manual scoring, leading to similar performance to human sleep experts, at least on scoring of healthy subjects. Despite tremendous progress, we have not seen automatic sleep scoring adopted widely in clinical environments. This review aims to give a shared view of the authors on the most recent state-of-the-art development in automatic sleep staging, the challenges that still need to be addressed, and the future directions for automatic sleep scoring to achieve clinical value.
Collapse
Affiliation(s)
- Huy Phan
- School of Electronic Engineering and Computer Science, Queen Mary University of London, Mile End Rd, London, E1 4NS, UNITED KINGDOM OF GREAT BRITAIN AND NORTHERN IRELAND
| | - Kaare Mikkelsen
- Department of Electrical and Computer Engineering, Aarhus Universitet, Finlandsgade 22, Aarhus, 8000, DENMARK
| |
Collapse
|
41
|
Du-Yan G, Jia-Xing W, Yan W, Xuan-Yu L. Convolutional neural network is a good technique for sleep staging based on HRV: a comparative analysis. Neurosci Lett 2022; 779:136550. [DOI: 10.1016/j.neulet.2022.136550] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/09/2021] [Revised: 02/12/2022] [Accepted: 02/24/2022] [Indexed: 11/16/2022]
|
42
|
Representations of temporal sleep dynamics: review and synthesis of the literature. Sleep Med Rev 2022; 63:101611. [DOI: 10.1016/j.smrv.2022.101611] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/09/2021] [Revised: 01/25/2022] [Accepted: 02/07/2022] [Indexed: 12/13/2022]
|
43
|
Kim D, Lee J, Woo Y, Jeong J, Kim C, Kim DK. Deep Learning Application to Clinical Decision Support System in Sleep Stage Classification. J Pers Med 2022; 12:jpm12020136. [PMID: 35207623 PMCID: PMC8880374 DOI: 10.3390/jpm12020136] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/01/2021] [Revised: 12/24/2021] [Accepted: 12/30/2021] [Indexed: 01/14/2023] Open
Abstract
Recently, deep learning for automated sleep stage classification has been introduced with promising results. However, as many challenges impede their routine application, automatic sleep scoring algorithms are not widely used. Typically, polysomnography (PSG) uses multiple channels for higher accuracy; however, the disadvantages include a requirement for a patient to stay one or more nights in the lab wearing uncomfortable sensors and wires. To avoid the inconvenience caused by the multiple channels, we aimed to develop a deep learning model for use in clinical decision support systems (CDSSs) and combined convolutional neural networks and a transformer for the supervised learning of three classes of sleep stages only with single-channel EEG data (C4-M1). The data for training, validation, and test were derived from 1590, 341, and 343 polysomnography recordings, respectively. The developed model yielded an overall accuracy of 91.4%, comparable with that of human experts. Based on the severity of obstructive sleep apnea, the model’s accuracy was 94.3%, 91.9%, 91.9%, and 90.6% in normal, mild, moderate, and severe cases, respectively. Our deep learning model enables accurate and rapid delineation of three-class sleep staging and could be useful as a CDSS for application in real-world clinical practice.
Collapse
Affiliation(s)
- Dongyoung Kim
- Department of Computer Engineering, Hallym University, Chuncheon 24252, Korea; (D.K.); (J.L.); (Y.W.); (J.J.)
| | - Jeonggun Lee
- Department of Computer Engineering, Hallym University, Chuncheon 24252, Korea; (D.K.); (J.L.); (Y.W.); (J.J.)
| | - Yunhee Woo
- Department of Computer Engineering, Hallym University, Chuncheon 24252, Korea; (D.K.); (J.L.); (Y.W.); (J.J.)
| | - Jaemin Jeong
- Department of Computer Engineering, Hallym University, Chuncheon 24252, Korea; (D.K.); (J.L.); (Y.W.); (J.J.)
| | - Chulho Kim
- Department of Neurology, Chuncheon Sacred Heart Hospital, Hallym University College of Medicine, Chuncheon 24252, Korea;
- Institute of New Frontier Research, Division of Big Data and Artificial Intelligence, Chuncheon Sacred Heart Hospital, Chuncheon 24252, Korea
| | - Dong-Kyu Kim
- Institute of New Frontier Research, Division of Big Data and Artificial Intelligence, Chuncheon Sacred Heart Hospital, Chuncheon 24252, Korea
- Department of Otorhinolaryngology-Head and Neck Surgery, Chuncheon Sacred Heart Hospital, Hallym University College of Medicine, Chuncheon 24252, Korea
- Correspondence: ; Tel.: +82-33-240-5180; Fax: +82-33-241-2909
| |
Collapse
|
44
|
Vaquerizo-Villar F, Álvarez D, Gutiérrez-Tobal GC, Arroyo-Domingo CA, del Campo F, Hornero R. Deep-Learning Model Based on Convolutional Neural Networks to Classify Apnea–Hypopnea Events from the Oximetry Signal. ADVANCES IN EXPERIMENTAL MEDICINE AND BIOLOGY 2022; 1384:255-264. [PMID: 36217089 DOI: 10.1007/978-3-031-06413-5_15] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
Automated analysis of the blood oxygen saturation (SpO2) signal from nocturnal oximetry has shown usefulness to simplify the diagnosis of obstructive sleep apnea (OSA), including the detection of respiratory events. However, the few preceding studies using SpO2 recordings have focused on the automated detection of respiratory events versus normal respiration, without making any distinction between apneas and hypopneas. In this sense, the characteristics of oxygen desaturations differ between obstructive apnea and hypopnea episodes. In this chapter, we use the SpO2 signal along with a convolutional neural network (CNN)-based deep-learning architecture for the automatic identification of apnea and hypopnea events. A total of 398 SpO2 signals from adult OSA patients were used for this purpose. A CNN architecture was trained using 30-s epochs from the SpO2 signal for the automatic classification of three classes: normal respiration, apnea, and hypopnea. Then, the apnea index (AI), the hypopnea index (HI), and the apnea-hypopnea index (AHI) were obtained by aggregating the outputs of the CNN for each subject (AICNN, HICNN, and AHICNN). This model showed a promising diagnostic performance in an independent test set, with 80.3% 3-class accuracy and 0.539 3-class Cohen's kappa for the classification of respiratory events. Furthermore, AICNN, HICNN, and AHICNN showed a high agreement with the values obtained from the standard PSG: 0.8023, 0.6774, and 0.8466 intra-class correlation coefficients (ICCs), respectively. This suggests that CNN can be used to analyze SpO2 recordings for the automated diagnosis of OSA in at-home oximetry tests.
Collapse
|
45
|
Korom M, Camacho MC, Filippi CA, Licandro R, Moore LA, Dufford A, Zöllei L, Graham AM, Spann M, Howell B, Shultz S, Scheinost D. Dear reviewers: Responses to common reviewer critiques about infant neuroimaging studies. Dev Cogn Neurosci 2021; 53:101055. [PMID: 34974250 PMCID: PMC8733260 DOI: 10.1016/j.dcn.2021.101055] [Citation(s) in RCA: 16] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/15/2021] [Revised: 11/28/2021] [Accepted: 12/26/2021] [Indexed: 01/07/2023] Open
Abstract
The field of adult neuroimaging relies on well-established principles in research design, imaging sequences, processing pipelines, as well as safety and data collection protocols. The field of infant magnetic resonance imaging, by comparison, is a young field with tremendous scientific potential but continuously evolving standards. The present article aims to initiate a constructive dialog between researchers who grapple with the challenges and inherent limitations of a nascent field and reviewers who evaluate their work. We address 20 questions that researchers commonly receive from research ethics boards, grant, and manuscript reviewers related to infant neuroimaging data collection, safety protocols, study planning, imaging sequences, decisions related to software and hardware, and data processing and sharing, while acknowledging both the accomplishments of the field and areas of much needed future advancements. This article reflects the cumulative knowledge of experts in the FIT’NG community and can act as a resource for both researchers and reviewers alike seeking a deeper understanding of the standards and tradeoffs involved in infant neuroimaging. The field of infant MRI is young with evolving standards. We address 20 questions that researchers commonly receive reviewers. These come from research ethics boards, grant, and manuscript reviewers. This article reflects the cumulative knowledge of experts in the FIT’NG community.
Collapse
Affiliation(s)
- Marta Korom
- Department of Psychological and Brain Sciences, University of Delaware, Newark, DE, USA.
| | - M Catalina Camacho
- Division of Biology and Biomedical Sciences (Neurosciences), Washington University School of Medicine, St. Louis, MO, USA.
| | - Courtney A Filippi
- Emotion and Development Branch, National Institute of Mental Health, Bethesda, MD, USA
| | - Roxane Licandro
- Institute of Visual Computing and Human-Centered Technology, Computer Vision Lab, TU Wien, Vienna, Austria; Department of Biomedical Imaging and Image-guided Therapy, Computational Imaging Research, Medical University of Vienna, Vienna, Austria
| | - Lucille A Moore
- Department of Psychiatry, Oregon Health and Science University, Portland, OR, USA
| | - Alexander Dufford
- Department of Radiology & Biomedical Imaging, Yale School of Medicine, New Haven, CT, USA
| | - Lilla Zöllei
- A.A. Martinos Center for Biomedical Imaging, Department of Radiology, Massachusetts General Hospital, Boston, MA, USA
| | - Alice M Graham
- Department of Psychiatry, Oregon Health and Science University, Portland, OR, USA
| | - Marisa Spann
- Department of Psychiatry, Columbia University Irving Medical Center, New York, NY, USA
| | - Brittany Howell
- Fralin Biomedical Research Institute at Virginia Tech Carilion, Department of Human Development and Family Science, Virginia Polytechnic Institute and State University, Roanoke, VA, USA
| | | | - Sarah Shultz
- Division of Autism & Department of Pediatrics, Emory University School of Medicine, Atlanta, GA, USA; Marcus Autism Center, Children's Healthcare of Atlanta, Atlanta, GA, USA.
| | - Dustin Scheinost
- Department of Radiology & Biomedical Imaging, Yale School of Medicine, New Haven, CT, USA.
| |
Collapse
|
46
|
Metzner C, Schilling A, Traxdorf M, Schulze H, Krauss P. Sleep as a random walk: a super-statistical analysis of EEG data across sleep stages. Commun Biol 2021; 4:1385. [PMID: 34893700 PMCID: PMC8664947 DOI: 10.1038/s42003-021-02912-6] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/10/2021] [Accepted: 11/23/2021] [Indexed: 11/15/2022] Open
Abstract
In clinical practice, human sleep is classified into stages, each associated with different levels of muscular activity and marked by characteristic patterns in the EEG signals. It is however unclear whether this subdivision into discrete stages with sharply defined boundaries is truly reflecting the dynamics of human sleep. To address this question, we consider one-channel EEG signals as heterogeneous random walks: stochastic processes controlled by hyper-parameters that are themselves time-dependent. We first demonstrate the heterogeneity of the random process by showing that each sleep stage has a characteristic distribution and temporal correlation function of the raw EEG signals. Next, we perform a super-statistical analysis by computing hyper-parameters, such as the standard deviation, kurtosis, and skewness of the raw signal distributions, within subsequent 30-second epochs. It turns out that also the hyper-parameters have characteristic, sleep-stage-dependent distributions, which can be exploited for a simple Bayesian sleep stage detection. Moreover, we find that the hyper-parameters are not piece-wise constant, as the traditional hypnograms would suggest, but show rising or falling trends within and across sleep stages, pointing to an underlying continuous rather than sub-divided process that controls human sleep. Based on the hyper-parameters, we finally perform a pairwise similarity analysis between the different sleep stages, using a quantitative measure for the separability of data clusters in multi-dimensional spaces. To improve our understand of how EEG activity reflects the dynamics of human sleep, Metzner et al. use human EEG data and superstatistical analysis to demonstrate that each sleep stage has a characteristic distribution and temporal correlation function of raw EEG signals. They also show that the hyper-parameters controlling the EEG signals have characteristic, sleep-stage-dependent distributions, which can be exploited for a simple Bayesian sleep stage detection.
Collapse
Affiliation(s)
- Claus Metzner
- Neuroscience Lab, Experimental Otolaryngology, University Hospital Erlangen, Erlangen, Germany.
| | - Achim Schilling
- Neuroscience Lab, Experimental Otolaryngology, University Hospital Erlangen, Erlangen, Germany.,Laboratory of Sensory and Cognitive Neuroscience, Aix-Marseille University, Marseille, France.,Cognitive Computational Neuroscience Group, Friedrich-Alexander University Erlangen-Nuremberg, Nuremberg, Germany
| | - Maximilian Traxdorf
- Department of Otorhinolaryngology, Paracelsus Medical University, Nuremberg, Germany
| | - Holger Schulze
- Neuroscience Lab, Experimental Otolaryngology, University Hospital Erlangen, Erlangen, Germany
| | - Patrick Krauss
- Neuroscience Lab, Experimental Otolaryngology, University Hospital Erlangen, Erlangen, Germany.,Cognitive Computational Neuroscience Group, Friedrich-Alexander University Erlangen-Nuremberg, Nuremberg, Germany.,Pattern Recognition Lab, Friedrich-Alexander University Erlangen-Nuremberg, Nuremberg, Germany
| |
Collapse
|
47
|
Vaquerizo-Villar F, Alvarez D, Kraemer JF, Wessel N, Gutierrez-Tobal GC, Calvo E, Del Campo F, Kheirandish-Gozal L, Gozal D, Penzel T, Hornero R. Automatic Sleep Staging in Children with Sleep Apnea using Photoplethysmography and Convolutional Neural Networks. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2021; 2021:216-219. [PMID: 34891275 DOI: 10.1109/embc46164.2021.9629995] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/13/2023]
Abstract
Sleep staging is of paramount importance in children with suspicion of pediatric obstructive sleep apnea (OSA). Complexity, cost, and intrusiveness of overnight polysomnography (PSG), the gold standard, have led to the search for alternative tests. In this sense, the photoplethysmography signal (PPG) carries useful information about the autonomous nervous activity associated to sleep stages and can be easily acquired in pediatric sleep apnea home tests with a pulse oximeter. In this study, we use the PPG signal along with convolutional neural networks (CNN), a deep-learning technique, for the automatic identification of the three main levels of sleep: wake (W), rapid eye movement (REM), and non-REM sleep. A database of 366 PPG recordings from pediatric OSA patients is involved in the study. A CNN architecture was trained using 30-s epochs from the PPG signal for three-stage sleep classification. This model showed a promising diagnostic performance in an independent test set, with 78.2% accuracy and 0.57 Cohen's kappa for W/NREM/REM classification. Furthermore, the percentage of time in wake stage obtained for each subject showed no statistically significant differences with the manually scored from PSG. These results were superior to the only state-of-the-art study focused on the analysis of the PPG signal in the automated detection of sleep stages in children suffering from OSA. This suggests that CNN can be used along with PPG recordings for sleep stages scoring in pediatric home sleep apnea tests.
Collapse
|
48
|
Van der Plas D, Verbraecken J, Willemen M, Meert W, Davis J. Evaluation of Automated Hypnogram Analysis on Multi-Scored Polysomnographies. Front Digit Health 2021; 3:707589. [PMID: 34713177 PMCID: PMC8521900 DOI: 10.3389/fdgth.2021.707589] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/10/2021] [Accepted: 06/29/2021] [Indexed: 11/21/2022] Open
Abstract
A new method for automated sleep stage scoring of polysomnographies is proposed that uses a random forest approach to model feature interactions and temporal effects. The model mostly relies on features based on the rules from the American Academy of Sleep Medicine, which allows medical experts to gain insights into the model. A common way to evaluate automated approaches to constructing hypnograms is to compare the one produced by the algorithm to an expert's hypnogram. However, given the same data, two expert annotators will construct (slightly) different hypnograms due to differing interpretations of the data or individual mistakes. A thorough evaluation of our method is performed on a multi-labeled dataset in which both the inter-rater variability as well as the prediction uncertainties are taken into account, leading to a new standard for the evaluation of automated sleep stage scoring algorithms. On all epochs, our model achieves an accuracy of 82.7%, which is only slightly lower than the inter-rater disagreement. When only considering the 63.3% of the epochs where both the experts and algorithm are certain, the model achieves an accuracy of 97.8%. Transition periods between sleep stages are identified and studied for the first time. Scoring guidelines for medical experts are provided to complement the certain predictions by scoring only a few epochs manually. This makes the proposed method highly time-efficient while guaranteeing a highly accurate final hypnogram.
Collapse
Affiliation(s)
- Dries Van der Plas
- Onafhankelijke Software Groep (OSG bv), Micromed Group, Kontich, Belgium.,Department of Computer Science, Leuven AI, KU Leuven, Leuven, Belgium.,Faculty of Medicine and Health Sciences, University of Antwerp, Antwerp, Belgium
| | - Johan Verbraecken
- Faculty of Medicine and Health Sciences, University of Antwerp, Antwerp, Belgium.,Multidisciplinary Sleep Disorders Centre, Antwerp University Hospital, Antwerp, Belgium.,Department of Pulmonary Medicine, Antwerp University Hospital, Antwerp, Belgium
| | - Marc Willemen
- Multidisciplinary Sleep Disorders Centre, Antwerp University Hospital, Antwerp, Belgium
| | - Wannes Meert
- Department of Computer Science, Leuven AI, KU Leuven, Leuven, Belgium
| | - Jesse Davis
- Department of Computer Science, Leuven AI, KU Leuven, Leuven, Belgium
| |
Collapse
|
49
|
Loh HW, Hong W, Ooi CP, Chakraborty S, Barua PD, Deo RC, Soar J, Palmer EE, Acharya UR. Application of Deep Learning Models for Automated Identification of Parkinson's Disease: A Review (2011-2021). SENSORS 2021; 21:s21217034. [PMID: 34770340 PMCID: PMC8587636 DOI: 10.3390/s21217034] [Citation(s) in RCA: 17] [Impact Index Per Article: 5.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 09/20/2021] [Revised: 10/07/2021] [Accepted: 10/19/2021] [Indexed: 12/18/2022]
Abstract
Parkinson’s disease (PD) is the second most common neurodegenerative disorder affecting over 6 million people globally. Although there are symptomatic treatments that can increase the survivability of the disease, there are no curative treatments. The prevalence of PD and disability-adjusted life years continue to increase steadily, leading to a growing burden on patients, their families, society and the economy. Dopaminergic medications can significantly slow down the progression of PD when applied during the early stages. However, these treatments often become less effective with the disease progression. Early diagnosis of PD is crucial for immediate interventions so that the patients can remain self-sufficient for the longest period of time possible. Unfortunately, diagnoses are often late, due to factors such as a global shortage of neurologists skilled in early PD diagnosis. Computer-aided diagnostic (CAD) tools, based on artificial intelligence methods, that can perform automated diagnosis of PD, are gaining attention from healthcare services. In this review, we have identified 63 studies published between January 2011 and July 2021, that proposed deep learning models for an automated diagnosis of PD, using various types of modalities like brain analysis (SPECT, PET, MRI and EEG), and motion symptoms (gait, handwriting, speech and EMG). From these studies, we identify the best performing deep learning model reported for each modality and highlight the current limitations that are hindering the adoption of such CAD tools in healthcare. Finally, we propose new directions to further the studies on deep learning in the automated detection of PD, in the hopes of improving the utility, applicability and impact of such tools to improve early detection of PD globally.
Collapse
Affiliation(s)
- Hui Wen Loh
- School of Science and Technology, Singapore University of Social Sciences, Singapore 599494, Singapore
| | - Wanrong Hong
- Cogninet Brain Team, Cogninet Australia, Sydney, NSW 2010, Australia
| | - Chui Ping Ooi
- School of Science and Technology, Singapore University of Social Sciences, Singapore 599494, Singapore
| | - Subrata Chakraborty
- Faculty of Engineering and Information Technology, University of Technology Sydney, Sydney, NSW 2007, Australia
| | - Prabal Datta Barua
- Cogninet Brain Team, Cogninet Australia, Sydney, NSW 2010, Australia
- Faculty of Engineering and Information Technology, University of Technology Sydney, Sydney, NSW 2007, Australia
- School of Business (Information Systems), Faculty of Business, Education, Law & Arts, University of Southern Queensland, Toowoomba, QLD 4350, Australia
| | - Ravinesh C Deo
- School of Sciences, University of Southern Queensland, Springfield, QLD 4300, Australia
| | - Jeffrey Soar
- School of Business (Information Systems), Faculty of Business, Education, Law & Arts, University of Southern Queensland, Toowoomba, QLD 4350, Australia
| | - Elizabeth E Palmer
- Centre of Clinical Genetics, Sydney Children's Hospitals Network, Randwick, NSW 2031, Australia
- School of Women's and Children's Health, University of New South Wales, Randwick, NSW 2031, Australia
| | - U Rajendra Acharya
- School of Science and Technology, Singapore University of Social Sciences, Singapore 599494, Singapore
- School of Business (Information Systems), Faculty of Business, Education, Law & Arts, University of Southern Queensland, Toowoomba, QLD 4350, Australia
- School of Engineering, Ngee Ann Polytechnic, Singapore 599489, Singapore
- Department of Bioinformatics and Medical Engineering, Asia University, Taichung 413, Taiwan
- Research Organization for Advanced Science and Technology (IROAST), Kumamoto University, Kumamoto 860-8555, Japan
| |
Collapse
|
50
|
Kuo CE, Chen GT, Liao PY. An EEG spectrogram-based automatic sleep stage scoring method via data augmentation, ensemble convolution neural network, and expert knowledge. Biomed Signal Process Control 2021. [DOI: 10.1016/j.bspc.2021.102981] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/20/2022]
|