1
|
Cusinato R, Gross S, Bainier M, Janz P, Schoenenberger P, Redondo RL. Workflow for the unsupervised clustering of sleep stages identifies light and deep sleep in electrophysiological recordings in mice. J Neurosci Methods 2024; 408:110155. [PMID: 38710233 DOI: 10.1016/j.jneumeth.2024.110155] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/11/2023] [Revised: 03/12/2024] [Accepted: 04/27/2024] [Indexed: 05/08/2024]
Abstract
BACKGROUND Sleep physiology plays a critical role in brain development and aging. Accurate sleep staging, which categorizes different sleep states, is fundamental for sleep physiology studies. Traditional methods for sleep staging rely on manual, rule-based scoring techniques, which limit their accuracy and adaptability. NEW METHOD We describe, test and challenge a workflow for unsupervised clustering of sleep states (WUCSS) in rodents, which uses accelerometer and electrophysiological data to classify different sleep states. WUCSS utilizes unsupervised clustering to identify sleep states using six features, extracted from 4-second epochs. RESULTS We gathered high-quality EEG recordings combined with accelerometer data in diverse transgenic mouse lines (male ApoE3 versus ApoE4 knockin; male CNTNAP2 KO versus wildtype littermates). WUCSS showed high recall, precision, and F1-score against manual scoring on awake, NREM, and REM sleep states. Within NREM, WUCSS consistently identified two additional clusters that qualify as deep and light sleep states. COMPARISON WITH EXISTING METHODS The ability of WUCSS to discriminate between deep and light sleep enhanced the precision and comprehensiveness of the current mouse sleep physiology studies. This differentiation led to the discovery of an additional sleep phenotype, notably in CNTNAP2 KO mice, showcasing the method's superiority over traditional scoring methods. CONCLUSIONS WUCSS, with its unsupervised approach and classification of deep and light sleep states, provides an unbiased opportunity for researchers to enhance their understanding of sleep physiology. Its high accuracy, adaptability, and ability to save time and resources make it a valuable tool for improving sleep staging in both clinical and preclinical research.
Collapse
Affiliation(s)
- Riccardo Cusinato
- Roche Pharma Research and Early Development, Neuroscience and Rare Diseases, Roche Innovation Center Basel, F. Hoffmann-La Roche Ltd, Grenzacherstrasse 124, Basel 4070, Switzerland
| | - Simon Gross
- Roche Pharma Research and Early Development, Neuroscience and Rare Diseases, Roche Innovation Center Basel, F. Hoffmann-La Roche Ltd, Grenzacherstrasse 124, Basel 4070, Switzerland.
| | - Marie Bainier
- Roche Pharma Research and Early Development, Neuroscience and Rare Diseases, Roche Innovation Center Basel, F. Hoffmann-La Roche Ltd, Grenzacherstrasse 124, Basel 4070, Switzerland
| | - Philipp Janz
- Roche Pharma Research and Early Development, Neuroscience and Rare Diseases, Roche Innovation Center Basel, F. Hoffmann-La Roche Ltd, Grenzacherstrasse 124, Basel 4070, Switzerland
| | - Philipp Schoenenberger
- Roche Pharma Research and Early Development, Neuroscience and Rare Diseases, Roche Innovation Center Basel, F. Hoffmann-La Roche Ltd, Grenzacherstrasse 124, Basel 4070, Switzerland
| | - Roger L Redondo
- Roche Pharma Research and Early Development, Neuroscience and Rare Diseases, Roche Innovation Center Basel, F. Hoffmann-La Roche Ltd, Grenzacherstrasse 124, Basel 4070, Switzerland
| |
Collapse
|
2
|
Li C, Mu Y, Zhu P, Pan Y, Zhang S, Yang L, Xu P, Li F. Sleep stages classification by fusing the time-related synchronization analysis and brain activations. Brain Res Bull 2024; 215:111017. [PMID: 38914295 DOI: 10.1016/j.brainresbull.2024.111017] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/26/2024] [Revised: 05/28/2024] [Accepted: 06/15/2024] [Indexed: 06/26/2024]
Abstract
Sleep staging plays an important role in the diagnosis and treatment of clinical sleep disorders. The sleep staging standard defines every 30 seconds as a sleep period, which may mean that there exist similar brain activity patterns during the same sleep period. Thus, in this work, we propose a novel time-related synchronization analysis framework named time-related multimodal sleep scoring model (TRMSC) to explore the potential time-related patterns of sleeping. In the proposed TRMSC, the time-related synchronization analysis is first conducted on the single channel electrophysiological signal, i.e., Electroencephalogram (EEG) and Electrooculogram (EOG), to explore the time-related patterns, and the spectral activation features are also extracted by spectrum analysis to obtain the multimodal features. With the extracted multimodal features, the feature fusion and selection strategy is utilized to obtain the optimal feature set and achieve robust sleep staging. To verify the effectiveness of the proposed TRMSC, sleep staging experiments were conducted on the Sleep-EDF dataset, and the experimental results indicate that the proposed TRMSC has achieved better performance than other existing strategies, which proves that the time-related synchronization features can make up for the shortcomings of traditional spectrum-based strategies and achieve a higher classification accuracy. The proposed TRMSC model may be helpful for portable sleep analyzers and provide a new analytical method for clinical sleeping research.
Collapse
Affiliation(s)
- Cunbo Li
- Clinical Hospital of Chengdu Brain Science Institute, MOE Key Lab for Neuroinformation and School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu 610054, China
| | - Yufeng Mu
- Clinical Hospital of Chengdu Brain Science Institute, MOE Key Lab for Neuroinformation and School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu 610054, China
| | - Pengcheng Zhu
- Clinical Hospital of Chengdu Brain Science Institute, MOE Key Lab for Neuroinformation and School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu 610054, China
| | - Yue Pan
- Clinical Hospital of Chengdu Brain Science Institute, MOE Key Lab for Neuroinformation and School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu 610054, China
| | - Shuhan Zhang
- Clinical Hospital of Chengdu Brain Science Institute, MOE Key Lab for Neuroinformation and School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu 610054, China
| | - Lei Yang
- Clinical Hospital of Chengdu Brain Science Institute, MOE Key Lab for Neuroinformation and School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu 610054, China
| | - Peng Xu
- Clinical Hospital of Chengdu Brain Science Institute, MOE Key Lab for Neuroinformation and School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu 610054, China
| | - Fali Li
- Clinical Hospital of Chengdu Brain Science Institute, MOE Key Lab for Neuroinformation and School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu 610054, China.
| |
Collapse
|
3
|
Zhang F, Wu H, Guo Y. Semi-supervised multi-source transfer learning for cross-subject EEG motor imagery classification. Med Biol Eng Comput 2024; 62:1655-1672. [PMID: 38324109 DOI: 10.1007/s11517-024-03032-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/23/2023] [Accepted: 12/27/2023] [Indexed: 02/08/2024]
Abstract
Electroencephalogram (EEG) motor imagery (MI) classification refers to the use of EEG signals to identify and classify subjects' motor imagery activities; this task has received increasing attention with the development of brain-computer interfaces (BCIs). However, the collection of EEG data is usually time-consuming and labor-intensive, which makes it difficult to obtain sufficient labeled data from the new subject to train a new model. Moreover, the EEG signals of different individuals exhibit significant differences, leading to a significant drop in the performance of a model trained on the existing subjects when directly classifying EEG signals acquired from new subjects. Therefore, it is crucial to make full use of the EEG data of the existing subjects and the unlabeled EEG data of the new target subject to improve the MI classification performance achieved for the target subject. This research study proposes a semi-supervised multi-source transfer (SSMT) learning model to address the above problems; the model learns informative and domain-invariant representations to address cross-subject MI-EEG classification tasks. In particular, a dynamic transferred weighting schema is presented to obtain the final predictions by integrating the weighted features derived from multi-source domains. The average accuracies achieved on two publicly available EEG datasets reach 83.57 % and 85.09 % , respectively, validating the effectiveness of the SSMT process. The SSMT process reveals the importance of informative and domain-invariant representations in MI classification tasks, as they make full use of the domain-invariant information acquired from each subject.
Collapse
Affiliation(s)
| | - Hanliang Wu
- Liwan District People's Hospital of Guangzhou, Guangzhou, China.
| | - Yuxin Guo
- Guangzhou Institute of Science and Technology, Guangzhou, China
| |
Collapse
|
4
|
Yazdi M, Samaee M, Massicotte D. A Review on Automated Sleep Study. Ann Biomed Eng 2024; 52:1463-1491. [PMID: 38493234 DOI: 10.1007/s10439-024-03486-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/07/2023] [Accepted: 02/25/2024] [Indexed: 03/18/2024]
Abstract
In recent years, research on automated sleep analysis has witnessed significant growth, reflecting advancements in understanding sleep patterns and their impact on overall health. This review synthesizes findings from an exhaustive analysis of 87 papers, systematically retrieved from prominent databases such as Google Scholar, PubMed, IEEE Xplore, and ScienceDirect. The selection criteria prioritized studies focusing on methods employed, signal modalities utilized, and machine learning algorithms applied in automated sleep analysis. The overarching goal was to critically evaluate the strengths and weaknesses of the proposed methods, shedding light on the current landscape and future directions in sleep research. An in-depth exploration of the reviewed literature revealed a diverse range of methodologies and machine learning approaches employed in automated sleep studies. Notably, K-Nearest Neighbors (KNN), Ensemble Learning Methods, and Support Vector Machine (SVM) emerged as versatile and potent classifiers, exhibiting high accuracies in various applications. However, challenges such as performance variability and computational demands were observed, necessitating judicious classifier selection based on dataset intricacies. In addition, the integration of traditional feature extraction methods with deep structures and the combination of different deep neural networks were identified as promising strategies to enhance diagnostic accuracy in sleep-related studies. The reviewed literature emphasized the need for adaptive classifiers, cross-modality integration, and collaborative efforts to drive the field toward more accurate, robust, and accessible sleep-related diagnostic solutions. This comprehensive review serves as a solid foundation for researchers and practitioners, providing an organized synthesis of the current state of knowledge in automated sleep analysis. By highlighting the strengths and challenges of various methodologies, this review aims to guide future research toward more effective and nuanced approaches to sleep diagnostics.
Collapse
Affiliation(s)
- Mehran Yazdi
- Laboratory of Signal and System Integration, Department of Electrical and Computer Engineering, Université du Québec à Trois-Rivières, Trois-Rivières, Canada.
- Signal and Image Processing Laboratory, School of Electrical and Computer Engineering, Shiraz University, Shiraz, Iran.
| | - Mahdi Samaee
- Signal and Image Processing Laboratory, School of Electrical and Computer Engineering, Shiraz University, Shiraz, Iran
| | - Daniel Massicotte
- Laboratory of Signal and System Integration, Department of Electrical and Computer Engineering, Université du Québec à Trois-Rivières, Trois-Rivières, Canada
| |
Collapse
|
5
|
Han J, Wei X, Faisal AA. EEG decoding for datasets with heterogenous electrode configurations using transfer learning graph neural networks. J Neural Eng 2023; 20:066027. [PMID: 37931308 DOI: 10.1088/1741-2552/ad09ff] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/19/2023] [Accepted: 11/06/2023] [Indexed: 11/08/2023]
Abstract
Objective. Brain-machine interfacing (BMI) has greatly benefited from adopting machine learning methods for feature learning that require extensive data for training, which are often unavailable from a single dataset. Yet, it is difficult to combine data across labs or even data within the same lab collected over the years due to the variation in recording equipment and electrode layouts resulting in shifts in data distribution, changes in data dimensionality, and altered identity of data dimensions. Our objective is to overcome this limitation and learn from many different and diverse datasets across labs with different experimental protocols.Approach. To tackle the domain adaptation problem, we developed a novel machine learning framework combining graph neural networks (GNNs) and transfer learning methodologies for non-invasive motor imagery (MI) EEG decoding, as an example of BMI. Empirically, we focus on the challenges of learning from EEG data with different electrode layouts and varying numbers of electrodes. We utilize three MI EEG databases collected using very different numbers of EEG sensors (from 22 channels to 64) and layouts (from custom layouts to 10-20).Main results. Our model achieved the highest accuracy with lower standard deviations on the testing datasets. This indicates that the GNN-based transfer learning framework can effectively aggregate knowledge from multiple datasets with different electrode layouts, leading to improved generalization in subject-independent MI EEG classification.Significance. The findings of this study have important implications for brain-computer-interface research, as they highlight a promising method for overcoming the limitations posed by non-unified experimental setups. By enabling the integration of diverse datasets with varying electrode layouts, our proposed approach can help advance the development and application of BMI technologies.
Collapse
Affiliation(s)
- Jinpei Han
- Brain & Behaviour Lab, Department of Computing, Imperial College London, London SW7 2AZ, United Kingdom
| | - Xiaoxi Wei
- Brain & Behaviour Lab, Department of Computing, Imperial College London, London SW7 2AZ, United Kingdom
| | - A Aldo Faisal
- Brain & Behaviour Lab, Department of Computing, Imperial College London, London SW7 2AZ, United Kingdom
- Chair in Digital Health & Data Science, University of Bayreuth, 95447 Bayreuth, Germany
| |
Collapse
|
6
|
Yuan W, Xiang W, Si K, Yang C, Zhao L, Li J, Liu C. Multi-channel EEG-based sleep staging using brain functional connectivity and domain adaptation. Physiol Meas 2023; 44:105007. [PMID: 37827169 DOI: 10.1088/1361-6579/ad02db] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/16/2023] [Accepted: 10/12/2023] [Indexed: 10/14/2023]
Abstract
Objective.Sleep stage recognition has essential clinical value for evaluating human physical/mental condition and diagnosing sleep-related diseases. To conduct a five-class (wake, N1, N2, N3 and rapid eye movement) sleep staging task, twenty subjects with recorded six-channel electroencephalography (EEG) signals from the ISRUC-SLEEP dataset is used.Approach.Unlike the exist methods ignoring the channel coupling relationship and non-stationarity characteristics, we developed a brain functional connectivity method to provide a new insight for multi-channel analysis. Furthermore, we investigated three frequency-domain features: two functional connectivity estimations, i.e. synchronization likelihood (SL) and wavelet-based correlation (WC) among four frequency bands, and energy ratio (ER) related to six frequency bands, respectively. Then, the Gaussian support vector machine (SVM) method was used to predict the five sleep stages. The performance of the applied features is evaluated in both subject dependence experiment by ten-fold cross validation and subject independence experiment by leave-one-subject-out cross-validation, respectively.Main results.In subject dependence experiment, the results showed that the fused feature (fusion of SL, WC and ER features) contributes significant gain the performance of SVM classifier, where the mean of classification accuracy can achieve 83.97% ± 1.04%. However, in subject-independence experiment, the individual differences EEG patterns across subjects leads to inferior accuracy. Five typical domain adaptation (DA) methods were applied to reduce the discrepancy of feature distributions by selecting the optimal subspace dimension. Results showed that four DA methods can significantly improve the mean accuracy by 1.89%-5.22% compared to the baseline accuracy 57.44% in leave-one-subject-out cross-validation.Significance.Compared with traditional time-frequency and nonlinear features, brain functional connectivity features can capture the correlation between different brain regions. For the individual EEG response differences, domain adaptation methods can transform features to improve the performance of sleep staging algorithms.
Collapse
Affiliation(s)
- Wenhao Yuan
- Key Laboratory of Bioelectronics, School of Instrument Science and Engineering, Southeast University, Nanjing, 210096, People's Republic of China
| | - Wentao Xiang
- Jiangsu Province Engineering Research Center for Smart Wearable and Rehabilitation Devices, School of Biomedical Engineering and Informatics, Nanjing Medical University, Nanjing, 211166, People's Republic of China
| | - Kaiyue Si
- Key Laboratory of Bioelectronics, School of Instrument Science and Engineering, Southeast University, Nanjing, 210096, People's Republic of China
| | - Chunfeng Yang
- Key Laboratory of Computer Network and Information Integration of Ministry of Education, Southeast University, Nanjing, 210096, People's Republic of China
| | - Lina Zhao
- Key Laboratory of Bioelectronics, School of Instrument Science and Engineering, Southeast University, Nanjing, 210096, People's Republic of China
| | - Jianqing Li
- Key Laboratory of Bioelectronics, School of Instrument Science and Engineering, Southeast University, Nanjing, 210096, People's Republic of China
- Jiangsu Province Engineering Research Center for Smart Wearable and Rehabilitation Devices, School of Biomedical Engineering and Informatics, Nanjing Medical University, Nanjing, 211166, People's Republic of China
| | - Chengyu Liu
- Key Laboratory of Bioelectronics, School of Instrument Science and Engineering, Southeast University, Nanjing, 210096, People's Republic of China
| |
Collapse
|
7
|
Lyu J, Shi W, Zhang C, Yeh CH. A Novel Sleep Staging Method Based on EEG and ECG Multimodal Features Combination. IEEE Trans Neural Syst Rehabil Eng 2023; 31:4073-4084. [PMID: 37819827 DOI: 10.1109/tnsre.2023.3323892] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/13/2023]
Abstract
Accurate sleep staging evaluates the quality of sleep, supporting the clinical diagnosis and intervention of sleep disorders and related diseases. Although previous attempts to classify sleep stages have achieved high classification performance, little attention has been paid to integrating the rich information in brain and heart dynamics during sleep for sleep staging. In this study, we propose a generalized EEG and ECG multimodal feature combination to classify sleep stages with high efficiency and accuracy. Briefly, a hybrid features combination in terms of multiscale entropy and intrinsic mode function are used to reflect nonlinear dynamics in multichannel EEGs, along with heart rate variability measures over time/frequency domains, and sample entropy across scales are applied for ECGs. For both the max-relevance and min-redundancy method and principal component analysis were used for dimensionality reduction. The selected features were classified by four traditional machine learning classifiers. Macro-F1 score, macro-geometric mean, and Cohen kappa value are adopted to evaluate the classification performance of each class in an imbalanced dataset. Experimental results show that EEG features contribute more to wake stage classification while ECG features contribute more to deep sleep stages. The proposed combination achieves the highest accuracy of 84.3% and the highest kappa value of 0.794 on the support vector machine in the ISRUC-S3 dataset, suggesting the proposed multimodal features combination is promising in accuracy and efficiency compared to other state-of-the-art methods.
Collapse
|
8
|
Zan H, Yildiz A. Multi-task learning for arousal and sleep stage detection using fully convolutional networks. J Neural Eng 2023; 20:056034. [PMID: 37769664 DOI: 10.1088/1741-2552/acfe3a] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/29/2023] [Accepted: 09/28/2023] [Indexed: 10/03/2023]
Abstract
Objective.Sleep is a critical physiological process that plays a vital role in maintaining physical and mental health. Accurate detection of arousals and sleep stages is essential for the diagnosis of sleep disorders, as frequent and excessive occurrences of arousals disrupt sleep stage patterns and lead to poor sleep quality, negatively impacting physical and mental health. Polysomnography is a traditional method for arousal and sleep stage detection that is time-consuming and prone to high variability among experts.Approach. In this paper, we propose a novel multi-task learning approach for arousal and sleep stage detection using fully convolutional neural networks. Our model, FullSleepNet, accepts a full-night single-channel EEG signal as input and produces segmentation masks for arousal and sleep stage labels. FullSleepNet comprises four modules: a convolutional module to extract local features, a recurrent module to capture long-range dependencies, an attention mechanism to focus on relevant parts of the input, and a segmentation module to output final predictions.Main results.By unifying the two interrelated tasks as segmentation problems and employing a multi-task learning approach, FullSleepNet achieves state-of-the-art performance for arousal detection with an area under the precision-recall curve of 0.70 on Sleep Heart Health Study and Multi-Ethnic Study of Atherosclerosis datasets. For sleep stage classification, FullSleepNet obtains comparable performance on both datasets, achieving an accuracy of 0.88 and an F1-score of 0.80 on the former and an accuracy of 0.83 and an F1-score of 0.76 on the latter.Significance. Our results demonstrate that FullSleepNet offers improved practicality, efficiency, and accuracy for the detection of arousal and classification of sleep stages using raw EEG signals as input.
Collapse
Affiliation(s)
- Hasan Zan
- Vocational School, Mardin Artuklu University, Mardin, Turkey
| | - Abdulnasır Yildiz
- Department of Electrical and Electronics Engineering, Dicle University, Diyarbakir, Turkey
| |
Collapse
|
9
|
Lepage KQ, Jain S, Kvavilashvili A, Witcher M, Vijayan S. Unsupervised Multitaper Spectral Method for Identifying REM Sleep in Intracranial EEG Recordings Lacking EOG/EMG Data. Bioengineering (Basel) 2023; 10:1009. [PMID: 37760111 PMCID: PMC10525760 DOI: 10.3390/bioengineering10091009] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/28/2023] [Revised: 08/10/2023] [Accepted: 08/15/2023] [Indexed: 09/29/2023] Open
Abstract
A large number of human intracranial EEG (iEEG) recordings have been collected for clinical purposes, in institutions all over the world, but the vast majority of these are unaccompanied by EOG and EMG recordings which are required to separate Wake episodes from REM sleep using accepted methods. In order to make full use of this extremely valuable data, an accurate method of classifying sleep from iEEG recordings alone is required. Existing methods of sleep scoring using only iEEG recordings accurately classify all stages of sleep, with the exception that wake (W) and rapid-eye movement (REM) sleep are not well distinguished. A novel multitaper (Wake vs. REM) alpha-rhythm classifier is developed by generalizing K-means clustering for use with multitaper spectral eigencoefficients. The performance of this unsupervised method is assessed on eight subjects exhibiting normal sleep architecture in a hold-out analysis and is compared against a classical power detector. The proposed multitaper classifier correctly identifies 36±6 min of REM in one night of recorded sleep, while incorrectly labeling less than 10% of all labeled 30 s epochs for all but one subject (human rater reliability is estimated to be near 80%), and outperforms the equivalent statistical-power classical test. Hold-out analysis indicates that when using one night's worth of data, an accurate generalization of the method on new data is likely. For the purpose of studying sleep, the introduced multitaper alpha-rhythm classifier further paves the way to making available a large quantity of otherwise unusable IEEG data.
Collapse
Affiliation(s)
- Kyle Q. Lepage
- School of Neuroscience, Sandy Hall, Virginia Tech, 210 Drillfield Drive, Blacksburg, VA 24060, USA; (A.K.); (S.V.)
| | - Sparsh Jain
- Department of Biomedical Engineering and Mechanics, Virginia Tech, 325 Stanger St., Blacksburg, VA 24061, USA;
| | - Andrew Kvavilashvili
- School of Neuroscience, Sandy Hall, Virginia Tech, 210 Drillfield Drive, Blacksburg, VA 24060, USA; (A.K.); (S.V.)
| | - Mark Witcher
- Section of Neurosurgery, Carilion Clinic, Carilion Roanoke Memorial Hospital, 1906 Belleview Ave SE, Roanoke, VA 24014, USA;
| | - Sujith Vijayan
- School of Neuroscience, Sandy Hall, Virginia Tech, 210 Drillfield Drive, Blacksburg, VA 24060, USA; (A.K.); (S.V.)
| |
Collapse
|
10
|
Hasan MN, Koo I. Mixed-Input Deep Learning Approach to Sleep/Wake State Classification by Using EEG Signals. Diagnostics (Basel) 2023; 13:2358. [PMID: 37510104 PMCID: PMC10378260 DOI: 10.3390/diagnostics13142358] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/25/2023] [Revised: 07/04/2023] [Accepted: 07/08/2023] [Indexed: 07/30/2023] Open
Abstract
Sleep stage classification plays a pivotal role in predicting and diagnosing numerous health issues from human sleep data. Manual sleep staging requires human expertise, which is occasionally prone to error and variation. In recent times, availability of polysomnography data has aided progress in automatic sleep-stage classification. In this paper, a hybrid deep learning model is proposed for classifying sleep and wake states based on a single-channel electroencephalogram (EEG) signal. The model combines an artificial neural network (ANN) and a convolutional neural network (CNN) trained using mixed-input features. The ANN makes use of statistical features calculated from EEG epochs, and the CNN operates on Hilbert spectrum images generated during each epoch. The proposed method is assessed using single-channel Pz-Oz EEG signals from the Sleep-EDF database Expanded. The classification performance on four randomly selected individuals shows that the proposed model can achieve accuracy of around 96% in classifying between sleep and wake states from EEG recordings.
Collapse
Affiliation(s)
- Md Nazmul Hasan
- Department of Electrical, Electronic and Computer Engineering, University of Ulsan, Ulsan 44610, Republic of Korea
| | - Insoo Koo
- Department of Electrical, Electronic and Computer Engineering, University of Ulsan, Ulsan 44610, Republic of Korea
| |
Collapse
|
11
|
Craik A, González-España JJ, Alamir A, Edquilang D, Wong S, Sánchez Rodríguez L, Feng J, Francisco GE, Contreras-Vidal JL. Design and Validation of a Low-Cost Mobile EEG-Based Brain-Computer Interface. SENSORS (BASEL, SWITZERLAND) 2023; 23:5930. [PMID: 37447780 DOI: 10.3390/s23135930] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/09/2023] [Revised: 06/09/2023] [Accepted: 06/20/2023] [Indexed: 07/15/2023]
Abstract
Objective: We designed and validated a wireless, low-cost, easy-to-use, mobile, dry-electrode headset for scalp electroencephalography (EEG) recordings for closed-loop brain-computer (BCI) interface and internet-of-things (IoT) applications. Approach: The EEG-based BCI headset was designed from commercial off-the-shelf (COTS) components using a multi-pronged approach that balanced interoperability, cost, portability, usability, form factor, reliability, and closed-loop operation. Main Results: The adjustable headset was designed to accommodate 90% of the population. A patent-pending self-positioning dry electrode bracket allowed for vertical self-positioning while parting the user's hair to ensure contact of the electrode with the scalp. In the current prototype, five EEG electrodes were incorporated in the electrode bracket spanning the sensorimotor cortices bilaterally, and three skin sensors were included to measure eye movement and blinks. An inertial measurement unit (IMU) provides monitoring of head movements. The EEG amplifier operates with 24-bit resolution up to 500 Hz sampling frequency and can communicate with other devices using 802.11 b/g/n WiFi. It has high signal-to-noise ratio (SNR) and common-mode rejection ratio (CMRR) (121 dB and 110 dB, respectively) and low input noise. In closed-loop BCI mode, the system can operate at 40 Hz, including real-time adaptive noise cancellation and 512 MB of processor memory. It supports LabVIEW as a backend coding language and JavaScript (JS), Cascading Style Sheets (CSS), and HyperText Markup Language (HTML) as front-end coding languages and includes training and optimization of support vector machine (SVM) neural classifiers. Extensive bench testing supports the technical specifications and human-subject pilot testing of a closed-loop BCI application to support upper-limb rehabilitation and provides proof-of-concept validation for the device's use at both the clinic and at home. Significance: The usability, interoperability, portability, reliability, and programmability of the proposed wireless closed-loop BCI system provides a low-cost solution for BCI and neurorehabilitation research and IoT applications.
Collapse
Affiliation(s)
- Alexander Craik
- Department of Electrical and Computer Engineering, University of Houston, Houston, TX 77004, USA
- Noninvasive Brain-Machine Interface Systems Laboratory, NSF Industry-University Cooperative Research Center for Building Reliable Advances and Innovations in Neurotechnology (IUCRC BRAIN) Center, University of Houston, Houston, TX 77004, USA
| | - Juan José González-España
- Department of Electrical and Computer Engineering, University of Houston, Houston, TX 77004, USA
- Noninvasive Brain-Machine Interface Systems Laboratory, NSF Industry-University Cooperative Research Center for Building Reliable Advances and Innovations in Neurotechnology (IUCRC BRAIN) Center, University of Houston, Houston, TX 77004, USA
| | - Ayman Alamir
- Noninvasive Brain-Machine Interface Systems Laboratory, NSF Industry-University Cooperative Research Center for Building Reliable Advances and Innovations in Neurotechnology (IUCRC BRAIN) Center, University of Houston, Houston, TX 77004, USA
- Department of Biomedical Engineering, University of Houston, Houston, TX 77004, USA
- Department of Electrical Engineering, Jazan University, Jazan 45142, Saudi Arabia
| | - David Edquilang
- Department of Industrial Design, University of Houston, Houston, TX 77004, USA
| | - Sarah Wong
- Noninvasive Brain-Machine Interface Systems Laboratory, NSF Industry-University Cooperative Research Center for Building Reliable Advances and Innovations in Neurotechnology (IUCRC BRAIN) Center, University of Houston, Houston, TX 77004, USA
- Department of Industrial Design, University of Houston, Houston, TX 77004, USA
| | - Lianne Sánchez Rodríguez
- Department of Electrical and Computer Engineering, University of Houston, Houston, TX 77004, USA
- Noninvasive Brain-Machine Interface Systems Laboratory, NSF Industry-University Cooperative Research Center for Building Reliable Advances and Innovations in Neurotechnology (IUCRC BRAIN) Center, University of Houston, Houston, TX 77004, USA
| | - Jeff Feng
- Noninvasive Brain-Machine Interface Systems Laboratory, NSF Industry-University Cooperative Research Center for Building Reliable Advances and Innovations in Neurotechnology (IUCRC BRAIN) Center, University of Houston, Houston, TX 77004, USA
- Department of Industrial Design, University of Houston, Houston, TX 77004, USA
| | - Gerard E Francisco
- Department of Physical Medicine & Rehabilitation, University of Texas Health McGovern Medical School, Houston, TX 77030, USA
- The Institute for Rehabilitation and Research (TIRR) Memorial Hermann Hospital, Houston, TX 77030, USA
| | - Jose L Contreras-Vidal
- Department of Electrical and Computer Engineering, University of Houston, Houston, TX 77004, USA
- Noninvasive Brain-Machine Interface Systems Laboratory, NSF Industry-University Cooperative Research Center for Building Reliable Advances and Innovations in Neurotechnology (IUCRC BRAIN) Center, University of Houston, Houston, TX 77004, USA
| |
Collapse
|
12
|
Kang C, An S, Kim HJ, Devi M, Cho A, Hwang S, Lee HW. Age-integrated artificial intelligence framework for sleep stage classification and obstructive sleep apnea screening. Front Neurosci 2023; 17:1059186. [PMID: 37389364 PMCID: PMC10300414 DOI: 10.3389/fnins.2023.1059186] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/08/2022] [Accepted: 05/03/2023] [Indexed: 07/01/2023] Open
Abstract
Introduction Sleep is an essential function to sustain a healthy life, and sleep dysfunction can cause various physical and mental issues. In particular, obstructive sleep apnea (OSA) is one of the most common sleep disorders and, if not treated in a timely manner, OSA can lead to critical problems such as hypertension or heart disease. Methods The first crucial step in evaluating individuals' quality of sleep and diagnosing sleep disorders is to classify sleep stages using polysomnographic (PSG) data including electroencephalography (EEG). To date, such sleep stage scoring has been mainly performed manually via visual inspection by experts, which is not only a time-consuming and laborious process but also may yield subjective results. Therefore, we have developed a computational framework that enables automatic sleep stage classification utilizing the power spectral density (PSD) features of sleep EEG based on three different learning algorithms: support vector machine, k-nearest neighbors, and multilayer perceptron (MLP). In particular, we propose an integrated artificial intelligence (AI) framework to further inform the risk of OSA based on the characteristics in automatically scored sleep stages. Given the previous finding that the characteristics of sleep EEG differ by age group, we employed a strategy of training age-specific models (younger and older groups) and a general model and comparing their performance. Results The performance of the younger age-specific group model was similar to that of the general model (and even higher than the general model at certain stages), but the performance of the older age-specific group model was rather low, suggesting that bias in individual variables, such as age bias, should be considered during model training. Our integrated model yielded an accuracy of 73% in sleep stage classification and 73% in OSA screening when MLP algorithm was applied, which indicates that patients with OSA could be screened with the corresponding accuracy level only with sleep EEG without respiration-related measures. Discussion The current outcomes demonstrate the feasibility of AI-based computational studies that when combined with advances in wearable devices and relevant technologies could contribute to personalized medicine by not only assessing an individuals' sleep status conveniently at home but also by alerting them to the risk of sleep disorders and enabling early intervention.
Collapse
Affiliation(s)
- Chaewon Kang
- Computational Medicine, System Health Science and Engineering Program, Ewha Womans University, Seoul, Republic of Korea
| | - Sora An
- Department of Communication Disorders, Ewha Womans University, Seoul, Republic of Korea
| | - Hyeon Jin Kim
- Department of Neurology, Korea University Ansan Hospital, Ansan, Republic of Korea
- Department of Neurology, Ewha Womans University School of Medicine, Seoul, Republic of Korea
| | - Maithreyee Devi
- Computational Medicine, System Health Science and Engineering Program, Ewha Womans University, Seoul, Republic of Korea
| | - Aram Cho
- Department of Nursing Science, Ewha Womans University, Seoul, Republic of Korea
| | - Sungeun Hwang
- Department of Neurology, Ewha Womans University Mogdong Hospital, Seoul, Republic of Korea
| | - Hyang Woon Lee
- Computational Medicine, System Health Science and Engineering Program, Ewha Womans University, Seoul, Republic of Korea
- Department of Neurology, Ewha Womans University School of Medicine, Seoul, Republic of Korea
- Department of Medical Science, Ewha Womans University School of Medicine and Ewha Medical Research Institute, Seoul, Republic of Korea
| |
Collapse
|
13
|
Sharma M, Lodhi H, Yadav R, Elphick H, Acharya UR. Computerized detection of cyclic alternating patterns of sleep: A new paradigm, future scope and challenges. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2023; 235:107471. [PMID: 37037163 DOI: 10.1016/j.cmpb.2023.107471] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/24/2023] [Revised: 02/24/2023] [Accepted: 03/06/2023] [Indexed: 05/08/2023]
Abstract
BACKGROUND AND OBJECTIVES Sleep quality is associated with wellness, and its assessment can help diagnose several disorders and diseases. Sleep analysis is commonly performed based on self-rating indices, sleep duration, environmental factors, physiologically and polysomnographic-derived parameters, and the occurrence of disorders. However, the correlation that has been observed between the subjective assessment and objective measurements of sleep quality is small. Recently, a few automated systems have been suugested to measure sleep quality to address this challenge. Sleep quality can be assessed by evaluating macrostructure-based sleep analysis via the examination of sleep cycles, namely Rapid Eye Movement (REM) and Non Rapid Eye Movement (NREM) with N1, N2, and N3 stages. However, macrostructure sleep analysis does not consider transitory phenomena like K-complexes and transient fluctuations, which are indispensable in diagnosing various sleep disorders. The CAP, part of the microstructure of sleep, may offer a more precise and relevant examination of sleep and can be considered one of the candidates to measure sleep quality and identify sleep disorders such as insomnia and apnea. CAP is characterized by very subtle changes in the brain's electroencephalogram (EEG) signals that occur during the NREM stage of sleep. The variations among these patterns in healthy subjects and subjects with sleep disorders can be used to identify sleep disorders. Studying CAP is highly arduous for human experts; thus, developing automated systems for assessing CAP is gaining momentum. Developing new techniques for automated CAP detection installed in clinical setups is essential. This paper aims to analyze the algorithms and methods presented in the literature for the automatic assessment of CAP and the development of CAP-based sleep markers that may enhance sleep quality assessment, helping diagnose sleep disorders. METHODS This literature survey examined the automated assessment of CAP and related parameters. We have reviewed 34 research articles, including fourteen ML, nine DL, and ten based on some other techniques. RESULTS The review includes various algorithms, databases, features, classifiers, and classification performances and their comparisons, advantages, and limitations of automated systems for CAP assessment. CONCLUSION A detailed description of state-of-the-art research findings on automated CAP assessment and associated challenges has been presented. Also, the research gaps have been identified based on our review. Further, future research directions are suggested for sleep quality assessment using CAP.
Collapse
Affiliation(s)
- Manish Sharma
- Department of Electrical and Computer Science Engineering, Institute of Infrastructure, Technology, Research and Management (IITRAM), Ahmedabad, India.
| | - Harsh Lodhi
- Department of Electrical and Computer Science Engineering, Institute of Infrastructure, Technology, Research and Management (IITRAM), Ahmedabad, India.
| | - Rishita Yadav
- Department of Electrical and Computer Science Engineering, Institute of Infrastructure, Technology, Research and Management (IITRAM), Ahmedabad, India.
| | | | - U Rajendra Acharya
- Department of Bioinformatics and Medical Engineering, Asia University, Taichung 41354, Taiwan; School of Mathematics, Physics and Computing, University of Southern Queensland, Springfield, Australia; Department of Biomedical Engineering, School of Science and Technology, Singapore.
| |
Collapse
|
14
|
Motin MA, Karmakar C, Palaniswami M, Penzel T, Kumar D. Multi-stage sleep classification using photoplethysmographic sensor. ROYAL SOCIETY OPEN SCIENCE 2023; 10:221517. [PMID: 37063995 PMCID: PMC10090868 DOI: 10.1098/rsos.221517] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 12/01/2022] [Accepted: 03/24/2023] [Indexed: 06/19/2023]
Abstract
The conventional approach to monitoring sleep stages requires placing multiple sensors on patients, which is inconvenient for long-term monitoring and requires expert support. We propose a single-sensor photoplethysmographic (PPG)-based automated multi-stage sleep classification. This experimental study recorded the PPG during the entire night's sleep of 10 patients. Data analysis was performed to obtain 79 features from the recordings, which were then classified according to sleep stages. The classification results using support vector machine (SVM) with the polynomial kernel yielded an overall accuracy of 84.66%, 79.62% and 72.23% for two-, three- and four-stage sleep classification. These results show that it is possible to conduct sleep stage monitoring using only PPG. These findings open the opportunities for PPG-based wearable solutions for home-based automated sleep monitoring.
Collapse
Affiliation(s)
- Mohammod Abdul Motin
- Department of Electrical and Electronic Engineering, Rajshahi University of Engineering and Technology, Kazla, Rajshahi 6204, Bangladesh
| | - Chandan Karmakar
- School of IT, Deakin University, Burwood, Melbourne, VIC 3125, Australia
| | - Marimuthu Palaniswami
- Department of Electrical and Electronic Engineering, The University of Melbourne, Melbourne, VIC 3010, Australia
| | - Thomas Penzel
- Interdisciplinary Sleep Medicine Center, Charite Universitatsmedizin, 10117 Berlin, Germany
| | - Dinesh Kumar
- School of Electrical and Biomedical Engineering, RMIT University, Melbourne, VIC 3001, Australia
| |
Collapse
|
15
|
Arif S, Munawar S, Ali H. Driving drowsiness detection using spectral signatures of EEG-based neurophysiology. Front Physiol 2023; 14:1153268. [PMID: 37064914 PMCID: PMC10097971 DOI: 10.3389/fphys.2023.1153268] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/29/2023] [Accepted: 03/09/2023] [Indexed: 03/31/2023] Open
Abstract
Introduction: Drowsy driving is a significant factor causing dire road crashes and casualties around the world. Detecting it earlier and more effectively can significantly reduce the lethal aftereffects and increase road safety. As physiological conditions originate from the human brain, so neurophysiological signatures in drowsy and alert states may be investigated for this purpose. In this preface, A passive brain-computer interface (pBCI) scheme using multichannel electroencephalography (EEG) brain signals is developed for spatially localized and accurate detection of human drowsiness during driving tasks.Methods: This pBCI modality acquired electrophysiological patterns of 12 healthy subjects from the prefrontal (PFC), frontal (FC), and occipital cortices (OC) of the brain. Neurological states are recorded using six EEG channels spread over the right and left hemispheres in the PFC, FC, and OC of the sleep-deprived subjects during simulated driving tasks. In post-hoc analysis, spectral signatures of the δ, θ, α, and β rhythms are extracted in terms of spectral band powers and their ratios with a temporal correlation over the complete span of the experiment. Minimum redundancy maximum relevance, Chi-square, and ReliefF feature selection methods are used and aggregated with a Z-score based approach for global feature ranking. The extracted drowsiness attributes are classified using decision trees, discriminant analysis, logistic regression, naïve Bayes, support vector machines, k-nearest neighbors, and ensemble classifiers. The binary classification results are reported with confusion matrix-based performance assessment metrics.Results: In inter-classifier comparison, the optimized ensemble model achieved the best results of drowsiness classification with 85.6% accuracy and precision, 89.7% recall, 87.6% F1-score, 80% specificity, 70.3% Matthews correlation coefficient, 70.2% Cohen’s kappa score, and 91% area under the receiver operating characteristic curve with 76-ms execution time. In inter-channel comparison, the best results were obtained at the F8 electrode position in the right FC of the brain. The significance of all the results was validated with a p-value of less than 0.05 using statistical hypothesis testing methods.Conclusions: The proposed scheme has achieved better results for driving drowsiness detection with the accomplishment of multiple objectives. The predictor importance approach has reduced the feature extraction cost and computational complexity is minimized with the use of conventional machine learning classifiers resulting in low-cost hardware and software requirements. The channel selection approach has spatially localized the most promising brain region for drowsiness detection with only a single EEG channel (F8) which reduces the physical intrusiveness in normal driving operation. This pBCI scheme has a good potential for practical applications requiring earlier, more accurate, and less disruptive drowsiness detection using the spectral information of EEG biosignals.
Collapse
Affiliation(s)
- Saad Arif
- Department of Mechanical Engineering, HITEC University Taxila, Taxila Cantt, Pakistan
| | - Saba Munawar
- Department of Electrical and Computer Engineering, COMSATS University Islamabad, Wah Campus, Wah Cantt, Pakistan
| | - Hashim Ali
- Department of Computer Science, School of Engineering and Digital Sciences, Nazarbayev University, Astana, Kazakhstan
- *Correspondence: Hashim Ali,
| |
Collapse
|
16
|
Huang X, Shirahama K, Irshad MT, Nisar MA, Piet A, Grzegorzek M. Sleep Stage Classification in Children Using Self-Attention and Gaussian Noise Data Augmentation. SENSORS (BASEL, SWITZERLAND) 2023; 23:3446. [PMID: 37050506 PMCID: PMC10098613 DOI: 10.3390/s23073446] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 02/27/2023] [Revised: 03/20/2023] [Accepted: 03/22/2023] [Indexed: 06/19/2023]
Abstract
The analysis of sleep stages for children plays an important role in early diagnosis and treatment. This paper introduces our sleep stage classification method addressing the following two challenges: the first is the data imbalance problem, i.e., the highly skewed class distribution with underrepresented minority classes. For this, a Gaussian Noise Data Augmentation (GNDA) algorithm was applied to polysomnography recordings to seek the balance of data sizes for different sleep stages. The second challenge is the difficulty in identifying a minority class of sleep stages, given their short sleep duration and similarities to other stages in terms of EEG characteristics. To overcome this, we developed a DeConvolution- and Self-Attention-based Model (DCSAM) which can inverse the feature map of a hidden layer to the input space to extract local features and extract the correlations between all possible pairs of features to distinguish sleep stages. The results on our dataset show that DCSAM based on GNDA obtains an accuracy of 90.26% and a macro F1-score of 86.51% which are higher than those of our previous method. We also tested DCSAM on a well-known public dataset-Sleep-EDFX-to prove whether it is applicable to sleep data from adults. It achieves a comparable performance to state-of-the-art methods, especially accuracies of 91.77%, 92.54%, 94.73%, and 95.30% for six-stage, five-stage, four-stage, and three-stage classification, respectively. These results imply that our DCSAM based on GNDA has a great potential to offer performance improvements in various medical domains by considering the data imbalance problems and correlations among features in time series data.
Collapse
Affiliation(s)
- Xinyu Huang
- Institute of Medical Informatics, University of Lübeck, Ratzeburger Allee 160, 23562 Lübeck, Germany
| | - Kimiaki Shirahama
- Department of Informatics, Kindai University, 3-4-1 Kowakae, Higashiosaka City 577-8502, Osaka, Japan
| | - Muhammad Tausif Irshad
- Institute of Medical Informatics, University of Lübeck, Ratzeburger Allee 160, 23562 Lübeck, Germany
- Department of IT, University of the Punjab, Lahore 54000, Pakistan
| | | | - Artur Piet
- Institute of Medical Informatics, University of Lübeck, Ratzeburger Allee 160, 23562 Lübeck, Germany
| | - Marcin Grzegorzek
- Institute of Medical Informatics, University of Lübeck, Ratzeburger Allee 160, 23562 Lübeck, Germany
- Department of Knowledge Engineering, University of Economics, Bogucicka 3, 40287 Katowice, Poland
| |
Collapse
|
17
|
Fiorillo L, Monachino G, van der Meer J, Pesce M, Warncke JD, Schmidt MH, Bassetti CLA, Tzovara A, Favaro P, Faraci FD. U-Sleep's resilience to AASM guidelines. NPJ Digit Med 2023; 6:33. [PMID: 36878957 PMCID: PMC9988983 DOI: 10.1038/s41746-023-00784-0] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/21/2022] [Accepted: 02/21/2023] [Indexed: 03/08/2023] Open
Abstract
AASM guidelines are the result of decades of efforts aiming at standardizing sleep scoring procedure, with the final goal of sharing a worldwide common methodology. The guidelines cover several aspects from the technical/digital specifications, e.g., recommended EEG derivations, to detailed sleep scoring rules accordingly to age. Automated sleep scoring systems have always largely exploited the standards as fundamental guidelines. In this context, deep learning has demonstrated better performance compared to classical machine learning. Our present work shows that a deep learning-based sleep scoring algorithm may not need to fully exploit the clinical knowledge or to strictly adhere to the AASM guidelines. Specifically, we demonstrate that U-Sleep, a state-of-the-art sleep scoring algorithm, can be strong enough to solve the scoring task even using clinically non-recommended or non-conventional derivations, and with no need to exploit information about the chronological age of the subjects. We finally strengthen a well-known finding that using data from multiple data centers always results in a better performing model compared with training on a single cohort. Indeed, we show that this latter statement is still valid even by increasing the size and the heterogeneity of the single data cohort. In all our experiments we used 28528 polysomnography studies from 13 different clinical studies.
Collapse
Affiliation(s)
- Luigi Fiorillo
- Institute of Informatics, University of Bern, Bern, Switzerland.
- Institute of Digital Technologies for Personalized Healthcare ∣ MeDiTech, Department of Innovative Technologies, University of Applied Sciences and Arts of Southern Switzerland, Lugano, Switzerland.
| | - Giuliana Monachino
- Institute of Informatics, University of Bern, Bern, Switzerland
- Institute of Digital Technologies for Personalized Healthcare ∣ MeDiTech, Department of Innovative Technologies, University of Applied Sciences and Arts of Southern Switzerland, Lugano, Switzerland
| | - Julia van der Meer
- Sleep Wake Epilepsy Center ∣ NeuroTec, Department of Neurology, Inselspital, Bern University Hospital, University of Bern, Bern, Switzerland
| | - Marco Pesce
- Sleep Wake Epilepsy Center ∣ NeuroTec, Department of Neurology, Inselspital, Bern University Hospital, University of Bern, Bern, Switzerland
| | - Jan D Warncke
- Sleep Wake Epilepsy Center ∣ NeuroTec, Department of Neurology, Inselspital, Bern University Hospital, University of Bern, Bern, Switzerland
| | - Markus H Schmidt
- Sleep Wake Epilepsy Center ∣ NeuroTec, Department of Neurology, Inselspital, Bern University Hospital, University of Bern, Bern, Switzerland
| | - Claudio L A Bassetti
- Sleep Wake Epilepsy Center ∣ NeuroTec, Department of Neurology, Inselspital, Bern University Hospital, University of Bern, Bern, Switzerland
| | - Athina Tzovara
- Institute of Informatics, University of Bern, Bern, Switzerland
- Sleep Wake Epilepsy Center ∣ NeuroTec, Department of Neurology, Inselspital, Bern University Hospital, University of Bern, Bern, Switzerland
| | - Paolo Favaro
- Institute of Informatics, University of Bern, Bern, Switzerland
| | - Francesca D Faraci
- Institute of Digital Technologies for Personalized Healthcare ∣ MeDiTech, Department of Innovative Technologies, University of Applied Sciences and Arts of Southern Switzerland, Lugano, Switzerland
| |
Collapse
|
18
|
Al-Salman W, Li Y, Oudah AY, Almaged S. Sleep stage classification in EEG signals using the clustering approach based probability distribution features coupled with classification algorithms. Neurosci Res 2023; 188:51-67. [PMID: 36152918 DOI: 10.1016/j.neures.2022.09.009] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/11/2022] [Revised: 08/20/2022] [Accepted: 09/20/2022] [Indexed: 10/14/2022]
Abstract
Sleep scoring is one of the primary tasks for the classification of sleep stages in Electroencephalogram (EEG) signals. Manual visual scoring of sleep stages is time-consuming as well as being dependent on the experience of a highly qualified sleep expert. This paper aims to address these issues by developing a new method to automatically classify sleep stages in EEG signals. In this research, a robust method has been presented based on the clustering approach, coupled with probability distribution features, to identify six sleep stages with the use of EEG signals. Using this method, each 30-second EEG signal is firstly segmented into small epochs and then each epoch is divided into 60 sub-segments. Each sub-segment is decomposed into five levels by using a discrete wavelet transform (DWT) to obtain the approximation and detailed coefficient. The wavelet coefficient of each level is clustered using the k-means algorithm. Subsequently, features are extracted based on the probability distribution for each wavelet coefficient. The extracted features then are forwarded to the least squares support vector machine classifier (LS-SVM) to identify sleep stages. Comparisons with several existing methods are also made in this study. The proposed method for the classification of the sleep stages achieves an average accuracy rate of 97.4%. It can be an effective tool for sleep stages classification and can be useful for doctors and neurologists for diagnosing sleep disorders.
Collapse
Affiliation(s)
- Wessam Al-Salman
- School of Mathematics, Physics and Computing, University of Southern Queensland, Australia; University of Thi-Qar, College of Education for Pure Science, Iraq.
| | - Yan Li
- School of Mathematics, Physics and Computing, University of Southern Queensland, Australia; School of Electrical and Electronic Engineering, Hubei University of Technology, Wuhan, China
| | - Atheer Y Oudah
- University of Thi-Qar, College of Education for Pure Science, Iraq; Information and Communication Technology Research Group, Scientific Research Centre, Al-Ayen University, Thi-Qar, Iraq
| | | |
Collapse
|
19
|
Plucińska R, Jędrzejewski K, Malinowska U, Rogala J. Leveraging Multiple Distinct EEG Training Sessions for Improvement of Spectral-Based Biometric Verification Results. SENSORS (BASEL, SWITZERLAND) 2023; 23:2057. [PMID: 36850654 PMCID: PMC9963573 DOI: 10.3390/s23042057] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 01/16/2023] [Revised: 02/07/2023] [Accepted: 02/08/2023] [Indexed: 06/18/2023]
Abstract
Most studies on EEG-based biometry recognition report results based on signal databases, with a limited number of recorded EEG sessions using the same single EEG recording for both training and testing a proposed model. However, the EEG signal is highly vulnerable to interferences, electrode placement, and temporary conditions, which can lead to overestimated assessments of the considered methods. Our study examined how different numbers of distinct recording sessions used as training sessions would affect EEG-based verification. We analyzed the original data from 29 participants with 20 distinct recorded sessions each, as well as 23 additional impostors with only one session each. We applied raw coefficients of power spectral density estimate, and the coefficients of power spectral density estimate converted to the decibel scale, as the input to a shallow neural network. Our study showed that the variance introduced by multiple recording sessions affects sensitivity. We also showed that increasing the number of sessions above eight did not improve the results under our conditions. For 15 training sessions, the achieved accuracy was 96.7 ± 4.2%, and for eight training sessions and 12 test sessions, it was 94.9 ± 4.6%. For 15 training sessions, the rate of successful impostor attacks over all attack attempts was 3.1 ± 2.2%, but this number was not significantly different from using six recording sessions for training. Our findings indicate the need to include data from multiple recording sessions in EEG-based recognition for training, and that increasing the number of test sessions did not significantly affect the obtained results. Although the presented results are for the resting-state, they may serve as a baseline for other paradigms.
Collapse
Affiliation(s)
- Renata Plucińska
- Institute of Electronic Systems, Faculty of Electronics and Information Technology, Warsaw University of Technology, 00-665 Warsaw, Poland
| | - Konrad Jędrzejewski
- Institute of Electronic Systems, Faculty of Electronics and Information Technology, Warsaw University of Technology, 00-665 Warsaw, Poland
| | - Urszula Malinowska
- Institute of Experimental Physics, Faculty of Physics, University of Warsaw, 02-093 Warsaw, Poland
| | - Jacek Rogala
- Institute of Experimental Physics, Faculty of Physics, University of Warsaw, 02-093 Warsaw, Poland
| |
Collapse
|
20
|
Zhu F, Wang H, Li L, Bragin A, Cao D, Cheng Y. Intracranial electrophysiological recordings on a swine model of mesial temporal lobe epilepsy. Front Neurol 2023; 14:1077702. [PMID: 37139062 PMCID: PMC10150775 DOI: 10.3389/fneur.2023.1077702] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/27/2022] [Accepted: 03/20/2023] [Indexed: 05/05/2023] Open
Abstract
Objective To test the feasibility and reliability of intracranial electrophysiological recordings in an acute status epilepticus model on laboratory swine. Method Intrahippocampal injection of kainic acid (KA) was performed on 17 male Bama pigs (Sus scrofa domestica) weighing between 25 and 35 kg. Two stereoelectroencephalography (SEEG) electrodes with a total of 16 channels were implanted bilaterally along the sensorimotor cortex to the hippocampus. Brain electrical activity was recorded 2 h daily for 9-28 days. Three KA dosages were tested to evaluate the quantities capable of evoking status epilepticus. Local field potentials (LFPs) were recorded and compared before and after the KA injection. We quantified the epileptic patterns, including the interictal spikes, seizures, and high-frequency oscillations (HFOs), up to 4 weeks after the KA injection. Test-retest reliability using intraclass correlation coefficients (ICCs) were performed on interictal HFO rates to evaluate the recording stability of this model. Results The KA dosage test suggested that a 10 μl (1.0 μg/μl) intrahippocampal injection could successfully evoke status epilepticus lasting from 4 to 12 h. At this dosage, eight pigs (50% of total) had prolonged epileptic events (tonic-chronic seizures + interictal spikes n = 5, interictal spikes alone n = 3) in the later 4 weeks of the video-SEEG recording period. Four pigs (25% of total) had no epileptic activities, and another four (25%) had lost the cap or did not complete the experiments. Animals that showed epileptiform events were grouped as E + (n = 8) and the four animals showing no signs of epileptic events were grouped as E- (n = 4). A total of 46 electrophysiological seizures were captured in the 4-week post-KA period from 4 E + animals, with the earliest onset on day 9. The seizure durations ranged from 12 to 45 s. A significant increase of hippocampal HFOs rate (num/min) was observed in the E+ group during the post-KA period (weeks 1, 2,4, p < 0.05) compared to the baseline. But the E-showed no change or a decrease (in week 2, p = 0.43) compared to their baseline rate. The between-group comparison showed much higher HFO rates in E + vs. E - (F = 35, p < 0.01). The high ICC value [ICC (1, k) = 0.81, p < 0.05] quantified from the HFO rate suggested that this model had a stable measurement of HFOs during the four-week post-KA periods. Significance This study measured intracranial electrophysiological activity in a swine model of KA-induced mesial temporal lobe epilepsy (mTLE). Using the clinical SEEG electrode, we distinguished abnormal EEG patterns in the swine brain. The high test-retest reliability of HFO rates in the post-KA period suggests the utility of this model for studying mechanisms of epileptogenesis. The use of swine may provide satisfactory translational value for clinical epilepsy research.
Collapse
Affiliation(s)
- Fengjun Zhu
- Department of Neurosurgery, Shenzhen Children’s Hospital, Shenzhen, Guangdong, China
- Department of Neurosurgery, Second Affiliated Hospital of Chongqing Medical University, Chongqing, China
- Department of Neurology, University of California Los Angeles, Los Angeles, CA, United States
| | - Hanwen Wang
- Department of Neurology, University of California Los Angeles, Los Angeles, CA, United States
| | - Lin Li
- Department of Neurology, University of California Los Angeles, Los Angeles, CA, United States
- Department of Biomedical Engineering, University of North Texas, Denton, TX, United States
| | - Anatol Bragin
- Department of Neurology, University of California Los Angeles, Los Angeles, CA, United States
| | - Dezhi Cao
- Department of Neurosurgery, Shenzhen Children’s Hospital, Shenzhen, Guangdong, China
- *Correspondence: Dezhi Cao,
| | - Yuan Cheng
- Department of Neurosurgery, Second Affiliated Hospital of Chongqing Medical University, Chongqing, China
- Yuan Cheng,
| |
Collapse
|
21
|
A comprehensive evaluation of contemporary methods used for automatic sleep staging. Biomed Signal Process Control 2022. [DOI: 10.1016/j.bspc.2022.103819] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/21/2022]
|
22
|
Hsieh JC, Li Y, Wang H, Perz M, Tang Q, Tang KWK, Pyatnitskiy I, Reyes R, Ding H, Wang H. Design of hydrogel-based wearable EEG electrodes for medical applications. J Mater Chem B 2022; 10:7260-7280. [PMID: 35678148 DOI: 10.1039/d2tb00618a] [Citation(s) in RCA: 12] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/15/2022]
Abstract
The electroencephalogram (EEG) is considered to be a promising method for studying brain disorders. Because of its non-invasive nature, subjects take a lower risk compared to some other invasive methods, while the systems record the brain signal. With the technological advancement of neural and material engineering, we are in the process of achieving continuous monitoring of neural activity through wearable EEG. In this article, we first give a brief introduction to EEG bands, circuits, wired/wireless EEG systems, and analysis algorithms. Then, we review the most recent advances in the interfaces used for EEG recordings, focusing on hydrogel-based EEG electrodes. Specifically, the advances for important figures of merit for EEG electrodes are reviewed. Finally, we summarize the potential medical application of wearable EEG systems.
Collapse
Affiliation(s)
- Ju-Chun Hsieh
- Department of Biomedical Engineering, The University of Texas at Austin, Austin, TX 78712, USA.
| | - Yang Li
- Department of Chemical Engineering, Polytechnique Montréal, Montréal, Québec H3C3J7, Canada
| | - Huiqian Wang
- Department of Mathematics, The University of Texas at Austin, Austin, TX 78712, USA
| | - Matt Perz
- Department of Biomedical Engineering, The University of Texas at Austin, Austin, TX 78712, USA.
| | - Qiong Tang
- Department of Aerospace Engineering and Engineering Mechanics, The University of Texas at Austin, Austin, TX 78712, USA
| | - Kai Wing Kevin Tang
- Department of Biomedical Engineering, The University of Texas at Austin, Austin, TX 78712, USA.
| | - Ilya Pyatnitskiy
- Department of Biomedical Engineering, The University of Texas at Austin, Austin, TX 78712, USA.
| | - Raymond Reyes
- Department of Biomedical Engineering, The University of Texas at Austin, Austin, TX 78712, USA.
| | - Hong Ding
- Department of Biomedical Engineering, The University of Texas at Austin, Austin, TX 78712, USA.
| | - Huiliang Wang
- Department of Biomedical Engineering, The University of Texas at Austin, Austin, TX 78712, USA.
| |
Collapse
|
23
|
A Holistic Strategy for Classification of Sleep Stages with EEG. SENSORS 2022; 22:s22093557. [PMID: 35591246 PMCID: PMC9103466 DOI: 10.3390/s22093557] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/11/2022] [Revised: 05/03/2022] [Accepted: 05/05/2022] [Indexed: 02/01/2023]
Abstract
Manual sleep stage scoring is usually implemented with the help of sleep specialists by means of visual inspection of the neurophysiological signals of the patient. As it is a very hectic task to perform, automated sleep stage classification systems were developed in the past, and advancements are being made consistently by researchers. The various stages of sleep are identified by these automated sleep stage classification systems, and it is quite an important step to assist doctors for the diagnosis of sleep-related disorders. In this work, a holistic strategy named as clustering and dimensionality reduction with feature extraction cum selection for classification along with deep learning (CDFCD) is proposed for the classification of sleep stages with EEG signals. Though the methodology follows a similar structural flow as proposed in the past works, many advanced and novel techniques are proposed under each category in this work flow. Initially, clustering is applied with the help of hierarchical clustering, spectral clustering, and the proposed principal component analysis (PCA)-based subspace clustering. Then the dimensionality of it is reduced with the help of the proposed singular value decomposition (SVD)-based spectral algorithm and the standard variational Bayesian matrix factorization (VBMF) technique. Then the features are extracted and selected with the two novel proposed techniques, such as the sparse group lasso technique with dual-level implementation (SGL-DLI) and the ridge regression technique with limiting weight scheme (RR-LWS). Finally, the classification happens with the less explored multiclass Gaussian process classification (MGC), the proposed random arbitrary collective classification (RACC), and the deep learning technique using long short-term memory (LSTM) along with other conventional machine learning techniques. This methodology is validated on the sleep EDF database, and the results obtained with this methodology have surpassed the results of the previous studies in terms of the obtained classification accuracy reporting a high accuracy of 93.51% even for the six-classes classification problem.
Collapse
|
24
|
Adversarial learning for semi-supervised pediatric sleep staging with single-EEG channel. Methods 2022; 204:84-91. [DOI: 10.1016/j.ymeth.2022.03.013] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/21/2022] [Revised: 03/12/2022] [Accepted: 03/21/2022] [Indexed: 11/18/2022] Open
|
25
|
Evaluation of a Single-Channel EEG-Based Sleep Staging Algorithm. INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH 2022; 19:ijerph19052845. [PMID: 35270548 PMCID: PMC8910622 DOI: 10.3390/ijerph19052845] [Citation(s) in RCA: 10] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 11/23/2021] [Revised: 02/06/2022] [Accepted: 02/22/2022] [Indexed: 12/17/2022]
Abstract
Sleep staging is the basis of sleep assessment and plays a crucial role in the early diagnosis and intervention of sleep disorders. Manual sleep staging by a specialist is time-consuming and is influenced by subjective factors. Moreover, some automatic sleep staging algorithms are complex and inaccurate. The paper proposes a single-channel EEG-based sleep staging method that provides reliable technical support for diagnosing sleep problems. In this study, 59 features were extracted from three aspects: time domain, frequency domain, and nonlinear indexes based on single-channel EEG data. Support vector machine, neural network, decision tree, and random forest classifier were used to classify sleep stages automatically. The results reveal that the random forest classifier has the best sleep staging performance among the four algorithms. The recognition rate of the Wake phase was the highest, at 92.13%, and that of the N1 phase was the lowest, at 73.46%, with an average accuracy of 83.61%. The embedded method was adopted for feature filtering. The results of sleep staging of the 11-dimensional features after filtering show that the random forest model achieved 83.51% staging accuracy under the condition of reduced feature dimensions, and the coincidence rate with the use of all features for sleep staging was 94.85%. Our study confirms the robustness of the random forest model in sleep staging, which also represents a high classification accuracy with appropriate classifier algorithms, even using single-channel EEG data. This study provides a new direction for the portability of clinical EEG monitoring.
Collapse
|
26
|
Robust learning from corrupted EEG with dynamic spatial filtering. Neuroimage 2022; 251:118994. [PMID: 35181552 DOI: 10.1016/j.neuroimage.2022.118994] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/29/2021] [Revised: 02/03/2022] [Accepted: 02/11/2022] [Indexed: 11/20/2022] Open
Abstract
Building machine learning models using EEG recorded outside of the laboratory setting requires methods robust to noisy data and randomly missing channels. This need is particularly great when working with sparse EEG montages (1-6 channels), often encountered in consumer-grade or mobile EEG devices. Neither classical machine learning models nor deep neural networks trained end-to-end on EEG are typically designed or tested for robustness to corruption, and especially to randomly missing channels. While some studies have proposed strategies for using data with missing channels, these approaches are not practical when sparse montages are used and computing power is limited (e.g., wearables, cell phones). To tackle this problem, we propose dynamic spatial filtering (DSF), a multi-head attention module that can be plugged in before the first layer of a neural network to handle missing EEG channels by learning to focus on good channels and to ignore bad ones. We tested DSF on public EEG data encompassing ∼4,000 recordings with simulated channel corruption and on a private dataset of ∼100 at-home recordings of mobile EEG with natural corruption. Our proposed approach achieves the same performance as baseline models when no noise is applied, but outperforms baselines by as much as 29.4% accuracy when significant channel corruption is present. Moreover, DSF outputs are interpretable, making it possible to monitor the effective channel importance in real-time. This approach has the potential to enable the analysis of EEG in challenging settings where channel corruption hampers the reading of brain signals.
Collapse
|
27
|
Abstract
Autonomous vehicles (AVs) enable drivers to devote their primary attention to non-driving-related tasks (NDRTs). Consequently, AVs must provide intelligibility services appropriate to drivers’ in-situ states and in-car activities to ensure driver safety, and accounting for the type of NDRT being performed can result in higher intelligibility. We discovered that sleeping is drivers’ most preferred NDRT, and this could also result in a critical scenario when a take-over request (TOR) occurs. In this study, we designed TOR situations where drivers are woken from sleep in a high-fidelity AV simulator with motion systems, aiming to examine how drivers react to a TOR provided with our experimental conditions. We investigated how driving performance, perceived task workload, AV acceptance, and physiological responses in a TOR vary according to two factors: (1) feedforward timings and (2) presentation modalities. The results showed that when awakened by a TOR alert delivered >10 s prior to an event, drivers were more focused on the driving context and were unlikely to be influenced by TOR modality, whereas TOR alerts delivered <5 s prior needed a visual accompaniment to quickly inform drivers of on-road situations. This study furthers understanding of how a driver’s cognitive and physical demands interact with TOR situations at the moment of waking from sleep and designs effective interventions for intelligibility services to best comply with safety and driver experience in AVs.
Collapse
|
28
|
Eni M, Mordoh V, Zigel Y. Cough detection using a non-contact microphone: A nocturnal cough study. PLoS One 2022; 17:e0262240. [PMID: 35045111 PMCID: PMC8769326 DOI: 10.1371/journal.pone.0262240] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/29/2021] [Accepted: 12/19/2021] [Indexed: 11/19/2022] Open
Abstract
An automatic non-contact cough detector designed especially for night audio recordings that can distinguish coughs from snores and other sounds is presented. Two different classifiers were implemented and tested: a Gaussian Mixture Model (GMM) and a Deep Neural Network (DNN). The detected coughs were analyzed and compared in different sleep stages and in terms of severity of Obstructive Sleep Apnea (OSA), along with age, Body Mass Index (BMI), and gender. The database was composed of nocturnal audio signals from 89 subjects recorded during a polysomnography study. The DNN-based system outperformed the GMM-based system, at 99.8% accuracy, with a sensitivity and specificity of 86.1% and 99.9%, respectively (Positive Predictive Value (PPV) of 78.4%). Cough events were significantly more frequent during wakefulness than in the sleep stages (p < 0.0001) and were significantly less frequent during deep sleep than in other sleep stages (p < 0.0001). A positive correlation was found between BMI and the number of nocturnal coughs (R = 0.232, p < 0.05), and between the number of nocturnal coughs and OSA severity in men (R = 0.278, p < 0.05). This non-contact cough detection system may thus be implemented to track the progression of respiratory illnesses and test reactions to different medications even at night when a contact sensor is uncomfortable or infeasible.
Collapse
Affiliation(s)
- Marina Eni
- Department of Biomedical Engineering, Ben-Gurion University of the Negev, Beer-Sheva, Israel
- * E-mail:
| | - Valeria Mordoh
- Department of Biomedical Engineering, Ben-Gurion University of the Negev, Beer-Sheva, Israel
| | - Yaniv Zigel
- Department of Biomedical Engineering, Ben-Gurion University of the Negev, Beer-Sheva, Israel
| |
Collapse
|
29
|
Tuncer T, Dogan S, Baygin M, Rajendra Acharya U. Tetromino pattern based accurate EEG emotion classification model. Artif Intell Med 2022; 123:102210. [PMID: 34998511 DOI: 10.1016/j.artmed.2021.102210] [Citation(s) in RCA: 23] [Impact Index Per Article: 11.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/12/2021] [Revised: 10/31/2021] [Accepted: 11/01/2021] [Indexed: 11/17/2022]
Abstract
Nowadays, emotion recognition using electroencephalogram (EEG) signals is becoming a hot research topic. The aim of this paper is to classify emotions of EEG signals using a novel game-based feature generation function with high accuracy. Hence, a multileveled handcrafted feature generation automated emotion classification model using EEG signals is presented. A novel textural features generation method inspired by the Tetris game called Tetromino is proposed in this work. The Tetris game is one of the famous games worldwide, which uses various characters in the game. First, the EEG signals are subjected to discrete wavelet transform (DWT) to create various decomposition levels. Then, novel features are generated from the decomposed DWT sub-bands using the Tetromino method. Next, the maximum relevance minimum redundancy (mRMR) features selection method is utilized to select the most discriminative features, and the selected features are classified using support vector machine classifier. Finally, each channel's results (validation predictions) are obtained, and the mode function-based voting method is used to obtain the general results. We have validated our developed model using three databases (DREAMER, GAMEEMO, and DEAP). We have attained 100% accuracies using DREAMER and GAMEEMO datasets. Furthermore, over 99% of classification accuracy is achieved for DEAP dataset. Thus, our developed emotion detection model has yielded the best classification accuracy rate compared to the state-of-the-art techniques and is ready to be tested for clinical application after validating with more diverse datasets. Our results show the success of the presented Tetromino pattern-based EEG signal classification model validated using three public emotional EEG datasets.
Collapse
Affiliation(s)
- Turker Tuncer
- Department of Digital Forensics Engineering, College of Technology, Firat University, Elazig, Turkey.
| | - Sengul Dogan
- Department of Digital Forensics Engineering, College of Technology, Firat University, Elazig, Turkey
| | - Mehmet Baygin
- Department of Computer Engineering, Faculty of Engineering, Ardahan University, Ardahan, Turkey
| | - U Rajendra Acharya
- Ngee Ann Polytechnic, Department of Electronics and Computer Engineering, 599489, Singapore; Department of Biomedical Engineering, School of Science and Technology, SUSS University, Singapore; Department of Biomedical Informatics and Medical Engineering, Asia University, Taichung, Taiwan
| |
Collapse
|
30
|
Zhang H, Wang X, Li H, Mehendale S, Guan Y. Auto-annotating sleep stages based on polysomnographic data. PATTERNS 2022; 3:100371. [PMID: 35079710 PMCID: PMC8767308 DOI: 10.1016/j.patter.2021.100371] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/21/2021] [Revised: 07/15/2021] [Accepted: 09/28/2021] [Indexed: 11/25/2022]
Abstract
Sleep disorders affect the quality of life, and the clinical diagnosis of sleep disorders is a time-consuming and tedious process requiring recording and annotating polysomnographic records. In this work, we developed an auto-annotation algorithm based on polysomnographic records and a deep learning architecture that predicts sleep stages at the millisecond level. The model improves the efficiency of the polysomnographic record annotation process by automatically annotating each record within 3.8 s of computation time and with high accuracy. Disease-related sleep stages, such as arousal and apnea, can also be identified by this model, which further expands the physiological insights that the model can potentially provide. Finally, we explored the applicability of the model to data collected from a different modality to demonstrate the robustness of the model. Polysomnography enables accurate annotation of sleeping stages by machine learning Apnea/arousal can be more accurately detected by full polysomnography than EEG U-net achieved excellent performance in sequence-to-sequence prediction Our deep learning model achieves human-level accuracy in sleep status annotations
Sleep quality is one of the top public health concerns. Disturbance during sleep will affect peoples' daily executive functions. In addition, some pathological sleeping conditions, such as arousal and apnea, are closely associated with severe health conditions such as cardiovascular diseases. Traditional sleeping surveillance requires laborious human effort while maintaining a limited reproducibility. In this study, we present a fast automatic sleep annotation deep learning model with excellent performances. Our model can annotate sleeping stages as well as sleeping arousal/apnea at the same time, which provides insight for clinical diagnosis of sleeping patients.
Collapse
|
31
|
Covering the Gap Between Sleep and Cognition – Mechanisms and Clinical Examples. ADVANCES IN EXPERIMENTAL MEDICINE AND BIOLOGY 2022; 1384:17-29. [PMID: 36217076 DOI: 10.1007/978-3-031-06413-5_2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/18/2022]
Abstract
A growing number of studies have shown the strong relationship between sleep and different cognitive processes, especially those that involve memory consolidation. Traditionally, these processes were attributed to mechanisms related to the macroarchitecture of sleep, as sleep cycles or the duration of specific stages, such as the REM stage. More recently, the relationship between different cognitive traits and specific waves (sleep spindles or slow oscillations) has been studied. We here present the most important physiological processes induced by sleep, with particular focus on brain electrophysiology. In addition, recent and classical literature were reviewed to cover the gap between sleep and cognition, while illustrating this relationship by means of clinical examples. Finally, we propose that future studies may focus not only on analyzing specific waves, but also on the relationship between their characteristics as potential biomarkers for multiple diseases.
Collapse
|
32
|
Mohammadi E, Makkiabadi B, Shamsollahi MB, Reisi P, Kermani S. Wavelet-Based Biphase Analysis of Brain Rhythms in Automated Wake-Sleep Classification. Int J Neural Syst 2021; 32:2250004. [PMID: 34967704 DOI: 10.1142/s0129065722500046] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022]
Abstract
Many studies in the field of sleep have focused on connectivity and coherence. Still, the nonstationary nature of electroencephalography (EEG) makes many of the previous methods unsuitable for automatic sleep detection. Time-frequency representations and high-order spectra are applied to nonstationary signal analysis and nonlinearity investigation, respectively. Therefore, combining wavelet and bispectrum, wavelet-based bi-phase (Wbiph) was proposed and used as a novel feature for sleep-wake classification. The results of the statistical analysis with emphasis on the importance of the gamma rhythm in sleep detection show that the Wbiph is more potent than coherence in the wake-sleep classification. The Wbiph has not been used in sleep studies before. However, the results and inherent advantages, such as the use of wavelet and bispectrum in its definition, suggest it as an excellent alternative to coherence. In the next part of this paper, a convolutional neural network (CNN) classifier was applied for the sleep-wake classification by Wbiph. The classification accuracy was 97.17% in nonLOSO and 95.48% in LOSO cross-validation, which is the best among previous studies on sleep-wake classification.
Collapse
Affiliation(s)
- Ehsan Mohammadi
- Department of Bioelectrics and Biomedical Engineering, School of Advanced Technologies in Medicine, Isfahan, University of Medical Sciences, Isfahan, Iran
| | - Bahador Makkiabadi
- Department of Medical Physics and Biomedical Engineering, School of Medicine, Tehran University of Medical, Sciences, Tehran, Iran
| | - Mohammad Bagher Shamsollahi
- Biomedical Signal and Image Processing Laboratory, Department of Electrical Engineering, Sharif University of Technology, Tehran, Iran
| | - Parham Reisi
- Department of Physiology, School of Medicine, Isfahan University of Medical Sciences, Isfahan, Iran
| | - Saeed Kermani
- Department of Bioelectrics and Biomedical Engineering, School of Advanced Technologies in Medicine, Isfahan, University of Medical Sciences, Isfahan, Iran
| |
Collapse
|
33
|
Prognosis of automated sleep staging based on two-layer ensemble learning stacking model using single-channel EEG signal. Soft comput 2021. [DOI: 10.1007/s00500-021-06218-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/20/2022]
|
34
|
Saeidi M, Karwowski W, Farahani FV, Fiok K, Taiar R, Hancock PA, Al-Juaid A. Neural Decoding of EEG Signals with Machine Learning: A Systematic Review. Brain Sci 2021; 11:1525. [PMID: 34827524 PMCID: PMC8615531 DOI: 10.3390/brainsci11111525] [Citation(s) in RCA: 44] [Impact Index Per Article: 14.7] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/01/2021] [Revised: 11/04/2021] [Accepted: 11/11/2021] [Indexed: 11/16/2022] Open
Abstract
Electroencephalography (EEG) is a non-invasive technique used to record the brain's evoked and induced electrical activity from the scalp. Artificial intelligence, particularly machine learning (ML) and deep learning (DL) algorithms, are increasingly being applied to EEG data for pattern analysis, group membership classification, and brain-computer interface purposes. This study aimed to systematically review recent advances in ML and DL supervised models for decoding and classifying EEG signals. Moreover, this article provides a comprehensive review of the state-of-the-art techniques used for EEG signal preprocessing and feature extraction. To this end, several academic databases were searched to explore relevant studies from the year 2000 to the present. Our results showed that the application of ML and DL in both mental workload and motor imagery tasks has received substantial attention in recent years. A total of 75% of DL studies applied convolutional neural networks with various learning algorithms, and 36% of ML studies achieved competitive accuracy by using a support vector machine algorithm. Wavelet transform was found to be the most common feature extraction method used for all types of tasks. We further examined the specific feature extraction methods and end classifier recommendations discovered in this systematic review.
Collapse
Affiliation(s)
- Maham Saeidi
- Computational Neuroergonomics Laboratory, Department of Industrial Engineering and Management Systems, University of Central Florida, Orlando, FL 32816, USA; (F.V.F.); (K.F.)
| | - Waldemar Karwowski
- Computational Neuroergonomics Laboratory, Department of Industrial Engineering and Management Systems, University of Central Florida, Orlando, FL 32816, USA; (F.V.F.); (K.F.)
| | - Farzad V. Farahani
- Computational Neuroergonomics Laboratory, Department of Industrial Engineering and Management Systems, University of Central Florida, Orlando, FL 32816, USA; (F.V.F.); (K.F.)
- Department of Biostatistics, Johns Hopkins University, Baltimore, MD 21218, USA
| | - Krzysztof Fiok
- Computational Neuroergonomics Laboratory, Department of Industrial Engineering and Management Systems, University of Central Florida, Orlando, FL 32816, USA; (F.V.F.); (K.F.)
| | - Redha Taiar
- MATIM, Moulin de la Housse, Université de Reims Champagne Ardenne, CEDEX 02, 51687 Reims, France;
| | - P. A. Hancock
- Department of Psychology, University of Central Florida, Orlando, FL 32816, USA;
| | - Awad Al-Juaid
- Industrial Engineering Department, Taif University, Taif 26571, Saudi Arabia;
| |
Collapse
|
35
|
da Silva Souto CF, Pätzold W, Wolf KI, Paul M, Matthiesen I, Bleichner MG, Debener S. Flex-Printed Ear-EEG Sensors for Adequate Sleep Staging at Home. Front Digit Health 2021; 3:688122. [PMID: 34713159 PMCID: PMC8522006 DOI: 10.3389/fdgth.2021.688122] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/30/2021] [Accepted: 06/01/2021] [Indexed: 12/03/2022] Open
Abstract
A comfortable, discrete and robust recording of the sleep EEG signal at home is a desirable goal but has been difficult to achieve. We investigate how well flex-printed electrodes are suitable for sleep monitoring tasks in a smartphone-based home environment. The cEEGrid ear-EEG sensor has already been tested in the laboratory for measuring night sleep. Here, 10 participants slept at home and were equipped with a cEEGrid and a portable amplifier (mBrainTrain, Serbia). In addition, the EEG of Fpz, EOG_L and EOG_R was recorded. All signals were recorded wirelessly with a smartphone. On average, each participant provided data for M = 7.48 h. An expert sleep scorer created hypnograms and annotated grapho-elements according to AASM based on the EEG of Fpz, EOG_L and EOG_R twice, which served as the baseline agreement for further comparisons. The expert scorer also created hypnograms using bipolar channels based on combinations of cEEGrid channels only, and bipolar cEEGrid channels complemented by EOG channels. A comparison of the hypnograms based on frontal electrodes with the ones based on cEEGrid electrodes (κ = 0.67) and the ones based on cEEGrid complemented by EOG channels (κ = 0.75) both showed a substantial agreement, with the combination including EOG channels showing a significantly better outcome than the one without (p = 0.006). Moreover, signal excerpts of the conventional channels containing grapho-elements were correlated with those of the cEEGrid in order to determine the cEEGrid channel combination that optimally represents the annotated grapho-elements. The results show that the grapho-elements were well-represented by the front-facing electrode combinations. The correlation analysis of the grapho-elements resulted in an average correlation coefficient of 0.65 for the most suitable electrode configuration of the cEEGrid. The results confirm that sleep stages can be identified with electrodes placement around the ear. This opens up opportunities for miniaturized ear-EEG systems that may be self-applied by users.
Collapse
Affiliation(s)
- Carlos F da Silva Souto
- Branch for Hearing, Speech and Audio Technology HSA, Fraunhofer Institute for Digital Media Technology IDMT, Oldenburg, Germany
| | - Wiebke Pätzold
- Branch for Hearing, Speech and Audio Technology HSA, Fraunhofer Institute for Digital Media Technology IDMT, Oldenburg, Germany
| | - Karen Insa Wolf
- Branch for Hearing, Speech and Audio Technology HSA, Fraunhofer Institute for Digital Media Technology IDMT, Oldenburg, Germany
| | | | - Ida Matthiesen
- Neuropsychology Lab, Department of Psychology, University of Oldenburg, Oldenburg, Germany
| | - Martin G Bleichner
- Neuropsychology Lab, Department of Psychology, University of Oldenburg, Oldenburg, Germany.,Neurophysiology of Everyday Life Group, Department of Psychology, University of Oldenburg, Oldenburg, Germany
| | - Stefan Debener
- Branch for Hearing, Speech and Audio Technology HSA, Fraunhofer Institute for Digital Media Technology IDMT, Oldenburg, Germany.,Neuropsychology Lab, Department of Psychology, University of Oldenburg, Oldenburg, Germany
| |
Collapse
|
36
|
Jain R, Ganesan RA. Reliable sleep staging of unseen subjects with fusion of multiple EEG features and RUSBoost. Biomed Signal Process Control 2021. [DOI: 10.1016/j.bspc.2021.103061] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/18/2023]
|
37
|
EEG based emotion detection using fourth order spectral moment and deep learning. Biomed Signal Process Control 2021. [DOI: 10.1016/j.bspc.2021.102755] [Citation(s) in RCA: 17] [Impact Index Per Article: 5.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022]
|
38
|
Automatic sleep stage classification with reduced epoch of EEG. EVOLUTIONARY INTELLIGENCE 2021. [DOI: 10.1007/s12065-021-00632-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/21/2022]
|
39
|
Grieger N, Schwabedal JTC, Wendel S, Ritze Y, Bialonski S. Automated scoring of pre-REM sleep in mice with deep learning. Sci Rep 2021; 11:12245. [PMID: 34112829 PMCID: PMC8192905 DOI: 10.1038/s41598-021-91286-0] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/09/2020] [Accepted: 05/24/2021] [Indexed: 11/08/2022] Open
Abstract
Reliable automation of the labor-intensive manual task of scoring animal sleep can facilitate the analysis of long-term sleep studies. In recent years, deep-learning-based systems, which learn optimal features from the data, increased scoring accuracies for the classical sleep stages of Wake, REM, and Non-REM. Meanwhile, it has been recognized that the statistics of transitional stages such as pre-REM, found between Non-REM and REM, may hold additional insight into the physiology of sleep and are now under vivid investigation. We propose a classification system based on a simple neural network architecture that scores the classical stages as well as pre-REM sleep in mice. When restricted to the classical stages, the optimized network showed state-of-the-art classification performance with an out-of-sample F1 score of 0.95 in male C57BL/6J mice. When unrestricted, the network showed lower F1 scores on pre-REM (0.5) compared to the classical stages. The result is comparable to previous attempts to score transitional stages in other species such as transition sleep in rats or N1 sleep in humans. Nevertheless, we observed that the sequence of predictions including pre-REM typically transitioned from Non-REM to REM reflecting sleep dynamics observed by human scorers. Our findings provide further evidence for the difficulty of scoring transitional sleep stages, likely because such stages of sleep are under-represented in typical data sets or show large inter-scorer variability. We further provide our source code and an online platform to run predictions with our trained network.
Collapse
Affiliation(s)
- Niklas Grieger
- Department of Medical Engineering and Technomathematics, FH Aachen University of Applied Sciences, Jülich, 52428, Germany
| | | | - Stefanie Wendel
- Department of Medical Psychology and Behavioral Neurobiology, University of Tübingen, Tübingen, 72076, Germany
| | - Yvonne Ritze
- Department of Medical Psychology and Behavioral Neurobiology, University of Tübingen, Tübingen, 72076, Germany
| | - Stephan Bialonski
- Department of Medical Engineering and Technomathematics, FH Aachen University of Applied Sciences, Jülich, 52428, Germany.
| |
Collapse
|
40
|
Banluesombatkul N, Ouppaphan P, Leelaarporn P, Lakhan P, Chaitusaney B, Jaimchariyatam N, Chuangsuwanich E, Chen W, Phan H, Dilokthanakul N, Wilaiprasitporn T. MetaSleepLearner: A Pilot Study on Fast Adaptation of Bio-Signals-Based Sleep Stage Classifier to New Individual Subject Using Meta-Learning. IEEE J Biomed Health Inform 2021; 25:1949-1963. [PMID: 33180737 DOI: 10.1109/jbhi.2020.3037693] [Citation(s) in RCA: 31] [Impact Index Per Article: 10.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
Identifying bio-signals based-sleep stages requires time-consuming and tedious labor of skilled clinicians. Deep learning approaches have been introduced in order to challenge the automatic sleep stage classification conundrum. However, the difficulties can be posed in replacing the clinicians with the automatic system due to the differences in many aspects found in individual bio-signals, causing the inconsistency in the performance of the model on every incoming individual. Thus, we aim to explore the feasibility of using a novel approach, capable of assisting the clinicians and lessening the workload. We propose the transfer learning framework, entitled MetaSleepLearner, based on Model Agnostic Meta-Learning (MAML), in order to transfer the acquired sleep staging knowledge from a large dataset to new individual subjects (source code is available at https://github.com/IoBT-VISTEC/MetaSleepLearner). The framework was demonstrated to require the labelling of only a few sleep epochs by the clinicians and allow the remainder to be handled by the system. Layer-wise Relevance Propagation (LRP) was also applied to understand the learning course of our approach. In all acquired datasets, in comparison to the conventional approach, MetaSleepLearner achieved a range of 5.4% to 17.7% improvement with statistical difference in the mean of both approaches. The illustration of the model interpretation after the adaptation to each subject also confirmed that the performance was directed towards reasonable learning. MetaSleepLearner outperformed the conventional approaches as a result from the fine-tuning using the recordings of both healthy subjects and patients. This is the first work that investigated a non-conventional pre-training method, MAML, resulting in a possibility for human-machine collaboration in sleep stage classification and easing the burden of the clinicians in labelling the sleep stages through only several epochs rather than an entire recording.
Collapse
|
41
|
Imperatori LS, Cataldi J, Betta M, Ricciardi E, Ince RAA, Siclari F, Bernardi G. Cross-participant prediction of vigilance stages through the combined use of wPLI and wSMI EEG functional connectivity metrics. Sleep 2021; 44:5998102. [PMID: 33220055 DOI: 10.1093/sleep/zsaa247] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/27/2020] [Revised: 11/01/2020] [Indexed: 11/12/2022] Open
Abstract
Functional connectivity (FC) metrics describe brain inter-regional interactions and may complement information provided by common power-based analyses. Here, we investigated whether the FC-metrics weighted Phase Lag Index (wPLI) and weighted Symbolic Mutual Information (wSMI) may unveil functional differences across four stages of vigilance-wakefulness (W), NREM-N2, NREM-N3, and REM sleep-with respect to each other and to power-based features. Moreover, we explored their possible contribution in identifying differences between stages characterized by distinct levels of consciousness (REM+W vs. N2+N3) or sensory disconnection (REM vs. W). Overnight sleep and resting-state wakefulness recordings from 24 healthy participants (27 ± 6 years, 13F) were analyzed to extract power and FC-based features in six classical frequency bands. Cross-validated linear discriminant analyses (LDA) were applied to investigate the ability of extracted features to discriminate (1) the four vigilance stages, (2) W+REM vs. N2+N3, and (3) W vs. REM. For the four-way vigilance stages classification, combining features based on power and both connectivity metrics significantly increased accuracy relative to considering only power, wPLI, or wSMI features. Delta-power and connectivity (0.5-4 Hz) represented the most relevant features for all the tested classifications, in line with a possible involvement of slow waves in consciousness and sensory disconnection. Sigma-FC, but not sigma-power (12-16 Hz), was found to strongly contribute to the differentiation between states characterized by higher (W+REM) and lower (N2+N3) probabilities of conscious experiences. Finally, alpha-FC resulted as the most relevant FC-feature for distinguishing among wakefulness and REM sleep and may thus reflect the level of disconnection from the external environment.
Collapse
Affiliation(s)
- Laura Sophie Imperatori
- MoMiLab, IMT School for Advanced Studies Lucca, Lucca, Italy.,Institute of Neuroscience and Psychology, University of Glasgow, Glasgow, United Kingdom
| | - Jacinthe Cataldi
- Center for Investigation and Research on Sleep, Lausanne University Hospital, Lausanne, Switzerland
| | - Monica Betta
- MoMiLab, IMT School for Advanced Studies Lucca, Lucca, Italy
| | | | - Robin A A Ince
- Institute of Neuroscience and Psychology, University of Glasgow, Glasgow, United Kingdom
| | - Francesca Siclari
- Center for Investigation and Research on Sleep, Lausanne University Hospital, Lausanne, Switzerland
| | - Giulio Bernardi
- MoMiLab, IMT School for Advanced Studies Lucca, Lucca, Italy.,Center for Investigation and Research on Sleep, Lausanne University Hospital, Lausanne, Switzerland
| |
Collapse
|
42
|
Phan H, Chen OY, Koch P, Lu Z, McLoughlin I, Mertins A, De Vos M. Towards More Accurate Automatic Sleep Staging via Deep Transfer Learning. IEEE Trans Biomed Eng 2021; 68:1787-1798. [PMID: 32866092 DOI: 10.1109/tbme.2020.3020381] [Citation(s) in RCA: 47] [Impact Index Per Article: 15.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
BACKGROUND Despite recent significant progress in the development of automatic sleep staging methods, building a good model still remains a big challenge for sleep studies with a small cohort due to the data-variability and data-inefficiency issues. This work presents a deep transfer learning approach to overcome these issues and enable transferring knowledge from a large dataset to a small cohort for automatic sleep staging. METHODS We start from a generic end-to-end deep learning framework for sequence-to-sequence sleep staging and derive two networks as the means for transfer learning. The networks are first trained in the source domain (i.e. the large database). The pretrained networks are then finetuned in the target domain (i.e. the small cohort) to complete knowledge transfer. We employ the Montreal Archive of Sleep Studies (MASS) database consisting of 200 subjects as the source domain and study deep transfer learning on three different target domains: the Sleep Cassette subset and the Sleep Telemetry subset of the Sleep-EDF Expanded database, and the Surrey-cEEGrid database. The target domains are purposely adopted to cover different degrees of data mismatch to the source domains. RESULTS Our experimental results show significant performance improvement on automatic sleep staging on the target domains achieved with the proposed deep transfer learning approach. CONCLUSIONS These results suggest the efficacy of the proposed approach in addressing the above-mentioned data-variability and data-inefficiency issues. SIGNIFICANCE As a consequence, it would enable one to improve the quality of automatic sleep staging models when the amount of data is relatively small.11The source code and the pretrained models are published at https://github.com/pquochuy/sleep_transfer_learning.
Collapse
|
43
|
Al-Salman W, Li Y, Wen P. Detection of k-complexes in EEG signals using a multi-domain feature extraction coupled with a least square support vector machine classifier. Neurosci Res 2021; 172:26-40. [PMID: 33965451 DOI: 10.1016/j.neures.2021.03.012] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/12/2020] [Revised: 03/22/2021] [Accepted: 03/31/2021] [Indexed: 01/28/2023]
Abstract
Sleep scoring is one of the primary tasks for the classification of sleep stages using electroencephalogram (EEG) signals. It is one of the most important diagnostic methods in sleep research and must be carried out with a high degree of accuracy because any errors in the scoring in the patient's sleep EEG recordings can cause serious problems. The aim of this research is to develop a new automatic method for detecting the most important characteristics in sleep stage 2 such as k-complexes based on multi-domain features. In this study, each EEG signal is divided into a set of segments using a sliding window technique. Based on extensive experiments during the training phase, the size of the sliding window is set to 0.5 s (s). Then a set of statistical, fractal, frequency and non-linear features are extracted from each epoch based on the time domain, Katz's algorithm, power spectrum density (PSD) and tunable Q-factor wavelet transform (TQWT). As a result, a vector of twenty-two features is obtained to represent each EEG segment. In order to detect k-complexes, the extracted features were analysed for their ability to detect the k-complex waveforms. Based on the analysis of the features, twelve out of twenty-two features are selected and forwarded to a least square support vector machine (LS-SVM) classifier to identify k-complexes in EEG signals. A set of various classification techniques of K-means and extreme learning machine classifiers are used to compare the obtained results and to evaluate the performance of the proposed method.The experimental results showed that the proposed method, based on multi-domain features, achieved better recognition results than other methods and classifiers. An average accuracy, sensitivity and specificity of 97.7 %, 97 %, and 94.2 % were obtained, respectively, with the CZ-A1 channel according to the R&K standard. The experimental results with high classification performance demonstrated that the technique can help doctors optimize the diagnosis and treatment of sleep disorders.
Collapse
Affiliation(s)
- Wessam Al-Salman
- School of Sciences, University of Southern Queensland, Australia; Thi-Qar University, College of Education for Pure Science, Iraq.
| | - Yan Li
- School of Sciences, University of Southern Queensland, Australia
| | - Peng Wen
- School of Electrical and Electronic Engineering, Hubei University of Technology, Wuhan, China
| |
Collapse
|
44
|
Tăuţan AM, Rossi AC, de Francisco R, Ionescu B. Dimensionality reduction for EEG-based sleep stage detection: comparison of autoencoders, principal component analysis and factor analysis. BIOMED ENG-BIOMED TE 2021; 66:125-136. [PMID: 33048831 DOI: 10.1515/bmt-2020-0139] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/25/2020] [Accepted: 08/19/2020] [Indexed: 11/15/2022]
Abstract
Methods developed for automatic sleep stage detection make use of large amounts of data in the form of polysomnographic (PSG) recordings to build predictive models. In this study, we investigate the effect of several dimensionality reduction techniques, i.e., principal component analysis (PCA), factor analysis (FA), and autoencoders (AE) on common classifiers, e.g., random forests (RF), multilayer perceptron (MLP), long-short term memory (LSTM) networks, for automated sleep stage detection. Experimental testing is carried out on the MGH Dataset provided in the "You Snooze, You Win: The PhysioNet/Computing in Cardiology Challenge 2018". The signals used as input are the six available (EEG) electoencephalographic channels and combinations with the other PSG signals provided: ECG - electrocardiogram, EMG - electromyogram, respiration based signals - respiratory efforts and airflow. We observe that a similar or improved accuracy is obtained in most cases when using all dimensionality reduction techniques, which is a promising result as it allows to reduce the computational load while maintaining performance and in some cases also improves the accuracy of automated sleep stage detection. In our study, using autoencoders for dimensionality reduction maintains the performance of the model, while using PCA and FA the accuracy of the models is in most cases improved.
Collapse
|
45
|
Abstract
Ever since the COVID-19 pandemic has majorly altered diagnosis and prognosis practices, the need for telemedicine and mobile/electronic health has never been more appreciated. Drastic complications of the pandemic such as burdens on the social and employment status resulting from extended quarantine and physical distancing, has also negatively impacted mental health. Doctors and healthcare workers have seen more than just the lungs affected by COVID-19. Neurological complications including stroke, headache, and seizures have been reported for populations of patients. Most mental conditions can be detected using the Electroencephalogram (EEG) signal. Brain disorders, neurodegenerative diseases, seizure/epilepsy, sleep/fatigue, stress, and depression have certain characteristics in the EEG wave, which clearly differentiate them from normal conditions. Smartphone apps analyzing the EEG signal have been introduced in the market. However, the efficacy of such apps has not been thoroughly investigated. Factors and their inter-relationships impacting efficacy can be studied through a causal model. This short communications/perspective paper outlines the initial premises of a system dynamics approach to assess the efficacy of smart EEG monitoring apps amid the pandemic, that could be revolutionary for patient well-being and care policies.
Collapse
|
46
|
Satapathy S, Loganathan D, Kondaveeti HK, Rath R. Performance analysis of machine learning algorithms on automated sleep staging feature sets. CAAI TRANSACTIONS ON INTELLIGENCE TECHNOLOGY 2021. [DOI: 10.1049/cit2.12042] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/20/2022] Open
Affiliation(s)
- Santosh Satapathy
- Puducherry Research Scholar of Computer Science and Engineering Pondicherry Engineering College, Puducherry India
| | - D Loganathan
- Professor of Computer Science and Engineering Pondicherry Engineering College, Puducherry Puducherry India
| | - Hari Kishan Kondaveeti
- Assistant Professor of Computer Science and Engineering VIT University, Amaravati Andhra Pradesh India
| | - RamaKrushna Rath
- Research Scholar of Computer Science and Engineering, Anna University Chennai India
| |
Collapse
|
47
|
Eltrass AS, Ghanem NH. A new automated multi-stage system of non-local means and multi-kernel adaptive filtering techniques for EEG noise and artifacts suppression. J Neural Eng 2021; 18. [PMID: 33545699 DOI: 10.1088/1741-2552/abe397] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/12/2020] [Accepted: 02/05/2021] [Indexed: 11/11/2022]
Abstract
Context.Electroencephalography (EEG) signals are contaminated with diverse types of noises and artifacts, which greatly distort EEG recording and increase the difficulty in obtaining accurate diagnosis.Objective.This paper investigates, for the first time, multi-kernel normalized least mean square with coherence-based sparsification (MKNLMS-CS) algorithm for suppressing different artifact components, and the 1D patch-based non-local means (NLM) algorithm for eliminating white and colored noises.Approach.A novel multi-stage system based on combining the NLM algorithm with the MKNLMS-CS algorithm is proposed for eliminating different noise and artifact sources by targeting each noise or artifact component in a single stage.Main Results.The proposed approach is applied to clinical real EEG data, and the results reveal the superior performance of the proposed system in removing white and colored noises, suppressing different artifact components, preserving the important and tiny features of the original EEG signal, and keeping the morphology of EEG frequency components.Significance.The proposed multi-stage design succeeds not only to suppress different artifact components and noise sources under low and high noise conditions, but also to achieve accurate sleep spindle detection from the filtered high-quality EEG signals. This demonstrates the usefulness of the proposed approach for obtaining high-resolution EEG signal from noisy and contaminated EEG recordings.
Collapse
Affiliation(s)
- Ahmed S Eltrass
- Electrical Engineering Department, Faculty of Engineering, Alexandria University, Alexandria, Egypt
| | - Noha H Ghanem
- Electrical Engineering Department, Faculty of Engineering, Alexandria University, Alexandria, Egypt
| |
Collapse
|
48
|
Chaabene S, Bouaziz B, Boudaya A, Hökelmann A, Ammar A, Chaari L. Convolutional Neural Network for Drowsiness Detection Using EEG Signals. SENSORS (BASEL, SWITZERLAND) 2021; 21:1734. [PMID: 33802357 PMCID: PMC7959292 DOI: 10.3390/s21051734] [Citation(s) in RCA: 15] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/05/2020] [Revised: 02/04/2021] [Accepted: 02/24/2021] [Indexed: 12/18/2022]
Abstract
Drowsiness detection (DD) has become a relevant area of active research in biomedical signal processing. Recently, various deep learning (DL) researches based on the EEG signals have been proposed to detect fatigue conditions. The research presented in this paper proposes an EEG classification system for DD based on DL networks. However, the proposed DD system is mainly realized into two procedures; (i) data acquisition and (ii) model analysis. For the data acquisition procedure, two key steps are considered, which are the signal collection using a wearable Emotiv EPOC+ headset to record 14 channels of EEG, and the signal annotation. Furthermore, a data augmentation (DA) step has been added to the proposed system to overcome the problem of over-fitting and to improve accuracy. As regards the model analysis, a comparative study is also introduced in this paper to argue the choice of DL architecture and frameworks used in our DD system. In this sense, The proposed DD protocol makes use of a convolutional neural network (CNN) architecture implemented using the Keras library. The results showed a high accuracy value (90.42%) in drowsy/awake discrimination and revealed the efficiency of the proposed DD system compared to other research works.
Collapse
Affiliation(s)
- Siwar Chaabene
- Multimedia InfoRmation Systems and Advanced Computing Laboratory (MIRACL), University of Sfax, Sfax 3021, Tunisia; (S.C.); (B.B.); (A.B.)
- Digital Research Center of Sfax, B.P. 275, Sakiet Ezzit, Sfax 3021, Tunisia
| | - Bassem Bouaziz
- Multimedia InfoRmation Systems and Advanced Computing Laboratory (MIRACL), University of Sfax, Sfax 3021, Tunisia; (S.C.); (B.B.); (A.B.)
- Digital Research Center of Sfax, B.P. 275, Sakiet Ezzit, Sfax 3021, Tunisia
| | - Amal Boudaya
- Multimedia InfoRmation Systems and Advanced Computing Laboratory (MIRACL), University of Sfax, Sfax 3021, Tunisia; (S.C.); (B.B.); (A.B.)
- Digital Research Center of Sfax, B.P. 275, Sakiet Ezzit, Sfax 3021, Tunisia
| | - Anita Hökelmann
- Institute of Sport Science, Otto-von-Guericke University Magdeburg, 39104 Magdeburg, Germany;
| | - Achraf Ammar
- Institute of Sport Science, Otto-von-Guericke University Magdeburg, 39104 Magdeburg, Germany;
- Interdisciplinary Laboratory in Neurosciences, Physiology and Psychology: Physical Activity, Health and Learning (LINP2), UFR STAPS, UPL, Paris Nanterre University, 92000 Nanterre, France
| | - Lotfi Chaari
- IRIT-ENSEEIHT, University of Toulouse, 31013 Toulouse, France;
| |
Collapse
|
49
|
Rule-Based EEG Classifier Utilizing Local Entropy of Time–Frequency Distributions. MATHEMATICS 2021. [DOI: 10.3390/math9040451] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
Electroencephalogram (EEG) signals are known to contain signatures of stimuli that induce brain activities. However, detecting these signatures to classify captured EEG waveforms is one of the most challenging tasks of EEG analysis. This paper proposes a novel time–frequency-based method for EEG analysis and characterization implemented in a computer-aided decision-support system that can be used to assist medical experts in interpreting EEG patterns. The computerized method utilizes EEG spectral non-stationarity, which is clearly revealed in the time–frequency distributions (TFDs) of multicomponent signals. The proposed algorithm, which is based on the modification of the Rényi entropy, called local or short-term Rényi entropy (STRE), was upgraded with a blind component separation procedure and instantaneous frequency (IF) estimation. The method was applied to EEGs of both forward and backward movements of the left and right hands, as well as to EEGs of imagined hand movements, which were captured by a 19-channel EEG recording system. The obtained results show that in a given virtual instrument, the proposed methods efficiently distinguish between real and imagined limb movements by considering their signatures in terms of the dominant EEG component’s IFs at the specified subset of EEG channels (namely, F3, F4, F7, F8, T3, and T4). Furthermore, computing the number of EEG signal components, their extraction, and IF estimation provide important information that shows potential to enhance existing clinical diagnostic techniques for detecting the intensity, location, and type of brain function abnormalities in patients with neurological motor control disorders.
Collapse
|
50
|
Drowsiness Detection Based on Intelligent Systems with Nonlinear Features for Optimal Placement of Encephalogram Electrodes on the Cerebral Area. SENSORS 2021; 21:s21041255. [PMID: 33578747 PMCID: PMC7916503 DOI: 10.3390/s21041255] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/18/2020] [Revised: 01/20/2021] [Accepted: 02/04/2021] [Indexed: 11/24/2022]
Abstract
Drowsiness while driving can lead to accidents that are related to the loss of perception during emergencies that harm the health. Among physiological signals, brain waves have been used as informative signals for the analyses of behavioral observations, steering information, and other biosignals during drowsiness. We inspected the machine learning methods for drowsiness detection based on brain signals with varying quantities of information. The results demonstrated that machine learning could be utilized to compensate for a lack of information and to account for individual differences. Cerebral area selection approaches to decide optimal measurement locations could be utilized to minimize the discomfort of participants. Although other statistics could provide additional information in further study, the optimized machine learning method could prevent the dangers of drowsiness while driving by considering a transitional state with nonlinear features. Because brain signals can be altered not only by mental fatigue but also by health status, the optimization analysis of the system hardware and software will be able to increase the power-efficiency and accessibility in acquiring brain waves for health enhancements in daily life.
Collapse
|