1
|
Borges Camargo Diniz J, Silva Santana L, Leite M, Silva Santana JL, Magalhães Costa SI, Martins Castro LH, Mota Telles JP. Advancing epilepsy diagnosis: A meta-analysis of artificial intelligence approaches for interictal epileptiform discharge detection. Seizure 2024; 122:80-86. [PMID: 39369555 DOI: 10.1016/j.seizure.2024.09.019] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/02/2024] [Revised: 09/23/2024] [Accepted: 09/24/2024] [Indexed: 10/08/2024] Open
Abstract
INTRODUCTION Interictal epileptiform discharges (IEDs) in electroencephalograms (EEGs) are an important biomarker for epilepsy. Currently, the gold standard for IED detection is the visual analysis performed by experts. However, this process is expert-biased, and time-consuming. Developing fast, accurate, and robust detection methods for IEDs based on EEG may facilitate epilepsy diagnosis. We aim to assess the performance of deep learning (DL) and classic machine learning (ML) algorithms in classifying EEG segments into IED and non-IED categories, as well as distinguishing whether the entire EEG contains IED or not. METHODS We systematically searched PubMed, Embase, and Web of Science following PRISMA guidelines. We excluded studies that only performed the detection of IEDs instead of binary segment classification. Risk of Bias was evaluated with Quality Assessment of Diagnostic Accuracy Studies (QUADAS-2). Meta-analysis with the overall area under the Summary Receiver Operating Characteristic (SROC), sensitivity, and specificity as effect measures, was performed with R software. RESULTS A total of 23 studies, comprising 3,629 patients, were eligible for synthesis. Eighteen models performed discharge-level classification, and 6 whole-EEG classification. For the IED-level classification, 3 models were validated in an external dataset with more than 50 patients and achieved a sensitivity of 84.9 % (95 % CI: 82.3-87.2) and a specificity of 68.7 % (95 % CI: 7.9-98.2). Five studies reported model performance using both internal validation (cross-validation) and external datasets. The meta-analysis revealed higher performance for internal validation, with 90.4 % sensitivity and 99.6 % specificity, compared to external validation, which showed 78.1 % sensitivity and 80.1 % specificity. CONCLUSION Meta-analysis showed higher performance for models validated with resampling methods compared to those using external datasets. Only a minority of models use more robust validation techniques, which often leads to overfitting.
Collapse
Affiliation(s)
| | | | | | - João Lucas Silva Santana
- Department of Neurology, Hospital das Clínicas da Faculdade de Medicina da Universidade de São Paulo, Brazil
| | - Sarah Isabela Magalhães Costa
- Instituto de Neurologia de Goiânia, Brazil Neurological Institute of Goiânia Brazil Department of Neurology Hospital das Clínicas da Faculdade de Medicina da Universidade de São Paulo, Brazil
| | | | - João Paulo Mota Telles
- Department of Neurology, Hospital das Clínicas da Faculdade de Medicina da Universidade de São Paulo, Brazil.
| |
Collapse
|
2
|
Shimizu R, Wu HT. Unveil sleep spindles with concentration of frequency and time (ConceFT). Physiol Meas 2024; 45:085003. [PMID: 39042095 DOI: 10.1088/1361-6579/ad66aa] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/12/2024] [Accepted: 07/19/2024] [Indexed: 07/24/2024]
Abstract
Objective.Sleep spindles contain crucial brain dynamics information. We introduce the novel non-linear time-frequency (TF) analysis tool 'Concentration of Frequency and Time' (ConceFT) to create an interpretable automated algorithm for sleep spindle annotation in EEG data and to measure spindle instantaneous frequencies (IFs).Approach.ConceFT effectively reduces stochastic EEG influence, enhancing spindle visibility in the TF representation. Our automated spindle detection algorithm, ConceFT-Spindle (ConceFT-S), is compared to A7 (non-deep learning) and SUMO (deep learning) using Dream and Montreal Archive of Sleep Studies (MASS) benchmark databases. We also quantify spindle IF dynamics.Main results.ConceFT-S achieves F1 scores of 0.765 in Dream and 0.791 in MASS, which surpass A7 and SUMO. We reveal that spindle IF is generally nonlinear.Significance.ConceFT offers an accurate, interpretable EEG-based sleep spindle detection algorithm and enables spindle IF quantification.
Collapse
Affiliation(s)
- Riki Shimizu
- Department of Biomedical Engineering, Duke University, Durham, NC 27708, United States of America
| | - Hau-Tieng Wu
- Courant Institute of Mathematical Sciences, New York University, New York, NY 10012, United States of America
| |
Collapse
|
3
|
Bandyopadhyay A, Oks M, Sun H, Prasad B, Rusk S, Jefferson F, Malkani RG, Haghayegh S, Sachdeva R, Hwang D, Agustsson J, Mignot E, Summers M, Fabbri D, Deak M, Anastasi M, Sampson A, Van Hout S, Seixas A. Strengths, weaknesses, opportunities, and threats of using AI-enabled technology in sleep medicine: a commentary. J Clin Sleep Med 2024; 20:1183-1191. [PMID: 38533757 PMCID: PMC11217619 DOI: 10.5664/jcsm.11132] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/20/2024] [Accepted: 03/20/2024] [Indexed: 03/28/2024]
Abstract
Over the past few years, artificial intelligence (AI) has emerged as a powerful tool used to efficiently automate several tasks across multiple domains. Sleep medicine is perfectly positioned to leverage this tool due to the wealth of physiological signals obtained through sleep studies or sleep tracking devices and abundance of accessible clinical data through electronic medical records. However, caution must be applied when utilizing AI, due to intrinsic challenges associated with novel technology. The Artificial Intelligence in Sleep Medicine Committee of the American Academy of Sleep Medicine reviews advancements in AI within the sleep medicine field. In this article, the Artificial Intelligence in Sleep Medicine committee members provide a commentary on the scope of AI technology in sleep medicine. The commentary identifies 3 pivotal areas in sleep medicine that can benefit from AI technologies: clinical care, lifestyle management, and population health management. This article provides a detailed analysis of the strengths, weaknesses, opportunities, and threats associated with using AI-enabled technologies in each pivotal area. Finally, the article broadly reviews barriers and challenges associated with using AI-enabled technologies and offers possible solutions. CITATION Bandyopadhyay A, Oks M, Sun H, et al. Strengths, weaknesses, opportunities, and threats of using AI-enabled technology in sleep medicine: a commentary. J Clin Sleep Med. 2024;20(7):1183-1191.
Collapse
Affiliation(s)
- Anuja Bandyopadhyay
- Department of Pediatrics, Indiana University School of Medicine, Indianapolis, Indiana
| | - Margarita Oks
- Department of Medicine, Northwell Health System, New York, New York
| | - Haoqi Sun
- Department of Neurology, Beth Israel Deaconess Medical Center, Boston, Massachusetts
| | - Bharati Prasad
- Department of Medicine, University of Illinois, Chicago, Illinois
| | - Sam Rusk
- EnsoData Research, EnsoData, Madison, Wisconsin
| | - Felicia Jefferson
- Department of Biochemistry and Molecular Biology, University of Nevada, Reno, Nevada
| | - Roneil Gopal Malkani
- Department of Neurology, Northwestern University Feinberg School of Medicine, Chicago, Illinois
- Neurology Service, Jesse Brown Veterans Affairs Medical Center, Chicago, Illinois
| | - Shahab Haghayegh
- Brigham and Women’s Hospital and Harvard Medical School, Boston, Massachusetts
| | - Ramesh Sachdeva
- Children’s Hospital of Michigan and Central Michigan University College of Medicine, Detroit, Michigan
| | - Dennis Hwang
- Kaiser Permanente Southern California, Los Angeles, California
| | | | - Emmanuel Mignot
- Stanford University, School of Medicine, Stanford, California
| | - Michael Summers
- Division of Pulmonary, Critical Care, and Sleep Medicine, University of Nebraska Medical Center, Omaha, Nebraska
| | | | | | | | | | | | - Azizi Seixas
- Department of Informatics and Health Data Science, University of Miami Miller School of Medicine, Miami, Florida
| |
Collapse
|
4
|
Yue H, Chen Z, Guo W, Sun L, Dai Y, Wang Y, Ma W, Fan X, Wen W, Lei W. Research and application of deep learning-based sleep staging: Data, modeling, validation, and clinical practice. Sleep Med Rev 2024; 74:101897. [PMID: 38306788 DOI: 10.1016/j.smrv.2024.101897] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/02/2023] [Revised: 12/30/2023] [Accepted: 01/04/2024] [Indexed: 02/04/2024]
Abstract
Over the past few decades, researchers have attempted to simplify and accelerate the process of sleep stage classification through various approaches; however, only a few such approaches have gained widespread acceptance. Artificial intelligence technology, particularly deep learning, is promising for earning the trust of the sleep medicine community in automated sleep-staging systems, thus facilitating its application in clinical practice and integration into daily life. We aimed to comprehensively review the latest methods that are applying deep learning for enhancing sleep staging efficiency and accuracy. Starting from the requisite "data" for constructing deep learning algorithms, we elucidated the current landscape of this domain and summarized the fundamental modeling process, encompassing signal selection, data pre-processing, model architecture, classification tasks, and performance metrics. Furthermore, we reviewed the applications of automated sleep staging in scenarios such as sleep-disorder screening, diagnostic procedures, and health monitoring and management. Finally, we conducted an in-depth analysis and discussion of the challenges and future in intelligent sleep staging, particularly focusing on large-scale sleep datasets, interdisciplinary collaborations, and human-computer interactions.
Collapse
Affiliation(s)
- Huijun Yue
- Otorhinolaryngology Hospital, The First Affiliated Hospital, Sun Yat-sen University, Guangzhou, People's Republic of China
| | - Zhuqi Chen
- Otorhinolaryngology Hospital, The First Affiliated Hospital, Sun Yat-sen University, Guangzhou, People's Republic of China
| | - Wenbin Guo
- Otorhinolaryngology Hospital, The First Affiliated Hospital, Sun Yat-sen University, Guangzhou, People's Republic of China
| | - Lin Sun
- Otorhinolaryngology Hospital, The First Affiliated Hospital, Sun Yat-sen University, Guangzhou, People's Republic of China
| | - Yidan Dai
- School of Computer Science, South China Normal University, Guangzhou, People's Republic of China
| | - Yiming Wang
- Otorhinolaryngology Hospital, The First Affiliated Hospital, Sun Yat-sen University, Guangzhou, People's Republic of China
| | - Wenjun Ma
- School of Computer Science, South China Normal University, Guangzhou, People's Republic of China
| | - Xiaomao Fan
- College of Big Data and Internet, Shenzhen Technology University, Shenzhen, People's Republic of China
| | - Weiping Wen
- Otorhinolaryngology Hospital, The First Affiliated Hospital, Sun Yat-sen University, Guangzhou, People's Republic of China; Department of Otolaryngology, The Sixth Affiliated Hospital, Sun Yat-sen University, Guangzhou, People's Republic of China.
| | - Wenbin Lei
- Otorhinolaryngology Hospital, The First Affiliated Hospital, Sun Yat-sen University, Guangzhou, People's Republic of China.
| |
Collapse
|
5
|
Tapia-Rivas NI, Estévez PA, Cortes-Briones JA. A robust deep learning detector for sleep spindles and K-complexes: towards population norms. Sci Rep 2024; 14:263. [PMID: 38167626 PMCID: PMC10762090 DOI: 10.1038/s41598-023-50736-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/21/2023] [Accepted: 12/24/2023] [Indexed: 01/05/2024] Open
Abstract
Sleep spindles (SSs) and K-complexes (KCs) are brain patterns involved in cognitive functions that appear during sleep. Large-scale sleep studies would benefit from precise and robust automatic sleep event detectors, capable of adapting the variability in both electroencephalography (EEG) signals and expert annotation rules. We introduce the Sleep EEG Event Detector (SEED), a deep learning system that outperforms existing approaches in SS and KC detection, reaching an F1-score of 80.5% and 83.7%, respectively, on the MASS2 dataset. SEED transfers well and requires minimal fine-tuning for new datasets and annotation styles. Remarkably, SEED substantially reduces the required amount of annotated data by using a novel pretraining approach that leverages the rule-based detector A7. An analysis of 11,224 subjects revealed that SEED's detections provide better estimates of SS population statistics than existing approaches. SEED is a powerful resource for obtaining sleep-event statistics that could be useful for establishing population norms.
Collapse
Affiliation(s)
| | - Pablo A Estévez
- Department of Electrical Engineering, University of Chile, Santiago, Chile.
- Millennium Institute of Intelligent Healthcare Engineering, Santiago, Chile.
- IMPACT, Center of Interventional Medicine for Precision and Advanced Cellular Therapy, Santiago, Chile.
| | - José A Cortes-Briones
- Schizophrenia and Neuropharmacology Research Group at Yale (SNRGY), Department of Psychiatry, Yale University School of Medicine, New Haven, CT, USA
- Abraham Ribicoff Research Facilities, Connecticut Mental Health Center, New Haven, CT, USA
- VA Connecticut Healthcare System, West Haven, CT, USA
| |
Collapse
|
6
|
Zahid AN, Jennum P, Mignot E, Sorensen HBD. MSED: A Multi-Modal Sleep Event Detection Model for Clinical Sleep Analysis. IEEE Trans Biomed Eng 2023; 70:2508-2518. [PMID: 37028083 DOI: 10.1109/tbme.2023.3252368] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/06/2023]
Abstract
Clinical sleep analysis require manual analysis of sleep patterns for correct diagnosis of sleep disorders. However, several studies have shown significant variability in manual scoring of clinically relevant discrete sleep events, such as arousals, leg movements, and sleep disordered breathing (apneas and hypopneas). We investigated whether an automatic method could be used for event detection and if a model trained on all events (joint model) performed better than corresponding event-specific models (single-event models). We trained a deep neural network event detection model on 1653 individual recordings and tested the optimized model on 1000 separate hold-out recordings. F1 scores for the optimized joint detection model were 0.70, 0.63, and 0.62 for arousals, leg movements, and sleep disordered breathing, respectively, compared to 0.65, 0.61, and 0.60 for the optimized single-event models. Index values computed from detected events correlated positively with manual annotations (r2 = 0.73, r2 = 0.77, r2 = 0.78, respectively). We furthermore quantified model accuracy based on temporal difference metrics, which improved overall by using the joint model compared to single-event models. Our automatic model jointly detects arousals, leg movements and sleep disordered breathing events with high correlation with human annotations. Finally, we benchmark against previous state-of-the-art multi-event detection models and found an overall increase in F1 score with our proposed model despite a 97.5% reduction in model size.
Collapse
|
7
|
Natraj N, Richards A. Sleep spindles, stress and PTSD: The state of the science and future directions. Neurobiol Stress 2023; 23:100516. [PMID: 36861030 PMCID: PMC9969071 DOI: 10.1016/j.ynstr.2023.100516] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/11/2022] [Revised: 01/16/2023] [Accepted: 01/17/2023] [Indexed: 01/27/2023] Open
Abstract
Sleep spindles are a signature feature of non-REM (NREM) sleep, with demonstrated relationships to sleep maintenance and learning and memory. Because PTSD is characterized by disturbances in sleep maintenance and in stress learning and memory, there is now a growing interest in examining the role of sleep spindles in the neurobiology of PTSD. This review provides an overview of methods for measuring and detecting sleep spindles as they pertain to human PTSD and stress research, presents a critical review of early findings examining sleep spindles in PTSD and stress neurobiology, and proposes several directions for future research. In doing so, this review underscores the extensive heterogeneity in sleep spindle measurement and detection methods, the wide range of spindle features that may be and have been examined, the many persisting unknowns about the clinical and functional relevance of those features, and the problems considering PTSD as a homogeneous group in between-group comparisons. This review also highlights the progress that has been made in this field and underscores the strong rationale for ongoing work in this area.
Collapse
Affiliation(s)
- Nikhilesh Natraj
- Department of Neurology, University of California, San Francisco, USA
- San Francisco VA Health Care System, San Francisco, USA
| | - Anne Richards
- San Francisco VA Health Care System, San Francisco, USA
- Department of Psychiatry and Behavioral Sciences and UCSF Weill Institute for Neurosciences, University of California, San Francisco, USA
| |
Collapse
|
8
|
Khasawneh N, Fraiwan M, Fraiwan L. Detection of K-complexes in EEG waveform images using faster R-CNN and deep transfer learning. BMC Med Inform Decis Mak 2022; 22:297. [PMID: 36397034 PMCID: PMC9673349 DOI: 10.1186/s12911-022-02042-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/21/2022] [Accepted: 11/07/2022] [Indexed: 11/19/2022] Open
Abstract
Background The electroencephalography (EEG) signal carries important information about the electrical activity of the brain, which may reveal many pathologies. This information is carried in certain waveforms and events, one of which is the K-complex. It is used by neurologists to diagnose neurophysiologic and cognitive disorders as well as sleep studies.
Existing detection methods largely depend on tedious, time-consuming, and error-prone manual inspection of the EEG waveform. Methods In this paper, a highly accurate K-complex detection system is developed. Based on multiple convolutional neural network (CNN) feature extraction backbones and EEG waveform images, a regions with faster regions with convolutional neural networks (Faster R-CNN) detector was designed, trained, and tested. Extensive performance evaluation was performed using four deep transfer learning feature extraction models (AlexNet, ResNet-101, VGG19 and Inceptionv3). The dataset was comprised of 10948 images of EEG waveforms, with the location of the K-complexes included as separate text files containing the bounding boxes information. Results The Inceptionv3 and VGG19-based detectors performed consistently high (i.e., up to 99.8% precision and 0.2% miss rate) over different testing scenarios, in which the number of training images was varied from 60% to 80% and the positive overlap threshold was increased from 60% to 90%. Conclusions Our automated method appears to be a highly accurate automatic K-complex detection in real-time that can aid practitioners in speedy EEG inspection. Graphical Abstract ![]()
Supplementary Information The online version contains supplementary material available at 10.1186/s12911-022-02042-x.
Collapse
|
9
|
Brink-Kjaer A, Leary EB, Sun H, Westover MB, Stone KL, Peppard PE, Lane NE, Cawthon PM, Redline S, Jennum P, Sorensen HBD, Mignot E. Age estimation from sleep studies using deep learning predicts life expectancy. NPJ Digit Med 2022; 5:103. [PMID: 35869169 PMCID: PMC9307657 DOI: 10.1038/s41746-022-00630-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/10/2022] [Accepted: 06/10/2022] [Indexed: 11/11/2022] Open
Abstract
Sleep disturbances increase with age and are predictors of mortality. Here, we present deep neural networks that estimate age and mortality risk through polysomnograms (PSGs). Aging was modeled using 2500 PSGs and tested in 10,699 PSGs from men and women in seven different cohorts aged between 20 and 90. Ages were estimated with a mean absolute error of 5.8 ± 1.6 years, while basic sleep scoring measures had an error of 14.9 ± 6.29 years. After controlling for demographics, sleep, and health covariates, each 10-year increment in age estimate error (AEE) was associated with increased all-cause mortality rate of 29% (95% confidence interval: 20-39%). An increase from -10 to +10 years in AEE translates to an estimated decreased life expectancy of 8.7 years (95% confidence interval: 6.1-11.4 years). Greater AEE was mostly reflected in increased sleep fragmentation, suggesting this is an important biomarker of future health independent of sleep apnea.
Collapse
Affiliation(s)
- Andreas Brink-Kjaer
- Department of Health Technology, Technical University of Denmark, Kongens Lyngby, Denmark.
- Danish Center for Sleep Medicine, Department of Clinical Neurophysiology, Rigshospitalet, Denmark.
- Stanford Center for Sleep Sciences and Medicine, Stanford University, Palo Alto, CA, USA.
| | - Eileen B Leary
- Stanford Center for Sleep Sciences and Medicine, Stanford University, Palo Alto, CA, USA
| | - Haoqi Sun
- Department of Neurology, Massachusetts General Hospital, Boston, MA, USA
| | - M Brandon Westover
- Department of Neurology, Massachusetts General Hospital, Boston, MA, USA
| | - Katie L Stone
- Research Institute, California Pacific Medical Center, San Francisco, CA, USA
- Department of Epidemiology and Biostatistics, University of California, San Francisco, CA, USA
| | - Paul E Peppard
- Department of Population Health Sciences, University of Wisconsin-Madison, Madison, WI, USA
| | - Nancy E Lane
- Department of Medicine, University of Davis School of Medicine, Sacramento, CA, USA
| | - Peggy M Cawthon
- Research Institute, California Pacific Medical Center, San Francisco, CA, USA
- Department of Epidemiology and Biostatistics, University of California, San Francisco, CA, USA
| | - Susan Redline
- Department of Medicine, Harvard Medical School, Boston, MA, USA
- Department of Medicine, Brigham and Women's Hospital, Boston, MA, USA
| | - Poul Jennum
- Danish Center for Sleep Medicine, Department of Clinical Neurophysiology, Rigshospitalet, Denmark
| | - Helge B D Sorensen
- Department of Health Technology, Technical University of Denmark, Kongens Lyngby, Denmark
| | - Emmanuel Mignot
- Stanford Center for Sleep Sciences and Medicine, Stanford University, Palo Alto, CA, USA.
| |
Collapse
|
10
|
Zhou W, Zhao X, Wang X, Zhou Y, Wang Y, Meng L, Fan J, Shen N, Zhou S, Chen W, Chen C. A Hybrid Expert System for Individualized Quantification of Electrical Status Epilepticus During Sleep Using Biogeography-Based Optimization. IEEE Trans Neural Syst Rehabil Eng 2022; 30:1920-1930. [PMID: 35763464 DOI: 10.1109/tnsre.2022.3186942] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
Electrical status epilepticus during sleep (ESES) is an epileptic encephalopathy in children with complex clinical manifestations. It is accompanied by specific electroencephalography (EEG) patterns of continuous spike and slow-waves. Quantifying such EEG patterns is critical to the diagnosis of ESES. While most of the existing automatic ESES quantification systems ignore the morphological variations of the signal as well as the individual variability among subjects. To address these issues, this paper presents a hybrid expert system that dedicates to mimicking the decision-making process of clinicians in ESES quantification by taking the morphological variations, individual variability, and medical knowledge into consideration. The proposed hybrid system not only offers a general scheme that could propel a semi-auto morphology analysis-based expert decision model to a fully automated ESES quantification with biogeography-based optimization (BBO), but also proposes a more precise individualized quantification system to involve the personalized characteristics by adopting an individualized parameters-selection framework. The feasibility and reliability of the proposed method are evaluated on a clinical dataset collected from twenty subjects at Children's Hospital of Fudan University, Shanghai, China. The estimation error for the individualized quantitative descriptor ESES is 0-4.32% and the average estimation error is 0.95% for all subjects. Experimental results show the presented system outperforms existing works and the individualized system significantly improves the performance of ESES quantification. The favorable results indicate that the proposed hybrid expert system for automatic ESES quantification is promising to support the diagnosis of ESES.
Collapse
|
11
|
Ellis CA, Miller RL, Calhoun VD. A Model Visualization-based Approach for Insight into Waveforms and Spectra Learned by CNNs. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2022; 2022:1643-1646. [PMID: 36086296 DOI: 10.1109/embc48229.2022.9871414] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/15/2023]
Abstract
Recent years have shown a growth in the application of deep learning architectures such as convolutional neural networks (CNNs), to electrophysiology analysis. However, using neural networks with raw time-series data makes explainability a significant challenge. Multiple explainability approaches have been developed for insight into the spectral features learned by CNNs from EEG. However, across electrophysiology modalities, and even within EEG, there are many unique waveforms of clinical relevance. Existing methods that provide insight into waveforms learned by CNNs are of questionable utility. In this study, we present a novel model visualization-based approach that analyzes the filters in the first convolutional layer of the network. To our knowledge, this is the first method focused on extracting explainable information from EEG waveforms learned by CNNs while also providing insight into the learned spectral features. We demonstrate the viability of our approach within the context of automated sleep stage classification, a well-characterized domain that can help validate our approach. We identify 3 subgroups of filters with distinct spectral properties, determine the relative importance of each group of filters, and identify several unique waveforms learned by the classifier that were vital to the classifier performance. Our approach represents a significant step forward in explainability for electrophysiology classifiers, which we also hope will be useful for providing insights in future studies. Clinical Relevance- Our approach can assist with the development and validation of clinical time-series classifiers.
Collapse
|
12
|
[Sleep spindles-Function, detection and use as biomarker for diagnostics in psychiatry]. DER NERVENARZT 2022; 93:882-891. [PMID: 35676333 DOI: 10.1007/s00115-022-01340-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Accepted: 05/17/2022] [Indexed: 10/18/2022]
Abstract
BACKGROUND The sleep spindle is a graphoelement of an electroencephalogram (EEG), which can be observed in light and deep sleep. Alterations in spindle activity have been described for a range of psychiatric disorders. Due to their relatively constant properties, sleep spindles may therefore be potential biomarkers in psychiatric diagnostics. METHOD This article presents an overview of the state of the science on the characteristics and functions of the sleep spindle as well as known alterations of spindle activity in psychiatric disorders. Various methodological approaches and developments of spindle detection are explained with respect to their potential for application in psychiatric diagnostics. RESULTS AND CONCLUSION Although alterations in spindle activity in psychiatric disorders are known and have been described in detail, their exact potential for psychiatric diagnostics has yet to be fully determined. In this respect, the acquisition of knowledge in research is currently constrained by manual and automated methods for spindle detection, which require high levels of resources and are error prone. Newer approaches to spindle detection based on deep-learning procedures could overcome the difficulties of previous detection methods, and thus open up new possibilities for the practical application of sleep spindles as biomarkers in the psychiatric practice.
Collapse
|
13
|
Kaulen L, Schwabedal JTC, Schneider J, Ritter P, Bialonski S. Advanced sleep spindle identification with neural networks. Sci Rep 2022; 12:7686. [PMID: 35538137 PMCID: PMC9090778 DOI: 10.1038/s41598-022-11210-y] [Citation(s) in RCA: 8] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/04/2022] [Accepted: 04/20/2022] [Indexed: 11/30/2022] Open
Abstract
Sleep spindles are neurophysiological phenomena that appear to be linked to memory formation and other functions of the central nervous system, and that can be observed in electroencephalographic recordings (EEG) during sleep. Manually identified spindle annotations in EEG recordings suffer from substantial intra- and inter-rater variability, even if raters have been highly trained, which reduces the reliability of spindle measures as a research and diagnostic tool. The Massive Online Data Annotation (MODA) project has recently addressed this problem by forming a consensus from multiple such rating experts, thus providing a corpus of spindle annotations of enhanced quality. Based on this dataset, we present a U-Net-type deep neural network model to automatically detect sleep spindles. Our model’s performance exceeds that of the state-of-the-art detector and of most experts in the MODA dataset. We observed improved detection accuracy in subjects of all ages, including older individuals whose spindles are particularly challenging to detect reliably. Our results underline the potential of automated methods to do repetitive cumbersome tasks with super-human performance.
Collapse
Affiliation(s)
- Lars Kaulen
- Department of Medical Engineering and Technomathematics, FH Aachen University of Applied Sciences, 52428, Jülich, Germany
| | | | - Jules Schneider
- Department of Psychiatry and Psychotherapy, University Hospital Carl Gustav Carus, Technische Universität Dresden, 01307, Dresden, Germany
| | - Philipp Ritter
- Department of Psychiatry and Psychotherapy, University Hospital Carl Gustav Carus, Technische Universität Dresden, 01307, Dresden, Germany
| | - Stephan Bialonski
- Department of Medical Engineering and Technomathematics, FH Aachen University of Applied Sciences, 52428, Jülich, Germany. .,Institute for Data-Driven Technologies, FH Aachen University of Applied Sciences, 52428, Jülich, Germany.
| |
Collapse
|
14
|
LSDD-EEGNet: An efficient end-to-end framework for EEG-based depression detection. Biomed Signal Process Control 2022. [DOI: 10.1016/j.bspc.2022.103612] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
|
15
|
Kaur M, Sakhare SR, Wanjale K, Akter F. Early Stroke Prediction Methods for Prevention of Strokes. Behav Neurol 2022; 2022:7725597. [PMID: 35449792 PMCID: PMC9017592 DOI: 10.1155/2022/7725597] [Citation(s) in RCA: 17] [Impact Index Per Article: 8.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/26/2021] [Revised: 03/02/2022] [Accepted: 03/21/2022] [Indexed: 02/06/2023] Open
Abstract
The emergence of the latest technologies gives rise to the usage of noninvasive techniques for assisting health-care systems. Amongst the four major cardiovascular diseases, stroke is one of the most dangerous and life-threatening disease, but the life of a patient can be saved if the stroke is detected during early stage. The literature reveals that the patients always experience ministrokes which are also known as transient ischemic attacks (TIA) before experiencing the actual attack of the stroke. Most of the literature work is based on the MRI and CT scan images for classifying the cardiovascular diseases including a stroke which is an expensive approach for diagnosis of early strokes. In India where cases of strokes are rising, there is a need to explore noninvasive cheap methods for the diagnosis of early strokes. Hence, this problem has motivated us to conduct the study presented in this paper. A noninvasive approach for the early diagnosis of the strokes is proposed. The cascaded prediction algorithms are time-consuming in producing the results and cannot work on the raw data and without making use of the properties of EEG. Therefore, the objective of this paper is to devise mechanisms to forecast strokes on the basis of processed EEG data. This paper is proposing time series-based approaches such as LSTM, biLSTM, GRU, and FFNN that can handle time series-based predictions to make useful decisions. The experimental research outcome reveals that all the algorithms taken up for the research study perform well on the prediction problem of early stroke detection, but GRU performs the best with 95.6% accuracy, whereas biLSTM gives 91% accuracy and LSTM gives 87% accuracy and FFNN gives 83% accuracy. The experimental outcome is able to measure the brain waves to predict the signs of strokes. The findings can certainly assist the physicians to detect the stroke at early stages to save the lives of the patients.
Collapse
Affiliation(s)
- Mandeep Kaur
- Department of Computer Science, Savitribai Phule Pune University, Pune, India
| | - Sachin R. Sakhare
- Computer Engineering Department, Vishwakarma Institute of Information Technology, Kondhwa (Bk), Pune, India
| | - Kirti Wanjale
- Computer Engineering Department, Vishwakarma Institute of Information Technology, Kondhwa (Bk), Pune, India
| | - Farzana Akter
- Department of ICT, Bangabandhu Sheikh Mujibur Rahman Digital University, Bangladesh
| |
Collapse
|
16
|
You J, Jiang D, Ma Y, Wang Y. SpindleU-Net: An Adaptive U-Net Framework for Sleep Spindle Detection in Single-Channel EEG. IEEE Trans Neural Syst Rehabil Eng 2021; 29:1614-1623. [PMID: 34398759 DOI: 10.1109/tnsre.2021.3105443] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
The sleep spindles in EEG have become one type of biomarker used to assess cognitive abilities and related disorders, and thus their detection is crucial for clinical research. This task, traditionally performed by sleep experts, is time-consuming. Many methods have been proposed to automate this process, yet an increase in performance is still expected. Inspired by the application in image segmentation, we propose a point-wise spindle detection method based on the U-Net framework with an attention module (SpindleU-Net). It maps the sequences of arbitrary-length EEG inputs to those of dense labels of spindle or non-spindle on freely chosen intervals. The attention module that focuses on the salient spindle region allows better performance, and a task-specific loss function is defined to alleviate the problem of imbalanced classification. As a deep learning method, SpindleU-Net outperforms state-of-the-art methods on the widely used benchmark dataset of MASS as well as the DREAMS dataset with a small number of samples. On MASS dataset it achieves average F1 scores of 0.854 and 0.803 according to its consistency with the annotations by two sleep experts respectively. On DREAMS dataset, it shows the average F1 score of 0.739. Its cross-dataset performance is also better compared to other methods, showing the good generalization ability for cross-dataset applications.
Collapse
|
17
|
Deep Learning-Based Stroke Disease Prediction System Using Real-Time Bio Signals. SENSORS 2021; 21:s21134269. [PMID: 34206540 PMCID: PMC8271462 DOI: 10.3390/s21134269] [Citation(s) in RCA: 11] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 05/10/2021] [Revised: 06/15/2021] [Accepted: 06/16/2021] [Indexed: 11/17/2022]
Abstract
The emergence of an aging society is inevitable due to the continued increases in life expectancy and decreases in birth rate. These social changes require new smart healthcare services for use in daily life, and COVID-19 has also led to a contactless trend necessitating more non-face-to-face health services. Due to the improvements that have been achieved in healthcare technologies, an increasing number of studies have attempted to predict and analyze certain diseases in advance. Research on stroke diseases is actively underway, particularly with the aging population. Stroke, which is fatal to the elderly, is a disease that requires continuous medical observation and monitoring, as its recurrence rate and mortality rate are very high. Most studies examining stroke disease to date have used MRI or CT images for simple classification. This clinical approach (imaging) is expensive and time-consuming while requiring bulky equipment. Recently, there has been increasing interest in using non-invasive measurable EEGs to compensate for these shortcomings. However, the prediction algorithms and processing procedures are both time-consuming because the raw data needs to be separated before the specific attributes can be obtained. Therefore, in this paper, we propose a new methodology that allows for the immediate application of deep learning models on raw EEG data without using the frequency properties of EEG. This proposed deep learning-based stroke disease prediction model was developed and trained with data collected from real-time EEG sensors. We implemented and compared different deep-learning models (LSTM, Bidirectional LSTM, CNN-LSTM, and CNN-Bidirectional LSTM) that are specialized in time series data classification and prediction. The experimental results confirmed that the raw EEG data, when wielded by the CNN-bidirectional LSTM model, can predict stroke with 94.0% accuracy with low FPR (6.0%) and FNR (5.7%), thus showing high confidence in our system. These experimental results demonstrate the feasibility of non-invasive methods that can easily measure brain waves alone to predict and monitor stroke diseases in real time during daily life. These findings are expected to lead to significant improvements for early stroke detection with reduced cost and discomfort compared to other measuring techniques.
Collapse
|
18
|
Olesen AN, Jørgen Jennum P, Mignot E, Sorensen HBD. Automatic sleep stage classification with deep residual networks in a mixed-cohort setting. Sleep 2021; 44:5897250. [PMID: 32844179 DOI: 10.1093/sleep/zsaa161] [Citation(s) in RCA: 29] [Impact Index Per Article: 9.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/06/2020] [Revised: 06/30/2020] [Indexed: 11/13/2022] Open
Abstract
STUDY OBJECTIVES Sleep stage scoring is performed manually by sleep experts and is prone to subjective interpretation of scoring rules with low intra- and interscorer reliability. Many automatic systems rely on few small-scale databases for developing models, and generalizability to new datasets is thus unknown. We investigated a novel deep neural network to assess the generalizability of several large-scale cohorts. METHODS A deep neural network model was developed using 15,684 polysomnography studies from five different cohorts. We applied four different scenarios: (1) impact of varying timescales in the model; (2) performance of a single cohort on other cohorts of smaller, greater, or equal size relative to the performance of other cohorts on a single cohort; (3) varying the fraction of mixed-cohort training data compared with using single-origin data; and (4) comparing models trained on combinations of data from 2, 3, and 4 cohorts. RESULTS Overall classification accuracy improved with increasing fractions of training data (0.25%: 0.782 ± 0.097, 95% CI [0.777-0.787]; 100%: 0.869 ± 0.064, 95% CI [0.864-0.872]), and with increasing number of data sources (2: 0.788 ± 0.102, 95% CI [0.787-0.790]; 3: 0.808 ± 0.092, 95% CI [0.807-0.810]; 4: 0.821 ± 0.085, 95% CI [0.819-0.823]). Different cohorts show varying levels of generalization to other cohorts. CONCLUSIONS Automatic sleep stage scoring systems based on deep learning algorithms should consider as much data as possible from as many sources available to ensure proper generalization. Public datasets for benchmarking should be made available for future research.
Collapse
Affiliation(s)
- Alexander Neergaard Olesen
- Department of Health Technology, Technical University of Denmark, Kgs. Lyngby, Denmark.,Stanford Center for Sleep Sciences and Medicine, Stanford University, Palo Alto, CA.,Danish Center for Sleep Medicine, Department of Clinical Neurophysiology, Rigshospitalet, Glostrup, Denmark
| | - Poul Jørgen Jennum
- Danish Center for Sleep Medicine, Department of Clinical Neurophysiology, Rigshospitalet, Glostrup, Denmark
| | - Emmanuel Mignot
- Stanford Center for Sleep Sciences and Medicine, Stanford University, Palo Alto, CA
| | | |
Collapse
|
19
|
Arnal PJ, Thorey V, Debellemaniere E, Ballard ME, Bou Hernandez A, Guillot A, Jourde H, Harris M, Guillard M, Van Beers P, Chennaoui M, Sauvet F. The Dreem Headband compared to polysomnography for electroencephalographic signal acquisition and sleep staging. Sleep 2021; 43:5841249. [PMID: 32433768 PMCID: PMC7751170 DOI: 10.1093/sleep/zsaa097] [Citation(s) in RCA: 136] [Impact Index Per Article: 45.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/04/2019] [Revised: 04/23/2020] [Indexed: 01/11/2023] Open
Abstract
Study Objectives The development of ambulatory technologies capable of monitoring brain activity during sleep longitudinally is critical for advancing sleep science. The aim of this study was to assess the signal acquisition and the performance of the automatic sleep staging algorithms of a reduced-montage dry-electroencephalographic (EEG) device (Dreem headband, DH) compared to the gold-standard polysomnography (PSG) scored by five sleep experts. Methods A total of 25 subjects who completed an overnight sleep study at a sleep center while wearing both a PSG and the DH simultaneously have been included in the analysis. We assessed (1) similarity of measured EEG brain waves between the DH and the PSG; (2) the heart rate, breathing frequency, and respiration rate variability (RRV) agreement between the DH and the PSG; and (3) the performance of the DH’s automatic sleep staging according to American Academy of Sleep Medicine guidelines versus PSG sleep experts manual scoring. Results The mean percentage error between the EEG signals acquired by the DH and those from the PSG for the monitoring of α was 15 ± 3.5%, 16 ± 4.3% for β, 16 ± 6.1% for λ, and 10 ± 1.4% for θ frequencies during sleep. The mean absolute error for heart rate, breathing frequency, and RRV was 1.2 ± 0.5 bpm, 0.3 ± 0.2 cpm, and 3.2 ± 0.6%, respectively. Automatic sleep staging reached an overall accuracy of 83.5 ± 6.4% (F1 score: 83.8 ± 6.3) for the DH to be compared with an average of 86.4 ± 8.0% (F1 score: 86.3 ± 7.4) for the 5 sleep experts. Conclusions These results demonstrate the capacity of the DH to both monitor sleep-related physiological signals and process them accurately into sleep stages. This device paves the way for, large-scale, longitudinal sleep studies. Clinical Trial Registration NCT03725943.
Collapse
Affiliation(s)
- Pierrick J Arnal
- Dreem, Science Team, New York, NY
- Corresponding author. Pierrick J. Arnal, Dreem, Science Team, 450 Park Ave S, New York, NY 10016.
| | | | | | | | | | | | | | | | - Mathias Guillard
- French Armed Forces Biomedical Research Institute (IRBA), Fatigue and Vigilance Unit, Bretigny-sur-Orge, France
- EA 7330 VIFASOM, Paris Descartes University, Paris, France
| | - Pascal Van Beers
- French Armed Forces Biomedical Research Institute (IRBA), Fatigue and Vigilance Unit, Bretigny-sur-Orge, France
- EA 7330 VIFASOM, Paris Descartes University, Paris, France
| | - Mounir Chennaoui
- French Armed Forces Biomedical Research Institute (IRBA), Fatigue and Vigilance Unit, Bretigny-sur-Orge, France
- EA 7330 VIFASOM, Paris Descartes University, Paris, France
| | - Fabien Sauvet
- French Armed Forces Biomedical Research Institute (IRBA), Fatigue and Vigilance Unit, Bretigny-sur-Orge, France
- EA 7330 VIFASOM, Paris Descartes University, Paris, France
| |
Collapse
|
20
|
Zhao X, Chen C, Zhou W, Wang Y, Fan J, Wang Z, Akbarzadeh S, Chen W. An energy screening and morphology characterization-based hybrid expert scheme for automatic identification of micro-sleep event K-complex. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2021; 201:105955. [PMID: 33556760 DOI: 10.1016/j.cmpb.2021.105955] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/03/2020] [Accepted: 01/24/2021] [Indexed: 06/12/2023]
Abstract
BACKGROUND AND OBJECTIVE K-complexes, as a significant indicator in sleep staging and sleep protection, are an important micro-event in sleep analysis. Clinically, K-complexes are recognized through the expert visual inspection of electroencephalogram (EEG) during sleep. Since this process is laborious and has high inter-observer variability, developing automated K-complex detection methods can alleviate the burden on clinicians while providing reliable recognition results. However, existing methods face the following issues. First, most work only identifies the K-complexes in stage 2, which requires distinguishing the sleep stages as the prerequisite for further events' identification. Second, most approaches can only detect the occurrence of events without the ability to predict their location and duration, which are also essential to sleep analysis. METHODS In this work, a novel hybrid expert scheme for K-complex detection is proposed by integrating signal morphology with expert knowledge into the decision-making process. To eliminate artifacts, and to minimize the individual variability in raw sleep EEG signals, the potential K-complex candidates are first screened by combining Teager energy operator (TEO) and personalized thresholds. Then, to distinguish signal shapes from background activity, a novel frame of filtering based on morphological filtering (MF) is devised to differentiate morphological components of K-complex waveforms from EEG series. Finally, K-complex waveforms are identified from the extracted morphological information by judgment rules, which are inspired by expert knowledge of micro-sleep events. RESULTS Detection performance is evaluated by its application on the public database MASS-C1 (Montreal archives of sleep studies cohort one) which includes the recordings of 19 healthy adults. The detection performance demonstrates an F-measure of 0.63 with a recall of 0.81 and a precision of 0.53 on average. The duration error between events and detections is 0.10 s. CONCLUSIONS The presented scheme has detected the occurrence of events. Meanwhile, it has recognized their locations and durations. The favorable results exhibit that the proposed scheme outperforms the state-of-the-art studies and has great potential to help release the burden of experts in sleep EEG analysis.
Collapse
Affiliation(s)
- Xian Zhao
- Center for Intelligent Medical Electronics (CIME), School of Information Science and Engineering, Fudan University, Shanghai 200433, China.
| | - Chen Chen
- Center for Intelligent Medical Electronics (CIME), School of Information Science and Engineering, Fudan University, Shanghai 200433, China; Human Phenome Institute, Fudan University, Shanghai 201203, China.
| | - Wei Zhou
- Center for Intelligent Medical Electronics (CIME), School of Information Science and Engineering, Fudan University, Shanghai 200433, China.
| | - Yalin Wang
- Center for Intelligent Medical Electronics (CIME), School of Information Science and Engineering, Fudan University, Shanghai 200433, China; Human Phenome Institute, Fudan University, Shanghai 201203, China.
| | - Jiahao Fan
- Center for Intelligent Medical Electronics (CIME), School of Information Science and Engineering, Fudan University, Shanghai 200433, China; Human Phenome Institute, Fudan University, Shanghai 201203, China.
| | - Zeyu Wang
- Center for Intelligent Medical Electronics (CIME), School of Information Science and Engineering, Fudan University, Shanghai 200433, China.
| | - Saeed Akbarzadeh
- Center for Intelligent Medical Electronics (CIME), School of Information Science and Engineering, Fudan University, Shanghai 200433, China.
| | - Wei Chen
- Center for Intelligent Medical Electronics (CIME), School of Information Science and Engineering, Fudan University, Shanghai 200433, China; Human Phenome Institute, Fudan University, Shanghai 201203, China.
| |
Collapse
|
21
|
Geng D, Alkhachroum A, Melo Bicchi M, Jagid J, Cajigas I, Chen ZS. Deep learning for robust detection of interictal epileptiform discharges. J Neural Eng 2021; 18. [PMID: 33770777 DOI: 10.1088/1741-2552/abf28e] [Citation(s) in RCA: 18] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/11/2020] [Accepted: 03/26/2021] [Indexed: 01/13/2023]
Abstract
OBJECTIVE Automatic detection of interictal epileptiform discharges (IEDs, short as ``spikes'') from an epileptic brain can help predict seizure recurrence and support the diagnosis of epilepsy. Developing fast, reliable and robust detection methods for IEDs based on scalp or intracortical EEG may facilitate online seizure monitoring and closed-loop neurostimulation. APPROACH We developed a new deep learning approach, which employs a long short-term memory (LSTM) network architecture (``IEDnet'') and an auxiliary classifier generative adversarial network (AC-GAN), to train on both expert-annotated and augmented spike events from intracranial electroencephalography (iEEG) recordings of epilepsy patients. We validated our IEDnet with two real-world iEEG datasets, and compared IEDnet with the support vector machine (SVM) and random forest (RF) classifiers on their detection performances. MAIN RESULTS IEDnet achieved excellent cross-validated detection performances in terms of both sensitivity and specificity, and outperformed SVM and RF. Synthetic spike samples augmented by AC-GAN further improved the detection performance. In addition, the performance of IEDnet was robust with respect to the sampling frequency and noise. Furthermore, we also demonstrated the cross-institutional generalization ability of IEDnet while testing between two datasets. SIGNIFICANCE IEDnet achieves excellent detection performances in identifying interictal spikes. AC-GAN can produce augmented iEEG samples to improve supervised deep learning.
Collapse
Affiliation(s)
- David Geng
- New York University School of Medicine, One Park Avenue, New York, New York, 10016-6402, UNITED STATES
| | - Ayham Alkhachroum
- University of Miami Miller School of Medicine, 1600 NW 10th Avenue, Miami, Florida, 33136-1015, UNITED STATES
| | - Manuel Melo Bicchi
- University of Miami Miller School of Medicine, 1600 NW 10th Avenue, Miami, Florida, 33136-1015, UNITED STATES
| | - Jonathan Jagid
- University of Miami Miller School of Medicine, 1600 NW 10th Avenue, Miami, Florida, 33136-1015, UNITED STATES
| | - Iahn Cajigas
- Department of Neurological Surgery, University of Miami Miller School of Medicine, 1095 NW 14th Ter # D4-6, Miami, Miami, Florida, 33136-1060, UNITED STATES
| | - Zhe Sage Chen
- Psychiatry, New York University School of Medicine, One Park Avenue, Rm 226, New York, New York, 10016, UNITED STATES
| |
Collapse
|
22
|
Machine-Learning-Based Elderly Stroke Monitoring System Using Electroencephalography Vital Signals. APPLIED SCIENCES-BASEL 2021. [DOI: 10.3390/app11041761] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/03/2023]
Abstract
Stroke is the third highest cause of death worldwide after cancer and heart disease, and the number of stroke diseases due to aging is set to at least triple by 2030. As the top three causes of death worldwide are all related to chronic disease, the importance of healthcare is increasing even more. Models that can predict real-time health conditions and diseases using various healthcare services are attracting increasing attention. Most diagnosis and prediction methods of stroke for the elderly involve imaging techniques such as magnetic resonance imaging (MRI). It is difficult to rapidly and accurately diagnose and predict stroke diseases due to the long testing times and high costs associated with MRI. Thus, in this paper, we design and implement a health monitoring system that can predict the precursors of stroke diseases in the elderly in real time during daily walking. First, raw electroencephalography (EEG) data from six channels were preprocessed via Fast Fourier Transform (FFT). The raw EEG power values were then extracted from the raw spectra: alpha (α), beta (β), gamma (γ), delta (δ), and theta (θ) as well as the low β, high β, and θ to β ratio, respectively. The experiments in this paper confirm that the important features of EEG biometric signals alone during walking can accurately determine stroke precursors and occurrence in the elderly with more than 90% accuracy. Further, the Random Forest algorithm with quartiles and Z-score normalization validates the clinical significance and performance of the system proposed in this paper with a 92.51% stroke prediction accuracy. The proposed system can be implemented at a low cost, and it can be applied for early disease detection and prediction using the precursor symptoms of real-time stroke. Furthermore, it is expected that it will be able to detect other diseases such as cancer and heart disease in the future.
Collapse
|
23
|
Gong S, Xing K, Cichocki A, Li J. Deep Learning in EEG: Advance of the Last Ten-Year Critical Period. IEEE Trans Cogn Dev Syst 2021. [DOI: 10.1109/tcds.2021.3079712] [Citation(s) in RCA: 11] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
|
24
|
Olesen AN, Jennum P, Mignot E, Sorensen HBD. Deep transfer learning for improving single-EEG arousal detection. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2020; 2020:99-103. [PMID: 33017940 DOI: 10.1109/embc44109.2020.9176723] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
Abstract
Datasets in sleep science present challenges for machine learning algorithms due to differences in recording setups across clinics. We investigate two deep transfer learning strategies for overcoming the channel mismatch problem for cases where two datasets do not contain exactly the same setup leading to degraded performance in single-EEG models. Specifically, we train a baseline model on multivariate polysomnography data and subsequently replace the first two layers to prepare the architecture for single-channel electroencephalography data. Using a fine-tuning strategy, our model yields similar performance to the baseline model (F1=0.682 and F1=0.694, respectively), and was significantly better than a comparable single-channel model. Our results are promising for researchers working with small databases who wish to use deep learning models pre-trained on larger databases.
Collapse
|
25
|
Lechat B, Hansen K, Catcheside P, Zajamsek B. Beyond K-complex binary scoring during sleep: probabilistic classification using deep learning. Sleep 2020; 43:zsaa077. [PMID: 32301485 PMCID: PMC7751135 DOI: 10.1093/sleep/zsaa077] [Citation(s) in RCA: 12] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/11/2019] [Revised: 03/18/2020] [Indexed: 12/21/2022] Open
Abstract
STUDY OBJECTIVES K-complexes (KCs) are a recognized electroencephalography marker of sensory processing and a defining feature of sleep stage 2. KC frequency and morphology may also be reflective of sleep quality, aging, and a range of sleep and sensory processing deficits. However, manual scoring of K-complexes is impractical, time-consuming, and thus costly and currently not well-standardized. Although automated KC detection methods have been developed, performance and uptake remain limited. METHODS The proposed algorithm is based on a deep neural network and Gaussian process, which gives the input waveform a probability of being a KC ranging from 0% to 100%. The algorithm was trained on half a million synthetic KCs derived from manually scored sleep stage 2 KCs from the Montreal Archive of Sleep Study containing 19 healthy young participants. Algorithm performance was subsequently assessed on 700 independent recordings from the Cleveland Family Study using sleep stages 2 and 3 data. RESULTS The developed algorithm showed an F1 score (a measure of binary classification accuracy) of 0.78 and thus outperforms currently available KC scoring algorithms with F1 = 0.2-0.6. The probabilistic approach also captured expected variability in KC shape and amplitude within individuals and across age groups. CONCLUSIONS An automated probabilistic KC classification is well suited and effective for systematic KC detection for a more in-depth exploration of potential relationships between KCs during sleep and clinical outcomes such as health impacts and daytime symptomatology.
Collapse
Affiliation(s)
- Bastien Lechat
- Adelaide Institute for Sleep Health, College of Science and Engineering, Flinders University, Adelaide, Australia
| | - Kristy Hansen
- Adelaide Institute for Sleep Health, College of Science and Engineering, Flinders University, Adelaide, Australia
| | - Peter Catcheside
- Adelaide Institute for Sleep Health, College of Medicine and Public Health, Flinders University, Adelaide, Australia
| | - Branko Zajamsek
- Adelaide Institute for Sleep Health, College of Medicine and Public Health, Flinders University, Adelaide, Australia
| |
Collapse
|
26
|
Liu C, Hu SC, Wang C, Lafata K, Yin FF. Automatic detection of pulmonary nodules on CT images with YOLOv3: development and evaluation using simulated and patient data. Quant Imaging Med Surg 2020; 10:1917-1929. [PMID: 33014725 PMCID: PMC7495314 DOI: 10.21037/qims-19-883] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/24/2019] [Accepted: 06/29/2020] [Indexed: 12/15/2022]
Abstract
BACKGROUND To develop a high-efficiency pulmonary nodule computer-aided detection (CAD) method for localization and diameter estimation. METHODS The developed CAD method centralizes a novel convolutional neural network (CNN) algorithm, You Only Look Once (YOLO) v3, as a deep learning approach. This method is featured by two distinct properties: (I) an automatic multi-scale feature extractor for nodule feature screening, and (II) a feature-based bounding box generator for nodule localization and diameter estimation. Two independent studies were performed to train and evaluate this CAD method. One study comprised of a computer simulation that utilized computer-based ground truth. In this study, 300 CT scans were simulated by Cardiac-torso (XCAT) digital phantom. Spherical nodules of various sizes (i.e., 3-10 mm in diameter) were randomly implanted within the lung region of the simulated images-the second study utilized human-based ground truth in patients. The CAD method was developed by CT scans sourced from the LIDC-IDRI database. CT scans with slice thickness above 2.5 mm were excluded, leaving 888 CT images for analysis. A 10-fold cross-validation procedure was implemented in both studies to evaluate network hyper-parameterization and generalization. The overall accuracy of the CAD method was evaluated by the detection sensitivities, in response to average false positives (FPs) per image. In the patient study, the detection accuracy was further compared against 9 recently published CAD studies using free-receiver response operating characteristic (FROC) curve analysis. Localization and diameter estimation accuracies were quantified by the mean and standard error between the predicted value and ground truth. RESULTS The average results among the 10 cross-validation folds in both studies demonstrated the CAD method achieved high detection accuracy. The sensitivity was 99.3% (FPs =1), and improved to 100% (FPs =4) in the simulation study. The corresponding sensitivities were 90.0% and 95.4% in the patient study, displaying superiority over several conventional and CNN-based lung nodule CAD methods in the FROC curve analysis. Nodule localization and diameter estimation errors were less than 1 mm in both studies. The developed CAD method achieved high computational efficiency: it yields nodule-specific quantitative values (i.e., number, existence confidence, central coordinates, and diameter) within 0.1 s for 2D CT slice inputs. CONCLUSIONS The reported results suggest that the developed lung pulmonary nodule CAD method possesses high accuracies of nodule localization and diameter estimation. The high computational efficiency enables its potential clinical application in the future.
Collapse
Affiliation(s)
- Chenyang Liu
- Medical Physics Graduate Program, Duke Kunshan University, Kunshan, China
| | - Shen-Chiang Hu
- Medical Physics Graduate Program, Duke Kunshan University, Kunshan, China
| | - Chunhao Wang
- Department of Radiation Oncology, Duke University Medical Center, Durham, NC, USA
| | - Kyle Lafata
- Department of Radiation Oncology, Duke University Medical Center, Durham, NC, USA
| | - Fang-Fang Yin
- Medical Physics Graduate Program, Duke Kunshan University, Kunshan, China
- Department of Radiation Oncology, Duke University Medical Center, Durham, NC, USA
| |
Collapse
|
27
|
Zhao X, Wang X, Chen C, Fan J, Yu X, Wang Z, Akbarzadeh S, Li Q, Zhou S, Chen W. A knowledge-based approach for automatic quantification of epileptiform activity in children with electrical status epilepticus during sleep. J Neural Eng 2020; 17:046032. [DOI: 10.1088/1741-2552/aba6dd] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
|
28
|
Rim B, Sung NJ, Min S, Hong M. Deep Learning in Physiological Signal Data: A Survey. SENSORS (BASEL, SWITZERLAND) 2020; 20:E969. [PMID: 32054042 PMCID: PMC7071412 DOI: 10.3390/s20040969] [Citation(s) in RCA: 72] [Impact Index Per Article: 18.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 01/07/2020] [Revised: 01/31/2020] [Accepted: 02/09/2020] [Indexed: 12/11/2022]
Abstract
Deep Learning (DL), a successful promising approach for discriminative and generative tasks, has recently proved its high potential in 2D medical imaging analysis; however, physiological data in the form of 1D signals have yet to be beneficially exploited from this novel approach to fulfil the desired medical tasks. Therefore, in this paper we survey the latest scientific research on deep learning in physiological signal data such as electromyogram (EMG), electrocardiogram (ECG), electroencephalogram (EEG), and electrooculogram (EOG). We found 147 papers published between January 2018 and October 2019 inclusive from various journals and publishers. The objective of this paper is to conduct a detailed study to comprehend, categorize, and compare the key parameters of the deep-learning approaches that have been used in physiological signal analysis for various medical applications. The key parameters of deep-learning approach that we review are the input data type, deep-learning task, deep-learning model, training architecture, and dataset sources. Those are the main key parameters that affect system performance. We taxonomize the research works using deep-learning method in physiological signal analysis based on: (1) physiological signal data perspective, such as data modality and medical application; and (2) deep-learning concept perspective such as training architecture and dataset sources.
Collapse
Affiliation(s)
- Beanbonyka Rim
- Department of Computer Science, Soonchunhyang University, Asan 31538, Korea
| | - Nak-Jun Sung
- Department of Computer Science, Soonchunhyang University, Asan 31538, Korea
| | - Sedong Min
- Department of Medical IT Engineering, Soonchunhyang University, Asan 31538, Korea
| | - Min Hong
- Department of Computer Software Engineering, Soonchunhyang University, Asan 31538, Korea
| |
Collapse
|
29
|
Goldstein-Piekarski AN, Holt-Gosselin B, O'Hora K, Williams LM. Integrating sleep, neuroimaging, and computational approaches for precision psychiatry. Neuropsychopharmacology 2020; 45:192-204. [PMID: 31426055 PMCID: PMC6879628 DOI: 10.1038/s41386-019-0483-8] [Citation(s) in RCA: 16] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/01/2019] [Revised: 06/21/2019] [Accepted: 07/22/2019] [Indexed: 12/13/2022]
Abstract
In advancing precision psychiatry, we focus on what imaging technology and computational approaches offer for the future of diagnostic subtyping and personalized tailoring of interventions for sleep impairment in mood and anxiety disorders. Current diagnostic criteria for mood and anxiety tend to lump different forms of sleep disturbance together. Parsing the biological features of sleep impairment and brain circuit dysfunction is one approach to identifying subtypes within these disorders that are mechanistically coherent and offer targets for intervention. We focus on two large-scale neural circuits implicated in sleep impairment and in mood and anxiety disorders: the default mode network and negative affective network. Through a synthesis of existing knowledge about these networks, we pose a testable framework for understanding how hyper- versus hypo-engagement of these networks may underlie distinct features of mood and sleep impairment. Within this framework we consider whether poor sleep quality may have an explanatory role in previously observed associations between network dysfunction and mood symptoms. We expand this framework to future directions including the potential for connecting circuit-defined subtypes to more distal features derived from digital phenotyping and wearable technologies, and how new discovery may be advanced through machine learning approaches.
Collapse
Affiliation(s)
- Andrea N Goldstein-Piekarski
- Department of Psychiatry and Behavioral Sciences, Stanford University, 401 Quarry Road, Stanford, CA, 94305, USA
- Sierra-Pacific Mental Illness Research, Education, and Clinical Center (MIRECC), Veterans Affairs Palo Alto Health Care System, 3801 Miranda Avenue, Palo Alto, CA, 94304, USA
| | - Bailey Holt-Gosselin
- Department of Psychiatry and Behavioral Sciences, Stanford University, 401 Quarry Road, Stanford, CA, 94305, USA
| | - Kathleen O'Hora
- Sierra-Pacific Mental Illness Research, Education, and Clinical Center (MIRECC), Veterans Affairs Palo Alto Health Care System, 3801 Miranda Avenue, Palo Alto, CA, 94304, USA
| | - Leanne M Williams
- Department of Psychiatry and Behavioral Sciences, Stanford University, 401 Quarry Road, Stanford, CA, 94305, USA.
- Sierra-Pacific Mental Illness Research, Education, and Clinical Center (MIRECC), Veterans Affairs Palo Alto Health Care System, 3801 Miranda Avenue, Palo Alto, CA, 94304, USA.
| |
Collapse
|
30
|
Olesen AN, Chambon S, Thorey V, Jennum P, Mignot E, Sorensen HBD. Towards a Flexible Deep Learning Method for Automatic Detection of Clinically Relevant Multi-Modal Events in the Polysomnogram. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2019; 2019:556-561. [PMID: 31945960 DOI: 10.1109/embc.2019.8856570] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/10/2023]
Abstract
Much attention has been given to automatic sleep staging algorithms in past years, but the detection of discrete events in sleep studies is also crucial for precise characterization of sleep patterns and possible diagnosis of sleep disorders. We propose here a deep learning model for automatic detection and annotation of arousals and leg movements. Both of these are commonly seen during normal sleep, while an excessive amount of either is linked to disrupted sleep patterns, excessive daytime sleepiness impacting quality of life, and various sleep disorders. Our model was trained on 1,485 subjects and tested on 1,000 separate recordings of sleep. We tested two different experimental setups and found optimal arousal detection was attained by including a recurrent neural network module in our default model with a dynamic default event window (F1 = 0.75), while optimal leg movement detection was attained using a static event window (F1 = 0.65). Our work show promise while still allowing for improvements. Specifically, future research will explore the proposed model as a general-purpose sleep analysis model.
Collapse
|
31
|
de Chazal P, Sutherland K, Cistulli PA. Advanced polysomnographic analysis for OSA: A pathway to personalized management? Respirology 2019; 25:251-258. [PMID: 31038827 DOI: 10.1111/resp.13564] [Citation(s) in RCA: 12] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/06/2019] [Accepted: 03/11/2019] [Indexed: 12/15/2022]
Abstract
Obstructive sleep apnea (OSA) is a highly heterogeneous disorder, with diverse pathways to disease, expression of disease, susceptibility to co-morbidities and response to therapy, and is ideally suited to precision medicine approaches. Clinically, the content of the information-rich polysomnogram (PSG) is not currently fully utilized in determining patient management. Novel PSG parameters such as hypoxic burden, pulse transit time, cardiopulmonary coupling and the frequency representations of PSG sensor signals could predict a variety of cardiovascular disease, cancer and neurodegeneration co-morbidities. The PSG can also be used to identify key pathophysiological parameters such as loop gain, arousal threshold and muscle compensation which can enhance understanding of the causes of OSA in an individual, and thereby guide choices on therapy. Machine learning methods performing their own parameter extraction coupled with large PSG data sets offer an exciting opportunity for discovering new links between the PSG variables and disease outcomes. By exploiting existing and emerging analytical methods, the PSG may offer a pathway to personalized management for OSA.
Collapse
Affiliation(s)
- Philip de Chazal
- Charles Perkins Centre, Faculty of Engineering and I.T., University of Sydney, Sydney, NSW, Australia
| | - Kate Sutherland
- Charles Perkins Centre and Northern Clinical School, Faculty of Medicine and Health, University of Sydney, Sydney, NSW, Australia
| | - Peter A Cistulli
- Charles Perkins Centre and Northern Clinical School, Faculty of Medicine and Health, University of Sydney, Sydney, NSW, Australia
| |
Collapse
|