1
|
Nair SS, Guo A, Boen J, Aggarwal A, Chahal O, Tandon A, Patel M, Sankararaman S, Durr NJ, Azad TD, Pirracchio R, Stevens RD. A deep learning approach for generating intracranial pressure waveforms from extracranial signals routinely measured in the intensive care unit. Comput Biol Med 2024; 177:108677. [PMID: 38833800 DOI: 10.1016/j.compbiomed.2024.108677] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/25/2024] [Revised: 05/27/2024] [Accepted: 05/28/2024] [Indexed: 06/06/2024]
Abstract
Intracranial pressure (ICP) is commonly monitored to guide treatment in patients with serious brain disorders such as traumatic brain injury and stroke. Established methods to assess ICP are resource intensive and highly invasive. We hypothesized that ICP waveforms can be computed noninvasively from three extracranial physiological waveforms routinely acquired in the Intensive Care Unit (ICU): arterial blood pressure (ABP), photoplethysmography (PPG), and electrocardiography (ECG). We evaluated over 600 h of high-frequency (125 Hz) simultaneously acquired ICP, ABP, ECG, and PPG waveform data in 10 patients admitted to the ICU with critical brain disorders. The data were segmented in non-overlapping 10-s windows, and ABP, ECG, and PPG waveforms were used to train deep learning (DL) models to re-create concurrent ICP. The predictive performance of six different DL models was evaluated in single- and multi-patient iterations. The mean average error (MAE) ± SD of the best-performing models was 1.34 ± 0.59 mmHg in the single-patient and 5.10 ± 0.11 mmHg in the multi-patient analysis. Ablation analysis was conducted to compare contributions from single physiologic sources and demonstrated statistically indistinguishable performances across the top DL models for each waveform (MAE±SD 6.33 ± 0.73, 6.65 ± 0.96, and 7.30 ± 1.28 mmHg, respectively, for ECG, PPG, and ABP; p = 0.42). Results support the preliminary feasibility and accuracy of DL-enabled continuous noninvasive ICP waveform computation using extracranial physiological waveforms. With refinement and further validation, this method could represent a safer and more accessible alternative to invasive ICP, enabling assessment and treatment in low-resource settings.
Collapse
Affiliation(s)
- Shiker S Nair
- Department of Biomedical Engineering, Johns Hopkins University Whiting School of Engineering, Baltimore, MD, USA.
| | - Alina Guo
- Department of Biomedical Engineering, Johns Hopkins University Whiting School of Engineering, Baltimore, MD, USA
| | - Joseph Boen
- Department of Biomedical Engineering, Johns Hopkins University Whiting School of Engineering, Baltimore, MD, USA
| | - Ataes Aggarwal
- Department of Biomedical Engineering, Johns Hopkins University Whiting School of Engineering, Baltimore, MD, USA
| | - Ojas Chahal
- Department of Biomedical Engineering, Johns Hopkins University Whiting School of Engineering, Baltimore, MD, USA
| | - Arushi Tandon
- Department of Biomedical Engineering, Johns Hopkins University Whiting School of Engineering, Baltimore, MD, USA
| | - Meer Patel
- Department of Biomedical Engineering, Johns Hopkins University Whiting School of Engineering, Baltimore, MD, USA
| | - Sreenidhi Sankararaman
- Department of Biomedical Engineering, Johns Hopkins University Whiting School of Engineering, Baltimore, MD, USA
| | - Nicholas J Durr
- Department of Biomedical Engineering, Johns Hopkins University Whiting School of Engineering, Baltimore, MD, USA
| | - Tej D Azad
- Department of Neurosurgery, Johns Hopkins University School of Medicine, Baltimore, MD, USA
| | - Romain Pirracchio
- Department of Anesthesia and Perioperative Care, UCSF, San Francisco, USA
| | - Robert D Stevens
- Department of Biomedical Engineering, Johns Hopkins University Whiting School of Engineering, Baltimore, MD, USA; Department of Neurosurgery, Johns Hopkins University School of Medicine, Baltimore, MD, USA; Department of Anesthesiology and Critical Care Medicine, Johns Hopkins University, Baltimore, MD, USA; Department of Electrical and Computer Engineering, Johns Hopkins University, Baltimore, MD, USA.
| |
Collapse
|
2
|
Wang X, Yang W, Qi W, Wang Y, Ma X, Wang W. STaRNet: A spatio-temporal and Riemannian network for high-performance motor imagery decoding. Neural Netw 2024; 178:106471. [PMID: 38945115 DOI: 10.1016/j.neunet.2024.106471] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/18/2024] [Revised: 06/11/2024] [Accepted: 06/16/2024] [Indexed: 07/02/2024]
Abstract
Brain-computer interfaces (BCIs), representing a transformative form of human-computer interaction, empower users to interact directly with external environments through brain signals. In response to the demands for high accuracy, robustness, and end-to-end capabilities within BCIs based on motor imagery (MI), this paper introduces STaRNet, a novel model that integrates multi-scale spatio-temporal convolutional neural networks (CNNs) with Riemannian geometry. Initially, STaRNet integrates a multi-scale spatio-temporal feature extraction module that captures both global and local features, facilitating the construction of Riemannian manifolds from these comprehensive spatio-temporal features. Subsequently, a matrix logarithm operation transforms the manifold-based features into the tangent space, followed by a dense layer for classification. Without preprocessing, STaRNet surpasses state-of-the-art (SOTA) models by achieving an average decoding accuracy of 83.29% and a kappa value of 0.777 on the BCI Competition IV 2a dataset, and 95.45% accuracy with a kappa value of 0.939 on the High Gamma Dataset. Additionally, a comparative analysis between STaRNet and several SOTA models, focusing on the most challenging subjects from both datasets, highlights exceptional robustness of STaRNet. Finally, the visualizations of learned frequency bands demonstrate that temporal convolutions have learned MI-related frequency bands, and the t-SNE analyses of features across multiple layers of STaRNet exhibit strong feature extraction capabilities. We believe that the accurate, robust, and end-to-end capabilities of the STaRNet will facilitate the advancement of BCIs.
Collapse
Affiliation(s)
- Xingfu Wang
- CAS Key Laboratory of Space Manufacturing Technology, Technology and Engineering Center for Space Utilization, Chinese Academy of Sciences, Beijing, China; University of Chinese Academy of Sciences, Beijing, China
| | - Wenjie Yang
- CAS Key Laboratory of Space Manufacturing Technology, Technology and Engineering Center for Space Utilization, Chinese Academy of Sciences, Beijing, China; University of Chinese Academy of Sciences, Beijing, China
| | - Wenxia Qi
- CAS Key Laboratory of Space Manufacturing Technology, Technology and Engineering Center for Space Utilization, Chinese Academy of Sciences, Beijing, China; University of Chinese Academy of Sciences, Beijing, China
| | - Yu Wang
- National Engineering and Technology Research Center for ASIC Design, Institute of Automation, Chinese Academy of Sciences, Beijing, China; University of Chinese Academy of Sciences, Beijing, China
| | - Xiaojun Ma
- National Engineering and Technology Research Center for ASIC Design, Institute of Automation, Chinese Academy of Sciences, Beijing, China; University of Chinese Academy of Sciences, Beijing, China
| | - Wei Wang
- CAS Key Laboratory of Space Manufacturing Technology, Technology and Engineering Center for Space Utilization, Chinese Academy of Sciences, Beijing, China; University of Chinese Academy of Sciences, Beijing, China.
| |
Collapse
|
3
|
Cunlin H, Ye Y, Nenggang X. Self-supervised motor imagery EEG recognition model based on 1-D MTCNN-LSTM network. J Neural Eng 2024; 21:036014. [PMID: 38757187 DOI: 10.1088/1741-2552/ad48bc] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/14/2023] [Accepted: 05/08/2024] [Indexed: 05/18/2024]
Abstract
Objective.Aiming for the research on the brain-computer interface (BCI), it is crucial to design a MI-EEG recognition model, possessing a high classification accuracy and strong generalization ability, and not relying on a large number of labeled training samples.Approach.In this paper, we propose a self-supervised MI-EEG recognition method based on self-supervised learning with one-dimensional multi-task convolutional neural networks and long short-term memory (1-D MTCNN-LSTM). The model is divided into two stages: signal transform identification stage and pattern recognition stage. In the signal transform recognition phase, the signal transform dataset is recognized by the upstream 1-D MTCNN-LSTM network model. Subsequently, the backbone network from the signal transform identification phase is transferred to the pattern recognition phase. Then, it is fine-tuned using a trace amount of labeled data to finally obtain the motion recognition model.Main results.The upstream stage of this study achieves more than 95% recognition accuracy for EEG signal transforms, up to 100%. For MI-EEG pattern recognition, the model obtained recognition accuracies of 82.04% and 87.14% with F1 scores of 0.7856 and 0.839 on the datasets of BCIC-IV-2b and BCIC-IV-2a.Significance.The improved accuracy proves the superiority of the proposed method. It is prospected to be a method for accurate classification of MI-EEG in the BCI system.
Collapse
Affiliation(s)
- Hu Cunlin
- College of Mechanical Engineering, Anhui University of Technology, Maanshan, Anhui 243002, People's Republic of China
| | - Ye Ye
- College of Mechanical Engineering, Anhui University of Technology, Maanshan, Anhui 243002, People's Republic of China
| | - Xie Nenggang
- College of Mechanical Engineering, Anhui University of Technology, Maanshan, Anhui 243002, People's Republic of China
- College of Management Science and Engineering, Anhui University of Technology, Maanshan, Anhui 243002, People's Republic of China
| |
Collapse
|
4
|
AL-Quraishi MS, Tan WH, Elamvazuthi I, Ooi CP, Saad NM, Al-Hiyali MI, Karim H, Azhar Ali SS. Cortical signals analysis to recognize intralimb mobility using modified RNN and various EEG quantities. Heliyon 2024; 10:e30406. [PMID: 38726180 PMCID: PMC11079093 DOI: 10.1016/j.heliyon.2024.e30406] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/03/2024] [Revised: 04/17/2024] [Accepted: 04/25/2024] [Indexed: 05/12/2024] Open
Abstract
Electroencephalogram (EEG) signals are critical in interpreting sensorimotor activities for predicting body movements. However, their efficacy in identifying intralimb movements, such as the dorsiflexion and plantar flexion of the foot, remains suboptimal. This study aims to explore whether various EEG signal quantities can effectively recognize intralimb movements to facilitate the development of Brain-Computer Interface (BCI) devices for foot rehabilitation. This research involved twenty-two healthy, right-handed participants. EEG data were collected using 21 electrodes positioned over the motor cortex, while two electromyography (EMG) electrodes recorded the onset of ankle joint movements. The study focused on analyzing slow cortical potential (SCP) and sensorimotor rhythms (SMR) in alpha and beta bands from the EEG. Five key features-fourth-order Autoregressive feature, variance, waveform length, standard deviation, and permutation entropy-were extracted. A modified Recurrent Neural Network (RNN) including Long Short-term Memory (LSTM) and Gated Recurrent Unit (GRU) algorithms was developed for movement recognition. These were compared against conventional machine learning algorithms, including nonlinear Support Vector Machine (SVM) and k Nearest Neighbourhood (kNN) classifiers. The performance of the proposed models was assessed using two data schemes: within-subject and across-subjects. The findings demonstrated that the GRU and LSTM models significantly outperformed traditional machine learning algorithms in recognizing different EEG signal quantities for intralimb movement. The study indicates that deep learning models, particularly GRU and LSTM, hold superior potential over standard machine learning techniques in identifying intralimb movements using EEG signals. Where the accuracies of LSTM for within and across subjects were 98.87 ± 1.80 % and 87.38 ± 0.86 % respectively. Whereas the accuracy of GRU within and across subjects were 99.18 ± 1.28 % and 86.44 ± 0.69 % respectively. This advancement could significantly benefit the development of BCI devices aimed at foot rehabilitation, suggesting a new avenue for enhancing physical therapy outcomes.
Collapse
Affiliation(s)
- Maged S. AL-Quraishi
- Interdisciplinary Research Center for Smart Mobility and Logistics (IRC-SML), King Fahd University of Petroleum & Minerals (KFUPM), Dhahran, 31261, Saudi Arabia
| | - Wooi Haw Tan
- Center of Digital Home, Faculty of Engineering, Multimedia University, 63100, Cyberjaya, Selangor, Malaysia
| | - Irraivan Elamvazuthi
- Department of Electrical and Electronic Engineering, Universiti Teknologi PETRONAS, Bandar Seri Iskandar, 36210, Perak, Malaysia
| | - Chee Pun Ooi
- Center of Digital Home, Faculty of Engineering, Multimedia University, 63100, Cyberjaya, Selangor, Malaysia
| | - Naufal M. Saad
- Department of Electrical and Electronic Engineering, Universiti Teknologi PETRONAS, Bandar Seri Iskandar, 36210, Perak, Malaysia
| | - Mohammed Isam Al-Hiyali
- Department of Electrical and Electronic Engineering, Universiti Teknologi PETRONAS, Bandar Seri Iskandar, 36210, Perak, Malaysia
| | - H.A. Karim
- Center of Digital Home, Faculty of Engineering, Multimedia University, 63100, Cyberjaya, Selangor, Malaysia
| | - Syed Saad Azhar Ali
- Interdisciplinary Research Center for Smart Mobility and Logistics (IRC-SML), King Fahd University of Petroleum & Minerals (KFUPM), Dhahran, 31261, Saudi Arabia
- Aerospace Engineering Department, King Fahd University of Petroleum & Minerals (KFUPM), Dhahran, 31261, Saudi Arabia
| |
Collapse
|
5
|
Wang X, Wang Y, Qi W, Kong D, Wang W. BrainGridNet: A two-branch depthwise CNN for decoding EEG-based multi-class motor imagery. Neural Netw 2024; 170:312-324. [PMID: 38006734 DOI: 10.1016/j.neunet.2023.11.037] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/13/2023] [Revised: 11/14/2023] [Accepted: 11/16/2023] [Indexed: 11/27/2023]
Abstract
Brain-computer interfaces (BCIs) based on motor imagery (MI) enable the disabled to interact with the world through brain signals. To meet demands of real-time, stable, and diverse interactions, it is crucial to develop lightweight networks that can accurately and reliably decode multi-class MI tasks. In this paper, we introduce BrainGridNet, a convolutional neural network (CNN) framework that integrates two intersecting depthwise CNN branches with 3D electroencephalography (EEG) data to decode a five-class MI task. The BrainGridNet attains competitive results in both the time and frequency domains, with superior performance in the frequency domain. As a result, an accuracy of 80.26 percent and a kappa value of 0.753 are achieved by BrainGridNet, surpassing the state-of-the-art (SOTA) model. Additionally, BrainGridNet shows optimal computational efficiency, excels in decoding the most challenging subject, and maintains robust accuracy despite the random loss of 16 electrode signals. Finally, the visualizations demonstrate that BrainGridNet learns discriminative features and identifies critical brain regions and frequency bands corresponding to each MI class. The convergence of BrainGridNet's strong feature extraction capability, high decoding accuracy, steady decoding efficacy, and low computational costs renders it an appealing choice for facilitating the development of BCIs.
Collapse
Affiliation(s)
- Xingfu Wang
- CAS Key Laboratory of Space Manufacturing Technology, Technology and Engineering Center for Space Utilization, Chinese Academy of Sciences, Beijing, China; University of Chinese Academy of Sciences, Beijing, China
| | - Yu Wang
- Neural Computation and Brain Computer Interaction (NeuBCI) Research Center for Brain-inspired Intelligence, National Laboratory of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences, Beijing, China; University of Chinese Academy of Sciences, Beijing, China
| | - Wenxia Qi
- CAS Key Laboratory of Space Manufacturing Technology, Technology and Engineering Center for Space Utilization, Chinese Academy of Sciences, Beijing, China; University of Chinese Academy of Sciences, Beijing, China
| | - Delin Kong
- CAS Key Laboratory of Space Manufacturing Technology, Technology and Engineering Center for Space Utilization, Chinese Academy of Sciences, Beijing, China
| | - Wei Wang
- CAS Key Laboratory of Space Manufacturing Technology, Technology and Engineering Center for Space Utilization, Chinese Academy of Sciences, Beijing, China; University of Chinese Academy of Sciences, Beijing, China.
| |
Collapse
|
6
|
Farhad S, Metin SZ, Uyulan Ç, Makouei STZ, Metin B, Ergüzel TT, Tarhan N. Application of Hybrid DeepLearning Architectures for Identification of Individuals with Obsessive Compulsive Disorder Based on EEG Data. Clin EEG Neurosci 2024:15500594231222980. [PMID: 38192213 DOI: 10.1177/15500594231222980] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 01/10/2024]
Abstract
Objective: Obsessive-compulsive disorder (OCD) is a highly common psychiatric disorder. The symptoms of this condition overlap and co-occur with those of other psychiatric illnesses, making diagnosis difficult. The availability of biomarkers could be useful for aiding in diagnosis, although prior neuroimaging studies were unable to provide such biomarkers. Method: In this study, patients with OCD were classified from healthy controls using 2 different hybrid deep learning models: one-dimensional convolutional neural networks (1DCNN) together with long-short term memory (LSTM) and gradient recurrent units (GRU), respectively. Results: Both models exhibited exceptional classification accuracies in cross-validation and external validation phases. The mean classification accuracies in the cross-validation stage were 90.88% and 85.91% for the 1DCNN-LSTM and 1DCNN-GRU models, respectively. The inferior frontal, temporal, and occipital electrodes were predominant in providing discriminative features. Conclusion: Our findings underscore the potential of hybrid deep learning architectures utilizing EEG data to effectively differentiate patients with OCD from healthy controls. This promising approach holds implications for advancing clinical decision-making by offering valuable insights into diagnostic markers for OCD.
Collapse
Affiliation(s)
- Shams Farhad
- Department of Neuroscience, Uskudar University, Istanbul, Turkey
| | | | - Çağlar Uyulan
- Department of Mechanical Engineering, İzmir Katip Çelebi University, İzmir, Turkey
| | | | - Barış Metin
- Medical Faculty, Neurology Department, Uskudar University, Istanbul, Turkey
| | - Türker Tekin Ergüzel
- Faculty of Engineering and Natural Sciences, Department of Software Engineering, Uskudar University, Istanbul, Turkey
| | - Nevzat Tarhan
- Department of Psychiatry, Uskudar University, Istanbul, Turkey
| |
Collapse
|
7
|
Arı E, Taçgın E. Input Shape Effect on Classification Performance of Raw EEG Motor Imagery Signals with Convolutional Neural Networks for Use in Brain-Computer Interfaces. Brain Sci 2023; 13:brainsci13020240. [PMID: 36831784 PMCID: PMC9954790 DOI: 10.3390/brainsci13020240] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/01/2023] [Revised: 01/26/2023] [Accepted: 01/28/2023] [Indexed: 02/04/2023] Open
Abstract
EEG signals are interpreted, analyzed and classified by many researchers for use in brain-computer interfaces. Although there are many different EEG signal acquisition methods, one of the most interesting is motor imagery signals. Many different signal processing methods, machine learning and deep learning models have been developed for the classification of motor imagery signals. Among these, Convolutional Neural Network models generally achieve better results than other models. Because the size and shape of the data is important for training Convolutional Neural Network models and discovering the right relationships, researchers have designed and experimented with many different input shape structures. However, no study has been found in the literature evaluating the effect of different input shapes on model performance and accuracy. In this study, the effects of different input shapes on model performance and accuracy in the classification of EEG motor imagery signals were investigated, which had not been specifically studied before. In addition, signal preprocessing methods, which take a long time before classification, were not used; rather, two CNN models were developed for training and classification using raw data. Two different datasets, BCI Competition IV 2A and 2B, were used in classification processes. For different input shapes, 53.03-89.29% classification accuracy and 2-23 s epoch time were obtained for 2A dataset, 64.84-84.94% classification accuracy and 4-10 s epoch time were obtained for 2B dataset. This study showed that the input shape has a significant effect on the classification performance, and when the correct input shape is selected and the correct CNN architecture is developed, feature extraction and classification can be done well by the CNN architecture without any signal preprocessing.
Collapse
Affiliation(s)
- Emre Arı
- Department of Mechanical Engineering, Faculty of Engineering, Marmara University, Istanbul 34840, Turkey
- Department of Mechanical Engineering, Faculty of Engineering, Dicle University, Diyarbakır 21280, Turkey
- Correspondence:
| | - Ertuğrul Taçgın
- Department of Mechanical Engineering, Faculty of Engineering, Doğuş University, Istanbul 34775, Turkey
| |
Collapse
|