1
|
Zhou Y, Chen P, Fan Y, Wu Y. A Multimodal Feature Fusion Brain Fatigue Recognition System Based on Bayes-gcForest. SENSORS (BASEL, SWITZERLAND) 2024; 24:2910. [PMID: 38733015 PMCID: PMC11086115 DOI: 10.3390/s24092910] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/14/2024] [Revised: 04/28/2024] [Accepted: 04/30/2024] [Indexed: 05/13/2024]
Abstract
Modern society increasingly recognizes brain fatigue as a critical factor affecting human health and productivity. This study introduces a novel, portable, cost-effective, and user-friendly system for real-time collection, monitoring, and analysis of physiological signals aimed at enhancing the precision and efficiency of brain fatigue recognition and broadening its application scope. Utilizing raw physiological data, this study constructed a compact dataset that incorporated EEG and ECG data from 20 subjects to index fatigue characteristics. By employing a Bayesian-optimized multi-granularity cascade forest (Bayes-gcForest) for fatigue state recognition, this study achieved recognition rates of 95.71% and 96.13% on the DROZY public dataset and constructed dataset, respectively. These results highlight the effectiveness of the multi-modal feature fusion model in brain fatigue recognition, providing a viable solution for cost-effective and efficient fatigue monitoring. Furthermore, this approach offers theoretical support for designing rest systems for researchers.
Collapse
Affiliation(s)
- You Zhou
- College of Information Science and Technology, Nanjing Forestry University, Nanjing 210037, China (Y.F.)
| | - Pukun Chen
- Shanghai Shentian Industrial Co., Ltd., Shanghai 200090, China
- Shanghai Radio Equipment Research Institute, Shanghai 201109, China
| | - Yifan Fan
- College of Information Science and Technology, Nanjing Forestry University, Nanjing 210037, China (Y.F.)
| | - Yin Wu
- College of Information Science and Technology, Nanjing Forestry University, Nanjing 210037, China (Y.F.)
| |
Collapse
|
2
|
Rakhmatulin I, Dao MS, Nassibi A, Mandic D. Exploring Convolutional Neural Network Architectures for EEG Feature Extraction. SENSORS (BASEL, SWITZERLAND) 2024; 24:877. [PMID: 38339594 PMCID: PMC10856895 DOI: 10.3390/s24030877] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/04/2023] [Revised: 01/12/2024] [Accepted: 01/20/2024] [Indexed: 02/12/2024]
Abstract
The main purpose of this paper is to provide information on how to create a convolutional neural network (CNN) for extracting features from EEG signals. Our task was to understand the primary aspects of creating and fine-tuning CNNs for various application scenarios. We considered the characteristics of EEG signals, coupled with an exploration of various signal processing and data preparation techniques. These techniques include noise reduction, filtering, encoding, decoding, and dimension reduction, among others. In addition, we conduct an in-depth analysis of well-known CNN architectures, categorizing them into four distinct groups: standard implementation, recurrent convolutional, decoder architecture, and combined architecture. This paper further offers a comprehensive evaluation of these architectures, covering accuracy metrics, hyperparameters, and an appendix that contains a table outlining the parameters of commonly used CNN architectures for feature extraction from EEG signals.
Collapse
Affiliation(s)
- Ildar Rakhmatulin
- Department of Electrical and Electronic Engineering, Imperial College London, London SW7 2AZ, UK; (A.N.)
| | - Minh-Son Dao
- National Institute of Information and Communications Technology (NICT), Tokyo 184-0015, Japan
| | - Amir Nassibi
- Department of Electrical and Electronic Engineering, Imperial College London, London SW7 2AZ, UK; (A.N.)
| | - Danilo Mandic
- Department of Electrical and Electronic Engineering, Imperial College London, London SW7 2AZ, UK; (A.N.)
| |
Collapse
|
3
|
Shimoga Narayana Rao K, Asha V. An automatic classification approach for preterm delivery detection based on deep learning. Biomed Signal Process Control 2023. [DOI: 10.1016/j.bspc.2023.104771] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/29/2023]
|
4
|
Yang L, Wang Y, Zhu X, Yang X, Zheng C. A gated temporal-separable attention network for EEG-based depression recognition. Comput Biol Med 2023; 157:106782. [PMID: 36931203 DOI: 10.1016/j.compbiomed.2023.106782] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/31/2022] [Revised: 02/14/2023] [Accepted: 03/09/2023] [Indexed: 03/13/2023]
Abstract
Depression, a common mental illness worldwide, needs to be diagnosed and cured at an early stage. To assist clinical diagnosis, an EEG-based deep learning frame, which is named the gated temporal-separable attention network (GTSAN), is proposed in this paper for depression recognition. GTSAN model extracts discriminative information from EEG recordings in two ways. On the one hand, the gated recurrent unit (GRU) is used in the GTSAN model to capture the EEG historical information to form the features. On the other hand, the model digs the multilevel information by using an improved version of temporal convolutional network (TCN), called temporal-separable convolution network (TSCN), which applies causal convolution and dilated convolution to extract features from fine to coarse scales. The TSCN and GRU features can be produced in parallel. Finally, the new model introduces the attention mechanism to give different weights to these features, allowing them to be used to identify depression more effectively. Experiments on two depression datasets have demonstrated that the proposed model can mine potential depression patterns in data and obtain high recognition accuracies. The proposed model provides the possibility of using an EEG-based system to assist for diagnosing depression.
Collapse
Affiliation(s)
- Lijun Yang
- School of Mathematics and Statistics, Henan Engineering Research Center for Artificial Intelligence Theory and Algorithms, Henan University, Kaifeng 475004, China; Center for Applied Mathematics of Henan Province, Henan University, Zhengzhou, 450046, China.
| | - Yixin Wang
- School of Mathematics and Statistics, Henan Engineering Research Center for Artificial Intelligence Theory and Algorithms, Henan University, Kaifeng 475004, China.
| | - Xiangru Zhu
- Institute of Cognition, Brain, and Health, Henan University, Kaifeng 475004, China.
| | - Xiaohui Yang
- School of Mathematics and Statistics, Henan Engineering Research Center for Artificial Intelligence Theory and Algorithms, Henan University, Kaifeng 475004, China; Center for Applied Mathematics of Henan Province, Henan University, Zhengzhou, 450046, China.
| | - Chen Zheng
- School of Mathematics and Statistics, Henan Engineering Research Center for Artificial Intelligence Theory and Algorithms, Henan University, Kaifeng 475004, China; Center for Applied Mathematics of Henan Province, Henan University, Zhengzhou, 450046, China.
| |
Collapse
|
5
|
Ahmed MZI, Sinha N, Ghaderpour E, Phadikar S, Ghosh R. A Novel Baseline Removal Paradigm for Subject-Independent Features in Emotion Classification Using EEG. BIOENGINEERING (BASEL, SWITZERLAND) 2023; 10:bioengineering10010054. [PMID: 36671626 PMCID: PMC9854727 DOI: 10.3390/bioengineering10010054] [Citation(s) in RCA: 6] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 12/11/2022] [Revised: 12/25/2022] [Accepted: 12/27/2022] [Indexed: 01/03/2023]
Abstract
Emotion plays a vital role in understanding the affective state of mind of an individual. In recent years, emotion classification using electroencephalogram (EEG) has emerged as a key element of affective computing. Many researchers have prepared datasets, such as DEAP and SEED, containing EEG signals captured by the elicitation of emotion using audio-visual stimuli, and many studies have been conducted to classify emotions using these datasets. However, baseline power removal is still considered one of the trivial aspects of preprocessing in feature extraction. The most common technique that prevails is subtracting the baseline power from the trial EEG power. In this paper, a novel method called InvBase method is proposed for removing baseline power before extracting features that remain invariant irrespective of the subject. The features extracted from the baseline removed EEG data are then used for classification of two classes of emotion, i.e., valence and arousal. The proposed scheme is compared with subtractive and no-baseline-correction methods. In terms of classification accuracy, it outperforms the existing state-of-art methods in both valence and arousal classification. The InvBase method plus multilayer perceptron shows an improvement of 29% over the no-baseline-correction method and 15% over the subtractive method.
Collapse
Affiliation(s)
- Md. Zaved Iqubal Ahmed
- Department of Computer Science & Engineering, National Institute of Technology, Silchar 788010, India
- Correspondence: (M.Z.I.A.); (E.G.)
| | - Nidul Sinha
- Department of Electrical Engineering, National Institute of Technology, Silchar 788010, India
| | - Ebrahim Ghaderpour
- Department of Earth Sciences and CERI Research Center, Sapienza University of Rome, Piazzale Aldo Moro, 5, 00185 Rome, Italy
- Correspondence: (M.Z.I.A.); (E.G.)
| | - Souvik Phadikar
- Neurology Department, University of Wisconsin-Madison, Madison, WI 53705, USA
| | - Rajdeep Ghosh
- School of Computing Science and Engineering, VIT Bhopal University, Bhopal 466114, India
| |
Collapse
|
6
|
Xiong H, Chen JJ, Gikaro JM, Wang CG, Lin F. Activation Patterns of Functional Brain Network in Response to Action Observation-Induced and Non-Induced Motor Imagery of Swallowing: A Pilot Study. Brain Sci 2022; 12:brainsci12101420. [PMID: 36291353 PMCID: PMC9599111 DOI: 10.3390/brainsci12101420] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/11/2022] [Revised: 10/09/2022] [Accepted: 10/18/2022] [Indexed: 11/20/2022] Open
Abstract
Action observation (AO) combined with motor imagery (MI) was verified as more effective in improving limb function than AO or MI alone, while the underlying mechanism of swallowing was ambiguous. The study aimed at exploring the efficacy of AO combined with MI in swallowing. In this study, twelve subjects performed the motor imagery of swallowing (MI-SW) during magnetoencephalography (MEG) scanning, and trials were divided into three groups: the non-induced group (control group, CG), male AO-induced group (M-AIG), and female AO-induced group (F-AIG). We used event-related spectral perturbations (ERSPs) and phase locking value (PLV) to assess the degree of activation and connectivity of the brain regions during MI-SW in the three groups. The results showed that compared to CG, F-AIG and M-AIG significantly activated more brain regions in the frontoparietal, attention, visual, and cinguloopercular systems. In addition, M-AIG significantly activated the sensorimotor cortex compared to CG and F-AIG. For the brain network, F-AIG and M-AIG increased the diffusion of non-hub hot spots and cold hubs to the bilateral hemispheres which enhanced interhemispheric functional connectivity and information transmission efficiency in the MI-SW task. This study provided supporting evidence that AO induction could enhance the effect of MI-SW and supported the application of AO-induced MI-SW in clinical rehabilitation.
Collapse
Affiliation(s)
- Hao Xiong
- Department of Rehabilitation Medicine, Sir Run Run Hospital Nanjing Medical University, Nanjing 211100, China
- Department of Rehabilitation Medicine, The First Affiliated Hospital of Nanjing Medical University, Nanjing 210029, China
- School of Rehabilitation Medicine, Nanjing Medical University, Nanjing 210029, China
| | - Jin-Jin Chen
- Department of Rehabilitation Medicine, Sir Run Run Hospital Nanjing Medical University, Nanjing 211100, China
- Department of Rehabilitation Medicine, The First Affiliated Hospital of Nanjing Medical University, Nanjing 210029, China
- School of Rehabilitation Medicine, Nanjing Medical University, Nanjing 210029, China
| | - John M. Gikaro
- School of Rehabilitation Medicine, Nanjing Medical University, Nanjing 210029, China
| | - Chen-Guang Wang
- Department of Rehabilitation Medicine, Sir Run Run Hospital Nanjing Medical University, Nanjing 211100, China
| | - Feng Lin
- Department of Rehabilitation Medicine, Sir Run Run Hospital Nanjing Medical University, Nanjing 211100, China
- Department of Rehabilitation Medicine, The First Affiliated Hospital of Nanjing Medical University, Nanjing 210029, China
- Correspondence: ; Tel.: +86-025-87115719
| |
Collapse
|