1
|
Yang B, Liu H, Jiang T, Yu S. Fluctuation in cortical excitation/inhibition modulates capability of attention across time scales ranging from hours to seconds. Cereb Cortex 2024; 34:bhae309. [PMID: 39076112 DOI: 10.1093/cercor/bhae309] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/13/2024] [Revised: 07/04/2024] [Accepted: 07/13/2024] [Indexed: 07/31/2024] Open
Abstract
Sustained attention, as the basis of general cognitive ability, naturally varies across different time scales, spanning from hours, e.g. from wakefulness to drowsiness state, to seconds, e.g. trial-by-trail fluctuation in a task session. Whether there is a unified mechanism underneath such trans-scale variability remains unclear. Here we show that fluctuation of cortical excitation/inhibition (E/I) is a strong modulator to sustained attention in humans across time scales. First, we observed the ability to attend varied across different brain states (wakefulness, postprandial somnolence, sleep deprived), as well as within any single state with larger swings. Second, regardless of the time scale involved, we found highly attentive state was always linked to more balanced cortical E/I characterized by electroencephalography (EEG) features, while deviations from the balanced state led to temporal decline in attention, suggesting the fluctuation of cortical E/I as a common mechanism underneath trans-scale attentional variability. Furthermore, we found the variations of both sustained attention and cortical E/I indices exhibited fractal structure in the temporal domain, exhibiting features of self-similarity. Taken together, these results demonstrate that sustained attention naturally varies across different time scales in a more complex way than previously appreciated, with the cortical E/I as a shared neurophysiological modulator.
Collapse
Affiliation(s)
- Binghao Yang
- Laboratory of Brain Atlas and Brain-inspired Intelligence, Institute of Automation, Chinese Academy of Sciences, No. 95, Zhongguancun East Road, Haidian District, Beijing 100190, China
- School of Future Technology, University of Chinese Academy of Sciences, No. 19, Yuquan Road, Shijingshan District, Beijing 100049, China
- Key Laboratory of Brain Cognition and Brain-inspired Intelligence Technology, Chinese Academy of Sciences, No. 230, Yueyang Road, Shanghai 200031, China
| | - Hao Liu
- Laboratory of Brain Atlas and Brain-inspired Intelligence, Institute of Automation, Chinese Academy of Sciences, No. 95, Zhongguancun East Road, Haidian District, Beijing 100190, China
- Key Laboratory of Brain Cognition and Brain-inspired Intelligence Technology, Chinese Academy of Sciences, No. 230, Yueyang Road, Shanghai 200031, China
- School of Artificial Intelligence, University of Chinese Academy of Sciences, No. 19, Yuquan Road, Shijingshan District, Beijing 100049, China
| | - Tianzi Jiang
- Laboratory of Brain Atlas and Brain-inspired Intelligence, Institute of Automation, Chinese Academy of Sciences, No. 95, Zhongguancun East Road, Haidian District, Beijing 100190, China
- Key Laboratory of Brain Cognition and Brain-inspired Intelligence Technology, Chinese Academy of Sciences, No. 230, Yueyang Road, Shanghai 200031, China
- School of Artificial Intelligence, University of Chinese Academy of Sciences, No. 19, Yuquan Road, Shijingshan District, Beijing 100049, China
- Xiaoxiang Institute for Brain Health and Yongzhou Central Hospital, No. 151, Xiaoshui West Road, Lingling District, Yongzhou 425000, Hunan Province, China
| | - Shan Yu
- Laboratory of Brain Atlas and Brain-inspired Intelligence, Institute of Automation, Chinese Academy of Sciences, No. 95, Zhongguancun East Road, Haidian District, Beijing 100190, China
- School of Future Technology, University of Chinese Academy of Sciences, No. 19, Yuquan Road, Shijingshan District, Beijing 100049, China
- Key Laboratory of Brain Cognition and Brain-inspired Intelligence Technology, Chinese Academy of Sciences, No. 230, Yueyang Road, Shanghai 200031, China
- Lead contact. Laboratory of Brain Atlas and Brain-inspired Intelligence, Institute of Automation, Chinese Academy of Sciences, No. 95, Zhongguancun East Road, Haidian District, Beijing 100190, China
| |
Collapse
|
2
|
Xie J, Zhang J, Sun J, Ma Z, Qin L, Li G, Zhou H, Zhan Y. A Transformer-Based Approach Combining Deep Learning Network and Spatial-Temporal Information for Raw EEG Classification. IEEE Trans Neural Syst Rehabil Eng 2022; 30:2126-2136. [PMID: 35914032 DOI: 10.1109/tnsre.2022.3194600] [Citation(s) in RCA: 18] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
Abstract
The attention mechanism of the Transformer has the advantage of extracting feature correlation in the long-sequence data and visualizing the model. As time-series data, the spatial and temporal dependencies of the EEG signals between the time points and the different channels contain important information for accurate classification. So far, Transformer-based approaches have not been widely explored in motor-imagery EEG classification and visualization, especially lacking general models based on cross-individual validation. Taking advantage of the Transformer model and the spatial-temporal characteristics of the EEG signals, we designed Transformer-based models for classifications of motor imagery EEG based on the PhysioNet dataset. With 3s EEG data, our models obtained the best classification accuracy of 83.31%, 74.44%, and 64.22% on two-, three-, and four-class motor-imagery tasks in cross-individual validation, which outperformed other state-of-the-art models by 0.88%, 2.11%, and 1.06%. The inclusion of the positional embedding modules in the Transformer could improve the EEG classification performance. Furthermore, the visualization results of attention weights provided insights into the working mechanism of the Transformer-based networks during motor imagery tasks. The topography of the attention weights revealed a pattern of event-related desynchronization (ERD) which was consistent with the results from the spectral analysis of Mu and beta rhythm over the sensorimotor areas. Together, our deep learning methods not only provide novel and powerful tools for classifying and understanding EEG data but also have broad applications for brain-computer interface (BCI) systems.
Collapse
|
3
|
Wairagkar M, Hayashi Y, Nasuto SJ. Dynamics of Long-Range Temporal Correlations in Broadband EEG During Different Motor Execution and Imagery Tasks. Front Neurosci 2021; 15:660032. [PMID: 34121989 PMCID: PMC8193084 DOI: 10.3389/fnins.2021.660032] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/28/2021] [Accepted: 03/22/2021] [Indexed: 11/13/2022] Open
Abstract
Brain activity is composed of oscillatory and broadband arrhythmic components; however, there is more focus on oscillatory sensorimotor rhythms to study movement, but temporal dynamics of broadband arrhythmic electroencephalography (EEG) remain unexplored. We have previously demonstrated that broadband arrhythmic EEG contains both short- and long-range temporal correlations that change significantly during movement. In this study, we build upon our previous work to gain a deeper understanding of these changes in the long-range temporal correlation (LRTC) in broadband EEG and contrast them with the well-known LRTC in alpha oscillation amplitude typically found in the literature. We investigate and validate changes in LRTCs during five different types of movements and motor imagery tasks using two independent EEG datasets recorded with two different paradigms-our finger tapping dataset with single self-initiated asynchronous finger taps and publicly available EEG dataset containing cued continuous movement and motor imagery of fists and feet. We quantified instantaneous changes in broadband LRTCs by detrended fluctuation analysis on single trial 2 s EEG sliding windows. The broadband LRTC increased significantly (p < 0.05) during all motor tasks as compared to the resting state. In contrast, the alpha oscillation LRTC, which had to be computed on longer stitched EEG segments, decreased significantly (p < 0.05) consistently with the literature. This suggests the complementarity of underlying fast and slow neuronal scale-free dynamics during movement and motor imagery. The single trial broadband LRTC gave high average binary classification accuracy in the range of 70.54±10.03% to 76.07±6.40% for all motor execution and imagery tasks and hence can be used in brain-computer interface (BCI). Thus, we demonstrate generalizability, robustness, and reproducibility of novel motor neural correlate, the single trial broadband LRTC, during different motor execution and imagery tasks in single asynchronous and cued continuous motor-BCI paradigms and its contrasting behavior with LRTC in alpha oscillation amplitude.
Collapse
Affiliation(s)
- Maitreyee Wairagkar
- Brain Embodiment Laboratory, Biomedical Engineering, School of Biological Sciences, University of Reading, Reading, United Kingdom
- Biomechatronics Laboratory, Department of Mechanical Engineering, Imperial College London, London, United Kingdom
- Care Research and Technology Centre, The UK Dementia Research Institute (UK DRI), London, United Kingdom
| | - Yoshikatsu Hayashi
- Brain Embodiment Laboratory, Biomedical Engineering, School of Biological Sciences, University of Reading, Reading, United Kingdom
| | - Slawomir J. Nasuto
- Brain Embodiment Laboratory, Biomedical Engineering, School of Biological Sciences, University of Reading, Reading, United Kingdom
| |
Collapse
|
4
|
Multilinear Discriminative Spatial Patterns for Movement-Related Cortical Potential Based on EEG Classification with Tensor Representation. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE 2021; 2021:6634672. [PMID: 34135952 PMCID: PMC8175166 DOI: 10.1155/2021/6634672] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/29/2020] [Revised: 04/09/2021] [Accepted: 05/15/2021] [Indexed: 11/17/2022]
Abstract
The discriminative spatial patterns (DSP) algorithm is a classical and effective feature extraction technique for decoding of voluntary finger premovements from electroencephalography (EEG). As a purely data-driven subspace learning algorithm, DSP essentially is a spatial-domain filter and does not make full use of the information in frequency domain. The paper presents multilinear discriminative spatial patterns (MDSP) to derive multiple interrelated lower dimensional discriminative subspaces of low frequency movement-related cortical potential (MRCP). Experimental results on two finger movement tasks' EEG datasets demonstrate the effectiveness of the proposed MDSP method.
Collapse
|
5
|
Nguyen PTM, Hayashi Y, Baptista MDS, Kondo T. Collective almost synchronization-based model to extract and predict features of EEG signals. Sci Rep 2020; 10:16342. [PMID: 33004963 PMCID: PMC7530765 DOI: 10.1038/s41598-020-73346-z] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/11/2020] [Accepted: 09/15/2020] [Indexed: 01/11/2023] Open
Abstract
Understanding the brain is important in the fields of science, medicine, and engineering. A promising approach to better understand the brain is through computing models. These models were adjusted to reproduce data collected from the brain. One of the most commonly used types of data in neuroscience comes from electroencephalography (EEG), which records the tiny voltages generated when neurons in the brain are activated. In this study, we propose a model based on complex networks of weakly connected dynamical systems (Hindmarsh-Rose neurons or Kuramoto oscillators), set to operate in a dynamic regime recognized as Collective Almost Synchronization (CAS). Our model not only successfully reproduces EEG data from both healthy and epileptic EEG signals, but it also predicts EEG features, the Hurst exponent, and the power spectrum. The proposed model is able to forecast EEG signals 5.76 s in the future. The average forecasting error was 9.22%. The random Kuramoto model produced the outstanding result for forecasting seizure EEG with an error of 11.21%.
Collapse
Affiliation(s)
- Phuong Thi Mai Nguyen
- Department of Computer and Information Sciences, Tokyo University of Agriculture and Technology, Tokyo, 184-8588, Japan
| | - Yoshikatsu Hayashi
- Biomedical Science/Engineering, School of Biological Sciences, University of Reading, Reading, RG6 6UR, UK
| | - Murilo Da Silva Baptista
- Institute for Complex System and Mathematical Biology, University of Aberdeen, Aberdeen, AB24 3UE, UK
| | - Toshiyuki Kondo
- Department of Computer and Information Sciences, Tokyo University of Agriculture and Technology, Tokyo, 184-8588, Japan.
| |
Collapse
|
6
|
Omam S, Babini MH, Sim S, Tee R, Nathan V, Namazi H. Complexity-based decoding of brain-skin relation in response to olfactory stimuli. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2020; 184:105293. [PMID: 31887618 DOI: 10.1016/j.cmpb.2019.105293] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/17/2019] [Revised: 12/12/2019] [Accepted: 12/20/2019] [Indexed: 06/10/2023]
Abstract
BACKGROUND AND OBJECTIVE Human body is covered with skin in different parts. In fact, skin reacts to different changes around human. For instance, when the surrounding temperature changes, human skin will react differently. It is known that the activity of skin is regulated by human brain. In this research, for the first time we investigate the relation between the activities of human skin and brain by mathematical analysis of Galvanic Skin Response (GSR) and Electroencephalography (EEG) signals. METHOD For this purpose, we employ fractal theory and analyze the variations of fractal dimension of GSR and EEG signals when subjects are exposed to different olfactory stimuli in the form of pleasant odors. RESULTS Based on the obtained results, the complexity of GSR signal changes with the complexity of EEG signal in case of different stimuli, where by increasing the molecular complexity of olfactory stimuli, the complexity of EEG and GSR signals increases. The results of statistical analysis showed the significant effect of stimulation on variations of complexity of GSR signal. In addition, based on effect size analysis, fourth odor with greatest molecular complexity had the greatest effect on variations of complexity of EEG and GSR signals. CONCLUSION Therefore, it can be said that human skin reaction changes with the variations in the activity of human brain. The result of analysis in this research can be further used to make a model between the activities of human skin and brain that will enable us to predict skin reaction to different stimuli.
Collapse
Affiliation(s)
- Shafiul Omam
- School of Engineering, Monash University, Selangor, Malaysia
| | | | - Sue Sim
- School of Engineering, Monash University, Selangor, Malaysia
| | - Rui Tee
- School of Pharmacy, Monash University, Selangor, Malaysia
| | - Visvamba Nathan
- School of Engineering, Monash University, Selangor, Malaysia
| | - Hamidreza Namazi
- School of Engineering, Monash University, Selangor, Malaysia; Faculty of Kinesiology, University of Calgary, Calgary, Alberta, Canada.
| |
Collapse
|