1
|
Nagarajan A, Robinson N, Ang KK, Chua KSG, Chew E, Guan C. Transferring a deep learning model from healthy subjects to stroke patients in a motor imagery brain-computer interface. J Neural Eng 2024; 21:016007. [PMID: 38091617 DOI: 10.1088/1741-2552/ad152f] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/19/2023] [Accepted: 12/13/2023] [Indexed: 01/18/2024]
Abstract
Objective.Motor imagery (MI) brain-computer interfaces (BCIs) based on electroencephalogram (EEG) have been developed primarily for stroke rehabilitation, however, due to limited stroke data, current deep learning methods for cross-subject classification rely on healthy data. This study aims to assess the feasibility of applying MI-BCI models pre-trained using data from healthy individuals to detect MI in stroke patients.Approach.We introduce a new transfer learning approach where features from two-class MI data of healthy individuals are used to detect MI in stroke patients. We compare the results of the proposed method with those obtained from analyses within stroke data. Experiments were conducted using Deep ConvNet and state-of-the-art subject-specific machine learning MI classifiers, evaluated on OpenBMI two-class MI-EEG data from healthy subjects and two-class MI versus rest data from stroke patients.Main results.Results of our study indicate that through domain adaptation of a model pre-trained using healthy subjects' data, an average MI detection accuracy of 71.15% (±12.46%) can be achieved across 71 stroke patients. We demonstrate that the accuracy of the pre-trained model increased by 18.15% after transfer learning (p<0.001). Additionally, the proposed transfer learning method outperforms the subject-specific results achieved by Deep ConvNet and FBCSP, with significant enhancements of 7.64% (p<0.001) and 5.55% (p<0.001) in performance, respectively. Notably, the healthy-to-stroke transfer learning approach achieved similar performance to stroke-to-stroke transfer learning, with no significant difference (p>0.05). Explainable AI analyses using transfer models determined channel relevance patterns that indicate contributions from the bilateral motor, frontal, and parietal regions of the cortex towards MI detection in stroke patients.Significance.Transfer learning from healthy to stroke can enhance the clinical use of BCI algorithms by overcoming the challenge of insufficient clinical data for optimal training.
Collapse
Affiliation(s)
- Aarthy Nagarajan
- School of Computer Science and Engineering, Nanyang Technological University, 50 Nanyang Ave, Singapore 639798, Singapore
| | - Neethu Robinson
- School of Computer Science and Engineering, Nanyang Technological University, 50 Nanyang Ave, Singapore 639798, Singapore
| | - Kai Keng Ang
- School of Computer Science and Engineering, Nanyang Technological University, 50 Nanyang Ave, Singapore 639798, Singapore
- Institute for Infocomm Research, Agency of Science, Technology and Research (A*STAR), 1 Fusionopolis Way, Singapore 138632, Singapore
| | - Karen Sui Geok Chua
- Department of Rehabilitation Medicine, Tan Tock Seng Hospital, 11 Jln Tan Tock Seng, Singapore 308433, Singapore
| | - Effie Chew
- National University Health System, 1E Kent Ridge Road, Singapore 119228, Singapore
| | - Cuntai Guan
- School of Computer Science and Engineering, Nanyang Technological University, 50 Nanyang Ave, Singapore 639798, Singapore
| |
Collapse
|
2
|
Ivanov N, Lio A, Chau T. Towards user-centric BCI design: Markov chain-based user assessment for mental imagery EEG-BCIs. J Neural Eng 2023; 20:066037. [PMID: 38128128 DOI: 10.1088/1741-2552/ad17f2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/15/2023] [Accepted: 12/21/2023] [Indexed: 12/23/2023]
Abstract
Objective.While electroencephalography (EEG)-based brain-computer interfaces (BCIs) have many potential clinical applications, their use is impeded by poor performance for many users. To improve BCI performance, either via enhanced signal processing or user training, it is critical to understand and describe each user's ability to perform mental control tasks and produce discernible EEG patterns. While classification accuracy has predominantly been used to assess user performance, limitations and criticisms of this approach have emerged, thus prompting the need to develop novel user assessment approaches with greater descriptive capability. Here, we propose a combination of unsupervised clustering and Markov chain models to assess and describe user skill.Approach.Using unsupervisedK-means clustering, we segmented the EEG signal space into regions representing pattern states that users could produce. A user's movement through these pattern states while performing different tasks was modeled using Markov chains. Finally, using the steady-state distributions and entropy rates of the Markov chains, we proposed two metricstaskDistinctandrelativeTaskInconsistencyto assess, respectively, a user's ability to (i) produce distinct task-specific patterns for each mental task and (ii) maintain consistent patterns during individual tasks.Main results.Analysis of data from 14 adolescents using a three-class BCI revealed significant correlations between thetaskDistinctandrelativeTaskInconsistencymetrics and classification F1 score. Moreover, analysis of the pattern states and Markov chain models yielded descriptive information regarding user performance not immediately apparent from classification accuracy.Significance.Our proposed user assessment method can be used in concert with classifier-based analysis to further understand the extent to which users produce task-specific, time-evolving EEG patterns. In turn, this information could be used to enhance user training or classifier design.
Collapse
Affiliation(s)
- Nicolas Ivanov
- Bloorview Research Institute, Holland Bloorview Kids Rehabilitation Hospital, Toronto, ON, Canada
- Institute of Biomedical Engineering, University of Toronto, Toronto, ON, Canada
| | - Aaron Lio
- Division of Engineering Science, University of Toronto, Toronto, ON, Canada
| | - Tom Chau
- Bloorview Research Institute, Holland Bloorview Kids Rehabilitation Hospital, Toronto, ON, Canada
- Institute of Biomedical Engineering, University of Toronto, Toronto, ON, Canada
| |
Collapse
|
3
|
Liu K, Yang M, Xing X, Yu Z, Wu W. SincMSNet: a Sinc filter convolutional neural network for EEG motor imagery classification. J Neural Eng 2023; 20:056024. [PMID: 37683664 DOI: 10.1088/1741-2552/acf7f4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/25/2023] [Accepted: 09/08/2023] [Indexed: 09/10/2023]
Abstract
Objective.Motor imagery (MI) is widely used in brain-computer interfaces (BCIs). However, the decode of MI-EEG using convolutional neural networks (CNNs) remains a challenge due to individual variability.Approach.We propose a fully end-to-end CNN called SincMSNet to address this issue. SincMSNet employs the Sinc filter to extract subject-specific frequency band information and utilizes mixed-depth convolution to extract multi-scale temporal information for each band. It then applies a spatial convolutional block to extract spatial features and uses a temporal log-variance block to obtain classification features. The model of SincMSNet is trained under the joint supervision of cross-entropy and center loss to achieve inter-class separable and intra-class compact representations of EEG signals.Main results.We evaluated the performance of SincMSNet on the BCIC-IV-2a (four-class) and OpenBMI (two-class) datasets. SincMSNet achieves impressive results, surpassing benchmark methods. In four-class and two-class inter-session analysis, it achieves average accuracies of 80.70% and 71.50% respectively. In four-class and two-class single-session analysis, it achieves average accuracies of 84.69% and 76.99% respectively. Additionally, visualizations of the learned band-pass filter bands by Sinc filters demonstrate the network's ability to extract subject-specific frequency band information from EEG.Significance.This study highlights the potential of SincMSNet in improving the performance of MI-EEG decoding and designing more robust MI-BCIs. The source code for SincMSNet can be found at:https://github.com/Want2Vanish/SincMSNet.
Collapse
Affiliation(s)
- Ke Liu
- Chongqing Key Laboratory of Computational Intelligence, Chongqing University of Posts and Telecommunications, Chongqing 400065, People's Republic of China
- Key Laboratory of Big Data Intelligent Computing, Chongqing University of Posts and Telecommunications, Chongqing 400065, People's Republic of China
| | - Mingzhao Yang
- Chongqing Key Laboratory of Computational Intelligence, Chongqing University of Posts and Telecommunications, Chongqing 400065, People's Republic of China
| | - Xin Xing
- Chongqing Key Laboratory of Computational Intelligence, Chongqing University of Posts and Telecommunications, Chongqing 400065, People's Republic of China
| | - Zhuliang Yu
- College of Automation Science and Engineering, South China University of Technology, Guangzhou 510641, People's Republic of China
| | - Wei Wu
- Alto Neuroscience, Inc., Los Altos, CA 94022, United States of America
| |
Collapse
|
4
|
Ramirez-Nava AG, Mercado-Gutierrez JA, Quinzaños-Fresnedo J, Toledo-Peral C, Vega-Martinez G, Gutierrez MI, Pacheco-Gallegos MDR, Hernández-Arenas C, Gutiérrez-Martínez J. Functional electrical stimulation therapy controlled by a P300-based brain-computer interface, as a therapeutic alternative for upper limb motor function recovery in chronic post-stroke patients. A non-randomized pilot study. Front Neurol 2023; 14:1221160. [PMID: 37669261 PMCID: PMC10470638 DOI: 10.3389/fneur.2023.1221160] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/07/2023] [Accepted: 08/03/2023] [Indexed: 09/07/2023] Open
Abstract
Introduction Up to 80% of post-stroke patients present upper-limb motor impairment (ULMI), causing functional limitations in daily activities and loss of independence. UMLI is seldom fully recovered after stroke when using conventional therapeutic approaches. Functional Electrical Stimulation Therapy (FEST) controlled by Brain-Computer Interface (BCI) is an alternative that may induce neuroplastic changes, even in chronic post-stroke patients. The purpose of this work was to evaluate the effects of a P300-based BCI-controlled FEST intervention, for ULMI recovery of chronic post-stroke patients. Methods A non-randomized pilot study was conducted, including 14 patients divided into 2 groups: BCI-FEST, and Conventional Therapy. Assessments of Upper limb functionality with Action Research Arm Test (ARAT), performance impairment with Fugl-Meyer assessment (FMA), Functional Independence Measure (FIM) and spasticity through Modified Ashworth Scale (MAS) were performed at baseline and after carrying out 20 therapy sessions, and the obtained scores compared using Chi square and Mann-Whitney U statistical tests (𝛼 = 0.05). Results After training, we found statistically significant differences between groups for FMA (p = 0.012), ARAT (p < 0.001), and FIM (p = 0.025) scales. Discussion It has been shown that FEST controlled by a P300-based BCI, may be more effective than conventional therapy to improve ULMI after stroke, regardless of chronicity. Conclusion The results of the proposed BCI-FEST intervention are promising, even for the most chronic post-stroke patients often relegated from novel interventions, whose expected recovery with conventional therapy is very low. It is necessary to carry out a randomized controlled trial in the future with a larger sample of patients.
Collapse
Affiliation(s)
- Ana G. Ramirez-Nava
- Neurological Rehabilitation Division, Instituto Nacional de Rehabilitación “Luis Guillermo Ibarra Ibarra”, Tlalpan, Mexico
| | - Jorge A. Mercado-Gutierrez
- Medical Engineering Research Division, Instituto Nacional de Rehabilitación “Luis Guillermo Ibarra Ibarra”, Tlalpan, Mexico
| | - Jimena Quinzaños-Fresnedo
- Neurological Rehabilitation Division, Instituto Nacional de Rehabilitación “Luis Guillermo Ibarra Ibarra”, Tlalpan, Mexico
| | - Cinthya Toledo-Peral
- Medical Engineering Research Division, Instituto Nacional de Rehabilitación “Luis Guillermo Ibarra Ibarra”, Tlalpan, Mexico
| | - Gabriel Vega-Martinez
- Medical Engineering Research Division, Instituto Nacional de Rehabilitación “Luis Guillermo Ibarra Ibarra”, Tlalpan, Mexico
| | - Mario Ibrahin Gutierrez
- Consejo Nacional de Humanidades, Ciencias y Tecnologías - Instituto Nacional de Rehabilitación “Luis Guillermo Ibarra Ibarra”, Tlalpan, Mexico
| | | | - Claudia Hernández-Arenas
- Neurological Rehabilitation Division, Instituto Nacional de Rehabilitación “Luis Guillermo Ibarra Ibarra”, Tlalpan, Mexico
| | - Josefina Gutiérrez-Martínez
- Medical Engineering Research Division, Instituto Nacional de Rehabilitación “Luis Guillermo Ibarra Ibarra”, Tlalpan, Mexico
| |
Collapse
|
5
|
Wang P, Cao X, Zhou Y, Gong P, Yousefnezhad M, Shao W, Zhang D. A comprehensive review on motion trajectory reconstruction for EEG-based brain-computer interface. Front Neurosci 2023; 17:1086472. [PMID: 37332859 PMCID: PMC10272365 DOI: 10.3389/fnins.2023.1086472] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/01/2022] [Accepted: 05/03/2023] [Indexed: 06/20/2023] Open
Abstract
The advance in neuroscience and computer technology over the past decades have made brain-computer interface (BCI) a most promising area of neurorehabilitation and neurophysiology research. Limb motion decoding has gradually become a hot topic in the field of BCI. Decoding neural activity related to limb movement trajectory is considered to be of great help to the development of assistive and rehabilitation strategies for motor-impaired users. Although a variety of decoding methods have been proposed for limb trajectory reconstruction, there does not yet exist a review that covers the performance evaluation of these decoding methods. To alleviate this vacancy, in this paper, we evaluate EEG-based limb trajectory decoding methods regarding their advantages and disadvantages from a variety of perspectives. Specifically, we first introduce the differences in motor execution and motor imagery in limb trajectory reconstruction with different spaces (2D and 3D). Then, we discuss the limb motion trajectory reconstruction methods including experiment paradigm, EEG pre-processing, feature extraction and selection, decoding methods, and result evaluation. Finally, we expound on the open problem and future outlooks.
Collapse
Affiliation(s)
| | | | | | | | | | - Wei Shao
- *Correspondence: Wei Shao, ; Daoqiang Zhang,
| | | |
Collapse
|
6
|
Fu J, Chen S, Shu X, Lin Y, Jiang Z, Wei D, Gao J, Jia J. Functional-oriented, portable brain-computer interface training for hand motor recovery after stroke: a randomized controlled study. Front Neurosci 2023; 17:1146146. [PMID: 37250399 PMCID: PMC10213744 DOI: 10.3389/fnins.2023.1146146] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/17/2023] [Accepted: 04/07/2023] [Indexed: 05/31/2023] Open
Abstract
Background Brain-computer interfaces (BCIs) have been proven to be effective for hand motor recovery after stroke. Facing kinds of dysfunction of the paretic hand, the motor task of BCIs for hand rehabilitation is relatively single, and the operation of many BCI devices is complex for clinical use. Therefore, we proposed a functional-oriented, portable BCI equipment and explored the efficiency of hand motor recovery after a stroke. Materials and methods Stroke patients were randomly assigned to the BCI group and the control group. The BCI group received BCI-based grasp/open motor training, while the control group received task-oriented guidance training. Both groups received 20 sessions of motor training in 4 weeks, and each session lasted for 30 min. The Fugl-Meyer assessment of the upper limb (FMA-UE) was applied for the assessment of rehabilitation outcomes, and the EEG signals were obtained for processing. Results The progress of FMA-UE between the BCI group [10.50 (5.75, 16.50)] and the control group [5.00 (4.00, 8.00)] was significantly different (Z = -2.834, P = 0.005). Meanwhile, the FMA-UE of both groups improved significantly (P < 0.001). A total of 24 patients in the BCI group achieved the minimal clinically important difference (MCID) of FMA-UE with an effective rate of 80%, and 16 in the control group achieved the MCID, with an effective rate of 51.6%. The lateral index of the open task in the BCI group was significantly decreased (Z = -2.704, P = 0.007). The average BCI accuracy for 24 stroke patients in 20 sessions was 70.7%, which was improved by 5.0% in the final session compared with the first session. Conclusion Targeted hand movement and two motor task modes, namely grasp and open, to be applied in a BCI design may be suitable in stroke patients with hand dysfunction. The functional-oriented, portable BCI training can promote hand recovery after a stroke, and it is expected to be widely used in clinical practice. The lateral index change of inter-hemispheric balance may be the mechanism of motor recovery. Trial registration number ChiCTR2100044492.
Collapse
Affiliation(s)
- Jianghong Fu
- Department of Rehabilitation Medicine, Huashan Hospital, Fudan University, Shanghai, China
| | - Shugeng Chen
- Department of Rehabilitation Medicine, Huashan Hospital, Fudan University, Shanghai, China
| | - Xiaokang Shu
- School of Mechanical Engineering, Shanghai Jiao Tong University, Shanghai, China
| | - Yifang Lin
- Department of Rehabilitation Medicine, Huashan Hospital, Fudan University, Shanghai, China
| | - Zewu Jiang
- Department of Rehabilitation Medicine, Huashan Hospital, Fudan University, Shanghai, China
| | - Dongshuai Wei
- Department of Rehabilitation Medicine, Huashan Hospital, Fudan University, Shanghai, China
| | - Jiajia Gao
- Department of Rehabilitation Medicine, Shanghai No. 3 Rehabilitation Hospital, Shanghai, China
| | - Jie Jia
- Department of Rehabilitation Medicine, Huashan Hospital, Fudan University, Shanghai, China
- National Clinical Research Center for Aging and Medicine, Huashan Hospital, Fudan University, Shanghai, China
- National Center for Neurological Disorders, Huashan Hospital, Fudan University, Shanghai, China
| |
Collapse
|
7
|
Fu J, Jiang Z, Shu X, Chen S, Jia J. Correlation between the ERD in grasp/open tasks of BCIs and hand function of stroke patients: a cross-sectional study. Biomed Eng Online 2023; 22:36. [PMID: 37061673 PMCID: PMC10105926 DOI: 10.1186/s12938-023-01091-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/04/2022] [Accepted: 03/02/2023] [Indexed: 04/17/2023] Open
Abstract
BACKGROUND AND AIMS Brain-computer interfaces (BCIs) are emerging as a promising tool for upper limb recovery after stroke, and motor tasks are an essential part of BCIs for patient training and control of rehabilitative/assistive BCIs. However, the correlation between brain activation with different levels of motor impairment and motor tasks in BCIs is still not so clear. Thus, we aim to compare the brain activation of different levels of motor impairment in performing the hand grasping and opening tasks in BCIs. METHODS We instructed stroke patients to perform motor attempts (MA) to grasp and open the affected hand for 30 trials, respectively. During this period, they underwent EEG acquisition and BCIs accuracy recordings. They also received detailed history records and behavioral scale assessments (the Fugl-Meyer assessment of upper limb, FMA-UE). RESULTS The FMA-UE was negatively correlated with the event-related desynchronization (ERD) of the affected hemisphere during open MA (R = - 0.423, P = 0.009) but not with grasp MA (R = - 0.058, P = 0.733). Then we divided the stroke patients into group 1 (Brunnstrom recovery stages between I to II, n = 19) and group 2 (Brunnstrom recovery stages between III to VI, n = 23). No difference during the grasping task (t = 0.091, P = 0.928), but a significant difference during the open task (t = 2.156, P = 0.037) was found between the two groups on the affected hemisphere. No significant difference was found in the unaffected hemisphere. CONCLUSIONS The study indicated that brain activation is positively correlated with the hand function of stroke in open-hand tasks. In the grasping task, the patients in the different groups have a similar brain response, while in the open task, mildly injured patients have more brain activation in open the hand than the poor hand function patients.
Collapse
Affiliation(s)
- Jianghong Fu
- Department of Rehabilitation Medicine, Huashan Hospital, Fudan University, 12 Mid-Wulumuqi Road, Jing'an District, Shanghai, 200040, China
| | - ZeWu Jiang
- Department of Rehabilitation Medicine, Huashan Hospital, Fudan University, 12 Mid-Wulumuqi Road, Jing'an District, Shanghai, 200040, China
| | - Xiaokang Shu
- School of Mechanical Engineering, Shanghai Jiao Tong University, Shanghai, China
| | - Shugeng Chen
- Department of Rehabilitation Medicine, Huashan Hospital, Fudan University, 12 Mid-Wulumuqi Road, Jing'an District, Shanghai, 200040, China.
| | - Jie Jia
- Department of Rehabilitation Medicine, Huashan Hospital, Fudan University, 12 Mid-Wulumuqi Road, Jing'an District, Shanghai, 200040, China.
- National Clinical Research Center for Aging and Medicine, Huashan Hospital, Fudan University, Shanghai, China.
- National Center for Neurological Disorders, Shanghai, China.
| |
Collapse
|
8
|
Ivanov N, Chau T. Riemannian geometry-based metrics to measure and reinforce user performance changes during brain-computer interface user training. Front Comput Neurosci 2023; 17:1108889. [PMID: 36860616 PMCID: PMC9968793 DOI: 10.3389/fncom.2023.1108889] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/26/2022] [Accepted: 01/25/2023] [Indexed: 02/15/2023] Open
Abstract
Despite growing interest and research into brain-computer interfaces (BCI), their usage remains limited outside of research laboratories. One reason for this is BCI inefficiency, the phenomenon where a significant number of potential users are unable to produce machine-discernible brain signal patterns to control the devices. To reduce the prevalence of BCI inefficiency, some have advocated for novel user-training protocols that enable users to more effectively modulate their neural activity. Important considerations for the design of these protocols are the assessment measures that are used for evaluating user performance and for providing feedback that guides skill acquisition. Herein, we present three trial-wise adaptations (running, sliding window and weighted average) of Riemannian geometry-based user-performance metrics (classDistinct reflecting the degree of class separability and classStability reflecting the level of within-class consistency) to enable feedback to the user following each individual trial. We evaluated these metrics, along with conventional classifier feedback, using simulated and previously recorded sensorimotor rhythm-BCI data to assess their correlation with and discrimination of broader trends in user performance. Analysis revealed that the sliding window and weighted average variants of our proposed trial-wise Riemannian geometry-based metrics more accurately reflected performance changes during BCI sessions compared to conventional classifier output. The results indicate the metrics are a viable method for evaluating and tracking user performance changes during BCI-user training and, therefore, further investigation into how these metrics may be presented to users during training is warranted.
Collapse
Affiliation(s)
- Nicolas Ivanov
- PRISM Lab, Bloorview Research Institute, Holland Bloorview Kids Rehabilitation Hospital, Toronto, ON, Canada
- Institute of Biomedical Engineering, University of Toronto, Toronto, ON, Canada
| | - Tom Chau
- PRISM Lab, Bloorview Research Institute, Holland Bloorview Kids Rehabilitation Hospital, Toronto, ON, Canada
- Institute of Biomedical Engineering, University of Toronto, Toronto, ON, Canada
| |
Collapse
|
9
|
A Review of Brain Activity and EEG-Based Brain-Computer Interfaces for Rehabilitation Application. BIOENGINEERING (BASEL, SWITZERLAND) 2022; 9:bioengineering9120768. [PMID: 36550974 PMCID: PMC9774292 DOI: 10.3390/bioengineering9120768] [Citation(s) in RCA: 12] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 10/26/2022] [Revised: 11/29/2022] [Accepted: 11/30/2022] [Indexed: 12/12/2022]
Abstract
Patients with severe CNS injuries struggle primarily with their sensorimotor function and communication with the outside world. There is an urgent need for advanced neural rehabilitation and intelligent interaction technology to provide help for patients with nerve injuries. Recent studies have established the brain-computer interface (BCI) in order to provide patients with appropriate interaction methods or more intelligent rehabilitation training. This paper reviews the most recent research on brain-computer-interface-based non-invasive rehabilitation systems. Various endogenous and exogenous methods, advantages, limitations, and challenges are discussed and proposed. In addition, the paper discusses the communication between the various brain-computer interface modes used between severely paralyzed and locked patients and the surrounding environment, particularly the brain-computer interaction system utilizing exogenous (induced) EEG signals (such as P300 and SSVEP). This discussion reveals with an examination of the interface for collecting EEG signals, EEG components, and signal postprocessing. Furthermore, the paper describes the development of natural interaction strategies, with a focus on signal acquisition, data processing, pattern recognition algorithms, and control techniques.
Collapse
|
10
|
Mansour S, Giles J, Ang KK, Nair KPS, Phua KS, Arvaneh M. Exploring the ability of stroke survivors in using the contralesional hemisphere to control a brain-computer interface. Sci Rep 2022; 12:16223. [PMID: 36171400 PMCID: PMC9519575 DOI: 10.1038/s41598-022-20345-x] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/16/2022] [Accepted: 09/12/2022] [Indexed: 11/09/2022] Open
Abstract
Brain-computer interfaces (BCIs) have recently been shown to be clinically effective as a novel method of stroke rehabilitation. In many BCI-based studies, the activation of the ipsilesional hemisphere was considered a key factor required for motor recovery after stroke. However, emerging evidence suggests that the contralesional hemisphere also plays a role in motor function rehabilitation. The objective of this study is to investigate the effectiveness of the BCI in detecting motor imagery of the affected hand from contralesional hemisphere. We analyzed a large EEG dataset from 136 stroke patients who performed motor imagery of their stroke-impaired hand. BCI features were extracted from channels covering either the ipsilesional, contralesional or bilateral hemisphere, and the offline BCI accuracy was computed using 10 [Formula: see text] 10-fold cross-validations. Our results showed that most stroke patients can operate the BCI using either their contralesional or ipsilesional hemisphere. Those with the ipsilesional BCI accuracy of less than 60% had significantly higher motor impairments than those with the ipsilesional BCI accuracy above 80%. Interestingly, those with the ipsilesional BCI accuracy of less than 60% achieved a significantly higher contralesional BCI accuracy, whereas those with the ipsilesional BCI accuracy more than 80% had significantly poorer contralesional BCI accuracy. This study suggests that contralesional BCI may be a useful approach for those with a high motor impairment who cannot accurately generate signals from ipsilesional hemisphere to effectively operate BCI.
Collapse
Affiliation(s)
- Salem Mansour
- Department of Automatic Control and Systems Engineering, University of Sheffield, Mapping Street, Sheffield, S13JD, UK.
| | - Joshua Giles
- Department of Automatic Control and Systems Engineering, University of Sheffield, Mapping Street, Sheffield, S13JD, UK
- Agency for Science Technology and Research, Institute for Infocomm Research, Singapore, Singapore
| | - Kai Keng Ang
- Agency for Science Technology and Research, Institute for Infocomm Research, Singapore, Singapore
- School of Computer Science and Engineering, Nanyang Technological University, Singapore, Singapore
| | - Krishnan P S Nair
- Neurology, Royal Hallamshire Hospital, Sheffield Teaching Hospitals NHS Foundation Trust and The University of Sheffield, Sheffield, UK
| | - Kok Soon Phua
- Agency for Science Technology and Research, Institute for Infocomm Research, Singapore, Singapore
| | - Mahnaz Arvaneh
- Department of Automatic Control and Systems Engineering, University of Sheffield, Mapping Street, Sheffield, S13JD, UK
| |
Collapse
|
11
|
Jia J. Exploration on neurobiological mechanisms of the central–peripheral–central closed-loop rehabilitation. Front Cell Neurosci 2022; 16:982881. [PMID: 36119128 PMCID: PMC9479450 DOI: 10.3389/fncel.2022.982881] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/30/2022] [Accepted: 08/12/2022] [Indexed: 11/13/2022] Open
Abstract
Central and peripheral interventions for brain injury rehabilitation have been widely employed. However, as patients’ requirements and expectations for stroke rehabilitation have gradually increased, the limitations of simple central intervention or peripheral intervention in the rehabilitation application of stroke patients’ function have gradually emerged. Studies have suggested that central intervention promotes the activation of functional brain regions and improves neural plasticity, whereas peripheral intervention enhances the positive feedback and input of sensory and motor control modes to the central nervous system, thereby promoting the remodeling of brain function. Based on the model of a central–peripheral–central (CPC) closed loop, the integration of center and peripheral interventions was effectively completed to form “closed-loop” information feedback, which could be applied to specific brain areas or function-related brain regions of patients. Notably, the closed loop can also be extended to central and peripheral immune systems as well as central and peripheral organs such as the brain–gut axis and lung–brain axis. In this review article, the model of CPC closed-loop rehabilitation and the potential neuroimmunological mechanisms of a closed-loop approach will be discussed. Further, we highlight critical questions about the neuroimmunological aspects of the closed-loop technique that merit future research attention.
Collapse
Affiliation(s)
- Jie Jia
- Department of Rehabilitation Medicine, Huashan Hospital, Fudan University, Shanghai, China
- National Center for Neurological Disorders, Shanghai, China
- National Clinical Research Center for Aging and Medicine, Huashan Hospital, Fudan University, Shanghai, China
- National Regional Medical Center, Fujian, China
- The First Affiliated Hospital of Fujian Medical University, Fujian, China
- *Correspondence: Jie Jia,
| |
Collapse
|
12
|
Chen L, Zhang L, Wang Z, Gu B, Zhang X, Ming D. The Effects of Sensory Threshold Somatosensory Electrical Stimulation on Users With Different MI-BCI Performance. Front Neurosci 2022; 16:909434. [PMID: 35784856 PMCID: PMC9247255 DOI: 10.3389/fnins.2022.909434] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/31/2022] [Accepted: 05/23/2022] [Indexed: 11/13/2022] Open
Abstract
Motor imagery-based brain-computer interface (MI-BCI) has been largely studied to improve motor learning and promote motor recovery. However, the difficulty in performing MI limits the widespread application of MI-BCI. It has been suggested that the usage of sensory threshold somatosensory electrical stimulation (st-SES) is a promising way to guide participants on MI tasks, but it is still unclear whether st-SES is effective for all users. In the present study, we aimed to examine the effects of st-SES on the MI-BCI performance in two BCI groups (High Performers and Low Performers). Twenty healthy participants were recruited to perform MI and resting tasks with EEG recordings. These tasks were modulated with or without st-SES. We demonstrated that st-SES improved the performance of MI-BCI in the Low Performers, but led to a decrease in the accuracy of MI-BCI in the High Performers. Furthermore, for the Low Performers, the combination of st-SES and MI resulted in significantly greater event-related desynchronization (ERD) and sample entropy of sensorimotor rhythm than MI alone. However, the ERD and sample entropy values of MI did not change significantly during the st-SES intervention in the High Performers. Moreover, we found that st-SES had an effect on the functional connectivity of the fronto-parietal network in the alpha band of Low Performers and the beta band of High Performers, respectively. Our results demonstrated that somatosensory input based on st-SES was only beneficial for sensorimotor cortical activation and MI-BCI performance in the Low Performers, but not in the High Performers. These findings help to optimize guidance strategies to adapt to different categories of users in the practical application of MI-BCI.
Collapse
Affiliation(s)
- Long Chen
- Department of Biomedical Engineering, Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, China
| | - Lei Zhang
- Department of Biomedical Engineering, Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, China
| | - Zhongpeng Wang
- Department of Biomedical Engineering, College of Precision Instruments & Optoelectronics Engineering, Tianjin University, Tianjin, China
| | - Bin Gu
- Department of Biomedical Engineering, College of Precision Instruments & Optoelectronics Engineering, Tianjin University, Tianjin, China
| | - Xin Zhang
- Department of Biomedical Engineering, College of Precision Instruments & Optoelectronics Engineering, Tianjin University, Tianjin, China
| | - Dong Ming
- Department of Biomedical Engineering, Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, China
- Department of Biomedical Engineering, College of Precision Instruments & Optoelectronics Engineering, Tianjin University, Tianjin, China
| |
Collapse
|
13
|
Chi X, Wan C, Wang C, Zhang Y, Chen X, Cui H. A Novel Hybrid Brain-Computer Interface Combining Motor Imagery and Intermodulation Steady-State Visual Evoked Potential. IEEE Trans Neural Syst Rehabil Eng 2022; 30:1525-1535. [PMID: 35657833 DOI: 10.1109/tnsre.2022.3179971] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
The hybrid brain-computer interface (hBCI) combining motor imagery (MI) and steady-state visual evoked potential (SSVEP) has been proven to have better performance than a pure MI- or SSVEP-based brain-computer interface (BCI). In most studies on hBCIs, subjects have been required to focus their attention on flickering light-emitting diodes (LEDs) or blocks while imagining body movements. However, these two classical tasks performed concurrently have a poor correlation. Therefore, it is necessary to reduce the task complexity of such a system and improve its user-friendliness. Aiming to achieve this goal, this study proposes a novel hybrid BCI that combines MI and intermodulation SSVEPs. In the proposed system, images of both hands flicker at the same frequency (i.e., 30 Hz) but at different grasp frequencies (i.e., 1 Hz for the left hand, and 1.5 Hz for the right hand), resulting in different intermodulation frequencies for encoding targets. Additionally, movement observation for subjects can help to perform the MI task better. In this study, two types of brain signals are classified independently and then fused by a scoring mechanism based on the probability distribution of relevant parameters. The online verification results showed that the average accuracies of 12 healthy subjects and 11 stroke patients were 92.40 ± 7.45% and 73.07 ± 9.07%, respectively. The average accuracies of 10 healthy subjects in the MI, SSVEP, and hybrid tasks were 84.00 ± 12.81%, 80.75 ± 8.08%, and 89.00 ± 9.94%, respectively. The high recognition accuracy verifies the feasibility and robustness of the proposed system. This study provides a novel and natural paradigm for a hybrid BCI based on MI and SSVEP.
Collapse
|
14
|
Kumari R, Janković M, Costa A, Savić A, Konstantinović L, Djordjević O, Vucković A. Short term priming effect of brain-actuated muscle stimulation using bimanual movements in stroke. Clin Neurophysiol 2022; 138:108-121. [DOI: 10.1016/j.clinph.2022.03.002] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/11/2021] [Revised: 02/26/2022] [Accepted: 03/01/2022] [Indexed: 11/03/2022]
|
15
|
Abstract
OBJECTIVE Modeling the brain as a white box is vital for investigating the brain. However, the physical properties of the human brain are unclear. Therefore, BCI algorithms using EEG signals are generally a data-driven approach and generate a black- or gray-box model. This paper presents the first EEG-based BCI algorithm (EEG-BCI using Gang neurons, EEGG) decomposing the brain into some simple components with physical meaning and integrating recognition and analysis of brain activity. APPROACH Independent and interactive components of neurons or brain regions can fully describe the brain. This paper constructed a relation frame based on the independent and interactive compositions for intention recognition and analysis using a novel dendrite module of Gang neurons. A total of 4,906 EEG data of left- and right-hand motor imagery(MI) from 26 subjects were obtained from GigaDB. Firstly, this paper explored EEGG's classification performance by cross-subject accuracy. Secondly, this paper transformed the trained EEGG model into a relation spectrum expressing independent and interactive components of brain regions. Then, the relation spectrum was verified using the known ERD/ERS phenomenon. Finally, this paper explored the previously unreachable further BCI-based analysis of the brain. MAIN RESULTS (1) EEGG was more robust than typical "CSP+" algorithms for the low-quality data. (2) The relation spectrum showed the known ERD/ERS phenomenon. (3) Interestingly, EEGG showed that interactive components between brain regions suppressed ERD/ERS effects on classification. This means that generating fine hand intention needs more centralized activation in the brain. SIGNIFICANCE EEGG decomposed the biological EEG-intention system of this paper into the relation spectrum inheriting the Taylor series (in analogy with the data-driven but human-readable Fourier transform and frequency spectrum), which offers a novel frame for analysis of the brain.
Collapse
|
16
|
Meng J, Wu Z, Li S, Zhu X. Effects of Gaze Fixation on the Performance of a Motor Imagery-Based Brain-Computer Interface. Front Hum Neurosci 2022; 15:773603. [PMID: 35140593 PMCID: PMC8818858 DOI: 10.3389/fnhum.2021.773603] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/10/2021] [Accepted: 12/08/2021] [Indexed: 11/13/2022] Open
Abstract
Motor imagery-based brain-computer interfaces (BCIs) have been studied without controlling subjects’ gaze fixation position previously. The effect of gaze fixation and covert attention on the behavioral performance of BCI is still unknown. This study designed a gaze fixation controlled experiment. Subjects were required to conduct a secondary task of gaze fixation when performing the primary task of motor imagination. Subjects’ performance was analyzed according to the relationship between motor imagery target and the gaze fixation position, resulting in three BCI control conditions, i.e., congruent, incongruent, and center cross trials. A group of fourteen subjects was recruited. The average group performances of three different conditions did not show statistically significant differences in terms of BCI control accuracy, feedback duration, and trajectory length. Further analysis of gaze shift response time revealed a significantly shorter response time for congruent trials compared to incongruent trials. Meanwhile, the parietal occipital cortex also showed active neural activities for congruent and incongruent trials, and this was revealed by a contrast analysis of R-square values and lateralization index. However, the lateralization index computed from the parietal and occipital areas was not correlated with the BCI behavioral performance. Subjects’ BCI behavioral performance was not affected by the position of gaze fixation and covert attention. This indicated that motor imagery-based BCI could be used freely in robotic arm control without sacrificing performance.
Collapse
Affiliation(s)
- Jianjun Meng
- Department of Mechanical Engineering, Shanghai Jiao Tong University, Shanghai, China
- *Correspondence: Jianjun Meng,
| | - Zehan Wu
- Department of Neurosurgery, Huashan Hospital, Fudan University, Shanghai, China
| | - Songwei Li
- Department of Mechanical Engineering, Shanghai Jiao Tong University, Shanghai, China
| | - Xiangyang Zhu
- Department of Mechanical Engineering, Shanghai Jiao Tong University, Shanghai, China
| |
Collapse
|
17
|
Mansour S, Ang KK, Nair KP, Phua KS, Arvaneh M. Efficacy of Brain-Computer Interface and the Impact of Its Design Characteristics on Poststroke Upper-limb Rehabilitation: A Systematic Review and Meta-analysis of Randomized Controlled Trials. Clin EEG Neurosci 2022; 53:79-90. [PMID: 33913351 PMCID: PMC8619716 DOI: 10.1177/15500594211009065] [Citation(s) in RCA: 16] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/08/2020] [Revised: 02/03/2021] [Accepted: 03/12/2021] [Indexed: 11/15/2022]
Abstract
Background. A number of recent randomized controlled trials reported the efficacy of brain-computer interface (BCI) for upper-limb stroke rehabilitation compared with other therapies. Despite the encouraging results reported, there is a significant variance in the reported outcomes. This paper aims to investigate the effectiveness of different BCI designs on poststroke upper-limb rehabilitation. Methods. The effect sizes of pooled and individual studies were assessed by computing Hedge's g values with a 95% confidence interval. Subgroup analyses were also performed to examine the impact of different BCI designs on the treatment effect. Results. The study included 12 clinical trials involving 298 patients. The analysis showed that the BCI yielded significant superior short-term and long-term efficacy in improving the upper-limb motor function compared to the control therapies (Hedge's g = 0.73 and 0.33, respectively). Based on our subgroup analyses, the BCI studies that used the intention of movement had a higher effect size compared to those used motor imagery (Hedge's g = 1.21 and 0.55, respectively). The BCI studies using band power features had a significantly higher effect size than those using filter bank common spatial patterns features (Hedge's g = 1.25 and - 0.23, respectively). Finally, the studies that used functional electrical stimulation as the BCI feedback had the highest effect size compared to other devices (Hedge's g = 1.2). Conclusion. This meta-analysis confirmed the effectiveness of BCI for upper-limb rehabilitation. Our findings support the use of band power features, the intention of movement, and the functional electrical stimulation in future BCI designs for poststroke upper-limb rehabilitation.
Collapse
Affiliation(s)
- Salem Mansour
- Department of Automatic Control and Systems Engineering, University
of Sheffield, UK
| | - Kai Keng Ang
- Agency for Science Technology and
Research, Institute for Infocomm Research, Singapore, Singapore
- School of Computer Science and Engineering, Nanyang Technological
University, Singapore
| | - Krishnan P.S. Nair
- School of Computer Science and Engineering, Nanyang Technological
University, Singapore
| | - Kok Soon Phua
- Agency for Science Technology and
Research, Institute for Infocomm Research, Singapore, Singapore
| | - Mahnaz Arvaneh
- Department of Automatic Control and Systems Engineering, University
of Sheffield, UK
| |
Collapse
|
18
|
Wang Y, Luo Z, Zhao S, Xie L, Xu M, Ming D, Yin E. Spatial localization in target detection based on decoding N2pc component. J Neurosci Methods 2021; 369:109440. [PMID: 34979193 DOI: 10.1016/j.jneumeth.2021.109440] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/03/2021] [Revised: 10/08/2021] [Accepted: 12/11/2021] [Indexed: 11/18/2022]
Abstract
BACKGROUND The Gaze-independent BCI system is used to restore communication in patients with eye movement disorders. One available control mechanism is the utilization of spatial attention. However, spatial information is mostly used to simply answer the "True/False" target recognition question and is seldom used to improve the efficiency of target detection. Therefore, it is necessary to utilize the potential advantages of spatial attention to improving the target detection efficiency. NEW METHOD We found that N2pc could be used to assess spatial attention shift and determine target position. It was a negative wave in the posterior brain on the contralateral target stimulus. From this, we designed a novel spatial coding paradigm to achieve two main purposes at each stimulus presentation: target recognition and spatial localization. COMPARISON WITH EXISTING METHODS We used a two-step classification framework to decode the P300 and N2pc components. RESULTS The average decoding accuracy of fourteen subjects was 84.43% (σ = 1.14%), and the classification accuracy of six subjects was more than 85%. The information transfer rate of the spatial coding paradigm could reach 60.52 bits/min. Compared with the single stimulus paradigm, the target detection efficiency was successfully improved by approximately 10%. CONCLUSIONS The spatial coding paradigm proposed in this paper answered both "True/False" and "Left/Right" questions by decoding spatial attention information. This method could significantly improve image detection efficiencies, such as visual search tasks, Internet image screening, or military target determination.
Collapse
Affiliation(s)
- Yijing Wang
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin 300072, China
| | - Zhiguo Luo
- Defense Innovation Institute, Academy of Military Sciences (AMS), Beijing100071, China; Tianjin Artificial Intelligence Innovation Center (TAIIC),Tianjin 300450, China
| | - Shaokai Zhao
- College of Life Sciences and Key Laboratory of Bioactive Materials Ministry of Education, Nankai University, Tianjin 300071, China
| | - Liang Xie
- Defense Innovation Institute, Academy of Military Sciences (AMS), Beijing100071, China; Tianjin Artificial Intelligence Innovation Center (TAIIC),Tianjin 300450, China
| | - Minpeng Xu
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin 300072, China
| | - Dong Ming
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin 300072, China
| | - Erwei Yin
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin 300072, China; Defense Innovation Institute, Academy of Military Sciences (AMS), Beijing100071, China; Tianjin Artificial Intelligence Innovation Center (TAIIC),Tianjin 300450, China.
| |
Collapse
|
19
|
Chen S, Shu X, Wang H, Ding L, Fu J, Jia J. The Differences Between Motor Attempt and Motor Imagery in Brain-Computer Interface Accuracy and Event-Related Desynchronization of Patients With Hemiplegia. Front Neurorobot 2021; 15:706630. [PMID: 34803647 PMCID: PMC8602190 DOI: 10.3389/fnbot.2021.706630] [Citation(s) in RCA: 16] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/07/2021] [Accepted: 10/07/2021] [Indexed: 11/13/2022] Open
Abstract
Background: Motor attempt and motor imagery (MI) are two common motor tasks used in brain-computer interface (BCI). They are widely researched for motor rehabilitation in patients with hemiplegia. The differences between the motor attempt (MA) and MI tasks of patients with hemiplegia can be used to promote BCI application. This study aimed to explore the accuracy of BCI and event-related desynchronization (ERD) between the two tasks. Materials and Methods: We recruited 13 patients with stroke and 3 patients with traumatic brain injury, to perform MA and MI tasks in a self-control design. The BCI accuracies from the bilateral, ipsilesional, and contralesional hemispheres were analyzed and compared between different tasks. The cortical activation patterns were evaluated with ERD and laterality index (LI). Results: The study showed that the BCI accuracies of MA were significantly (p < 0.05) higher than MI in the bilateral, ipsilesional, and contralesional hemispheres in the alpha-beta (8–30 Hz) frequency bands. There was no significant difference in ERD and LI between the MA and MI tasks in the 8–30 Hz frequency bands. However, in the MA task, there was a negative correlation between the ERD values in the channel CP1 and ipsilesional hemispheric BCI accuracies (r = −0.552, p = 0.041, n = 14) and a negative correlation between the ERD values in channel CP2 and bilateral hemispheric BCI accuracies (r = −0.543, p = 0.045, n = 14). While in the MI task, there were negative correlations between the ERD values in channel C4 and bilateral hemispheric BCI accuracies (r = −0.582, p = 0.029, n = 14) as well as the contralesional hemispheric BCI accuracies (r = −0.657, p = 0.011, n = 14). As for motor dysfunction, there was a significant positive correlation between the ipsilesional BCI accuracies and FMA scores of the hand part in 8–13 Hz (r = 0.565, p = 0.035, n = 14) in the MA task and a significant positive correlation between the ipsilesional BCI accuracies and FMA scores of the hand part in 13–30 Hz (r = 0.558, p = 0.038, n = 14) in the MI task. Conclusion: The MA task may achieve better BCI accuracy but have similar cortical activations with the MI task. Cortical activation (ERD) may influence the BCI accuracy, which should be carefully considered in the BCI motor rehabilitation of patients with hemiplegia.
Collapse
Affiliation(s)
- Shugeng Chen
- Department of Rehabilitation Medicine, Huashan Hospital, Fudan University, Shanghai, China
| | - Xiaokang Shu
- School of Mechanical Engineering, Shanghai Jiao Tong University, Shanghai, China
| | - Hewei Wang
- Department of Rehabilitation Medicine, Huashan Hospital, Fudan University, Shanghai, China
| | - Li Ding
- Department of Rehabilitation Medicine, Huashan Hospital, Fudan University, Shanghai, China
| | - Jianghong Fu
- Department of Rehabilitation Medicine, Huashan Hospital, Fudan University, Shanghai, China
| | - Jie Jia
- Department of Rehabilitation Medicine, Huashan Hospital, Fudan University, Shanghai, China.,National Clinical Research Center for Aging and Medicine, Huashan Hospital, Fudan University, Shanghai, China.,National Center for Neurological Disorders, Shanghai, China
| |
Collapse
|
20
|
Park S, Ha J, Kim DH, Kim L. Improving Motor Imagery-Based Brain-Computer Interface Performance Based on Sensory Stimulation Training: An Approach Focused on Poorly Performing Users. Front Neurosci 2021; 15:732545. [PMID: 34803582 PMCID: PMC8602688 DOI: 10.3389/fnins.2021.732545] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/29/2021] [Accepted: 10/20/2021] [Indexed: 11/13/2022] Open
Abstract
The motor imagery (MI)-based brain-computer interface (BCI) is an intuitive interface that provides control over computer applications directly from brain activity. However, it has shown poor performance compared to other BCI systems such as P300 and SSVEP BCI. Thus, this study aimed to improve MI-BCI performance by training participants in MI with the help of sensory inputs from tangible objects (i.e., hard and rough balls), with a focus on poorly performing users. The proposed method is a hybrid of training and imagery, combining motor execution and somatosensory sensation from a ball-type stimulus. Fourteen healthy participants participated in the somatosensory-motor imagery (SMI) experiments (within-subject design) involving EEG data classification with a three-class system (signaling with left hand, right hand, or right foot). In the scenario of controlling a remote robot to move it to the target point, the participants performed MI when faced with a three-way intersection. The SMI condition had a better classification performance than did the MI condition, achieving a 68.88% classification performance averaged over all participants, which was 6.59% larger than that in the MI condition (p < 0.05). In poor performers, the classification performance in SMI was 10.73% larger than in the MI condition (62.18% vs. 51.45%). However, good performers showed a slight performance decrement (0.86%) in the SMI condition compared to the MI condition (80.93% vs. 81.79%). Combining the brain signals from the motor and somatosensory cortex, the proposed hybrid MI-BCI system demonstrated improved classification performance, this phenomenon was predominant in poor performers (eight out of nine subjects). Hybrid MI-BCI systems may significantly contribute to reducing the proportion of BCI-inefficiency users and closing the performance gap with other BCI systems.
Collapse
Affiliation(s)
- Sangin Park
- Center for Bionics, Korea Institute of Science and Technology, Seoul, South Korea
| | - Jihyeon Ha
- Center for Bionics, Korea Institute of Science and Technology, Seoul, South Korea
- Department of Biomedical Engineering, Hanyang University, Seoul, South Korea
| | - Da-Hye Kim
- Center for Bionics, Korea Institute of Science and Technology, Seoul, South Korea
| | - Laehyun Kim
- Center for Bionics, Korea Institute of Science and Technology, Seoul, South Korea
- Department of HY-KIST Bio-Convergence, Hanyang University, Seoul, South Korea
| |
Collapse
|
21
|
Leeuwis N, Yoon S, Alimardani M. Functional Connectivity Analysis in Motor-Imagery Brain Computer Interfaces. Front Hum Neurosci 2021; 15:732946. [PMID: 34720907 PMCID: PMC8555469 DOI: 10.3389/fnhum.2021.732946] [Citation(s) in RCA: 13] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/29/2021] [Accepted: 09/03/2021] [Indexed: 11/25/2022] Open
Abstract
Motor Imagery BCI systems have a high rate of users that are not capable of modulating their brain activity accurately enough to communicate with the system. Several studies have identified psychological, cognitive, and neurophysiological measures that might explain this MI-BCI inefficiency. Traditional research had focused on mu suppression in the sensorimotor area in order to classify imagery, but this does not reflect the true dynamics that underlie motor imagery. Functional connectivity reflects the interaction between brain regions during the MI task and resting-state network and is a promising tool in improving MI-BCI classification. In this study, 54 novice MI-BCI users were split into two groups based on their accuracy and their functional connectivity was compared in three network scales (Global, Large and Local scale) during the resting-state, left vs. right-hand motor imagery task, and the transition between the two phases. Our comparison of High and Low BCI performers showed that in the alpha band, functional connectivity in the right hemisphere was increased in High compared to Low aptitude MI-BCI users during motor imagery. These findings contribute to the existing literature that indeed connectivity might be a valuable feature in MI-BCI classification and in solving the MI-BCI inefficiency problem.
Collapse
Affiliation(s)
- Nikki Leeuwis
- Department of Cognitive Science and Artificial Intelligence, Tilburg University, Tilburg, Netherlands
| | | | | |
Collapse
|
22
|
Feng Z, Sun Y, Qian L, Qi Y, Wang Y, Guan C, Sun Y. Design a novel BCI for neurorehabilitation using concurrent LFP and EEG features: a case study. IEEE Trans Biomed Eng 2021; 69:1554-1563. [PMID: 34582344 DOI: 10.1109/tbme.2021.3115799] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
Abstract
Brain-computer interfaces (BCI) that enables people with severe motor disabilities to use their brain signals for direct control of objects have attracted increased interest in rehabilitation. To date, no study has investigated feasibility of the BCI framework incorporating both intracortical and scalp signals. Methods: Concurrent local field potential (LFP) from the hand-knob area and scalp EEG were recorded in a paraplegic patient undergoing a spike-based close-loop neurorehabilitation training. Based upon multimodal spatio-spectral feature extraction and Naive Bayes classification, we developed, for the first time, a novel LFP-EEG-BCI for motor intention decoding. A transfer learning (TL) approach was employed to further improve the feasibility. The performance of the proposed LFP-EEG-BCI for four-class upper-limb motor intention decoding was assessed. Results: Using a decision fusion strategy, we showed that the LFP-EEG-BCI significantly (p <0.05) outperformed single modal BCI (LFP-BCI and EEG-BCI) in terms of decoding accuracy with the best performance achieved using regularized common spatial pattern features. Interrogation of feature characteristics revealed discriminative spatial and spectral patterns, which may lead to new insights for better understanding of brain dynamics during different motor imagery tasks and promote development of efficient decoding algorithms. Moreover, we showed that similar classification performance could be obtained with few training trials, therefore highlighting the efficacy of TL. Conclusion: The present findings demonstrated the superiority of the novel LFP-EEG-BCI in motor intention decoding. Significance: This work introduced a novel LFP-EEG-BCI that may lead to new directions for developing practical neurorehabilitation systems with high detection accuracy and multi-paradigm feasibility in clinical applications.
Collapse
|
23
|
Al-Qazzaz NK, Alyasseri ZAA, Abdulkareem KH, Ali NS, Al-Mhiqani MN, Guger C. EEG feature fusion for motor imagery: A new robust framework towards stroke patients rehabilitation. Comput Biol Med 2021; 137:104799. [PMID: 34478922 DOI: 10.1016/j.compbiomed.2021.104799] [Citation(s) in RCA: 21] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/21/2021] [Revised: 08/18/2021] [Accepted: 08/22/2021] [Indexed: 10/20/2022]
Abstract
Stroke is the second foremost cause of death worldwide and is one of the most common causes of disability. Several approaches have been proposed to manage stroke patient rehabilitation such as robotic devices and virtual reality systems, and researchers have found that the brain-computer interfaces (BCI) approaches can provide better results. Therefore, the most challenging tasks with BCI applications involve identifying the best technique(s) that can reveal the neuron stimulus information from the patients' brains and extracting the most effective features from these signals as well. Accordingly, the main novelty of this paper is twofold: propose a new feature fusion method for motor imagery (MI)-based BCI and develop an automatic MI framework to detect the changes pre- and post-rehabilitation. This study investigated the electroencephalography (EEG) dataset from post-stroke patients with upper extremity hemiparesis. All patients performed 25 MI-based BCI sessions with follow up assessment visits to examine the functional changes before and after EEG neurorehabilitation. In the first stage, conventional filters and automatic independent component analysis with wavelet transform (AICA-WT) denoising technique were used. Next, attributes from time, entropy and frequency domains were computed, and the effective features were combined into time-entropy-frequency (TEF) attributes. Consequently, the AICA-WT and the TEF fusion set were utilised to develop an AICA-WT-TEF framework. Then, support vector machine (SVM), k-nearest neighbours (kNN) and random forest (RF) classification technique were tested for MI-based BCI rehabilitation. The proposed AICA-WT-TEF framework with RF classifier achieves the best results compared with other classifiers. Finally, the proposed framework and feature fusion set achieve a significant performance in terms of accuracy measures compared to the state-of-the-art. Therefore, the proposed methods could be crucial for improving the process of automatic MI rehabilitation and are recommended for implementation in real-time applications.
Collapse
Affiliation(s)
- Noor Kamal Al-Qazzaz
- Department of Biomedical Engineering, Al-Khwarizmi College of Engineering, University of Baghdad, Baghdad, 47146, Iraq.
| | - Zaid Abdi Alkareem Alyasseri
- Center for Artificial Intelligence Technology, Faculty of Information Science and Technology, Universiti Kebangsaan Malaysia, 43600, Bangi, Selangor, Malaysia; ECE Department-Faculty of Engineering, University of Kufa, P.O. Box 21, Najaf, Iraq.
| | | | - Nabeel Salih Ali
- Information Technology Research and Development Centre/ University of Kufa, Kufa, P.O. Box (21), Najaf Governorate, Iraq.
| | - Mohammed Nasser Al-Mhiqani
- Information Security and Networking Research Group (InFORSNET), Faculty of Information and Communication Technology, Universiti Teknikal Malaysia Melaka, Durian Tunggal, 76100, Malaysia.
| | | |
Collapse
|
24
|
Wu Q, Ge Y, Ma D, Pang X, Cao Y, Zhang X, Pan Y, Zhang T, Dou W. Analysis of Prognostic Risk Factors Determining Poor Functional Recovery After Comprehensive Rehabilitation Including Motor-Imagery Brain-Computer Interface Training in Stroke Patients: A Prospective Study. Front Neurol 2021; 12:661816. [PMID: 34177767 PMCID: PMC8222567 DOI: 10.3389/fneur.2021.661816] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/31/2021] [Accepted: 04/20/2021] [Indexed: 11/13/2022] Open
Abstract
Objective: Upper limb (UL) motor function recovery, especially distal function, is one of the main goals of stroke rehabilitation as this function is important to perform activities of daily living (ADL). The efficacy of the motor-imagery brain-computer interface (MI-BCI) has been demonstrated in patients with stroke. Most patients with stroke receive comprehensive rehabilitation, including MI-BCI and routine training. However, most aspects of MI-BCI training for patients with subacute stroke are based on routine training. Risk factors for inadequate distal UL functional recovery in these patients remain unclear; therefore, it is more realistic to explore the prognostic factors of this comprehensive treatment based on clinical practice. The present study aims to investigate the independent risk factors that might lead to inadequate distal UL functional recovery in patients with stroke after comprehensive rehabilitation including MI-BCI (CRIMI-BCI). Methods: This prospective study recruited 82 patients with stroke who underwent CRIMI-BCI. Motor-imagery brain-computer interface training was performed for 60 min per day, 5 days per week for 4 weeks. The primary outcome was improvement of the wrist and hand dimensionality of Fugl-Meyer Assessment (δFMA-WH). According to the improvement score, the patients were classified into the efficient group (EG, δFMA-WH > 2) and the inefficient group (IG, δFMA-WH ≤ 2). Binary logistic regression was used to analyze clinical and demographic data, including aphasia, spasticity of the affected hand [assessed by Modified Ashworth Scale (MAS-H)], initial UL function, age, gender, time since stroke (TSS), lesion hemisphere, and lesion location. Results: Seventy-three patients completed the study. After training, all patients showed significant improvement in FMA-UL (Z = 7.381, p = 0.000**), FMA-SE (Z = 7.336, p = 0.000**), and FMA-WH (Z = 6.568, p = 0.000**). There were 35 patients (47.9%) in the IG group and 38 patients (52.1%) in the EG group. Multivariate analysis revealed that presence of aphasia [odds ratio (OR) 4.617, 95% confidence interval (CI) 1.435-14.860; p < 0.05], initial FMA-UL score ≤ 30 (OR 5.158, 95% CI 1.150-23.132; p < 0.05), and MAS-H ≥ level I+ (OR 3.810, 95% CI 1.231-11.790; p < 0.05) were the risk factors for inadequate distal UL functional recovery in patients with stroke after CRIMI-BCI. Conclusion: We concluded that CRIMI-BCI improved UL function in stroke patients with varying effectiveness. Inferior initial UL function, significant hand spasticity, and presence of aphasia were identified as independent risk factors for inadequate distal UL functional recovery in stroke patients after CRIMI-BCI.
Collapse
Affiliation(s)
- Qiong Wu
- School of Rehabilitation Medicine, China Rehabilitation Research Center, Capital Medical University, Beijing, China.,Department of Rehabilitation Medicine, Beijing Tsinghua Changgung Hospital, School of Clinical Medicine, Tsinghua University, Beijing, China
| | - Yunxiang Ge
- Department of Electronic Engineering, Beijing National Research Center for Information Science and Technology (BNRist), Tsinghua University, Beijing, China
| | - Di Ma
- Department of Rehabilitation Medicine, Beijing Tsinghua Changgung Hospital, School of Clinical Medicine, Tsinghua University, Beijing, China
| | - Xue Pang
- Department of Rehabilitation Medicine, Beijing Tsinghua Changgung Hospital, School of Clinical Medicine, Tsinghua University, Beijing, China
| | - Yingyu Cao
- School of Mechanical Engineering, Beijing Institute of Petrochemical Technology, Beijing, China
| | - Xiaofei Zhang
- Department of Clinical Epidemiology and Biostatistics, Beijing Tsinghua Changgung Hospital, Tsinghua University, Beijing, China
| | - Yu Pan
- Department of Rehabilitation Medicine, Beijing Tsinghua Changgung Hospital, School of Clinical Medicine, Tsinghua University, Beijing, China
| | - Tong Zhang
- School of Rehabilitation Medicine, China Rehabilitation Research Center, Capital Medical University, Beijing, China
| | - Weibei Dou
- Department of Electronic Engineering, Beijing National Research Center for Information Science and Technology (BNRist), Tsinghua University, Beijing, China
| |
Collapse
|
25
|
Sosnik R, Li Z. Reconstruction of hand, elbow and shoulder actual and imagined trajectories in 3D space using EEG current source dipoles. J Neural Eng 2021; 18. [PMID: 33752186 DOI: 10.1088/1741-2552/abf0d7] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/14/2020] [Accepted: 03/22/2021] [Indexed: 11/12/2022]
Abstract
OBJECTIVE Growing evidence suggests that EEG electrode (sensor) potential time series (PTS) of slow cortical potentials (SCPs) hold motor neural correlates that can be used for motion trajectory prediction (MTP), commonly by multiple linear regression (mLR). It is not yet known whether arm-joint trajectories can be reliably decoded from current sources, computed from sensor data, from which brain areas they can be decoded and using which neural features. APPROACH In this study, the PTS of 44 sensors were fed into sLORETA source localization software to compute current source activity in 30 regions of interest (ROIs) found in a recent meta-analysis to be engaged in action execution, motor imagery and motor preparation. The current sources PTS and band-power time series (BTS) in several frequency bands and time lags were used to predict actual and imagined trajectories in 3D space of the three velocity components of the hand, elbow and shoulder of nine subjects using an mLR model. MAIN RESULTS For all arm joints and movement types, current source SCPs PTS contributed most to trajectory reconstruction with time lags 150ms, 116ms and 84ms providing the highest contribution, and current source BTS in any of the tested frequency bands was not informative. Person's correlation coefficient (r) averaged across movement types, arm joints and velocity components using source data was slightly lower than using sensor data (r=0.25 and r=0.28, respectively). For each ROI, the three current source dipoles had different contribution to the reconstruction of each of the three velocity components. SIGNIFICANCE Overall, our results demonstrate the feasibility of predicting of actual and imagined 3D trajectories of all arm joints from current sources, computed from scalp EEG. These findings may be used by developers of a future BCI as a validated set of contributing ROIs.
Collapse
Affiliation(s)
- Ronen Sosnik
- Electrical, Electronics and Communication Engineering, Holon Institute of Technology, 52 Golomb St., Holon, 5810201, ISRAEL
| | - Zheng Li
- State Key Laboratory of Cognitive Neuroscience and Learning & IDG/McGovern Institute for Brain Research, Beijing Normal University, Yingdong Building, Xinjiekouwai Street 19, Beijing Haidian, Beijing, 100875, CHINA
| |
Collapse
|
26
|
Singh A, Hussain AA, Lal S, Guesgen HW. A Comprehensive Review on Critical Issues and Possible Solutions of Motor Imagery Based Electroencephalography Brain-Computer Interface. SENSORS 2021; 21:s21062173. [PMID: 33804611 PMCID: PMC8003721 DOI: 10.3390/s21062173] [Citation(s) in RCA: 36] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/28/2020] [Revised: 03/15/2021] [Accepted: 03/16/2021] [Indexed: 01/16/2023]
Abstract
Motor imagery (MI) based brain–computer interface (BCI) aims to provide a means of communication through the utilization of neural activity generated due to kinesthetic imagination of limbs. Every year, a significant number of publications that are related to new improvements, challenges, and breakthrough in MI-BCI are made. This paper provides a comprehensive review of the electroencephalogram (EEG) based MI-BCI system. It describes the current state of the art in different stages of the MI-BCI (data acquisition, MI training, preprocessing, feature extraction, channel and feature selection, and classification) pipeline. Although MI-BCI research has been going for many years, this technology is mostly confined to controlled lab environments. We discuss recent developments and critical algorithmic issues in MI-based BCI for commercial deployment.
Collapse
|
27
|
Caicedo-Acosta J, Castaño GA, Acosta-Medina C, Alvarez-Meza A, Castellanos-Dominguez G. Deep Neural Regression Prediction of Motor Imagery Skills Using EEG Functional Connectivity Indicators. SENSORS (BASEL, SWITZERLAND) 2021; 21:1932. [PMID: 33801817 PMCID: PMC7999933 DOI: 10.3390/s21061932] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/05/2021] [Revised: 02/20/2021] [Accepted: 02/25/2021] [Indexed: 11/16/2022]
Abstract
Motor imaging (MI) induces recovery and neuroplasticity in neurophysical regulation. However, a non-negligible portion of users presents insufficient coordination skills of sensorimotor cortex control. Assessments of the relationship between wakefulness and tasks states are conducted to foster neurophysiological and mechanistic interpretation in MI-related applications. Thus, to understand the organization of information processing, measures of functional connectivity are used. Also, models of neural network regression prediction are becoming popular, These intend to reduce the need for extracting features manually. However, predicting MI practicing's neurophysiological inefficiency raises several problems, like enhancing network regression performance because of the overfitting risk. Here, to increase the prediction performance, we develop a deep network regression model that includes three procedures: leave-one-out cross-validation combined with Monte Carlo dropout layers, subject clustering of MI inefficiency, and transfer learning between neighboring runs. Validation is performed using functional connectivity predictors extracted from two electroencephalographic databases acquired in conditions close to real MI applications (150 users), resulting in a high prediction of pretraining desynchronization and initial training synchronization with adequate physiological interpretability.
Collapse
Affiliation(s)
- Julian Caicedo-Acosta
- Signal Processing and Recognition Group, Universidad Nacional de Colombia, Manizales 170001, Colombia; (C.A.-M.); (A.A.-M.); (G.C.-D.)
| | - German A. Castaño
- Grupo de investigación Cultura de la Calidad en la Educación, Universidad Nacional de Colombia, Manizales 170001, Colombia;
| | - Carlos Acosta-Medina
- Signal Processing and Recognition Group, Universidad Nacional de Colombia, Manizales 170001, Colombia; (C.A.-M.); (A.A.-M.); (G.C.-D.)
| | - Andres Alvarez-Meza
- Signal Processing and Recognition Group, Universidad Nacional de Colombia, Manizales 170001, Colombia; (C.A.-M.); (A.A.-M.); (G.C.-D.)
| | - German Castellanos-Dominguez
- Signal Processing and Recognition Group, Universidad Nacional de Colombia, Manizales 170001, Colombia; (C.A.-M.); (A.A.-M.); (G.C.-D.)
| |
Collapse
|
28
|
Zhang R, Li F, Zhang T, Yao D, Xu P. Subject inefficiency phenomenon of motor imagery brain-computer interface: Influence factors and potential solutions. BRAIN SCIENCE ADVANCES 2021. [DOI: 10.26599/bsa.2020.9050021] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022] Open
Abstract
Motor imagery brain–computer interfaces (MI‐BCIs) have great potential value in prosthetics control, neurorehabilitation, and gaming; however, currently, most such systems only operate in controlled laboratory environments. One of the most important obstacles is the MI‐BCI inefficiency phenomenon. The accuracy of MI‐BCI control varies significantly (from chance level to 100% accuracy) across subjects due to the not easily induced and unstable MI‐related EEG features. An MI‐BCI inefficient subject is defined as a subject who cannot achieve greater than 70% accuracy after sufficient training time, and multiple survey results indicate that inefficient subjects account for 10%–50% of the experimental population. The widespread use of MI‐BCI has been seriously limited due to these large percentages of inefficient subjects. In this review, we summarize recent findings of the cause of MI‐BCI inefficiency from resting‐state brain function, task‐related brain activity, brain structure, and psychological perspectives. These factors help understand the reasons for inter‐subject MI‐BCI control performance variability, and it can be concluded that the lower resting‐state sensorimotor rhythm (SMR) is the key factor in MI‐BCI inefficiency, which has been confirmed by multiple independent laboratories. We then propose to divide MI‐BCI inefficient subjects into three categories according to the resting‐state SMR and offline/online accuracy to apply more accurate approaches to solve the inefficiency problem. The potential solutions include developing transfer learning algorithms, new experimental paradigms, mindfulness meditation practice, novel training strategies, and identifying new motor imagery‐related EEG features. To date, few studies have focused on improving the control accuracy of MI‐BCI inefficient subjects; thus, we appeal to the BCI community to focus more on this research area. Only by reducing the percentage of inefficient subjects can we create the opportunity to expand the value and influence of MI‐BCI.
Collapse
Affiliation(s)
- Rui Zhang
- Henan Key Laboratory of Brain Science and Brain‐Computer Interface Technology, School of Electrical Engineering, Zhengzhou University, Zhengzhou 450001, Henan, China
| | - Fali Li
- MOE Key Lab for NeuroInformation, University of Electronic Science and Technology of China, Chengdu 611731, Sichuan, China
| | - Tao Zhang
- Science of School, Xihua University, Chengdu 610039, Sichuan, China
| | - Dezhong Yao
- Henan Key Laboratory of Brain Science and Brain‐Computer Interface Technology, School of Electrical Engineering, Zhengzhou University, Zhengzhou 450001, Henan, China
- MOE Key Lab for NeuroInformation, University of Electronic Science and Technology of China, Chengdu 611731, Sichuan, China
| | - Peng Xu
- MOE Key Lab for NeuroInformation, University of Electronic Science and Technology of China, Chengdu 611731, Sichuan, China
| |
Collapse
|
29
|
Li MA, Wang RT, Wei LN. Fuzzy support vector machine with joint optimization of genetic algorithm and fuzzy c-means. Technol Health Care 2021; 29:921-937. [PMID: 33459673 DOI: 10.3233/thc-202619] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Abstract
BACKGROUND Motor imagery electroencephalogram (MI-EEG) play an important role in the field of neurorehabilitation, and a fuzzy support vector machine (FSVM) is one of the most used classifiers. Specifically, a fuzzy c-means (FCM) algorithm was used to membership calculation to deal with the classification problems with outliers or noises. However, FCM is sensitive to its initial value and easily falls into local optima. OBJECTIVE The joint optimization of genetic algorithm (GA) and FCM is proposed to enhance robustness of fuzzy memberships to initial cluster centers, yielding an improved FSVM (GF-FSVM). METHOD The features of each channel of MI-EEG are extracted by the improved refined composite multivariate multiscale fuzzy entropy and fused to form a feature vector for a trial. Then, GA is employed to optimize the initial cluster center of FCM, and the fuzzy membership degrees are calculated through an iterative process and further applied to classify two-class MI-EEGs. RESULTS Extensive experiments are conducted on two publicly available datasets, the average recognition accuracies achieve 99.89% and 98.81% and the corresponding kappa values are 0.9978 and 0.9762, respectively. CONCLUSION The optimized cluster centers of FCM via GA are almost overlapping, showing great stability, and GF-FSVM obtains higher classification accuracies and higher consistency as well.
Collapse
Affiliation(s)
- Ming-Ai Li
- Faculty of Information Technology, Beijing University of Technology, Beijing, China.,Beijing Key Laboratory of Computational Intelligence and Intelligent System, Beijing, China.,Engineering Research Center of Digital Community, Ministry of Education, Beijing, China
| | - Ruo-Tu Wang
- Faculty of Information Technology, Beijing University of Technology, Beijing, China
| | - Li-Na Wei
- Faculty of Information Technology, Beijing University of Technology, Beijing, China
| |
Collapse
|
30
|
Phang CR, Ko LW. Intralobular and Interlobular Parietal Functional Network Correlated to MI-BCI Performance. IEEE Trans Neural Syst Rehabil Eng 2020; 28:2671-2680. [PMID: 33201822 DOI: 10.1109/tnsre.2020.3038657] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
Brain-computer interface (BCI) brings hope to patients suffering from neuromuscular diseases, by allowing the control of external devices using neural signals from the central nervous system. However, a portion of individuals was unable to operate BCI with high efficacy. This research aimed to study the brain-wide functional connectivity differences that contributed to BCI performance, and investigate the relationship between task-related connectivity strength and BCI performance. Functional connectivity was estimated using pairwise Pearson's correlation from the EEG of 48 subjects performing left or right hand motor imagery (MI) tasks. The classification accuracy of linear support vector machine (SVM) to distinguish both tasks were used to represent MI-BCI performance. The significant differences in connectivity strengths were examined using Welch's T-test. The association between accuracy and connection strength was studied using correlation model. Three intralobular and fourteen interlobular connections from the parietal lobe showed a correlation of 0.31 and -0.34 respectively. Results indicate that alpha wave connectivity from 8 Hz to 13 Hz was more related to classification performance compared to high-frequency waves. Subject-independent trial-based analysis shows that MI trials executed with stronger intralobular and interlobular parietal connections performed significantly better than trials with weaker connections. Further investigation from an independent MI dataset reveals several similar connections that were correlated with MI-BCI performance. The functional connectivity of the parietal lobe could potentially allow prediction of MI-BCI performance and enable implementation of neurofeedback training for users to improve the usability of MI-BCI.
Collapse
|
31
|
Reichert C, Dürschmid S, Bartsch MV, Hopf JM, Heinze HJ, Hinrichs H. Decoding the covert shift of spatial attention from electroencephalographic signals permits reliable control of a brain-computer interface. J Neural Eng 2020; 17:056012. [PMID: 32906103 DOI: 10.1088/1741-2552/abb692] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/21/2022]
Abstract
OBJECTIVE One of the main goals of brain-computer interfaces (BCI) is to restore communication abilities in patients. BCIs often use event-related potentials (ERPs) like the P300 which signals the presence of a target in a stream of stimuli. The P300 and related approaches, however, are inherently limited, as they require many stimulus presentations to obtain a usable control signal. Many approaches depend on gaze direction to focus the target, which is also not a viable approach in many cases, because eye movements might be impaired in potential users. Here we report on a BCI that avoids both shortcomings by decoding spatial target information, independent of gaze shifts. APPROACH We present a new method to decode from the electroencephalogram (EEG) covert shifts of attention to one out of four targets simultaneously presented in the left and right visual field. The task is designed to evoke the N2pc component-a hemisphere lateralized response, elicited over the occipital scalp contralateral to the attended target. The decoding approach involves decoding of the N2pc based on data-driven estimation of spatial filters and a correlation measure. MAIN RESULTS Despite variability of decoding performance across subjects, 22 out of 24 subjects performed well above chance level. Six subjects even exceeded 80% (cross-validated: 89%) correct predictions in a four-class discrimination task. Hence, the single-trial N2pc proves to be a component that allows for reliable BCI control. An offline analysis of the EEG data with respect to their dependence on stimulation time and number of classes demonstrates that the present method is also a workable approach for two-class tasks. SIGNIFICANCE Our method extends the range of strategies for gaze-independent BCI control. The proposed decoding approach has the potential to be efficient in similar applications intended to decode ERPs.
Collapse
Affiliation(s)
- Christoph Reichert
- Leibniz Institute for Neurobiology, Magdeburg, Germany. Forschungscampus STIMULATE, Magdeburg, Germany. Center for Behavioral Brain Sciences (CBBS), Magdeburg, Germany
| | | | | | | | | | | |
Collapse
|
32
|
Velasquez-Martinez L, Caicedo-Acosta J, Acosta-Medina C, Alvarez-Meza A, Castellanos-Dominguez G. Regression Networks for Neurophysiological Indicator Evaluation in Practicing Motor Imagery Tasks. Brain Sci 2020; 10:E707. [PMID: 33020435 PMCID: PMC7600302 DOI: 10.3390/brainsci10100707] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/26/2020] [Revised: 09/21/2020] [Accepted: 09/25/2020] [Indexed: 11/21/2022] Open
Abstract
Motor Imagery (MI) promotes motor learning in activities, like developing professional motor skills, sports gestures, and patient rehabilitation. However, up to 30% of users may not develop enough coordination skills after training sessions because of inter and intra-subject variability. Here, we develop a data-driven estimator, termed Deep Regression Network (DRN), which jointly extracts and performs the regression analysis in order to assess the efficiency of the individual brain networks in practicing MI tasks. The proposed double-stage estimator initially learns a pool of deep patterns, extracted from the input data, in order to feed a neural regression model, allowing for infering the distinctiveness between subject assemblies having similar variability. The results, which were obtained on real-world MI data, prove that the DRN estimator fosters pre-training neural desynchronization and initial training synchronization to predict the bi-class accuracy response, thus providing a better understanding of the Brain-Computer Interface inefficiency of subjects.
Collapse
Affiliation(s)
- Luisa Velasquez-Martinez
- Signal Processing and Recognition Group, Universidad Nacional de Colombia, Manizales 170004, Colombia; (J.C.-A.); (C.A.-M.); (A.A.-M.); (G.C.-D.)
| | | | | | | | | |
Collapse
|
33
|
Su S, Chai G, Shu X, Sheng X, Zhu X. Electrical stimulation-induced SSSEP as an objective index to evaluate the difference of tactile acuity between the left and right hand. J Neural Eng 2020; 17:016053. [PMID: 31801122 DOI: 10.1088/1741-2552/ab5ee9] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/31/2022]
Abstract
OBJECTIVE The objective of this study is to propose an objective index to evaluate the difference of tactile acuity between the left and right hand based on steady-state somatosensory evoked potential (SSSEP). APPROACH Two kinds of tactile sensations (vibration and pressure) with three levels of intensities (low/medium/high) were evoked on two finger areas of the left or right hand (thumb and index for healthy hands, thumb and index-projected areas for disabled hands) via transcutaneous electrical nerve stimulation (TENS). Three forearm amputees and 13 able-bodied subjects were recruited to discriminate the specific level and area of the applied stimulation. Electroencephalography was adopted to simultaneously record the somatosensory cortex response to TENS. We assessed the discrimination performance (discrimination accuracy rate (AR) and response time (RT)) to quantify the tactile acuity, while the evoked SSSEP was synchronously analyzed. Linear regression analyses were performed between the difference of SSSEP amplitudes and the difference of discrimination performance for the left and right hand stimulation. MAIN RESULTS Frequency domain analysis revealed that SSSEP amplitude increased with the increase of the stimulation intensity. There were positive correlations between the difference of SSSEP amplitudes and the difference of ARs for the left and right hand stimulation in the sensations of vibration (R 2 = 0.6389 for able-bodied subjects, R 2 = 0.5328 for amputees) and pressure (R 2 = 0.6102 for able-bodied subjects, R 2 = 0.5452 for amputees), respectively. Significance The SSSEP amplitude could be used as an objective index to evaluate the difference of the tactile acuity between the left and right hand and has the potential to be applied in sensory rehabilitation for amputees or stroke patients.
Collapse
Affiliation(s)
- Shiyong Su
- State Key Laboratory of Mechanical System and Vibration, Shanghai Jiao Tong University, Shanghai, People's Republic of China
| | | | | | | | | |
Collapse
|
34
|
Chabuda A, Dovgialo M, Duszyk A, Stróż A, Pawlisz M, Durka P. Successful BCI communication via high-frequency SSVEP or visual, audio or tactile P300 in 30 tested volunteers. Acta Neurobiol Exp (Wars) 2020. [DOI: 10.21307/ane-2019-039] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
|
35
|
Thompson MC. Critiquing the Concept of BCI Illiteracy. SCIENCE AND ENGINEERING ETHICS 2019; 25:1217-1233. [PMID: 30117107 DOI: 10.1007/s11948-018-0061-1] [Citation(s) in RCA: 59] [Impact Index Per Article: 9.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/20/2018] [Accepted: 08/10/2018] [Indexed: 06/08/2023]
Abstract
Brain-computer interfaces (BCIs) are a form of technology that read a user's neural signals to perform a task, often with the aim of inferring user intention. They demonstrate potential in a wide range of clinical, commercial, and personal applications. But BCIs are not always simple to operate, and even with training some BCI users do not operate their systems as intended. Many researchers have described this phenomenon as "BCI illiteracy," and a body of research has emerged aiming to characterize, predict, and solve this perceived problem. However, BCI illiteracy is an inadequate concept for explaining difficulty that users face in operating BCI systems. BCI illiteracy is a methodologically weak concept; furthermore, it relies on the flawed assumption that BCI users possess physiological or functional traits that prevent proficient performance during BCI use. Alternative concepts to BCI illiteracy may offer better outcomes for prospective users and may avoid the conceptual pitfalls that BCI illiteracy brings to the BCI research process.
Collapse
Affiliation(s)
- Margaret C Thompson
- Department of Electrical Engineering, University of Washington, 185 Stevens Way, Paul Allen Center - Room AE100R, Campus Box 352500, Seattle, WA, 98195-2500, USA.
- Center for Sensorimotor Neural Engineering, Box 37, 1414 NE 42nd St., Suite 204, Seattle, WA, 98105-6271, USA.
| |
Collapse
|
36
|
Meng J, He B. Exploring Training Effect in 42 Human Subjects Using a Non-invasive Sensorimotor Rhythm Based Online BCI. Front Hum Neurosci 2019; 13:128. [PMID: 31057380 PMCID: PMC6481252 DOI: 10.3389/fnhum.2019.00128] [Citation(s) in RCA: 30] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/08/2018] [Accepted: 03/28/2019] [Indexed: 11/16/2022] Open
Abstract
Electroencephalography based brain-computer interfaces (BCIs) show promise of providing an alternative communication channel between the brain and an external device. It is well acknowledged that BCI control is a skill and could be improved through practice and training. In this study, we explore the change of BCI behavioral performance as well as the electrophysiological properties across three training sessions in a pool of 42 human subjects. Our results show that the group average of BCI accuracy and the information transfer rate improved significantly in the third session compared to the first session; especially the significance reached in a smaller subset of a low BCI performance group (average accuracy <70%) as well. There was a significant difference of event-related desynchronization (ERD) lateralization for BCI control between the left- and right-hand imagination task in the last two sessions, but this significant difference was not revealed in the first training sessions. No significant change of R 2 value or event-related desynchronization and synchronization (ERD/ERS) for either channel C3 or channel C4, which were used for online control, was found across the training sessions. The change of ERD lateralization was also not significant across the training sessions. The present results indicate that BCI training could induce a change of behavioral performance and electrophysiological properties quickly, within just a few hours of training, distributed into three sessions. Multiple training sessions might especially be beneficial for the low BCI performers.
Collapse
Affiliation(s)
| | - Bin He
- Department of Biomedical Engineering, Carnegie Mellon University, Pittsburgh, PA, United States
| |
Collapse
|
37
|
Chen ML, Fu D, Boger J, Jiang N. Age-Related Changes in Vibro-Tactile EEG Response and Its Implications in BCI Applications: A Comparison Between Older and Younger Populations. IEEE Trans Neural Syst Rehabil Eng 2019; 27:603-610. [PMID: 30872232 DOI: 10.1109/tnsre.2019.2890968] [Citation(s) in RCA: 15] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
The rapid increase in the number of older adults around the world is accelerating research in applications to support age-related conditions, such as brain-computer interface (BCI) applications for post-stroke neurorehabilitation. The signal processing algorithms for electroencephalogram (EEG) and other physiological signals that are currently used in BCI have been developed on data from much younger populations. It is unclear how age-related changes may affect the EEG signal and therefore the use of BCI by older adults. This research investigated the EEG response to vibro-tactile stimulation from 11 younger (21.7±2.76 years old) and 11 older (72.0±8.07 years old) subjects. The results showed that: 1) the spatial patterns of cortical activation in older subjects were significantly different from those of younger subjects, with markedly reduced lateralization; 2) there is a general power reduction of the EEG measured from older subjects. The average left vs. right BCI performance accuracy of older subjects was 66.4±5.70%, 15.9% lower than that of the younger subjects (82.3±12.4%) and statistically significantly different (t(10)= -3.57, p= 0.005). Future research should further investigate age-differences that may exist in electrophysiology and take these into consideration when developing applications that target the older population.
Collapse
|
38
|
Shu X, Chen S, Meng J, Yao L, Sheng X, Jia J, Farina D, Zhu X. Tactile Stimulation Improves Sensorimotor Rhythm-based BCI Performance in Stroke Patients. IEEE Trans Biomed Eng 2018; 66:1987-1995. [PMID: 30452349 DOI: 10.1109/tbme.2018.2882075] [Citation(s) in RCA: 23] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
OBJECTIVE BCI decoding accuracy plays a crucial role in practical applications. With accurate feedback, BCI-based therapy determines beneficial neural plasticity in stroke patients. In this study, we aimed at improving sensorimotor rhythm (SMR)-based BCI performance by integrating motor tasks with tactile stimulation. METHODS Eleven stroke patients were recruited for three experimental conditions, i.e., motor attempt (MA) condition, tactile stimulation (TS) condition, and tactile stimulation-assisted motor attempt (TS-MA) condition. Tactile stimulation was delivered to the paretic hand wrist during both task and idle states using a DC vibrator. RESULTS We observed that the TS-MA condition achieved greater motor-related cortical activation (MRCA) in alpha-beta band when compared with both TS and MA conditions. Consequently, online BCI decoding accuracies between task and idle states were significantly improved from 74.5% in the MA condition to 85.1% in the TS-MA condition (p < 0.001), whereas the accuracy in the TS condition was 54.6% (approaching to the chance level of 50%). CONCLUSION This finding demonstrates that sensory afferent from peripheral nerves benefits the neural process of sensorimotor cortex in stroke patients. With appropriate sensory stimulation, MRCA is enhanced and corresponding brain patterns are more discriminative. SIGNIFICANCE This novel SMR-BCI paradigm shows great promise to facilitate the practical application of BCI-based stroke rehabilitation.
Collapse
|
39
|
Choi SI, Han CH, Choi GY, Shin J, Song KS, Im CH, Hwang HJ. On the Feasibility of Using an Ear-EEG to Develop an Endogenous Brain-Computer Interface. SENSORS (BASEL, SWITZERLAND) 2018; 18:E2856. [PMID: 30158505 PMCID: PMC6165202 DOI: 10.3390/s18092856] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/20/2018] [Revised: 08/26/2018] [Accepted: 08/28/2018] [Indexed: 11/27/2022]
Abstract
Brain-computer interface (BCI) studies based on electroencephalography (EEG) measured around the ears (ear-EEGs) have mostly used exogenous paradigms involving brain activity evoked by external stimuli. The objective of this study is to investigate the feasibility of ear-EEGs for development of an endogenous BCI system that uses self-modulated brain activity. We performed preliminary and main experiments where EEGs were measured on the scalp and behind the ears to check the reliability of ear-EEGs as compared to scalp-EEGs. In the preliminary and main experiments, subjects performed eyes-open and eyes-closed tasks, and they performed mental arithmetic (MA) and light cognitive (LC) tasks, respectively. For data analysis, the brain area was divided into four regions of interest (ROIs) (i.e., frontal, central, occipital, and ear area). The preliminary experiment showed that the degree of alpha activity increase of the ear area with eyes closed is comparable to those of other ROIs (occipital > ear > central > frontal). In the main experiment, similar event-related (de)synchronization (ERD/ERS) patterns were observed between the four ROIs during MA and LC, and all ROIs showed the mean classification accuracies above 70% required for effective binary communication (MA vs. LC) (occipital = ear = central = frontal). From the results, we demonstrated that ear-EEG can be used to develop an endogenous BCI system based on cognitive tasks without external stimuli, which allows the usability of ear-EEGs to be extended.
Collapse
Affiliation(s)
- Soo-In Choi
- Department of Medical IT Convergence Engineering, Kumoh National Institute of Technology, Gumi 39177, Korea.
| | - Chang-Hee Han
- Berlin Institute of Technology, Machine Learning Group, Marchstrasse 23, 10587 Berlin, Germany.
| | - Ga-Young Choi
- Department of Medical IT Convergence Engineering, Kumoh National Institute of Technology, Gumi 39177, Korea.
| | - Jaeyoung Shin
- Department of Biomedical Engineering, Hanyang University, Seoul 04763, Korea.
| | - Kwang Soup Song
- Department of Medical IT Convergence Engineering, Kumoh National Institute of Technology, Gumi 39177, Korea.
| | - Chang-Hwan Im
- Department of Biomedical Engineering, Hanyang University, Seoul 04763, Korea.
| | - Han-Jeong Hwang
- Department of Medical IT Convergence Engineering, Kumoh National Institute of Technology, Gumi 39177, Korea.
| |
Collapse
|