1
|
Sujatha Ravindran A, Contreras-Vidal J. An empirical comparison of deep learning explainability approaches for EEG using simulated ground truth. Sci Rep 2023; 13:17709. [PMID: 37853010 PMCID: PMC10584975 DOI: 10.1038/s41598-023-43871-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/02/2023] [Accepted: 09/29/2023] [Indexed: 10/20/2023] Open
Abstract
Recent advancements in machine learning and deep learning (DL) based neural decoders have significantly improved decoding capabilities using scalp electroencephalography (EEG). However, the interpretability of DL models remains an under-explored area. In this study, we compared multiple model explanation methods to identify the most suitable method for EEG and understand when some of these approaches might fail. A simulation framework was developed to evaluate the robustness and sensitivity of twelve back-propagation-based visualization methods by comparing to ground truth features. Multiple methods tested here showed reliability issues after randomizing either model weights or labels: e.g., the saliency approach, which is the most used visualization technique in EEG, was not class or model-specific. We found that DeepLift was consistently accurate as well as robust to detect the three key attributes tested here (temporal, spatial, and spectral precision). Overall, this study provides a review of model explanation methods for DL-based neural decoders and recommendations to understand when some of these methods fail and what they can capture in EEG.
Collapse
Affiliation(s)
- Akshay Sujatha Ravindran
- Noninvasive Brain-Machine Interface System Laboratory, Department of Electrical and Computer Engineering, University of Houston, Houston, 77204, USA.
- IUCRC BRAIN, University of Houston, Houston, 77204, USA.
- Alto Neuroscience, Los Altos, CA, 94022, USA.
| | - Jose Contreras-Vidal
- Noninvasive Brain-Machine Interface System Laboratory, Department of Electrical and Computer Engineering, University of Houston, Houston, 77204, USA
- IUCRC BRAIN, University of Houston, Houston, 77204, USA
| |
Collapse
|
2
|
Belkacem AN, Jamil N, Khalid S, Alnajjar F. On closed-loop brain stimulation systems for improving the quality of life of patients with neurological disorders. Front Hum Neurosci 2023; 17:1085173. [PMID: 37033911 PMCID: PMC10076878 DOI: 10.3389/fnhum.2023.1085173] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/31/2022] [Accepted: 03/06/2023] [Indexed: 04/11/2023] Open
Abstract
Emerging brain technologies have significantly transformed human life in recent decades. For instance, the closed-loop brain-computer interface (BCI) is an advanced software-hardware system that interprets electrical signals from neurons, allowing communication with and control of the environment. The system then transmits these signals as controlled commands and provides feedback to the brain to execute specific tasks. This paper analyzes and presents the latest research on closed-loop BCI that utilizes electric/magnetic stimulation, optogenetic, and sonogenetic techniques. These techniques have demonstrated great potential in improving the quality of life for patients suffering from neurodegenerative or psychiatric diseases. We provide a comprehensive and systematic review of research on the modalities of closed-loop BCI in recent decades. To achieve this, the authors used a set of defined criteria to shortlist studies from well-known research databases into categories of brain stimulation techniques. These categories include deep brain stimulation, transcranial magnetic stimulation, transcranial direct-current stimulation, transcranial alternating-current stimulation, and optogenetics. These techniques have been useful in treating a wide range of disorders, such as Alzheimer's and Parkinson's disease, dementia, and depression. In total, 76 studies were shortlisted and analyzed to illustrate how closed-loop BCI can considerably improve, enhance, and restore specific brain functions. The analysis revealed that literature in the area has not adequately covered closed-loop BCI in the context of cognitive neural prosthetics and implanted neural devices. However, the authors demonstrate that the applications of closed-loop BCI are highly beneficial, and the technology is continually evolving to improve the lives of individuals with various ailments, including those with sensory-motor issues or cognitive deficiencies. By utilizing emerging techniques of stimulation, closed-loop BCI can safely improve patients' cognitive and affective skills, resulting in better healthcare outcomes.
Collapse
Affiliation(s)
- Abdelkader Nasreddine Belkacem
- Department of Computer and Network Engineering, College of Information Technology, UAE University, Al-Ain, United Arab Emirates
- *Correspondence: Abdelkader Nasreddine Belkacem
| | - Nuraini Jamil
- Department of Computer Science and Software Engineering, College of Information Technology, UAE University, Al-Ain, United Arab Emirates
| | - Sumayya Khalid
- Department of Computer Science and Software Engineering, College of Information Technology, UAE University, Al-Ain, United Arab Emirates
| | - Fady Alnajjar
- Department of Computer Science and Software Engineering, College of Information Technology, UAE University, Al-Ain, United Arab Emirates
- Center for Brain Science, RIKEN, Saitama, Japan
- Fady Alnajjar
| |
Collapse
|
3
|
Mencel J, Marusiak J, Jaskólska A, Kamiński Ł, Kurzyński M, Wołczowski A, Jaskólski A, Kisiel-Sajewicz K. Motor imagery training of goal-directed reaching in relation to imagery of reaching and grasping in healthy people. Sci Rep 2022; 12:18610. [PMID: 36329083 PMCID: PMC9633838 DOI: 10.1038/s41598-022-21890-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/14/2022] [Accepted: 10/05/2022] [Indexed: 11/06/2022] Open
Abstract
The study aimed to determine whether four weeks of motor imagery training (MIT) of goal-directed reaching (reaching to grasp task) would affect the cortical activity during motor imagery of reaching (MIR) and grasping (MIG) in the same way. We examined cortical activity regarding event-related potentials (ERPs) in healthy young participants. Our study also evaluated the subjective vividness of the imagery. Furthermore, we aimed to determine the relationship between the subjective assessment of motor imagery (MI) ability to reach and grasp and the cortical activity during those tasks before and after training to understand the underlying neuroplasticity mechanisms. Twenty-seven volunteers participated in MIT of goal-directed reaching and two measurement sessions before and after MIT. During the sessions 128-channel electroencephalography (EEG) was recorded during MIR and MIG. Also, participants assessed the vividness of the MI tasks using a visual analog scale (VAS). The vividness of imagination improved significantly (P < .05) after MIT. A repeated measures ANOVA showed that the task (MIR/MIG) and the location of electrodes had a significant effect on the ERP's amplitude (P < .05). The interaction between the task, location, and session (before/after MIT) also had a significant effect on the ERP's amplitude (P < .05). Finally, the location of electrodes and the interaction between location and session had a significant effect on the ERP's latency (P < .05). We found that MIT influenced the EEG signal associated with reaching differently than grasping. The effect was more pronounced for MIR than for MIG. Correlation analysis showed that changes in the assessed parameters due to MIT reduced the relationship between the subjective evaluation of imagining and the EEG signal. This finding means that the subjective evaluation of imagining cannot be a simple, functional insight into the bioelectrical activity of the cerebral cortex expressed by the ERPs in mental training. The changes we noted in ERPs after MIT may benefit the use of non-invasive EEG in the brain-computer interface (BCI) context.Trial registration: NCT04048083.
Collapse
Affiliation(s)
- Joanna Mencel
- grid.8505.80000 0001 1010 5103Department of Kinesiology, Faculty of Physiotherapy, Wroclaw University of Health and Sport Sciences, Al. I. J. Paderewskiego 35, budynek P4, 51-612 Wrocław, Poland
| | - Jarosław Marusiak
- grid.8505.80000 0001 1010 5103Department of Kinesiology, Faculty of Physiotherapy, Wroclaw University of Health and Sport Sciences, Al. I. J. Paderewskiego 35, budynek P4, 51-612 Wrocław, Poland
| | - Anna Jaskólska
- grid.8505.80000 0001 1010 5103Department of Kinesiology, Faculty of Physiotherapy, Wroclaw University of Health and Sport Sciences, Al. I. J. Paderewskiego 35, budynek P4, 51-612 Wrocław, Poland
| | - Łukasz Kamiński
- grid.8505.80000 0001 1010 5103Department of Kinesiology, Faculty of Physiotherapy, Wroclaw University of Health and Sport Sciences, Al. I. J. Paderewskiego 35, budynek P4, 51-612 Wrocław, Poland
| | - Marek Kurzyński
- grid.7005.20000 0000 9805 3178Department of Field Theory, Electronic Circuits and Optoelectronics, Faculty of Electronics, Photonics and Microsystems, Wroclaw University of Science and Technology, Wroclaw, Poland
| | - Andrzej Wołczowski
- grid.7005.20000 0000 9805 3178Department of Field Theory, Electronic Circuits and Optoelectronics, Faculty of Electronics, Photonics and Microsystems, Wroclaw University of Science and Technology, Wroclaw, Poland
| | - Artur Jaskólski
- grid.8505.80000 0001 1010 5103Department of Kinesiology, Faculty of Physiotherapy, Wroclaw University of Health and Sport Sciences, Al. I. J. Paderewskiego 35, budynek P4, 51-612 Wrocław, Poland
| | - Katarzyna Kisiel-Sajewicz
- grid.8505.80000 0001 1010 5103Department of Kinesiology, Faculty of Physiotherapy, Wroclaw University of Health and Sport Sciences, Al. I. J. Paderewskiego 35, budynek P4, 51-612 Wrocław, Poland
| |
Collapse
|
4
|
Channel selection from source localization: A review of four EEG-based brain-computer interfaces paradigms. Behav Res Methods 2022:10.3758/s13428-022-01897-2. [PMID: 35794417 DOI: 10.3758/s13428-022-01897-2] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 05/27/2022] [Indexed: 11/08/2022]
Abstract
Channel selection is a critical part of the classification procedure for multichannel electroencephalogram (EEG)-based brain-computer interfaces (BCI). An optimized subset of electrodes reduces computational complexity and optimizes accuracy. Different tasks activate different sources in the brain and are characterized by distinctive channels. The goal of the current review is to define a subset of electrodes for each of four popular BCI paradigms: motor imagery, motor execution, steady-state visual evoked potentials and P300. Twenty-one studies have been reviewed to identify the most significant activations of cortical sources. The relevant EEG sensors are determined from the reported 3D Talairach coordinates. They are scored by their weighted mean Cohen's d and its confidence interval, providing the magnitude of the corresponding effect size and its statistical significance. Our goal is to create a knowledge-based channel selection framework with a sufficient statistical power. The core channel selection (CCS) could be used as a reference by EEG researchers and would have the advantages of practicality and rapidity, allowing for an easy implementation of semiparametric algorithms.
Collapse
|
5
|
Motor Imagery: How to Assess, Improve Its Performance, and Apply It for Psychosis Diagnostics. Diagnostics (Basel) 2022; 12:diagnostics12040949. [PMID: 35453997 PMCID: PMC9025310 DOI: 10.3390/diagnostics12040949] [Citation(s) in RCA: 8] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/24/2022] [Revised: 04/03/2022] [Accepted: 04/07/2022] [Indexed: 11/16/2022] Open
Abstract
With this review, we summarize the state-of-the-art of scientific studies in the field of motor imagery (MI) and motor execution (ME). We composed the brain map and description that correlate different brain areas with the type of movements it is responsible for. That gives a more complete and systematic picture of human brain functionality in the case of ME and MI. We systematized the most popular methods for assessing the quality of MI performance and discussed their advantages and disadvantages. We also reviewed the main directions for the use of transcranial magnetic stimulation (TMS) in MI research and considered the principal effects of TMS on MI performance. In addition, we discuss the main applications of MI, emphasizing its use in the diagnostics of various neurodegenerative disorders and psychoses. Finally, we discuss the research gap and possible improvements for further research in the field.
Collapse
|
6
|
Vasilyev AN, Nuzhdin YO, Kaplan AY. Does Real-Time Feedback Affect Sensorimotor EEG Patterns in Routine Motor Imagery Practice? Brain Sci 2021; 11:brainsci11091234. [PMID: 34573253 PMCID: PMC8469546 DOI: 10.3390/brainsci11091234] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/02/2021] [Revised: 09/16/2021] [Accepted: 09/16/2021] [Indexed: 11/23/2022] Open
Abstract
Background. Motor imagery engages much of the same neural circuits as an overt movement. Therefore, the mental rehearsal of movements is often used to supplement physical training and might aid motor neurorehabilitation after stroke. One attempt to capture the brain’s involvement in imagery involves the use, as a marker, of the depression or event-related desynchronization (ERD) of thalamocortical sensorimotor rhythms found in a human electroencephalogram (EEG). Using fast real-time processing, it is possible to make the subject aware of their own brain reactions or—even better—to turn them into actions through a technology called the brain–computer interface (BCI). However, it remains unclear whether BCI-enabled imagery facilitates a stronger or qualitatively different brain response compared to the open-loop training. Methods. Seven healthy volunteers who were experienced in both closed and open-loop motor imagery took part in six experimental sessions over a period of 4.5 months, in which they performed kinesthetic imagery of a previously known set of finger and arm movements with simultaneous 30-channel EEG acquisition. The first and the last session mostly consisted of feedback trials in which the subjects were presented with the classification results of the EEG patterns in real time; during the other sessions, no feedback was provided. Spatiotemporal and amplitude features of the ERD patterns concomitant with imagery were compared across experimental days and between feedback conditions using linear mixed-effects modeling. Results. The main spatial sources of ERD appeared to be highly stable across the six experimental days, remaining nearly identical in five of seven subjects (Pearson’s ρ > 0.94). Only in one subject did the spatial pattern of activation statistically significantly differ (p = 0.009) between the feedback and no-feedback conditions. Real-time visual feedback delivered through the BCI did not significantly increase the ERD strength. Conclusion. The results imply that the potential benefits of MI could be yielded by well-habituated subjects with a simplified open-loop setup, e.g., through at-home self-practice.
Collapse
Affiliation(s)
- Anatoly N. Vasilyev
- Department of Human and Animal Physiology, Faculty of Biology, M.V. Lomonosov Moscow State University, 119234 Moscow, Russia; (Y.O.N.); (A.Y.K.)
- MEG Center, Moscow State University of Psychology and Education, 123290 Moscow, Russia
- Correspondence:
| | - Yury O. Nuzhdin
- Department of Human and Animal Physiology, Faculty of Biology, M.V. Lomonosov Moscow State University, 119234 Moscow, Russia; (Y.O.N.); (A.Y.K.)
| | - Alexander Y. Kaplan
- Department of Human and Animal Physiology, Faculty of Biology, M.V. Lomonosov Moscow State University, 119234 Moscow, Russia; (Y.O.N.); (A.Y.K.)
- Center for Neurotechnology and Machine Learning, Immanuel Kant Baltic Federal University, 236016 Kaliningrad, Russia
| |
Collapse
|
7
|
Bobrova EV, Reshetnikova VV, Vershinina EA, Grishin AA, Bobrov PD, Frolov AA, Gerasimenko YP. Success of Hand Movement Imagination Depends on Personality Traits, Brain Asymmetry, and Degree of Handedness. Brain Sci 2021; 11:853. [PMID: 34202413 PMCID: PMC8301954 DOI: 10.3390/brainsci11070853] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/25/2021] [Revised: 06/23/2021] [Accepted: 06/23/2021] [Indexed: 12/05/2022] Open
Abstract
Brain-computer interfaces (BCIs), based on motor imagery, are increasingly used in neurorehabilitation. However, some people cannot control BCI, predictors of this are the features of brain activity and personality traits. It is not known whether the success of BCI control is related to interhemispheric asymmetry. The study was conducted on 44 BCI-naive subjects and included one BCI session, EEG-analysis, 16PF Cattell Questionnaire, estimation of latent left-handedness, and of subjective complexity of real and imagery movements. The success of brain states recognition during imagination of left hand (LH) movement compared to the rest is higher in reserved, practical, skeptical, and not very sociable individuals. Extraversion, liveliness, and dominance are significant for the imagination of right hand (RH) movements in "pure" right-handers, and sensitivity in latent left-handers. Subjective complexity of real LH and of imagery RH movements correlates with the success of brain states recognition in the imagination of movement of LH compared to RH and depends on the level of handedness. Thus, the level of handedness is the factor influencing the success of BCI control. The data are supposed to be connected with hemispheric differences in motor control, lateralization of dopamine, and may be important for rehabilitation of patients after a stroke.
Collapse
Affiliation(s)
- Elena V. Bobrova
- Pavlov Institute of Physiology of the Russian Academy of Sciences, 199034 Saint-Petersburg, Russia; (V.V.R.); (E.A.V.); (A.A.G.); (Y.P.G.)
| | - Varvara V. Reshetnikova
- Pavlov Institute of Physiology of the Russian Academy of Sciences, 199034 Saint-Petersburg, Russia; (V.V.R.); (E.A.V.); (A.A.G.); (Y.P.G.)
| | - Elena A. Vershinina
- Pavlov Institute of Physiology of the Russian Academy of Sciences, 199034 Saint-Petersburg, Russia; (V.V.R.); (E.A.V.); (A.A.G.); (Y.P.G.)
| | - Alexander A. Grishin
- Pavlov Institute of Physiology of the Russian Academy of Sciences, 199034 Saint-Petersburg, Russia; (V.V.R.); (E.A.V.); (A.A.G.); (Y.P.G.)
| | - Pavel D. Bobrov
- Institute of Translational Medicine of Pirogov of Russian National Research Medical University, 117997 Moscow, Russia; (P.D.B.); (A.A.F.)
- Institute of Higher Nervous Activity and Neurophysiology of the Russian Academy of Sciences, 117485 Moscow, Russia
| | - Alexander A. Frolov
- Institute of Translational Medicine of Pirogov of Russian National Research Medical University, 117997 Moscow, Russia; (P.D.B.); (A.A.F.)
- Institute of Higher Nervous Activity and Neurophysiology of the Russian Academy of Sciences, 117485 Moscow, Russia
| | - Yury P. Gerasimenko
- Pavlov Institute of Physiology of the Russian Academy of Sciences, 199034 Saint-Petersburg, Russia; (V.V.R.); (E.A.V.); (A.A.G.); (Y.P.G.)
- Department of Physiology and Biophysics, University of Louisville, Louisville, KY 40292, USA
- Kentucky Spinal Cord Injury Research Center, Frazier Rehab Institute, University of Louisville, UofL Health, Louisville, KY 40202, USA
| |
Collapse
|
8
|
Exploring the Use of Brain-Computer Interfaces in Stroke Neurorehabilitation. BIOMED RESEARCH INTERNATIONAL 2021; 2021:9967348. [PMID: 34239936 PMCID: PMC8235968 DOI: 10.1155/2021/9967348] [Citation(s) in RCA: 18] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/20/2021] [Accepted: 06/04/2021] [Indexed: 11/17/2022]
Abstract
With the continuous development of artificial intelligence technology, "brain-computer interfaces" are gradually entering the field of medical rehabilitation. As a result, brain-computer interfaces (BCIs) have been included in many countries' strategic plans for innovating this field, and subsequently, major funding and talent have been invested in this technology. In neurological rehabilitation for stroke patients, the use of BCIs opens up a new chapter in "top-down" rehabilitation. In our study, we first reviewed the latest BCI technologies, then presented recent research advances and landmark findings in BCI-based neurorehabilitation for stroke patients. Neurorehabilitation was focused on the areas of motor, sensory, speech, cognitive, and environmental interactions. Finally, we summarized the shortcomings of BCI use in the field of stroke neurorehabilitation and the prospects for BCI technology development for rehabilitation.
Collapse
|
9
|
Mencel J, Jaskólska A, Marusiak J, Kamiński Ł, Kurzyński M, Wołczowski A, Jaskólski A, Kisiel-Sajewicz K. Motor Imagery Training of Reaching-to-Grasp Movement Supplemented by a Virtual Environment in an Individual With Congenital Bilateral Transverse Upper-Limb Deficiency. Front Psychol 2021; 12:638780. [PMID: 33828507 PMCID: PMC8019807 DOI: 10.3389/fpsyg.2021.638780] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/07/2020] [Accepted: 03/03/2021] [Indexed: 11/30/2022] Open
Abstract
This study explored the effect of kinesthetic motor imagery training on reaching-to-grasp movement supplemented by a virtual environment in a patient with congenital bilateral transverse upper-limb deficiency. Based on a theoretical assumption, it is possible to conduct such training in this patient. The aim of this study was to evaluate whether cortical activity related to motor imagery of reaching and motor imagery of grasping of the right upper limb was changed by computer-aided imagery training (CAIT) in a patient who was born without upper limbs compared to a healthy control subject, as characterized by multi-channel electroencephalography (EEG) signals recorded before and 4, 8, and 12 weeks after CAIT. The main task during CAIT was to kinesthetically imagine the execution of reaching-to-grasp movements without any muscle activation, supplemented by computer visualization of movements provided by a special headset. Our experiment showed that CAIT can be conducted in the patient with higher vividness of imagery for reaching than grasping tasks. Our results confirm that CAIT can change brain activation patterns in areas related to motor planning and the execution of reaching and grasping movements, and that the effect was more pronounced in the patient than in the healthy control subject. The results show that CAIT has a different effect on the cortical activity related to the motor imagery of a reaching task than on the cortical activity related to the motor imagery of a grasping task. The change observed in the activation patterns could indicate CAIT-induced neuroplasticity, which could potentially be useful in rehabilitation or brain-computer interface purposes for such patients, especially before and after transplantation. This study was part of a registered experiment (ID: NCT04048083).
Collapse
Affiliation(s)
- Joanna Mencel
- Department of Kinesiology, Faculty of Physiotherapy, University School of Physical Education in Wrocław, Wrocław, Poland
| | - Anna Jaskólska
- Department of Kinesiology, Faculty of Physiotherapy, University School of Physical Education in Wrocław, Wrocław, Poland
| | - Jarosław Marusiak
- Department of Kinesiology, Faculty of Physiotherapy, University School of Physical Education in Wrocław, Wrocław, Poland
| | - Łukasz Kamiński
- Department of Kinesiology, Faculty of Physiotherapy, University School of Physical Education in Wrocław, Wrocław, Poland
| | - Marek Kurzyński
- Department of Systems and Computer Networks, Faculty of Electronics, Wrocław University of Science and Technology, Wrocław, Poland
| | - Andrzej Wołczowski
- Department of Fundamental Cybernetics and Robotics, Institute of Computer Engineering, Control and Robotics, Wrocław University of Science and Technology, Wrocław, Poland
| | - Artur Jaskólski
- Department of Kinesiology, Faculty of Physiotherapy, University School of Physical Education in Wrocław, Wrocław, Poland
| | - Katarzyna Kisiel-Sajewicz
- Department of Kinesiology, Faculty of Physiotherapy, University School of Physical Education in Wrocław, Wrocław, Poland
| |
Collapse
|
10
|
Zhang R, Li F, Zhang T, Yao D, Xu P. Subject inefficiency phenomenon of motor imagery brain-computer interface: Influence factors and potential solutions. BRAIN SCIENCE ADVANCES 2021. [DOI: 10.26599/bsa.2020.9050021] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022] Open
Abstract
Motor imagery brain–computer interfaces (MI‐BCIs) have great potential value in prosthetics control, neurorehabilitation, and gaming; however, currently, most such systems only operate in controlled laboratory environments. One of the most important obstacles is the MI‐BCI inefficiency phenomenon. The accuracy of MI‐BCI control varies significantly (from chance level to 100% accuracy) across subjects due to the not easily induced and unstable MI‐related EEG features. An MI‐BCI inefficient subject is defined as a subject who cannot achieve greater than 70% accuracy after sufficient training time, and multiple survey results indicate that inefficient subjects account for 10%–50% of the experimental population. The widespread use of MI‐BCI has been seriously limited due to these large percentages of inefficient subjects. In this review, we summarize recent findings of the cause of MI‐BCI inefficiency from resting‐state brain function, task‐related brain activity, brain structure, and psychological perspectives. These factors help understand the reasons for inter‐subject MI‐BCI control performance variability, and it can be concluded that the lower resting‐state sensorimotor rhythm (SMR) is the key factor in MI‐BCI inefficiency, which has been confirmed by multiple independent laboratories. We then propose to divide MI‐BCI inefficient subjects into three categories according to the resting‐state SMR and offline/online accuracy to apply more accurate approaches to solve the inefficiency problem. The potential solutions include developing transfer learning algorithms, new experimental paradigms, mindfulness meditation practice, novel training strategies, and identifying new motor imagery‐related EEG features. To date, few studies have focused on improving the control accuracy of MI‐BCI inefficient subjects; thus, we appeal to the BCI community to focus more on this research area. Only by reducing the percentage of inefficient subjects can we create the opportunity to expand the value and influence of MI‐BCI.
Collapse
Affiliation(s)
- Rui Zhang
- Henan Key Laboratory of Brain Science and Brain‐Computer Interface Technology, School of Electrical Engineering, Zhengzhou University, Zhengzhou 450001, Henan, China
| | - Fali Li
- MOE Key Lab for NeuroInformation, University of Electronic Science and Technology of China, Chengdu 611731, Sichuan, China
| | - Tao Zhang
- Science of School, Xihua University, Chengdu 610039, Sichuan, China
| | - Dezhong Yao
- Henan Key Laboratory of Brain Science and Brain‐Computer Interface Technology, School of Electrical Engineering, Zhengzhou University, Zhengzhou 450001, Henan, China
- MOE Key Lab for NeuroInformation, University of Electronic Science and Technology of China, Chengdu 611731, Sichuan, China
| | - Peng Xu
- MOE Key Lab for NeuroInformation, University of Electronic Science and Technology of China, Chengdu 611731, Sichuan, China
| |
Collapse
|
11
|
Yuan K, Wang X, Chen C, Lau CCY, Chu WCW, Tong RKY. Interhemispheric Functional Reorganization and its Structural Base After BCI-Guided Upper-Limb Training in Chronic Stroke. IEEE Trans Neural Syst Rehabil Eng 2020; 28:2525-2536. [PMID: 32997632 DOI: 10.1109/tnsre.2020.3027955] [Citation(s) in RCA: 16] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
Brain-computer interface (BCI)-guided robot-assisted upper-limb training has been increasingly applied to stroke rehabilitation. However, the induced long-term neuroplasticity modulation still needs to be further characterized. This study investigated the functional reorganization and its structural base after BCI-guided robot-assisted training using resting-state fMRI, task-based fMRI, and diffusion tensor imaging (DTI) data. The clinical improvement and the neurological changes before, immediately after, and six months after 20-session BCI-guided robot hand training were explored in 14 chronic stroke subjects. The structural base of the induced functional reorganization and motor improvement were also investigated using DTI. Repeated measure ANOVA indicated long-term motor improvement was found (F[2, 26] = 6.367, p = 0.006). Significantly modulated functional connectivity (FC) was observed between ipsilesional motor regions (M1 and SMA) and some contralesional areas (SMA, PMd, SPL) in the seed-based analysis. Modulated FC with ipsilesional M1 was significantly correlated with motor function improvement (r = 0.6455, p = 0.0276). Besides, increased interhemispheric FC among the sensorimotor area from resting-state data and increased laterality index from task-based data together indicated the re-balance of the two hemispheres during the recovery. Multiple linear regression models suggested that both motor function improvement and the functional change between ipsilesional M1 and contralesional premotor area were significantly associated with the ipsilesional corticospinal tract integrity. The results in the current study provided solid support for stroke recovery mechanism in terms of interhemispheric interaction and its structural substrates, which could further enhance the understanding of BCI training in stroke rehabilitation. This study was registered at https://clinicaltrials.gov (NCT02323061).
Collapse
|
12
|
Jiang X, Saggar H, Ryu SI, Shenoy KV, Kao JC. Structure in Neural Activity during Observed and Executed Movements Is Shared at the Neural Population Level, Not in Single Neurons. Cell Rep 2020; 32:108006. [DOI: 10.1016/j.celrep.2020.108006] [Citation(s) in RCA: 12] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/15/2020] [Revised: 05/24/2020] [Accepted: 07/16/2020] [Indexed: 12/30/2022] Open
|
13
|
Tariq M, Trivailo PM, Simic M. Mu-Beta event-related (de)synchronization and EEG classification of left-right foot dorsiflexion kinaesthetic motor imagery for BCI. PLoS One 2020; 15:e0230184. [PMID: 32182270 PMCID: PMC7077852 DOI: 10.1371/journal.pone.0230184] [Citation(s) in RCA: 18] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/13/2019] [Accepted: 02/24/2020] [Indexed: 01/30/2023] Open
Abstract
The left and right foot representation area is located within the interhemispheric fissure of the sensorimotor cortex and share spatial proximity. This makes it difficult to visualize the cortical lateralization of event-related (de)synchronization (ERD/ERS) during left and right foot motor imageries. The aim of this study is to investigate the possibility of using ERD/ERS in the mu, low beta, and high beta bandwidth, during left and right foot dorsiflexion kinaesthetic motor imageries (KMI), as unilateral control commands for a brain-computer interface (BCI). EEG was recorded from nine healthy participants during cue-based left-right foot dorsiflexion KMI tasks. The features were analysed for common average and bipolar references. With each reference, mu and beta band-power features were analysed using time–frequency (TF) maps, scalp topographies, and average time course for ERD/ERS. The cortical lateralization of ERD/ERS, during left and right foot KMI, was confirmed. Statistically significant features were classified using LDA, SVM, and KNN model, and evaluated using the area under ROC curves. An increase in high beta power following the end of KMI for both tasks was recorded, from right and left hemispheres, respectively, at the vertex. The single trial analysis and classification models resulted in high discrimination accuracies, i.e. maximum 83.4% for beta ERS, 79.1% for beta ERD, and 74.0% for mu ERD. With each model the features performed above the statistical chance level of 2-class discrimination for a BCI. Our findings indicate these features can evoke left-right differences in single EEG trials. This suggests that any BCI employing unilateral foot KMI can attain classification accuracy suitable for practical implementation. Given results stipulate the novel utilization of mu and beta as independent control features for discrimination of bilateral foot KMI in a BCI.
Collapse
Affiliation(s)
- Madiha Tariq
- School of Engineering, RMIT University, Melbourne, VIC, Australia
| | | | - Milan Simic
- School of Engineering, RMIT University, Melbourne, VIC, Australia
- * E-mail:
| |
Collapse
|
14
|
Kovyazina MS, Varako NA, Lyukmanov RK, Asiatskaya GA, Suponeva NA, Trofimova AK. Neurofeedback in the Rehabilitation of Patients with Motor Disorders after Stroke. ACTA ACUST UNITED AC 2019. [DOI: 10.1134/s0362119719040042] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/23/2022]
|
15
|
Imagery of movements immediately following performance allows learning of motor skills that interfere. Sci Rep 2018; 8:14330. [PMID: 30254381 PMCID: PMC6156339 DOI: 10.1038/s41598-018-32606-9] [Citation(s) in RCA: 21] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/03/2018] [Accepted: 09/05/2018] [Indexed: 12/15/2022] Open
Abstract
Motor imagery, that is the mental rehearsal of a motor skill, can lead to improvements when performing the same skill. Here we show a powerful and complementary role, in which motor imagery of different movements after actually performing a skill allows learning that is not possible without imagery. We leverage a well-studied motor learning task in which subjects reach in the presence of a dynamic (force-field) perturbation. When two opposing perturbations are presented alternately for the same physical movement, there is substantial interference, preventing any learning. However, when the same physical movement is associated with follow-through movements that differ for each perturbation, both skills can be learned. Here we show that when subjects perform the skill and only imagine the follow-through, substantial learning occurs. In contrast, without such motor imagery there was no learning. Therefore, motor imagery can have a profound effect on skill acquisition even when the imagery is not of the skill itself. Our results suggest that motor imagery may evoke different neural states for the same physical state, thereby enhancing learning.
Collapse
|
16
|
Tariq M, Trivailo PM, Simic M. EEG-Based BCI Control Schemes for Lower-Limb Assistive-Robots. Front Hum Neurosci 2018; 12:312. [PMID: 30127730 PMCID: PMC6088276 DOI: 10.3389/fnhum.2018.00312] [Citation(s) in RCA: 88] [Impact Index Per Article: 14.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/03/2018] [Accepted: 07/16/2018] [Indexed: 12/14/2022] Open
Abstract
Over recent years, brain-computer interface (BCI) has emerged as an alternative communication system between the human brain and an output device. Deciphered intents, after detecting electrical signals from the human scalp, are translated into control commands used to operate external devices, computer displays and virtual objects in the real-time. BCI provides an augmentative communication by creating a muscle-free channel between the brain and the output devices, primarily for subjects having neuromotor disorders, or trauma to nervous system, notably spinal cord injuries (SCI), and subjects with unaffected sensorimotor functions but disarticulated or amputated residual limbs. This review identifies the potentials of electroencephalography (EEG) based BCI applications for locomotion and mobility rehabilitation. Patients could benefit from its advancements such as wearable lower-limb (LL) exoskeletons, orthosis, prosthesis, wheelchairs, and assistive-robot devices. The EEG communication signals employed by the aforementioned applications that also provide feasibility for future development in the field are sensorimotor rhythms (SMR), event-related potentials (ERP) and visual evoked potentials (VEP). The review is an effort to progress the development of user's mental task related to LL for BCI reliability and confidence measures. As a novel contribution, the reviewed BCI control paradigms for wearable LL and assistive-robots are presented by a general control framework fitting in hierarchical layers. It reflects informatic interactions, between the user, the BCI operator, the shared controller, the robotic device and the environment. Each sub layer of the BCI operator is discussed in detail, highlighting the feature extraction, classification and execution methods employed by the various systems. All applications' key features and their interaction with the environment are reviewed for the EEG-based activity mode recognition, and presented in form of a table. It is suggested to structure EEG-BCI controlled LL assistive devices within the presented framework, for future generation of intent-based multifunctional controllers. Despite the development of controllers, for BCI-based wearable or assistive devices that can seamlessly integrate user intent, practical challenges associated with such systems exist and have been discerned, which can be constructive for future developments in the field.
Collapse
Affiliation(s)
| | | | - Milan Simic
- School of Engineering, RMIT University Melbourne, Melbourne, VIC, Australia
| |
Collapse
|
17
|
Tanaka H, Matsugi A, Okada Y. The effects of imaginary voluntary muscle contraction and relaxation on cerebellar brain inhibition. Neurosci Res 2018; 133:15-20. [DOI: 10.1016/j.neures.2017.11.004] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/18/2017] [Revised: 11/13/2017] [Accepted: 11/13/2017] [Indexed: 11/24/2022]
|
18
|
Toriyama H, Ushiba J, Ushiyama J. Subjective Vividness of Kinesthetic Motor Imagery Is Associated With the Similarity in Magnitude of Sensorimotor Event-Related Desynchronization Between Motor Execution and Motor Imagery. Front Hum Neurosci 2018; 12:295. [PMID: 30108492 PMCID: PMC6079198 DOI: 10.3389/fnhum.2018.00295] [Citation(s) in RCA: 21] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/27/2018] [Accepted: 07/05/2018] [Indexed: 11/26/2022] Open
Abstract
In the field of psychology, it has been well established that there are two types of motor imagery such as kinesthetic motor imagery (KMI) and visual motor imagery (VMI), and the subjective evaluation for vividness of motor imagery each differs across individuals. This study aimed to examine how the motor imagery ability assessed by the psychological scores is associated with the physiological measure using electroencephalogram (EEG) sensorimotor rhythm during KMI task. First, 20 healthy young individuals evaluated subjectively how vividly they can perform each of KMI and VMI by using the Kinesthetic and Visual Imagery Questionnaire (KVIQ). We assessed their motor imagery abilities by summing each of KMI and VMI scores in KVIQ (KMItotal and VMItotal). Second, in physiological experiments, they repeated two strengths (10 and 40% of maximal effort) of isometric voluntary wrist-dorsiflexion. Right after each contraction, they also performed its KMI. The scalp EEGs over the sensorimotor cortex were recorded during the tasks. The EEG power is known to decrease in the alpha-and-beta band (7–35 Hz) from resting state to performing state of voluntary contraction (VC) or motor imagery. This phenomenon is referred to as event-related desynchronization (ERD). For each strength of the tasks, we calculated the maximal peak of ERD during VC, and that during its KMI, and measured the degree of similarity (ERDsim) between them. The results showed significant negative correlations between KMItotal and ERDsim for both strengths (p < 0.05) (i.e., the higher the KMItotal, the smaller the ERDsim). These findings suggest that in healthy individuals with higher motor imagery ability from a first-person perspective, KMI efficiently engages the shared cortical circuits corresponding with motor execution, including the sensorimotor cortex, with high compliance.
Collapse
Affiliation(s)
- Hisato Toriyama
- Graduate School of Media and Governance, Keio University, Fujisawa, Japan
| | - Junichi Ushiba
- Department of Biosciences and Informatics, Faculty of Science and Technology, Keio University, Yokohama, Japan.,Keio Institute of Pure and Applied Sciences, Yokohama, Japan
| | - Junichi Ushiyama
- Faculty of Environment and Information Studies, Keio University, Fujisawa, Japan.,Department of Rehabilitation Medicine, Keio University School of Medicine, Keio University, Tokyo, Japan
| |
Collapse
|
19
|
Lukoyanov MV, Gordleeva SY, Pimashkin AS, Grigor’ev NA, Savosenkov AV, Motailo A, Kazantsev VB, Kaplan AY. The Efficiency of the Brain-Computer Interfaces Based on Motor Imagery with Tactile and Visual Feedback. ACTA ACUST UNITED AC 2018. [DOI: 10.1134/s0362119718030088] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/23/2022]
|
20
|
Nuic D, Vinti M, Karachi C, Foulon P, Van Hamme A, Welter ML. The feasibility and positive effects of a customised videogame rehabilitation programme for freezing of gait and falls in Parkinson's disease patients: a pilot study. J Neuroeng Rehabil 2018; 15:31. [PMID: 29636105 PMCID: PMC5894136 DOI: 10.1186/s12984-018-0375-x] [Citation(s) in RCA: 22] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/19/2017] [Accepted: 04/03/2018] [Indexed: 11/13/2022] Open
Abstract
BACKGROUND Freezing of gait and falls represent a major burden in patients with advanced forms of Parkinson's disease (PD). These axial motor signs are not fully alleviated by drug treatment or deep-brain stimulation. Recently, virtual reality has emerged as a rehabilitation option for these patients. In this pilot study, we aim to determine the feasibility and acceptability of rehabilitation with a customised videogame to treat gait and balance disorders in PD patients, and assess its effects on these disabling motor signs. METHODS We developed a customised videogame displayed on a screen using the Kinect system. To play, the patient had to perform large amplitude and fast movements of all four limbs, pelvis and trunk, in response to visual and auditory cueing, to displace an avatar to collect coins and avoid obstacles to gain points. We tested ten patients with advanced forms of PD (median disease duration = 16.5 years) suffering from freezing of gait and/or falls (Hoehn&Yahr score ≥ 3) resistant to antiparkinsonian treatment and deep brain stimulation. Patients performed 18 training sessions during a 6-9 week period. We measured the feasibility and acceptability of our rehabilitation programme and its effects on parkinsonian disability, gait and balance disorders (with clinical scales and kinematics recordings), positive and negative affects, and quality of life, after the 9th and 18th training sessions and 3 months later. RESULTS All patients completed the 18 training sessions with high feasibility, acceptability and satisfaction scores. After training, the freezing-of-gait questionnaire, gait-and-balance scale and axial score significantly decreased by 39, 38 and 41%, respectively, and the activity-balance confidence scale increased by 35%. Kinematic gait parameters also significantly improved with increased step length and gait velocity and decreased double-stance time. Three months after the final session, no significant change persisted except decreased axial score and increased step length and velocity. CONCLUSIONS This study suggests that rehabilitation with a customised videogame to treat gait and balance disorders is feasible, well accepted, and effective in parkinsonian patients. These data serve as preliminary evidence for further larger and controlled studies to propose this customised videogame rehabilitation programme at home. TRIAL REGISTRATION ClinicalTrials.gov NCT02469350 .
Collapse
Affiliation(s)
- Dijana Nuic
- CNRS, UMR7225, Institut du Cerveau et de la Moelle Epinière, Sorbonne universités, Université Pierre et Marie Curie (UPMC) Paris P6; UMRS 1127, 75013 Paris, France
- LabCom BRAIN e-NOVATION, Institut du Cerveau et de la Moelle épinière (ICM), 75013 Paris, France
| | - Maria Vinti
- LabCom BRAIN e-NOVATION, Institut du Cerveau et de la Moelle épinière (ICM), 75013 Paris, France
| | - Carine Karachi
- CNRS, UMR7225, Institut du Cerveau et de la Moelle Epinière, Sorbonne universités, Université Pierre et Marie Curie (UPMC) Paris P6; UMRS 1127, 75013 Paris, France
- Neurosurgery Department, Hôpital de la Salpêtrière, Groupe Hospitalier Pitié-Salpêtrière, APHP, 75013 Paris, France
| | - Pierre Foulon
- LabCom BRAIN e-NOVATION, Institut du Cerveau et de la Moelle épinière (ICM), 75013 Paris, France
- GENIOUS System, 92700 Colombes, France
| | - Angèle Van Hamme
- CNRS, UMR7225, Institut du Cerveau et de la Moelle Epinière, Sorbonne universités, Université Pierre et Marie Curie (UPMC) Paris P6; UMRS 1127, 75013 Paris, France
- PANAM Platform, Institut du Cerveau et de la Moelle épinière, 75013 Paris, France
| | - Marie-Laure Welter
- CNRS, UMR7225, Institut du Cerveau et de la Moelle Epinière, Sorbonne universités, Université Pierre et Marie Curie (UPMC) Paris P6; UMRS 1127, 75013 Paris, France
- LabCom BRAIN e-NOVATION, Institut du Cerveau et de la Moelle épinière (ICM), 75013 Paris, France
- PANAM Platform, Institut du Cerveau et de la Moelle épinière, 75013 Paris, France
- Neurophysiology Department, Rouen University Hospital, Rouen-Normandie University, 76000 Rouen, France
| |
Collapse
|
21
|
Ma H, Zheng M, Lu Y, Hua X, Xu W. Cerebral plasticity after contralateral cervical nerve transfer in human by longitudinal PET evaluation. J Clin Neurosci 2018; 48:95-99. [DOI: 10.1016/j.jocn.2017.10.085] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/26/2017] [Accepted: 10/23/2017] [Indexed: 12/24/2022]
|
22
|
Frolov AA, Mokienko O, Lyukmanov R, Biryukova E, Kotov S, Turbina L, Nadareyshvily G, Bushkova Y. Post-stroke Rehabilitation Training with a Motor-Imagery-Based Brain-Computer Interface (BCI)-Controlled Hand Exoskeleton: A Randomized Controlled Multicenter Trial. Front Neurosci 2017; 11:400. [PMID: 28775677 PMCID: PMC5517482 DOI: 10.3389/fnins.2017.00400] [Citation(s) in RCA: 140] [Impact Index Per Article: 20.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/09/2017] [Accepted: 06/26/2017] [Indexed: 11/20/2022] Open
Abstract
Repeated use of brain-computer interfaces (BCIs) providing contingent sensory feedback of brain activity was recently proposed as a rehabilitation approach to restore motor function after stroke or spinal cord lesions. However, there are only a few clinical studies that investigate feasibility and effectiveness of such an approach. Here we report on a placebo-controlled, multicenter clinical trial that investigated whether stroke survivors with severe upper limb (UL) paralysis benefit from 10 BCI training sessions each lasting up to 40 min. A total of 74 patients participated: median time since stroke is 8 months, 25 and 75% quartiles [3.0; 13.0]; median severity of UL paralysis is 4.5 points [0.0; 30.0] as measured by the Action Research Arm Test, ARAT, and 19.5 points [11.0; 40.0] as measured by the Fugl-Meyer Motor Assessment, FMMA. Patients in the BCI group (n = 55) performed motor imagery of opening their affected hand. Motor imagery-related brain electroencephalographic activity was translated into contingent hand exoskeleton-driven opening movements of the affected hand. In a control group (n = 19), hand exoskeleton-driven opening movements of the affected hand were independent of brain electroencephalographic activity. Evaluation of the UL clinical assessments indicated that both groups improved, but only the BCI group showed an improvement in the ARAT's grasp score from 0 [0.0; 14.0] to 3.0 [0.0; 15.0] points (p < 0.01) and pinch scores from 0.0 [0.0; 7.0] to 1.0 [0.0; 12.0] points (p < 0.01). Upon training completion, 21.8% and 36.4% of the patients in the BCI group improved their ARAT and FMMA scores respectively. The corresponding numbers for the control group were 5.1% (ARAT) and 15.8% (FMMA). These results suggests that adding BCI control to exoskeleton-assisted physical therapy can improve post-stroke rehabilitation outcomes. Both maximum and mean values of the percentage of successfully decoded imagery-related EEG activity, were higher than chance level. A correlation between the classification accuracy and the improvement in the upper extremity function was found. An improvement of motor function was found for patients with different duration, severity and location of the stroke.
Collapse
Affiliation(s)
- Alexander A. Frolov
- Research Institute of Translational Medicine, Pirogov Russian National Research Medical UniversityMoscow, Russia
- Laboratory of Mathematical Neurobiology of Learning of Institute of Higher Nervous Activity and Neurophysiology, Russian Academy of SciencesMoscow, Russia
| | - Olesya Mokienko
- Research Institute of Translational Medicine, Pirogov Russian National Research Medical UniversityMoscow, Russia
- Department of Neurorehabilitation and Physiotherapy of Research Center of Neurology, Russian Academy of Medical SciencesMoscow, Russia
| | - Roman Lyukmanov
- Research Institute of Translational Medicine, Pirogov Russian National Research Medical UniversityMoscow, Russia
- Department of Neurorehabilitation and Physiotherapy of Research Center of Neurology, Russian Academy of Medical SciencesMoscow, Russia
| | - Elena Biryukova
- Research Institute of Translational Medicine, Pirogov Russian National Research Medical UniversityMoscow, Russia
- Laboratory of Mathematical Neurobiology of Learning of Institute of Higher Nervous Activity and Neurophysiology, Russian Academy of SciencesMoscow, Russia
| | - Sergey Kotov
- Department of Neurology, Vladimirsky Moscow Regional Research Clinical InstituteMoscow, Russia
| | - Lydia Turbina
- Department of Neurology, Vladimirsky Moscow Regional Research Clinical InstituteMoscow, Russia
| | - Georgy Nadareyshvily
- Medical Faculty, Pirogov Russian National Research Medical UniversityMoscow, Russia
| | - Yulia Bushkova
- Research Institute of Cerebrovascular Pathology and Stroke, Pirogov Russian National Research Medical UniversityMoscow, Russia
| |
Collapse
|
23
|
Lebedev MA, Nicolelis MAL. Brain-Machine Interfaces: From Basic Science to Neuroprostheses and Neurorehabilitation. Physiol Rev 2017; 97:767-837. [PMID: 28275048 DOI: 10.1152/physrev.00027.2016] [Citation(s) in RCA: 235] [Impact Index Per Article: 33.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/08/2023] Open
Abstract
Brain-machine interfaces (BMIs) combine methods, approaches, and concepts derived from neurophysiology, computer science, and engineering in an effort to establish real-time bidirectional links between living brains and artificial actuators. Although theoretical propositions and some proof of concept experiments on directly linking the brains with machines date back to the early 1960s, BMI research only took off in earnest at the end of the 1990s, when this approach became intimately linked to new neurophysiological methods for sampling large-scale brain activity. The classic goals of BMIs are 1) to unveil and utilize principles of operation and plastic properties of the distributed and dynamic circuits of the brain and 2) to create new therapies to restore mobility and sensations to severely disabled patients. Over the past decade, a wide range of BMI applications have emerged, which considerably expanded these original goals. BMI studies have shown neural control over the movements of robotic and virtual actuators that enact both upper and lower limb functions. Furthermore, BMIs have also incorporated ways to deliver sensory feedback, generated from external actuators, back to the brain. BMI research has been at the forefront of many neurophysiological discoveries, including the demonstration that, through continuous use, artificial tools can be assimilated by the primate brain's body schema. Work on BMIs has also led to the introduction of novel neurorehabilitation strategies. As a result of these efforts, long-term continuous BMI use has been recently implicated with the induction of partial neurological recovery in spinal cord injury patients.
Collapse
|
24
|
Vasilyev A, Liburkina S, Yakovlev L, Perepelkina O, Kaplan A. Assessing motor imagery in brain-computer interface training: Psychological and neurophysiological correlates. Neuropsychologia 2017; 97:56-65. [PMID: 28167121 DOI: 10.1016/j.neuropsychologia.2017.02.005] [Citation(s) in RCA: 49] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/16/2016] [Revised: 01/10/2017] [Accepted: 02/03/2017] [Indexed: 11/16/2022]
Abstract
Motor imagery (MI) is considered to be a promising cognitive tool for improving motor skills as well as for rehabilitation therapy of movement disorders. It is believed that MI training efficiency could be improved by using the brain-computer interface (BCI) technology providing real-time feedback on person's mental attempts. While BCI is indeed a convenient and motivating tool for practicing MI, it is not clear whether it could be used for predicting or measuring potential positive impact of the training. In this study, we are trying to establish whether the proficiency in BCI control is associated with any of the neurophysiological or psychological correlates of motor imagery, as well as to determine possible interrelations among them. For that purpose, we studied motor imagery in a group of 19 healthy BCI-trained volunteers and performed a correlation analysis across various quantitative assessment metrics. We examined subjects' sensorimotor event-related EEG events, corticospinal excitability changes estimated with single-pulse transcranial magnetic stimulation (TMS), BCI accuracy and self-assessment reports obtained with specially designed questionnaires and interview routine. Our results showed, expectedly, that BCI performance is dependent on the subject's capability to suppress EEG sensorimotor rhythms, which in turn is correlated with the idle state amplitude of those oscillations. Neither BCI accuracy nor the EEG features associated with MI were found to correlate with the level of corticospinal excitability increase during motor imagery, and with assessed imagery vividness. Finally, a significant correlation was found between the level of corticospinal excitability increase and kinesthetic vividness of imagery (KVIQ-20 questionnaire). Our results suggest that two distinct neurophysiological mechanisms might mediate possible effects of motor imagery: the non-specific cortical sensorimotor disinhibition and the focal corticospinal excitability increase. Acquired data suggests that BCI-based approach is unreliable in assessing motor imagery due to its high dependence on subject's innate EEG features (e.g. resting mu-rhythm amplitude). Therefore, employment of additional assessment protocols, such as TMS and psychological testing, is required for more comprehensive evaluation of the subject's motor imagery training efficiency.
Collapse
Affiliation(s)
| | - Sofya Liburkina
- Lomonosov Moscow State University, Moscow, Russian Federation
| | - Lev Yakovlev
- Lomonosov Moscow State University, Moscow, Russian Federation
| | | | - Alexander Kaplan
- Lomonosov Moscow State University, Moscow, Russian Federation; Lobachevsky State University of Nizhni Novgorod, Nizhni Novgorod, Russian Federation
| |
Collapse
|
25
|
Gharabaghi A. What Turns Assistive into Restorative Brain-Machine Interfaces? Front Neurosci 2016; 10:456. [PMID: 27790085 PMCID: PMC5061808 DOI: 10.3389/fnins.2016.00456] [Citation(s) in RCA: 23] [Impact Index Per Article: 2.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/21/2015] [Accepted: 09/21/2016] [Indexed: 12/18/2022] Open
Abstract
Brain-machine interfaces (BMI) may support motor impaired patients during activities of daily living by controlling external devices such as prostheses (assistive BMI). Moreover, BMIs are applied in conjunction with robotic orthoses for rehabilitation of lost motor function via neurofeedback training (restorative BMI). Using assistive BMI in a rehabilitation context does not automatically turn them into restorative devices. This perspective article suggests key features of restorative BMI and provides the supporting evidence: In summary, BMI may be referred to as restorative tools when demonstrating subsequently (i) operant learning and progressive evolution of specific brain states/dynamics, (ii) correlated modulations of functional networks related to the therapeutic goal, (iii) subsequent improvement in a specific task, and (iv) an explicit correlation between the modulated brain dynamics and the achieved behavioral gains. Such findings would provide the rationale for translating BMI-based interventions into clinical settings for reinforcement learning and motor rehabilitation following stroke.
Collapse
Affiliation(s)
- Alireza Gharabaghi
- Division of Functional and Restorative Neurosurgery, and Centre for Integrative Neuroscience, Eberhard Karls University Tuebingen Tuebingen, Germany
| |
Collapse
|
26
|
Kim TW, Lee BH. Clinical usefulness of brain-computer interface-controlled functional electrical stimulation for improving brain activity in children with spastic cerebral palsy: a pilot randomized controlled trial. J Phys Ther Sci 2016; 28:2491-2494. [PMID: 27799677 PMCID: PMC5080159 DOI: 10.1589/jpts.28.2491] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/23/2016] [Accepted: 05/23/2016] [Indexed: 11/24/2022] Open
Abstract
[Purpose] Evaluating the effect of brain-computer interface (BCI)-based functional electrical stimulation (FES) training on brain activity in children with spastic cerebral palsy (CP) was the aim of this study. [Subjects and Methods] Subjects were randomized into a BCI-FES group (n=9) and a functional electrical stimulation (FES) control group (n=9). Subjects in the BCI-FES group received wrist and hand extension training with FES for 30 minutes per day, 5 times per week for 6 weeks under the BCI-based program. The FES group received wrist and hand extension training with FES for the same amount of time. Sensorimotor rhythms (SMR) and middle beta waves (M-beta) were measured in frontopolar regions 1 and 2 (Fp1, Fp2) to determine the effects of BCI-FES training. [Results] Significant improvements in the SMR and M-beta of Fp1 and Fp2 were seen in the BCI-FES group. In contrast, significant improvement was only seen in the SMR and M-beta of Fp2 in the control group. [Conclusion] The results of the present study suggest that BCI-controlled FES training may be helpful in improving brain activity in patients with cerebral palsy and may be applied as effectively as traditional FES training.
Collapse
Affiliation(s)
- Tae-Woo Kim
- Graduate School of Physical Therapy, Sahmyook University, Republic of Korea
| | - Byoung-Hee Lee
- Department of Physical Therapy, Sahmyook University, Republic of Korea
| |
Collapse
|
27
|
Brain–robot interface driven plasticity: Distributed modulation of corticospinal excitability. Neuroimage 2016; 125:522-532. [DOI: 10.1016/j.neuroimage.2015.09.074] [Citation(s) in RCA: 60] [Impact Index Per Article: 7.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/14/2015] [Revised: 09/08/2015] [Accepted: 09/24/2015] [Indexed: 11/20/2022] Open
|
28
|
d'Avella A, Giese M, Ivanenko YP, Schack T, Flash T. Editorial: Modularity in motor control: from muscle synergies to cognitive action representation. Front Comput Neurosci 2015; 9:126. [PMID: 26500533 PMCID: PMC4598477 DOI: 10.3389/fncom.2015.00126] [Citation(s) in RCA: 44] [Impact Index Per Article: 4.9] [Reference Citation Analysis] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/11/2015] [Accepted: 09/22/2015] [Indexed: 12/24/2022] Open
Affiliation(s)
- Andrea d'Avella
- Department of Biomedical Sciences and Morphological and Functional Images, University of Messina Messina, Italy ; Laboratory of Neuromotor Physiology, Santa Lucia Foundation Rome, Italy
| | - Martin Giese
- Section for Computational Sensomotorics, Department of Cognitive Neurology, Hertie Institute for Clinical Brain Research and Center for Integrative Neuroscience, University Clinic Tuebingen Tuebingen, Germany
| | - Yuri P Ivanenko
- Laboratory of Neuromotor Physiology, Santa Lucia Foundation Rome, Italy
| | - Thomas Schack
- Research Group Neurocognition and Action-Biomechanics and Cognitive Interaction Technology-Center of Excellence, Bielefeld University Bielefeld, Germany
| | - Tamar Flash
- Department of Computer Science and Applied Mathematics, Weizmann Institute of Science Rehovot, Israel
| |
Collapse
|
29
|
Boe S, Gionfriddo A, Kraeutner S, Tremblay A, Little G, Bardouille T. Laterality of brain activity during motor imagery is modulated by the provision of source level neurofeedback. Neuroimage 2014; 101:159-67. [PMID: 24999037 DOI: 10.1016/j.neuroimage.2014.06.066] [Citation(s) in RCA: 47] [Impact Index Per Article: 4.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/25/2014] [Revised: 06/17/2014] [Accepted: 06/27/2014] [Indexed: 11/28/2022] Open
Abstract
Motor imagery (MI) may be effective as an adjunct to physical practice for motor skill acquisition. For example, MI is emerging as an effective treatment in stroke neurorehabilitation. As in physical practice, the repetitive activation of neural pathways during MI can drive short- and long-term brain changes that underlie functional recovery. However, the lack of feedback about MI performance may be a factor limiting its effectiveness. The provision of feedback about MI-related brain activity may overcome this limitation by providing the opportunity for individuals to monitor their own performance of this endogenous process. We completed a controlled study to isolate neurofeedback as the factor driving changes in MI-related brain activity across repeated sessions. Eighteen healthy participants took part in 3 sessions comprised of both actual and imagined performance of a button press task. During MI, participants in the neurofeedback group received source level feedback based on activity from the left and right sensorimotor cortex obtained using magnetoencephalography. Participants in the control group received no neurofeedback. MI-related brain activity increased in the sensorimotor cortex contralateral to the imagined movement across sessions in the neurofeedback group, but not in controls. Task performance improved across sessions but did not differ between groups. Our results indicate that the provision of neurofeedback during MI allows healthy individuals to modulate regional brain activity. This finding has the potential to improve the effectiveness of MI as a tool in neurorehabilitation.
Collapse
Affiliation(s)
- Shaun Boe
- Laboratory for Brain Recovery and Function, Dalhousie University, Halifax, Nova Scotia, Canada; School of Physiotherapy, Dalhousie University, Halifax, Nova Scotia, Canada; Department of Psychology and Neuroscience, Dalhousie University, Halifax Nova Scotia, Canada.
| | - Alicia Gionfriddo
- Laboratory for Brain Recovery and Function, Dalhousie University, Halifax, Nova Scotia, Canada; School of Physiotherapy, Dalhousie University, Halifax, Nova Scotia, Canada.
| | - Sarah Kraeutner
- Laboratory for Brain Recovery and Function, Dalhousie University, Halifax, Nova Scotia, Canada; Department of Psychology and Neuroscience, Dalhousie University, Halifax Nova Scotia, Canada.
| | - Antoine Tremblay
- Department of Psychology and Neuroscience, Dalhousie University, Halifax Nova Scotia, Canada.
| | - Graham Little
- Biomedical Translational Imaging Centre (BIOTIC), IWK Health Sciences Centre, Halifax, Nova Scotia, Canada.
| | - Timothy Bardouille
- School of Physiotherapy, Dalhousie University, Halifax, Nova Scotia, Canada; Biomedical Translational Imaging Centre (BIOTIC), IWK Health Sciences Centre, Halifax, Nova Scotia, Canada.
| |
Collapse
|