Neurofeedback of scalp bi-hemispheric EEG sensorimotor rhythm guides hemispheric activation of sensorimotor cortex in the targeted hemisphere

EEG decoding with spatiotemporal convolutional neural network for visualization and closed-loop control of sensorimotor activities: A simultaneous EEG-fMRI study

Closed-loop neurofeedback training utilizes neural signals such as scalp electroencephalograms (EEG) to manipulate specific neural activities and the associated behavioral performance. A spatiotemporal filter for high-density whole-head scalp EEG using a convolutional neural network can overcome the ambiguity of the signaling source because each EEG signal includes information on the remote regions. We simultaneously acquired EEG and functional magnetic resonance images in humans during the brain-computer interface (BCI) based neurofeedback training and compared the reconstructed and modeled hemodynamic responses of the sensorimotor network. Filters constructed with a convolutional neural network captured activities in the targeted network with spatial precision and specificity superior to those of the EEG signals preprocessed with standard pipelines used in BCI-based neurofeedback paradigms. The middle layers of the trained model were examined to characterize the neuronal oscillatory features that contributed to the reconstruction. Analysis of the layers for spatial convolution revealed the contribution of distributed cortical circuitries to reconstruction, including the frontoparietal and sensorimotor areas, and those of temporal convolution layers that successfully reconstructed the hemodynamic response function. Employing a spatiotemporal filter and leveraging the electrophysiological signatures of the sensorimotor excitability identified in our middle layer analysis would contribute to the development of a further effective neurofeedback intervention.

Relationship between resting-state functional connectivity and change in motor function after motor imagery intervention in patients with stroke: a scoping review

BACKGROUND

In clinical practice, motor imagery has been proposed as a treatment modality for stroke owing to its feasibility in patients with severe motor impairment. Motor imagery-based interventions can be categorized as open- or closed-loop. Closed-loop intervention is based on voluntary motor imagery and induced peripheral sensory afferent (e.g., Brain Computer Interface (BCI)-based interventions). Meanwhile, open-loop interventions include methods without voluntary motor imagery or sensory afferent. Resting-state functional connectivity (rs-FC) is defined as a significant temporal correlated signal among functionally related brain regions without any stimulus. rs-FC is a powerful tool for exploring the baseline characteristics of brain connectivity. Previous studies reported changes in rs-FC after motor imagery interventions. Systematic reviews also reported the effects of motor imagery-based interventions at the behavioral level. This study aimed to review and describe the relationship between the improvement in motor function and changes in rs-FC after motor imagery in patients with stroke.

REVIEW PROCESS

The literature review was based on Arksey and O'Malley's framework. PubMed, Ovid MEDLINE, Cochrane Central Register of Controlled Trials, and Web of Science were searched up to September 30, 2023. The included studies covered the following topics: illusion without voluntary action, motor imagery, action imitation, and BCI-based interventions. The correlation between rs-FC and motor function before and after the intervention was analyzed. After screening by two independent researchers, 13 studies on BCI-based intervention, motor imagery intervention, and kinesthetic illusion induced by visual stimulation therapy were included.

CONCLUSION

All studies relating to motor imagery in this review reported improvement in motor function post-intervention. Furthermore, all those studies demonstrated a significant relationship between the change in motor function and rs-FC (e.g., sensorimotor network and parietal cortex).

Effectiveness of motor and prefrontal cortical areas for brain-controlled functional electrical stimulation neuromodulation

Objective. Brain-computer interface (BCI)-controlled functional electrical stimulation (FES) could excite the central nervous system to enhance upper limb motor recovery. Our current study assessed the effectiveness of motor and prefrontal cortical activity-based BCI-FES to help elucidate the underlying neuromodulation mechanisms of this neurorehabilitation approach.Approach. The primary motor cortex (M1) and prefrontal cortex (PFC) BCI-FES interventions were performed for 25 min on separate days with twelve non-disabled participants. During the interventions, a single electrode from the contralateral M1 or PFC was used to detect event-related desynchronization (ERD) in the calibrated frequency range. If the BCI system detected ERD within 15 s of motor imagery, FES activated wrist extensor muscles. Otherwise, if the BCI system did not detect ERD within 15 s, a subsequent trial was initiated without FES. To evaluate neuromodulation effects, corticospinal excitability was assessed using single-pulse transcranial magnetic stimulation, and cortical excitability was assessed by motor imagery ERD and resting-state functional connectivity before, immediately, 30 min, and 60 min after each intervention.Main results. M1 and PFC BCI-FES interventions had similar success rates of approximately 80%, while the M1 intervention was faster in detecting ERD activity. Consequently, only the M1 intervention effectively elicited corticospinal excitability changes for at least 60 min around the targeted cortical area in the M1, suggesting a degree of spatial localization. However, cortical excitability measures did not indicate changes after either M1 or PFC BCI-FES.Significance. Neural mechanisms underlying the effectiveness of BCI-FES neuromodulation may be attributed to the M1 direct corticospinal projections and/or the closer timing between ERD detection and FES, which likely enhanced Hebbian-like plasticity by synchronizing cortical activation detected by the BCI system with the sensory nerve activation and movement related reafference elicited by FES.

Classification Algorithm for Electroencephalogram-based Motor Imagery Using Hybrid Neural Network with Spatio-temporal Convolution and Multi-head Attention Mechanism

Motor imagery (MI) is a brain-computer interface (BCI) technique in which specific brain regions are activated when people imagine their limbs (or muscles) moving, even without actual movement. The technology converts electroencephalogram (EEG) signals generated by the brain into computer-readable commands by measuring neural activity. Classification of motor imagery is one of the tasks in BCI. Researchers have done a lot of work on motor imagery classification, and the existing literature has relatively mature decoding methods for two-class motor tasks. However, as the categories of EEG-based motor imagery tasks increase, further exploration is needed for decoding research on four-class motor imagery tasks. In this study, we designed a hybrid neural network that combines spatiotemporal convolution and attention mechanisms. Specifically, the data is first processed by spatiotemporal convolution to extract features and then processed by a Multi-branch Convolution block. Finally, the processed data is input into the encoder layer of the Transformer for a self-attention calculation to obtain the classification results. Our approach was tested on the well-known MI datasets BCI Competition IV 2a and 2b, and the results show that the 2a dataset has a global average classification accuracy of 83.3% and a kappa value of 0.78. Experimental results show that the proposed method outperforms most of the existing methods.

Thirty-minute motor imagery exercise aided by EEG sensorimotor rhythm neurofeedback enhances morphing of sensorimotor cortices: a double-blind sham-controlled study

Neurofeedback training using electroencephalogram (EEG)-based brain-computer interfaces (BCIs) combined with mental rehearsals of motor behavior has demonstrated successful self-regulation of motor cortical excitability. However, it remains unclear whether the acquisition of skills to voluntarily control neural excitability is accompanied by structural plasticity boosted by neurofeedback. Here, we sought short-term changes in cortical structures induced by 30 min of BCI-based neurofeedback training, which aimed at the regulation of sensorimotor rhythm (SMR) in scalp EEG. When participants performed kinesthetic motor imagery of right finger movement with online feedback of either event-related desynchronisation (ERD) of SMR magnitude from the contralateral sensorimotor cortex (SM1) or those from other participants (i.e. placebo), the learning rate of SMR-ERD control was significantly different. Although overlapped structural changes in gray matter volumes were found in both groups, significant differences revealed by group-by-group comparison were spatially different; whereas the veritable neurofeedback group exhibited sensorimotor area-specific changes, the placebo exhibited spatially distributed changes. The white matter change indicated a significant decrease in the corpus callosum in the verum group. Furthermore, the learning rate of SMR regulation was correlated with the volume changes in the ipsilateral SM1, suggesting the involvement of interhemispheric motor control circuitries in BCI control tasks.

Brain-machine Interface (BMI)-based Neurorehabilitation for Post-stroke Upper Limb Paralysis

Because recovery from upper limb paralysis after stroke is challenging, compensatory approaches have been the main focus of upper limb rehabilitation. However, based on fundamental and clinical research indicating that the brain has a far greater potential for plastic change than previously thought, functional restorative approaches have become increasingly common. Among such interventions, constraint-induced movement therapy, task-specific training, robotic therapy, neuromuscular electrical stimulation (NMES), mental practice, mirror therapy, and bilateral arm training are recommended in recently published stroke guidelines. For severe upper limb paralysis, however, no effective therapy has yet been established. Against this background, there is growing interest in applying brain-machine interface (BMI) technologies to upper limb rehabilitation. Increasing numbers of randomized controlled trials have demonstrated the effectiveness of BMI neurorehabilitation, and several meta-analyses have shown medium to large effect sizes with BMI therapy. Subgroup analyses indicate higher intervention effects in the subacute group than the chronic group, when using movement attempts as the BMI-training trigger task rather than using motor imagery, and using NMES as the external device compared with using other devices. The Keio BMI team has developed an electroencephalography-based neurorehabilitation system and has published clinical and basic studies demonstrating its effectiveness and neurophysiological mechanisms. For its wider clinical application, the positioning of BMI therapy in upper limb rehabilitation needs to be clarified, BMI needs to be commercialized as an easy-to-use and cost-effective medical device, and training systems for rehabilitation professionals need to be developed. A technological breakthrough enabling selective modulation of neural circuits is also needed.

Toward an Adapted Neurofeedback for Post-stroke Motor Rehabilitation: State of the Art and Perspectives

Stroke is a severe health issue, and motor recovery after stroke remains an important challenge in the rehabilitation field. Neurofeedback (NFB), as part of a brain–computer interface, is a technique for modulating brain activity using on-line feedback that has proved to be useful in motor rehabilitation for the chronic stroke population in addition to traditional therapies. Nevertheless, its use and applications in the field still leave unresolved questions. The brain pathophysiological mechanisms after stroke remain partly unknown, and the possibilities for intervention on these mechanisms to promote cerebral plasticity are limited in clinical practice. In NFB motor rehabilitation, the aim is to adapt the therapy to the patient’s clinical context using brain imaging, considering the time after stroke, the localization of brain lesions, and their clinical impact, while taking into account currently used biomarkers and technical limitations. These modern techniques also allow a better understanding of the physiopathology and neuroplasticity of the brain after stroke. We conducted a narrative literature review of studies using NFB for post-stroke motor rehabilitation. The main goal was to decompose all the elements that can be modified in NFB therapies, which can lead to their adaptation according to the patient’s context and according to the current technological limits. Adaptation and individualization of care could derive from this analysis to better meet the patients’ needs. We focused on and highlighted the various clinical and technological components considering the most recent experiments. The second goal was to propose general recommendations and enhance the limits and perspectives to improve our general knowledge in the field and allow clinical applications. We highlighted the multidisciplinary approach of this work by combining engineering abilities and medical experience. Engineering development is essential for the available technological tools and aims to increase neuroscience knowledge in the NFB topic. This technological development was born out of the real clinical need to provide complementary therapeutic solutions to a public health problem, considering the actual clinical context of the post-stroke patient and the practical limits resulting from it.

Spatially bivariate EEG-neurofeedback can manipulate interhemispheric inhibition

Human behavior requires inter-regional crosstalk to employ the sensorimotor processes in the brain. Although external neuromodulation techniques have been used to manipulate interhemispheric sensorimotor activity, a central controversy concerns whether this activity can be volitionally controlled. Experimental tools lack the power to up- or down-regulate the state of the targeted hemisphere over a large dynamic range and, therefore, cannot evaluate the possible volitional control of the activity. We addressed this difficulty by using the recently developed method of spatially bivariate electroencephalography (EEG)-neurofeedback to systematically enable the participants to modulate their bilateral sensorimotor activities. Here, we report that participants learn to up- and down-regulate the ipsilateral excitability to the imagined hand while maintaining constant contralateral excitability; this modulates the magnitude of interhemispheric inhibition (IHI) assessed by the paired-pulse transcranial magnetic stimulation (TMS) paradigm. Further physiological analyses revealed that the manipulation capability of IHI magnitude reflected interhemispheric connectivity in EEG and TMS, which was accompanied by intrinsic bilateral cortical oscillatory activities. Our results show an interesting approach for neuromodulation, which might identify new treatment opportunities, e.g., in patients suffering from a stroke.

EEG characteristic investigation of the sixth-finger motor imagery and optimal channel selection for classification

OBJECTIVE

Supernumerary Robotic Limbs (SRL) are body augmentation robotic devices by adding extra limbs or fingers to the human body different from the traditional wearable robotic devices such as prosthesis and exoskeleton. We proposed a novel MI (Motor imagery)-based BCI paradigm based on the sixth-finger which imagines controlling the extra finger movements. The goal of this work is to investigate the EEG characteristics and the application potential of MI-based BCI systems based on the new imagination paradigm (the sixth finger MI).

APPROACH

14 subjects participated in the experiment involving the sixth finger MI tasks and rest state. Event-related spectral perturbation (ERSP) was adopted to analyse EEG spatial features and key-channel time-frequency features. Common spatial patterns (CSP) were used for feature extraction and classification was implemented by support vector machine (SVM). A genetic algorithm (GA) was used to select combinations of EEG channels that maximized classification accuracy and verified EEG patterns based on the sixth finger MI. And we conducted a longitudinal 4-week EEG control experiment based on the new paradigm.

MAIN RESULTS

ERD (event-related desynchronization) was found in the supplementary motor area (SMA) and primary motor area (M1) with a faint contralateral dominance. Unlike traditional MI based on the human hand, ERD was also found in frontal lobe. GA results showed that the distribution of the optimal 8-channel is similar to EEG topographical distributions, nearing parietal and frontal lobe. And the classification accuracy based on the optimal 8-channel (the highest accuracy of 80% and mean accuracy of 70%) was significantly better than that based on the random 8-channel (p<0.01).

SIGNIFICANCE

This work provided a new paradigm for MI-based MI system and verified its feasibility, widened the control bandwidth of the BCI system.

Neural Decoding of Chinese Sign Language With Machine Learning for Brain-Computer Interfaces

Limb motion decoding is an important part of brain-computer interface (BCI) research. Among the limb motion, sign language not only contains rich semantic information and abundant maneuverable actions but also provides different executable commands. However, many researchers focus on decoding the gross motor skills, such as the decoding of ordinary motor imagery or simple upper limb movements. Here we explored the neural features and decoding of Chinese sign language from electroencephalograph (EEG) signal with motor imagery and motor execution. Sign language not only contains rich semantic information, but also has abundant maneuverable actions, and provides us with more different executable commands. In this paper, twenty subjects were instructed to perform movement execution and movement imagery based on Chinese sign language. Seven classifiers are employed to classify the selected features of sign language EEG. L1 regularization is used to learn and select features that contain more information from the mean, power spectral density, sample entropy, and brain network connectivity. The best average classification accuracy of the classifier is 89.90% (imagery sign language is 83.40%). These results have shown the feasibility of decoding between different sign languages. The source location reveals that the neural circuits involved in sign language are related to the visual contact area and the pre-movement area. Experimental evaluation shows that the proposed decoding strategy based on sign language can obtain outstanding classification results, which provides a certain reference value for the subsequent research of limb decoding based on sign language.