Relationship between speed and EEG activity during imagined and executed hand movements

Beta oscillation is an indicator for two patterns of sensorimotor synchronization

Previous study indicates that there are two distinct behavioral patterns in the sensory-motor synchronization task with short stimulus onset asynchrony (SOA; 2-3 s) or long SOA (beyond 4 s). However, the underlying neural indicators and mechanisms have not been elucidated. The present study applied magnetoencephalography (MEG) technology to examine the functional role of several oscillations (beta, gamma, and mu) in sensorimotor synchronization with different SOAs to identify a reliable neural indicator. During MEG recording, participants underwent a listening task without motor response, a sound-motor synchronization task, and a motor-only continuation task. These tasks were used to explore whether and how the activity of oscillations changes across different behavioral patterns with different tempos. Results showed that during both the listening and the synchronization task, the beta oscillation changes with the tempo. Moreover, the event-related synchronization of beta oscillations was significantly correlated with motor timing during synchronization. In contrast, mu activity only changes with the tempo in the synchronization task, while the gamma activity remains unchanged. In summary, the current study indicates that beta oscillation could be an indicator of behavioral patterns between fast tempo and slow tempo in sensorimotor synchronization. Also, it is likely to be the potential mechanism of maintaining rhythmic continuous movements with short SOA, which is embedded within the 3 s time window.

Exploring empathic engagement in immersive media: An EEG study on mu rhythm suppression in VR

This study investigates the influence of immersive media, particularly Virtual Reality (VR), on empathic responses, in comparison to traditional television (TV), using electroencephalography (EEG). We employed mu rhythm suppression as a measurable neural marker to gauge empathic engagement, as its increase generally signifies heightened empathic responses. Our findings exhibit a greater mu rhythm suppression in VR conditions compared to TV conditions, suggesting a potential enhancement in empathic responses with VR. Furthermore, our results revealed that the strength of empathic responses was not confined to specific actions depicted in the video clips, underscoring the possibility of broader implications. This research contributes to the ongoing discourse on the effects of different media environments on empathic engagement, particularly emphasizing the unique role of immersive technologies such as VR. It invites further investigation into how such technologies can shape and potentially enhance the empathic experience.

Enhancing Brain-Computer Interface Performance by Incorporating Brain-to-Brain Coupling

Human cooperation relies on key features of social interaction in order to reach desirable outcomes. Similarly, human-robot interaction may benefit from integration with human-human interaction factors. In this paper, we aim to investigate brain-to-brain coupling during motor imagery (MI)-based brain-computer interface (BCI) training using eye-contact and hand-touch interaction. Twelve pairs of friends (experimental group) and 10 pairs of strangers (control group) were recruited for MI-based BCI tests concurrent with electroencephalography (EEG) hyperscanning. Event-related desynchronization (ERD) was estimated to measure cortical activation, and interbrain functional connectivity was assessed using multilevel statistical analysis. Furthermore, we compared BCI classification performance under different social interaction conditions. In the experimental group, greater ERD was found around the contralateral sensorimotor cortex under social interaction conditions compared with MI without any social interaction. Notably, EEG channels with decreased power were mainly distributed around the frontal, central, and occipital regions. A significant increase in interbrain coupling was also found under social interaction conditions. BCI decoding accuracies were significantly improved in the eye contact condition and eye and hand contact condition compared with the no-interaction condition. However, for the strangers' group, no positive effects were observed in comparisons of cortical activations between interaction and no-interaction conditions. These findings indicate that social interaction can improve the neural synchronization between familiar partners with enhanced brain activations and brain-to-brain coupling. This study may provide a novel method for enhancing MI-based BCI performance in conjunction with neural synchronization between users.

Decoding movement frequencies and limbs based on steady-state movement-related rhythms from noninvasive EEG

Objective.Decoding different types of movements noninvasively from electroencephalography (EEG) is an essential topic in neural engineering, especially in brain-computer interface. Although the widely used sensorimotor rhythm (SMR) is efficient in limb decoding, it lacks efficacy in decoding movement frequencies. Accumulating evidence supports the notion that the movement frequency is encoded in the steady-state movement-related rhythm (SSMRR). Our study has two primary objectives: firstly, to investigate the spatial-spectral representation of SSMRR in EEG during voluntary movements; secondly, to assess whether movement frequencies and limbs can be effectively decoded based on SSMRR.Approach.To comprehensively examine the representation of SSMRR, we investigated the frequency characteristics and spatial patterns associated with various rhythmic finger movements. Coherence analysis was performed between the sensor or source domain EEG and finger movements recorded by data gloves. A fusion model based on spectral SNR features and filter-bank common spatial pattern features was utilized to decode movement frequencies and limbs.Main results.At the group-level, sensor domain, and source domain coherence maps demonstrated that the accurate movement frequency (f0) and its first harmonic (f1) were encoded in the contralateral motor cortex. For the four-class classification, including two movement frequencies for both hands, the decoding accuracies for externally paced and internally paced movements were 73.14 ± 15.86% and 66.30 ± 17.26% (averaged across ten subjects, chance levels at 31.05% and 30.96%). Notably, the average results of five subjects with the highest decoding accuracies reached 87.21 ± 7.44% and 80.44 ± 7.99%.Significance.Our results verified the EEG representation of SSMRR and proved that the movement frequency and limb could be effectively decoded based on spatial-spectral features extracted from SSMRR. We suggest that SSMRR can serve as a complement to SMR to expand the range of decodable movement types and the approaches of limb decoding.

Decoding movement kinematics from EEG using an interpretable convolutional neural network

Continuous decoding of hand kinematics has been recently explored for the intuitive control of electroencephalography (EEG)-based Brain-Computer Interfaces (BCIs). Deep neural networks (DNNs) are emerging as powerful decoders, for their ability to automatically learn features from lightly pre-processed signals. However, DNNs for kinematics decoding lack in the interpretability of the learned features and are only used to realize within-subject decoders without testing other training approaches potentially beneficial for reducing calibration time, such as transfer learning. Here, we aim to overcome these limitations by using an interpretable convolutional neural network (ICNN) to decode 2-D hand kinematics (position and velocity) from EEG in a pursuit tracking task performed by 13 participants. The ICNN is trained using both within-subject and cross-subject strategies, and also testing the feasibility of transferring the knowledge learned on other subjects on a new one. Moreover, the network eases the interpretation of learned spectral and spatial EEG features. Our ICNN outperformed most of the other state-of-the-art decoders, showing the best trade-off between performance, size, and training time. Furthermore, transfer learning improved kinematics prediction in the low data regime. The network attributed the highest relevance for decoding to the delta-band across all subjects, and to higher frequencies (alpha, beta, low-gamma) for a cluster of them; contralateral central and parieto-occipital sites were the most relevant, reflecting the involvement of sensorimotor, visual and visuo-motor processing. The approach improved the quality of kinematics prediction from the EEG, at the same time allowing interpretation of the most relevant spectral and spatial features.

A comprehensive review on motion trajectory reconstruction for EEG-based brain-computer interface

The advance in neuroscience and computer technology over the past decades have made brain-computer interface (BCI) a most promising area of neurorehabilitation and neurophysiology research. Limb motion decoding has gradually become a hot topic in the field of BCI. Decoding neural activity related to limb movement trajectory is considered to be of great help to the development of assistive and rehabilitation strategies for motor-impaired users. Although a variety of decoding methods have been proposed for limb trajectory reconstruction, there does not yet exist a review that covers the performance evaluation of these decoding methods. To alleviate this vacancy, in this paper, we evaluate EEG-based limb trajectory decoding methods regarding their advantages and disadvantages from a variety of perspectives. Specifically, we first introduce the differences in motor execution and motor imagery in limb trajectory reconstruction with different spaces (2D and 3D). Then, we discuss the limb motion trajectory reconstruction methods including experiment paradigm, EEG pre-processing, feature extraction and selection, decoding methods, and result evaluation. Finally, we expound on the open problem and future outlooks.

Primary somatosensory cortex sensitivity may increase upon completion of a motor task

OBJECTIVES

The electroencephalogram and magnetic field primary somatosensory cortex (S1)-derived components are attenuated before and during motor tasks compared to the resting state, a phenomenon called gating; however, the S1 response after a motor task has not been well studied. We aimed to investigate sensory information processing immediately after motor tasks using magnetoencephalography.

MATERIALS AND METHODS

We investigated sensory information processing immediately after finger movement using magnetoencephalography in 14 healthy adults. Volunteers performed a simple reaction task where they were required to press a button when they received a cue. In parallel, electrical stimulation to the right index finger was applied at regular intervals to detect the magnetic brain field changes. The end of the motor task timing was defined using the event-related synchronization (ERS) appearance latency in the brain magnetic field's beta band around the primary motor cortex. The ERS appearance latency and the sensory stimuli timing applied every 500 ms were synchronized over the experimental system timeline. We examined whether there was a difference in the S1 somatosensory evoked field responses between the ERS emergence and ERS disappearance phase, focusing on the N20m-P35m peak-to-peak amplitude (N20m-P35m amplitude) value. A control experiment was also conducted in which only sensory stimulation was applied with no motor task.

RESULTS

The N20m-P35m mean amplitude value was significantly higher in the ERS emergence phase (15.81 nAm; standard deviation [SD], 6.54 nAm) than in the ERS disappearance phase (13.54 nAm; SD, 5.12 nAm) (p < 0.05) and the control (12.08 nAm, SD 5.61 nAm) (p = 0.013). No statistically significant differences were identified between the ERS disappearance phase and the control (p = 0.281).

CONCLUSIONS

The S1 sensitivity may increase rapidly after exiting from the gating influence in S1 (after completing a motor task).

From thinking fast to moving fast: motor control of fast limb movements in healthy individuals

The ability to produce high movement speeds is a crucial factor in human motor performance, from the skilled athlete to someone avoiding a fall. Despite this relevance, there remains a lack of both an integrative brain-to-behavior analysis of these movements and applied studies linking the known dependence on open-loop, central control mechanisms of these movements to their real-world implications, whether in the sports, performance arts, or occupational setting. In this review, we cover factors associated with the planning and performance of fast limb movements, from the generation of the motor command in the brain to the observed motor output. At each level (supraspinal, peripheral, and motor output), the influencing factors are presented and the changes brought by training and fatigue are discussed. The existing evidence of more applied studies relevant to practical aspects of human performance is also discussed. Inconsistencies in the existing literature both in the definitions and findings are highlighted, along with suggestions for further studies on the topic of fast limb movement control. The current heterogeneity in what is considered a fast movement and in experimental protocols makes it difficult to compare findings in the existing literature. We identified the role of the cerebellum in movement prediction and of surround inhibition in motor slowing, as well as the effects of fatigue and training on central motor control, as possible avenues for further research, especially in performance-driven populations.

Decoding trajectories of imagined hand movement using electrocorticograms for brain-machine interface

OBJECTIVE

Reaching hand movement is an important motor skill actively examined in brain-computer interface (BCI). Among various components of movement analyzed is the hand's trajectory, which describes the hand's continuous positions in three-dimensional space. While a large body of studies have investigated the decoding of real movements and the reconstruction of real hand movement trajectories from neural signals, fewer studies have attempted to decode the trajectory of imagined hand movement. To develop BCI systems for patients with hand motor dysfunctions, the systems essentially require to achieve movement-free control of external devices, which is only possible through successful decoding of purely imagined hand movement.

APPROACH

To achieve this goal, this study used a machine learning technique (i.e., the variational Bayesian least square) to analyze the electrocorticogram (ECoG) of eighteen epilepsy patients obtained from when they performed movement execution (ME) and kinesthetic movement imagination (KMI) of the reach-and-grasp hand action.

MAIN RESULTS

The variational Bayesian decoding model was able to successfully predict the imagined trajectories of hand movement significantly above chance level. The Pearson's correlation coefficient between imagined and predicted trajectories was 0.3393 and 0.4936 for the KMI (KMI trials only) and MEKMI paradigm (alternating trials of ME and KMI) respectively.

SIGNIFICANCE

This study demonstrated a high accuracy of prediction for trajectories of imagined hand movement, and more importantly, higher decoding accuracy of imagined trajectories in the MEKMI paradigm than in the KMI paradigm solely.

A Semi-Supervised Progressive Learning Algorithm for Brain-Computer Interface

Brain-computer interface (BCI) usually suffers from the problem of low recognition accuracy and large calibration time, especially when identifying motor imagery tasks for subjects with indistinct features and classifying fine grained motion control tasks by electroencephalogram (EEG)-electromyogram (EMG) fusion analysis. To fill the research gap, this paper presents an end-to-end semi-supervised learning framework for EEG classification and EEG-EMG fusion analysis. Benefiting from the proposed metric learning based label estimation strategy, sampling criterion and progressive learning scheme, the proposed framework efficiently extracts distinctive feature embedding from the unlabeled EEG samples and achieves a 5.40% improvement on BCI Competition IV Dataset IIa with 80% unlabeled samples and an average 3.35% improvement on two public BCI datasets. By employing synchronous EMG features as pseudo labels for the unlabeled EEG samples, the proposed framework further extracts deep level features of the synergistic complementarity between the EEG signals and EMG features based on the deep encoders, which improves the performance of hybrid BCI (with a 5.53% improvement for the Upper Limb Motion Dataset and an average 4.34% improvement on two hybrid datasets). Moreover, the ablation experiments show that the proposed framework can substantially improve the performance of the deep encoders (with an average 5.53% improvement). The proposed framework not only largely improves the performance of deep networks in the BCI system, but also significantly reduces the calibration time for EEG-EMG fusion analysis, which shows great potential for building an efficient and high-performance hybrid BCI for the motor rehabilitation process.

Stepping in time: Alpha-mu and beta oscillations during a walking synchronization task

Interpersonal behavioral synchrony is referred to as temporal coordination of action between two or more individuals. Humans tend to synchronize their movements during repetitive movement tasks such as walking. Mobile EEG technology now allows us to examine how this happens during gait. 18 participants equipped with foot accelerometers and mobile EEG walked with an experimenter in three conditions: With their view of the experimenter blocked, walking naturally, and trying to synchronize their steps with the experimenter. The experimenter walked following a headphone metronome to keep their steps consistent for all conditions. Step behavior and synchronization between the experimenter and participant were compared between conditions. Additionally, event-related spectral perturbations (ERSPs) were time-warped to the gait cycle in order to analyze alpha-mu (7.5-12.5 Hz) and beta (16-32 Hz) rhythms over the whole gait cycle. Step synchronization was significantly higher in the synchrony condition than in the natural condition. Likewise regarding ERSPs, right parietal channel (C4, C6, CP4, CP6) alpha-mu and central channel (C1, Cz, C2) beta power were suppressed from baseline in the walking synchrony condition compared to the natural walking condition. The natural and blocked conditions were not found to be significantly different in behavioral or spectral comparisons. Our results are compatible with the view that intentional synchronization employs systems associated with social interaction as well as the central motor system.

Motor Imagination of Lower Limb Movements at Different Frequencies

Motor imagination (MI) is the mental process of only imagining an action without an actual movement. Research on MI has made significant progress in feature information detection and machine learning decoding algorithms, but there are still problems, such as a low overall recognition rate and large differences in individual execution effects, which make the development of MI run into a bottleneck. Aiming at solving this bottleneck problem, the current study optimized the quality of the MI original signal by “enhancing the difficulty of imagination tasks,” conducted the qualitative and quantitative analyses of EEG rhythm characteristics, and used quantitative indicators, such as ERD mean value and recognition rate. Research on the comparative analysis of the lower limb MI of different tasks, namely, high-frequency motor imagination (HFMI) and low-frequency motor imagination (LFMI), was conducted. The results validate the following: the average ERD of HFMI (−1.827) is less than that of LFMI (−1.3487) in the alpha band, so did (−3.4756 < −2.2891) in the beta band. In the alpha and beta characteristic frequency bands, the average ERD of HFMI is smaller than that of LFMI, and the ERD values of the two are significantly different (p=0.0074 < 0.01; r = 0.945). The ERD intensity STD values of HFMI are less than those of LFMI. which suggests that the ERD intensity individual difference among the subjects is smaller in the HFMI mode than in the LFMI mode. The average recognition rate of HFMI is higher than that of LFMI (87.84% > 76.46%), and the recognition rate of the two modes is significantly different (p=0.0034 < 0.01; r = 0.429). In summary, this research optimizes the quality of MI brain signal sources by enhancing the difficulty of imagination tasks, achieving the purpose of improving the overall recognition rate of the lower limb MI of the participants and reducing the differences of individual execution effects and signal quality among the subjects.

Brain Processes Involved in Motor Planning Are a Dominant Factor for Inducing Event-Related Desynchronization

Event-related desynchronization (ERD) is a relative attenuation in the spectral power of an electroencephalogram (EEG) observed over the sensorimotor area during motor execution and motor imagery. It is a well-known EEG feature and is commonly employed in brain-computer interfaces. However, its underlying neural mechanisms are not fully understood, as ERD is a single variable correlated with external events involving numerous pathways, such as motor intention, planning, and execution. In this study, we aimed to identify a dominant factor for inducing ERD. Participants were instructed to grasp their right hand with three different (10, 25, or 40%MVF: maximum voluntary force) levels under two distinct experimental conditions: a closed-loop condition involving real-time visual force feedback (VF) or an open-loop condition in a feedforward (FF) manner. In each condition, participants were instructed to repeat the grasping task a certain number of times with a timeline of Rest (10.0 s), Preparation (1.0 s), and Motor Execution (4.0 s) periods, respectively. EEG signals were recorded simultaneously with the motor task to evaluate the time-course of the event-related spectrum perturbation for each condition and dissect the modulation of EEG power. We performed statistical analysis of mu and beta-ERD under the instructed grasping force levels and the feedback conditions. In the FF condition (i.e., no force feedback), mu and beta-ERD were significantly attenuated in the contralateral motor cortex during the middle of the motor execution period, while ERD in the VF condition was maintained even during keep grasping. Only mu-ERD at the somatosensory cortex tended to be slightly stronger in high load conditions. The results suggest that the extent of ERD reflects neural activity involved in the motor planning process for changing virtual equilibrium point rather than the motor control process for recruiting motor neurons to regulate grasping force.

Motor Intention Decoding from the Upper Limb by Graph Convolutional Network Based on Functional Connectivity

Decoding brain intention from noninvasively measured neural signals has recently been a hot topic in brain-computer interface (BCI). The motor commands about the movements of fine parts can increase the degrees of freedom under control and be applied to external equipment without stimulus. In the decoding process, the classifier is one of the key factors, and the graph information of the EEG was ignored by most researchers. In this paper, a graph convolutional network (GCN) based on functional connectivity was proposed to decode the motor intention of four fine parts movements (shoulder, elbow, wrist, hand). First, event-related desynchronization was analyzed to reveal the differences between the four classes. Second, functional connectivity was constructed by using synchronization likelihood (SL), phase-locking value (PLV), H index (H), mutual information (MI), and weighted phase-lag index (WPLI) to acquire the electrode pairs with a difference. Subsequently, a GCN and convolutional neural networks (CNN) were performed based on functional topological structures and time points, respectively. The results demonstrated that the proposed method achieved a decoding accuracy of up to 92.81% in the four-class task. Besides, the combination of GCN and functional connectivity can promote the development of BCI.

Decoding Hand Movement Types and Kinematic Information From Electroencephalogram

Brain-computer interfaces (BCIs) have achieved successful control of assistive devices, e.g. neuroprosthesis or robotic arm. Previous research based on hand movements Electroencephalogram (EEG) has shown limited success in precise and natural control. In this study, we explored the possibilities of decoding movement types and kinematic information for three reach-and-execute actions using movement-related cortical potentials (MRCPs). EEG signals were acquired from 12 healthy subjects during the execution of pinch, palmar and precision disk rotation actions that involved two levels of speeds and forces. In the case of discrimination between hand movement types under each of four different kinematics conditions, we obtained the average peak accuracies of 83.44% and 73.83% for the binary and 3-class classification, respectively. In the case of discrimination between different movement kinematics for each of three actions, the average peak accuracies of 82.9% and 58.2% could be achieved for the two and 4-class scenario. In both cases, peak decoding performance was significantly higher than the subject-specific chance level. We found that hand movement types all could be classified when these actions were executed at four different kinematic parameters. Meanwhile, for each of three hand movements, we decoded movement parameters successfully. Furthermore, the feasibility of decoding hand movements during hand retraction process was also demonstrated. These findings are of great importance for controlling neuroprosthesis or other rehabilitation devices in a fine and natural way, which would drastically increase the acceptance of motor impaired users.

Correcting physiological noise in whole-head functional near-infrared spectroscopy

BACKGROUND

Functional near-infrared spectroscopy (fNIRS) has been increasingly employed to monitor cerebral hemodynamics in normal and diseased conditions. However, fNIRS suffers from its susceptibility to superficial activity and systemic physiological noise. The objective of the study was to establish a noise reduction method for fNIRS in a whole-head montage.

NEW METHOD

We have developed an automated denoising method for whole-head fNIRS. A high-density montage consisting of 109 long-separation channels and 8 short-separation channels was used for recording. Auxiliary sensors were also used to measure motion, respiration and pulse simultaneously. The method incorporates principal component analysis and general linear model to identify and remove a globally uniform superficial component. Our denoising method was evaluated in experimental data acquired from a group of healthy human subjects during a visually cued motor task and further compared with a minimal preprocessing method and three established denoising methods in the literature. Quantitative metrics including contrast-to-noise ratio, within-subject standard deviation and adjusted coefficient of determination were evaluated.

RESULTS

After denoising, whole-head topography of fNIRS revealed focal activations concurrently in the primary motor and visual areas.

COMPARISON WITH EXISTING METHODS

Analysis showed that our method improves upon the four established preprocessing methods in the literature.

CONCLUSIONS

An automatic, effective and robust preprocessing pipeline was established for removing physiological noise in whole-head fNIRS recordings. Our method can enable fNIRS as a reliable tool in monitoring large-scale, network-level brain activities for clinical uses.

Disruptions of cortico-kinematic interactions in Parkinson's disease

The cortical role of the motor symptoms reflected by kinematic characteristics in Parkinson's disease (PD) is poorly understood. In this study, we aim to explore how PD affects cortico-kinematic interactions. Electroencephalographic (EEG) and kinematic data were recorded from seven healthy participants and eight participants diagnosed with PD during a set of self-paced finger tapping tasks. Event-related desynchronization (ERD) was compared between groups in the α (8-14 Hz), low-ß (14-20 Hz), and high-ß (20-35 Hz) frequency bands to investigate between-group differences in the cortical activities associated with movement. Average kinematic peak amplitudes and latencies were extracted alongside Sample Entropy (SaEn), a measure of signal complexity, as variables for comparison between groups. These variables were further correlated with average EEG power in each frequency band to establish within-group interactions between cortical motor functions and kinematic motor output. High ß-band power correlated with mean kinematic peak latency and signal complexity in the healthy group, while no correlation was found in the PD group. Also, the healthy group demonstrated stronger ERD in the broad ß-band than the PD participants. Our results suggest that cortical ß-band power in healthy populations is graded to finger tapping latency and complexity of movement, but this relationship is impaired in PD. These insights could help further enhance our understanding of the role of cortical ß-band oscillations in healthy movement and the possible disruption of that relationship in PD. These outcomes can provide further directions for treatment and therapeutic applications and potentially establish cortical biomarkers of Parkinson's disease.

Motor Imagery Hand Movement Direction Decoding Using Brain Computer Interface to Aid Stroke Recovery and Rehabilitation

Motor Imagery (MI)-based Brain Computer Interface (BCI) system is a potential technology for active neurorehabilitation of stroke patients by complementing the conventional passive rehabilitation methods. Research to date mainly focused on classifying left vs. right hand/foot MI of stroke patients. Though a very few studies have reported decoding imagined hand movement directions using electroencephalogram (EEG)-based BCI, the experiments were conducted on healthy subjects. Our work analyzes MI-based brain cortical activity from EEG signals and decodes the imagined hand movement directions in stroke patients. The decoded direction (left vs. right) of hand movement imagination is used to provide control commands to a motorized arm support on which patient's affected (paralyzed) arm is placed. This enables the patient to move his/her stroke-affected hand towards the intended (imagined) direction that aids neuroplasticity in the brain. The synchronization measure called Phase Locking Value (PLV), extracted from EEG, is the neuronal signature used to decode the directional movement of the MI task. Event-related desynchronization/synchronization (ERD/ERS) analysis on Mu and Beta frequency bands of EEG is done to select the time bin corresponding to the MI task. The dissimilarities between the two directions of MI tasks are identified by selecting the most significant channel pairs that provided maximum difference in PLV features. The training protocol has an initial calibration session followed by a feedback session with 50 trials of MI task in each session. The feedback session extracts PLV features corresponding to most significant channel pairs which are identified in the calibration session and is used to predict the direction of MI task in left/right direction. An average MI direction classification accuracy of 74.44% is obtained in performing the training protocol and 68.63% from the prediction protocol during feedback session on 16 stroke patients.

Neural decoding of continuous upper limb movements: a meta-analysis

OBJECTIVE

EEG-based motion trajectory decoding makes a promising approach for neurotechnology which can be used for neural control of motion reconstruction and neurorehabilitation tools. However, the feasibility and validity of continuous motion decoding by non-invasive brain activity are not clear. The main aim of this study was to perform a meta-analysis across studies that examined the ability of EEG-based continuous motion decoding of upper limb movements.

APPROACH

Pearson's correlation coefficient (CC) was used to evaluate the model performance of the studies and considered as an effect size. To estimate the overall effect size of neural decoding of motion trajectory across studies, characteristics of included studies were addressed and the random effect model was applied to the heterogeneous studies which estimated overall effect size distribution. Furthermore, the significant difference between the two subgroups of imagined and executed movements was analysed.

MAIN RESULTS

The mean of the overall effect size was computed 0.46 across the nonhomogeneous studies. The results showed no significant difference between imagined and executed movements (Chi²=0.28, df = 1, p = 0.60).

SIGNIFICANCE

Meta-analysis results confirm that imagination like execution movements can be used for neural decoding of motion trajectory in neural motor control systems. Also, nonlinear compare with linear model statistically confirmed to be more beneficial for complex movements. Furthermore, a new approach of synergy-based motion decoding can be significantly effective to increase model performance and more research needs to evaluate this method for different levels of complexity of movements.IMPLICATIONS FOR REHABILITATIONNeural decoding methods base on EEG as a non-invasive brain activity, are more user friendly for neurorehabilitation than invasive methods that developing of it makes it more applicable for reconstructing activities of daily living.Neurotechnology for neural control of motion reconstruction, makes the rehabilitation tools to be more synchrony with human intentional movement that can be used to improve the brain neuroplastisity in stroke or other paralysed people.The feasibility and validity of imagined movements equal with executed movements show that amputee people also can benefit EEG-based motion decoding for controling rehabilitation tools just by imagination of their intentional movements.For neurorehabilitation tools, comparing the study outcomes illucidate that the approach of synergy-based motor control in brain activities concluded significantly high performance that highlighted the need it to more investigated in future research.

Decoding of voluntary and involuntary upper-limb motor imagery based on graph fourier transform and cross-frequency coupling coefficients

OBJECTIVE

Brain-computer interface (BCI) technology based on motor imagery (MI) control has become a research hotspot but continues to encounter numerous challenges. BCI can assist in the recovery of stroke patients and serve as a key technology in robot control. Current research on MI almost exclusively focuses on the hands, feet, and tongue. Therefore, the purpose of this paper is to establish a four-class MI BCI system, in which the four types are the four articulations within the right upper limbs, involving the shoulder, elbow, wrist, and hand.

APPROACH

Ten subjects were chosen to perform nine upper-limb analytic movements, after which the differences were compared in P300, movement-related potentials(MRPS), and event-related desynchronization/event-related synchronization under voluntary MI (V-MI) and involuntary MI (INV-MI). Next, the cross-frequency coupling (CFC) coefficient based on mutual information was extracted from the electrodes and frequency bands with interest. Combined with the image Fourier transform and twin bounded support vector machine classifier, four kinds of electroencephalography data were classified, and the classifier's parameters were optimized using a genetic algorithm.

MAIN RESULTS

The results were shown to be encouraging, with an average accuracy of 93.2% and 92.2% for V-MI and INV-MI, respectively, and over 95% for any three classes and any two classes. In most cases, the accuracy of feature extraction using the proximal articulations as the basis was found to be relatively high and had better performance.

SIGNIFICANCE

This paper discussed four types of MI according to three aspects under two modes and classed them by combining graph Fourier transform and CFC. Accordingly, the theoretical discussion and classification methods may provide a fundamental theoretical basis for BCI interface applications.

Pre-movement changes in sensorimotor beta oscillations predict motor adaptation drive

Beta frequency oscillations in scalp electroencephalography (EEG) recordings over the primary motor cortex have been associated with the preparation and execution of voluntary movements. Here, we test whether changes in beta frequency are related to the preparation of adapted movements in human, and whether such effects generalise to other species (cat). Eleven healthy adult humans performed a joystick visuomotor adaptation task. Beta (15-25 Hz) scalp EEG signals recorded over the motor cortex during a pre-movement preparatory phase were, on average, significantly reduced in amplitude during early adaptation trials compared to baseline, late adaptation, or aftereffect trials. The changes in beta were not related to measurements of reaction time or reach duration. We also recorded local field potential (LFP) activity within the primary motor cortex of three cats during a prism visuomotor adaptation task. Analysis of these signals revealed similar reductions in motor cortical LFP beta frequencies during early adaptation. This effect was present when controlling for any influence of the reaction time and reach duration. Overall, the results are consistent with a reduction in pre-movement beta oscillations predicting an increase in adaptive drive in upcoming task performance when motor errors are largest in magnitude and the rate of adaptation is greatest.

Brain Activity During Unilateral Physical and Imagined Isometric Contractions

By convention, it is believed that the ipsilateral side of the body is controlled by the contralateral side of the brain. Past studies measuring brain activity primarily recorded changes before and after an intervention is performed on one side of the body within one hemisphere (usually the contralateral) of the brain. The purpose of this investigation was to observe the brain activity within the left and right hemispheres of the prefrontal and sensorimotor cortices during physical and imagined, dominant and non-dominant unilateral isometric elbow flexion. Fifteen right hand dominant individuals (six males and nine females) between the ages of 18 and 21 performed four different isometric contractions of their biceps brachii at a preacher curl bench: dominant physical contraction (DomCon), non-dominant physical contraction (NonCon), dominant imagined contraction (DomImagine), and non-dominant imagined contraction (NonImagine). Each contraction was sustained for 5 s followed by 30 s of rest. Motor activity-related cortical potential (MRCP) and event-related spectral perturbation (ERSP) within the right and left hemispheres of the sensorimotor and prefrontal cortices were determined for each condition at 500–1,000 ms and 2,000–2,500 ms after initiation of contraction. MRCP and ERSP were both changed at the 500–1,000 ms time window for all conditions. Changes in the 2,000–2,500 ms window were most consistently observed during physical contractions. While the changes during DomCon occurred in the left (contralateral) side of the brain, the greatest changes observed in MRCP and ERSP occurred in both sides of the brain during the NonCon condition. Further understanding of bilateral changes in brain activity during unilateral tasks is valuable for improving rehabilitation practices through mental and physical exercise.

Semi-Autonomous Robotic Arm Reaching With Hybrid Gaze-Brain Machine Interface

Recent developments in the non-muscular human-robot interface (HRI) and shared control strategies have shown potential for controlling the assistive robotic arm by people with no residual movement or muscular activity in upper limbs. However, most non-muscular HRIs only produce discrete-valued commands, resulting in non-intuitive and less effective control of the dexterous assistive robotic arm. Furthermore, the user commands and the robot autonomy commands usually switch in the shared control strategies of such applications. This characteristic has been found to yield a reduced sense of agency as well as frustration for the user according to previous user studies. In this study, we firstly propose an intuitive and easy-to-learn-and-use hybrid HRI by combing the Brain-machine interface (BMI) and the gaze-tracking interface. For the proposed hybrid gaze-BMI, the continuous modulation of the movement speed via the motor intention occurs seamlessly and simultaneously to the unconstrained movement direction control with the gaze signals. We then propose a shared control paradigm that always combines user input and the autonomy with the dynamic combination regulation. The proposed hybrid gaze-BMI and shared control paradigm were validated for a robotic arm reaching task performed with healthy subjects. All the users were able to employ the hybrid gaze-BMI for moving the end-effector sequentially to reach the target across the horizontal plane while also avoiding collisions with obstacles. The shared control paradigm maintained as much volitional control as possible, while providing the assistance for the most difficult parts of the task. The presented semi-autonomous robotic system yielded continuous, smooth, and collision-free motion trajectories for the end effector approaching the target. Compared to a system without assistances from robot autonomy, it significantly reduces the rate of failure as well as the time and effort spent by the user to complete the tasks.

Cortical Activations and BCI Performances at Different Speeds of Visual and Proprioceptive Stimulation

Motor imagery based brain-computer interface (MI-BCI) is one of the most common paradigms utilized in neurofeedback training (NFT) for rehabilitation engineering. Specifically, finding an appropriate feedback protocol is significantly important to improve the effectiveness of the motor training system. To this end, we investigated the electroencephalography(EEG) oscillatory patterns measured by event-related desynchronization (ERD) when sixteen participants accepted the visual and proprioceptive stimulation achieving the kinematic hand grasping movements at three different speeds (i.e. 1/3 Hz, 2/3 Hz and 1 Hz). The EEG results indicated that the ERD patterns showed no significant difference in sensorimotor cortex (i.e. C3 and FC3 channels) by comparing the three conditions. Nevertheless, the 2/3 Hz stimulation speed could achieve a significantly better classification performance than the other two conditions across all participants. Therefore, the visual and proprioceptive electrical stimulation achieving the kinematic hand grasping at 2/3 Hz speed might provide an available approach for the online MI-BCI system based NFT system in the future.

Decoding Imagined 3D Arm Movement Trajectories From EEG to Control Two Virtual Arms-A Pilot Study

Background: Realization of online control of an artificial or virtual arm using information decoded from EEG normally occurs by classifying different activation states or voluntary modulation of the sensorimotor activity linked to different overt actions of the subject. However, using a more natural control scheme, such as decoding the trajectory of imagined 3D arm movements to move a prosthetic, robotic, or virtual arm has been reported in a limited amount of studies, all using offline feed-forward control schemes.

Objective: In this study, we report the first attempt to realize online control of two virtual arms generating movements toward three targets/arm in 3D space. The 3D trajectory of imagined arm movements was decoded from power spectral density of mu, low beta, high beta, and low gamma EEG oscillations using multiple linear regression. The analysis was performed on a dataset recorded from three subjects in seven sessions wherein each session comprised three experimental blocks: an offline calibration block and two online feedback blocks. Target classification accuracy using predicted trajectories of the virtual arms was computed and compared with results of a filter-bank common spatial patterns (FBCSP) based multi-class classification method involving mutual information (MI) selection and linear discriminant analysis (LDA) modules.

Main Results: Target classification accuracy from predicted trajectory of imagined 3D arm movements in the offline runs for two subjects (mean 45%, std 5%) was significantly higher (p < 0.05) than chance level (33.3%). Nevertheless, the accuracy during real-time control of the virtual arms using the trajectory decoded directly from EEG was in the range of chance level (33.3%). However, the results of two subjects show that false-positive feedback may increase the accuracy in closed-loop. The FBCSP based multi-class classification method distinguished imagined movements of left and right arm with reasonable accuracy for two of the three subjects (mean 70%, std 5% compared to 50% chance level). However, classification of the imagined arm movement toward three targets was not successful with the FBCSP classifier as the achieved accuracy (mean 33%, std 5%) was similar to the chance level (33.3%). Sub-optimal components of the multi-session experimental paradigm were identified, and an improved paradigm proposed.

EEG Sensorimotor Correlates of Speed During Forearm Passive Movements

Although passive movement therapy has been widely adopted to recover lost motor functions of impaired body parts, the underlying neural mechanisms are still unclear. In this context, fully understanding how the proprioceptive input modulates the brain activity may provide valuable insights. Specifically, it has not been investigated how the speed of motions, passively guided by a haptic device, affects the sensorimotor rhythms (SMR). On the grounds that faster passive motions elicit larger quantity of afferent input, we hypothesize a proportional relationship between localized SMR features and passive movement speed. To address this hypothesis, we conducted an experiment where healthy subjects received passive forearm oscillations at different speed levels while their electroencephalogram was recorded. The mu and beta event related desynchronization (ERD) and beta rebound of both left and right sensorimotor areas are analyzed by linear mixed-effects models. Results indicate that passive movement speed is correlated with the contralateral beta rebound and ipsilateral mu ERD. The former has been previously linked with the processing of proprioceptive afferent input quantity, while the latter with speed-dependent inhibitory processes. This suggests the existence of functionally-distinct frequency-specific neuronal populations associated with passive movements. In future, our findings may guide the design of novel rehabilitation paradigms.

Toward understanding the neurophysiological basis of peripersonal space: An EEG study on healthy individuals

The subcortical mechanisms subtending the sensorimotor processes related to the peripersonal space (PPS) have been well characterized, whereas less evidence is available concerning the cortical mechanisms. We investigated the theta, alpha and beta event-related spectral perturbations (ERSP) while holding the forearm in different positions into the PPS of the face. Fifty healthy individuals were subjected to EEG recording while being provided with median nerve electric stimulation at the wrist of the right hand held at different hand-to-face distances. Theta and beta rhythms were significantly perturbed depending on the hand-to-face distance, whereas alpha oscillations reflected a more general, non-specific oscillatory response to the motor task. The perturbation of theta and beta frequency bands may reflect the processes of top-down modulation overseeing the conscious spatiotemporal encoding of sensory-motor information within the PPS. In other words, such perturbation reflects the continuous update of the conscious internal representations of the PPS to build up a purposeful and reflexive motor response.

BCI Monitor Enhances Electroencephalographic and Cerebral Hemodynamic Activations During Motor Training

Motor imagery-based brain-computer interface (MI-BCI) controlling functional electrical stimulation (FES) is promising for disabled patients to restore their motor functions. However, it remains unclear how much the BCI part can contribute to the functional coupling between the brain and muscle. Specifically, whether it can enhance the cerebral activation for motor training? Here, we investigate the electroencephalographic and cerebral hemodynamic responses for MI-BCI-FES training and MI-FES training, respectively. Twelve healthy subjects were recruited in the motor training study when concurrent electroencephalography (EEG) and functional near-infrared spectroscopy (fNIRS) were recorded. Compared with the MI-FES training conditions, the MI-BCI-FES could induce significantly stronger event-related desynchronization (ERD) and blood oxygen response, which demonstrates that BCI indeed plays a functional role in the closed-loop motor training. Therefore, this paper verifies the feasibility of using BCI to train motor functions in a closed-loop manner.

Single-Trial Recognition of Imagined Forces and Speeds of Hand Clenching Based on Brain Topography and Brain Network

To provide optional force and speed control parameters for brain-computer interfaces (BCIs), an effective feature extraction method of imagined force and speed of hand clenching based on electroencephalography (EEG) was explored. Twenty subjects were recruited to participate in the experiment. They were instructed to perform three different actual/imagined hand clenching force tasks (4 kg, 10 kg, and 16 kg) and three different hand clenching speed tasks (0.5 Hz, 1 Hz, and 2 Hz). Topographical maps parameters and brain network parameters of EEG were calculated as new features of imagined force and speed of hand clenching, which were classified by three classifiers: linear discrimination analysis, extreme learning machines and support vector machines. Topographical maps parameters were better for recognition of the hand clenching force task, while brain network parameters were better for recognition of the hand clenching speed task. After a combination of five types of features (energy, power spectrum of the autoregressive model, wavelet packet coefficients, topographical maps parameters and brain network parameters), the recognition rate of the hand clenching force task was 97%, and that of the hand clenching speed task was as high as 100%. The brain topographical and the brain network parameters are expected to improve the accuracy of decoding the EEG signal of imagined force and speed of hand clenching. A more efficient brain network may facilitate the recognition of force/speed of hand clenching. Combined features could significantly improve the single-trial recognition rate of imagined forces and speeds of hand clenching. The current study provides a new idea for the imagined force and speed of hand clenching that offers more control intention instructions for BCIs.

EEG source space analysis of the supervised factor analytic approach for the classification of multi-directional arm movement

OBJECTIVE

In electroencephalography (EEG)-based brain-computer interface (BCI) systems for motor control tasks the conventional practice is to decode motor intentions by using scalp EEG. However, scalp EEG only reveals certain limited information about the complex tasks of movement with a higher degree of freedom. Therefore, our objective is to investigate the effectiveness of source-space EEG in extracting relevant features that discriminate arm movement in multiple directions.

APPROACH

We have proposed a novel feature extraction algorithm based on supervised factor analysis that models the data from source-space EEG. To this end, we computed the features from the source dipoles confined to Brodmann areas of interest (BA4a, BA4p and BA6). Further, we embedded class-wise labels of multi-direction (multi-class) source-space EEG to an unsupervised factor analysis to make it into a supervised learning method.

MAIN RESULTS

Our approach provided an average decoding accuracy of 71% for the classification of hand movement in four orthogonal directions, that is significantly higher (>10%) than the classification accuracy obtained using state-of-the-art spatial pattern features in sensor space. Also, the group analysis on the spectral characteristics of source-space EEG indicates that the slow cortical potentials from a set of cortical source dipoles reveal discriminative information regarding the movement parameter, direction.

SIGNIFICANCE

This study presents evidence that low-frequency components in the source space play an important role in movement kinematics, and thus it may lead to new strategies for BCI-based neurorehabilitation.

Movement Kinematics Dynamically Modulates the Rolandic ~ 20-Hz Rhythm During Goal-Directed Executed and Observed Hand Actions

This study investigates whether movement kinematics modulates similarly the rolandic α and β rhythm amplitude during executed and observed goal-directed hand movements. It also assesses if this modulation relates to the corticokinematic coherence (CKC), which is the coupling observed between cortical activity and movement kinematics during such motor actions. Magnetoencephalography (MEG) signals were recorded from 11 right-handed healthy subjects while they performed or observed an actor performing the same repetitive hand pinching action. Subjects' and actor's forefinger movements were monitored with an accelerometer. Coherence was computed between acceleration signals and the amplitude of α (8-12 Hz) or β (15-25 Hz) oscillations. The coherence was also evaluated between source-projected MEG signals and their β amplitude. Coherence was mainly observed between acceleration and the amplitude of β oscillations at movement frequency within bilateral primary sensorimotor (SM1) cortex with no difference between executed and observed movements. Cross-correlation between the amplitude of β oscillations at the SM1 cortex and movement acceleration was maximal when acceleration was delayed by ~ 100 ms, both during movement execution and observation. Coherence between source-projected MEG signals and their β amplitude during movement observation and execution was not significantly different from that during rest. This study shows that observing others' actions engages in the viewer's brain similar dynamic modulations of SM1 cortex β rhythm as during action execution. Results support the view that different neural mechanisms might account for this modulation and CKC. These two kinematic-related phenomena might help humans to understand how observed motor actions are actually performed.

Changing Artificial Playback Speed and Real Movement Velocity Do Not Differentially Influence the Excitability of Primary Motor Cortex during Observation of a Repetitive Finger Movement

Action observation studies have investigated whether changing the speed of the observed movement affects the action observation network. There are two types of speed-changing conditions; one involves “changes in actual movement velocity,” and the other is “manipulation of video speed.” Previous studies have investigated the effects of these conditions separately, but to date, no study has directly investigated the differences between the effects of these conditions. In the “movement velocity condition,” increased velocity is associated with increased muscle activity; however, this change of muscle activities is not shown in the “video speed condition.” Therefore, a difference in the results obtained under these conditions could be considered to reflect a difference in muscle activity of actor in the video. The aim of the present study was to investigate the effects of different speed-changing conditions and spontaneous movement tempo (SMT) on the excitability of primary motor cortex (M1) during action observation, as assessed by motor-evoked potentials (MEPs) amplitudes induced by transcranial magnetic stimulation (TMS). A total of 29 healthy subjects observed a video clip of a repetitive index or little finger abduction movement under seven different speed conditions. The video clip in the movement velocity condition showed repetitive finger abduction movements made in time with an auditory metronome, at frequencies of 0.5, 1, 2, and 3 Hz. In the video speed condition, playback of the 1-Hz movement velocity condition video clip was modified to show movement frequencies of 0.5, 2, or 3 Hz (Hz-Fake). TMS was applied at the time of maximal abduction and MEPs were recorded from two right-hand muscles. There were no differences in M1 excitability between the movement velocity and video speed conditions. Moreover, M1 excitability did not vary across the speed conditions for either presentation condition. Our findings suggest that changing playback speed and actual differences in movement velocity do not differentially influence M1 excitability during observation of a simple action task, such as repetitive finger movement, and that it is not affected by SMT. In simple and meaningless observational task, people might not be able to recognize the difference in muscle activity of actor in the video.

Reconstruction of reaching movement trajectories using electrocorticographic signals in humans

In this study, we used electrocorticographic (ECoG) signals to extract the onset of arm movement as well as the velocity of the hand as a function of time. ECoG recordings were obtained from three individuals while they performed reaching tasks in the left, right and forward directions. The ECoG electrodes were placed over the motor cortex contralateral to the moving arm. Movement onset was detected from gamma activity with near perfect accuracy (> 98%), and a multiple linear regression model was used to predict the trajectory of the reaching task in three-dimensional space with an accuracy exceeding 85%. An adaptive selection of frequency bands was used for movement classification and prediction. This demonstrates the efficacy of developing a real-time brain-machine interface for arm movements with as few as eight ECoG electrodes.

A brain-computer interface driven by imagining different force loads on a single hand: an online feasibility study

Background

Motor imagery (MI) induced EEG patterns are widely used as control signals for brain-computer interfaces (BCIs). Kinetic and kinematic factors have been proved to be able to change EEG patterns during motor execution and motor imagery. However, to our knowledge, there is still no literature reporting an effective online MI-BCI using kinetic factor regulated EEG oscillations. This study proposed a novel MI-BCI paradigm in which users can online output multiple commands by imagining clenching their right hand with different force loads.

Methods

Eleven subjects participated in this study. During the experiment, they were asked to imagine clenching their right hands with two different force loads (30% maximum voluntary contraction (MVC) and 10% MVC). Multi-Common spatial patterns (Multi-CSPs) and support vector machines (SVMs) were used to build the classifier for recognizing three commands corresponding to high load MI, low load MI and relaxed status respectively. EMG were monitored to avoid voluntary muscle activities during the BCI operation. The event-related spectral perturbation (ERSP) method was used to analyse EEG variation during multiple load MI tasks.

Results

All subjects were able to drive BCI systems using motor imagery of different force loads in online experiments. We achieved an average online accuracy of 70.9%, with the highest accuracy of 83.3%, which was much higher than the chance level (33%). The event-related desynchronization (ERD) phenomenon during high load tasks was significantly higher than it was during low load tasks both in terms of intensity at electrode positions C3 (p < 0.05) and spatial distribution.

Conclusions

This paper demonstrated the feasibility of the proposed MI-BCI paradigm based on multi-force loads on the same limb through online studies. This paradigm could not only enlarge the command set of MI-BCI, but also provide a promising approach to rehabilitate patients with motor disabilities.

Upper limb movements can be decoded from the time-domain of low-frequency EEG

How neural correlates of movements are represented in the human brain is of ongoing interest and has been researched with invasive and non-invasive methods. In this study, we analyzed the encoding of single upper limb movements in the time-domain of low-frequency electroencephalography (EEG) signals. Fifteen healthy subjects executed and imagined six different sustained upper limb movements. We classified these six movements and a rest class and obtained significant average classification accuracies of 55% (movement vs movement) and 87% (movement vs rest) for executed movements, and 27% and 73%, respectively, for imagined movements. Furthermore, we analyzed the classifier patterns in the source space and located the brain areas conveying discriminative movement information. The classifier patterns indicate that mainly premotor areas, primary motor cortex, somatosensory cortex and posterior parietal cortex convey discriminative movement information. The decoding of single upper limb movements is specially interesting in the context of a more natural non-invasive control of e.g., a motor neuroprosthesis or a robotic arm in highly motor disabled persons.

EEG Oscillations Are Modulated in Different Behavior-Related Networks during Rhythmic Finger Movements

Sequencing and timing of body movements are essential to perform motoric tasks. In this study, we investigate the temporal relation between cortical oscillations and human motor behavior (i.e., rhythmic finger movements). High-density EEG recordings were used for source imaging based on individual anatomy. We separated sustained and movement phase-related EEG source amplitudes based on the actual finger movements recorded by a data glove. Sustained amplitude modulations in the contralateral hand area show decrease for α (10-12 Hz) and β (18-24 Hz), but increase for high γ (60-80 Hz) frequencies during the entire movement period. Additionally, we found movement phase-related amplitudes, which resembled the flexion and extension sequence of the fingers. Especially for faster movement cadences, movement phase-related amplitudes included high β (24-30 Hz) frequencies in prefrontal areas. Interestingly, the spectral profiles and source patterns of movement phase-related amplitudes differed from sustained activities, suggesting that they represent different frequency-specific large-scale networks. First, networks were signified by the sustained element, which statically modulate their synchrony levels during continuous movements. These networks may upregulate neuronal excitability in brain regions specific to the limb, in this study the right hand area. Second, movement phase-related networks, which modulate their synchrony in relation to the movement sequence. We suggest that these frequency-specific networks are associated with distinct functions, including top-down control, sensorimotor prediction, and integration. The separation of different large-scale networks, we applied in this work, improves the interpretation of EEG sources in relation to human motor behavior.

SIGNIFICANCE STATEMENT

EEG recordings provide high temporal resolution suitable to relate cortical oscillations to actual movements. Investigating EEG sources during rhythmic finger movements, we distinguish sustained from movement phase-related amplitude modulations. We separate these two EEG source elements motivated by our previous findings in gait. Here, we found two types of large-scale networks, representing the right fingers in distinction from the time sequence of the movements. These findings suggest that EEG source amplitudes reconstructed in a cortical patch are the superposition of these simultaneously present network activities. Separating these frequency-specific networks is relevant for studying function and possible dysfunction of the cortical sensorimotor system in humans as well as to provide more advanced features for brain-computer interfaces.

Perceptual Threshold Level for the Tactile Stimulation and Response Features of ERD/ERS-Based Specific Indices Upon Changes in High-Frequency Vibrations

This study was conducted to identify characteristics of the perceptual threshold level and electroencephalogram (EEG) responses to vibrotactile stimulations at various high frequencies, and to examine the possibility of distinguishing vibrotactile stimulations by frequency through such response characteristics. The vibrotactile stimulations of six frequencies (150, 200, 225, 250, 275 and 300 Hz) were exerted on the first joint of the right index finger. The perceptual threshold level was defined as the first minimum perceived intensity when the intensity stimulation was exerted step by step at each vibration frequency. EEG response characteristics were investigated by examining a single index corresponding to the peak or area of event-related desynchronization/synchronization (ERD/ERS) and seven specific indices derived by combining the single ERD/ERS indices. There was a significant difference in the perceptual threshold level across different frequencies. Specifically, the differences in vibration stimulus between 150 Hz and 200 Hz, and between 150 Hz and 225 Hz were significant. Of the EEG response characteristics, the single index of the peak or area of ERD/ERS did not show a significant difference by frequency. However, (ERS−ERD), ERD × (ERS−ERD), and ERS × (ERS−ERD) showed a significant difference between vibration stimulations at 150 Hz and 200 Hz, and between vibration stimulations at 150 Hz and 225 Hz, among the specific indices combined using the peak values of ERD/ERS. Furthermore, ERS × (ERS−ERD) showed a significant difference between 150 Hz and 225 Hz, and between 225 Hz and 275 Hz among the specific indices combined using the area of ERD/ERS. The perceptual threshold level and the specific indices of ERD/ERS suggested in the present study can be used as quantitative measurement indices to distinguish high-frequency vibration stimulation.

Imagined Hand Clenching Force and Speed Modulate Brain Activity and Are Classified by NIRS Combined With EEG

Simultaneous acquisition of brain activity signals from the sensorimotor area using NIRS combined with EEG, imagined hand clenching force and speed modulation of brain activity, as well as 6-class classification of these imagined motor parameters by NIRS-EEG were explored. Near infrared probes were aligned with C3 and C4, and EEG electrodes were placed midway between the NIRS probes. NIRS and EEG signals were acquired from six healthy subjects during six imagined hand clenching force and speed tasks involving the right hand. The results showed that NIRS combined with EEG is effective for simultaneously measuring brain activity of the sensorimotor area. The study also showed that in the duration of (0, 10) s for imagined force and speed of hand clenching, HbO first exhibited a negative variation trend, which was followed by a negative peak. After the negative peak, it exhibited a positive variation trend with a positive peak about 6-8 s after termination of imagined movement. During (-2, 1) s, the EEG may have indicated neural processing during the preparation, execution, and monitoring of a given imagined force and speed of hand clenching. The instantaneous phase, frequency, and amplitude feature of the EEG were calculated by Hilbert transform; HbO and the difference between HbO and Hb concentrations were extracted. The features of NIRS and EEG were combined to classify three levels of imagined force [at 20/50/80% MVGF (maximum voluntary grip force)] and speed (at 0.5/1/2 Hz) of hand clenching by SVM. The average classification accuracy of the NIRS-EEG fusion feature was 0.74 ± 0.02. These results may provide increased control commands of force and speed for a brain-controlled robot based on NIRS-EEG.

Brain-computer interfaces for patients with disorders of consciousness

The disorders of consciousness refer to clinical conditions that follow a severe head injury. Patients diagnosed as in a vegetative state lack awareness, while patients diagnosed as in a minimally conscious state retain fluctuating awareness. However, it is a challenge to accurately diagnose these disorders with clinical assessments of behavior. To improve diagnostic accuracy, neuroimaging-based approaches have been developed to detect the presence or absence of awareness in patients who lack overt responsiveness. For the small subset of patients who retain awareness, brain-computer interfaces could serve as tools for communication and environmental control. Here we review the existing literature concerning the sensory and cognitive abilities of patients with disorders of consciousness with respect to existing brain-computer interface designs. We highlight the challenges of device development for this special population and address some of the most promising approaches for future investigations.

Gait adaptation to visual kinematic perturbations using a real-time closed-loop brain-computer interface to a virtual reality avatar

OBJECTIVE

The control of human bipedal locomotion is of great interest to the field of lower-body brain-computer interfaces (BCIs) for gait rehabilitation. While the feasibility of closed-loop BCI systems for the control of a lower body exoskeleton has been recently shown, multi-day closed-loop neural decoding of human gait in a BCI virtual reality (BCI-VR) environment has yet to be demonstrated. BCI-VR systems provide valuable alternatives for movement rehabilitation when wearable robots are not desirable due to medical conditions, cost, accessibility, usability, or patient preferences.

APPROACH

In this study, we propose a real-time closed-loop BCI that decodes lower limb joint angles from scalp electroencephalography (EEG) during treadmill walking to control a walking avatar in a virtual environment. Fluctuations in the amplitude of slow cortical potentials of EEG in the delta band (0.1-3 Hz) were used for prediction; thus, the EEG features correspond to time-domain amplitude modulated potentials in the delta band. Virtual kinematic perturbations resulting in asymmetric walking gait patterns of the avatar were also introduced to investigate gait adaptation using the closed-loop BCI-VR system over a period of eight days.

MAIN RESULTS

Our results demonstrate the feasibility of using a closed-loop BCI to learn to control a walking avatar under normal and altered visuomotor perturbations, which involved cortical adaptations. The average decoding accuracies (Pearson's r values) in real-time BCI across all subjects increased from (Hip: 0.18 ± 0.31; Knee: 0.23 ± 0.33; Ankle: 0.14 ± 0.22) on Day 1 to (Hip: 0.40 ± 0.24; Knee: 0.55 ± 0.20; Ankle: 0.29 ± 0.22) on Day 8.

SIGNIFICANCE

These findings have implications for the development of a real-time closed-loop EEG-based BCI-VR system for gait rehabilitation after stroke and for understanding cortical plasticity induced by a closed-loop BCI-VR system.

Decoding Upper Limb Movement Attempt From EEG Measurements of the Contralesional Motor Cortex in Chronic Stroke Patients

GOAL

Stroke survivors usually require motor rehabilitation therapy as, due to the lesion, they completely or partially loss mobility in the limbs. Brain-computer interface technology offers the possibility of decoding the attempt to move paretic limbs in real time to improve existing motor rehabilitation. However, a major difficulty for the practical application of the BCI to stroke survivors is that the brain rhythms that encode the motor states might be diminished due to the lesion. This study investigates the continuous decoding of natural attempt to move the paralyzed upper limb in stroke survivors from electroencephalographic signals of the unaffected contralesional motor cortex.

RESULTS

Experiments were carried out with the aid of six severely affected chronic stroke patients performing/attempting self-selected reaching movements of the unaffected/affected upper limb. The electroencephalographic (EEG) analysis showed significant cortical activation on the uninjured motor cortex when moving the contralateral unaffected arm and in the attempt to move the ipsilateral affected arm. Using this activity, significant continuous decoding of movement was obtained in six out of six participants in movements of the unaffected limb, and in four out of six participants in the attempt to move the affected limb.

CONCLUSION

This study showed that it is possible to construct a decoder of the attempt to move the paretic arm for chronic stroke patients using the EEG activity of the healthy contralesional motor cortex.

SIGNIFICANCE

This decoding model could provide to stroke survivors with a natural, easy, and intuitive way to achieve control of BCIs or robot-assisted rehabilitation devices.

Movement Anticipation and EEG: Implications for BCI-Contingent Robot Therapy

Brain-computer interfacing is a technology that has the potential to improve patient engagement in robot-assisted rehabilitation therapy. For example, movement intention reduces mu (8-13 Hz) oscillation amplitude over the sensorimotor cortex, a phenomenon referred to as event-related desynchronization (ERD). In an ERD-contingent assistance paradigm, initial BCI-enhanced robotic therapy studies have used ERD to provide robotic assistance for movement. Here we investigated how ERD changed as a function of audio-visual stimuli, overt movement from the participant, and robotic assistance. Twelve unimpaired subjects played a computer game designed for rehabilitation therapy with their fingers using the FINGER robotic exoskeleton. In the game, the participant and robot matched movement timing to audio-visual stimuli in the form of notes approaching a target on the screen set to the consistent beat of popular music. The audio-visual stimulation of the game alone did not cause ERD, before or after training. In contrast, overt movement by the subject caused ERD, whether or not the robot assisted the finger movement. Notably, ERD was also present when the subjects remained passive and the robot moved their fingers to play the game. This ERD occurred in anticipation of the passive finger movement with similar onset timing as for the overt movement conditions. These results demonstrate that ERD can be contingent on expectation of robotic assistance; that is, the brain generates an anticipatory ERD in expectation of a robot-imposed but predictable movement. This is a caveat that should be considered in designing BCIs for enhancing patient effort in robotically-assisted therapy.

Assessing human mirror activity with EEG mu rhythm: A meta-analysis

A fundamental issue in cognitive neuroscience is how the brain encodes others' actions and intentions. In recent years, a potential advance in our knowledge on this issue is the discovery of mirror neurons in the motor cortex of the nonhuman primate. These neurons fire to both execution and observation of specific types of actions. Researchers use this evidence to fuel investigations of a human mirror system, suggesting a common neural code for perceptual and motor processes. Among the methods used for inferring mirror system activity in humans are changes in a particular frequency band in the electroencephalogram (EEG) called the mu rhythm. Mu frequency appears to decrease in amplitude (reflecting cortical activity) during both action execution and action observation. The current meta-analysis reviewed 85 studies (1,707 participants) of mu that infer human mirror system activity. Results demonstrated significant effect sizes for mu during execution (Cohen's d = 0.46, N = 701) as well as observation of action (Cohen's d = 0.31, N = 1,508), confirming a mirroring property in the EEG. A number of moderators were examined to determine the specificity of these effects. We frame these meta-analytic findings within the current discussion about the development and functions of a human mirror system, and conclude that changes in EEG mu activity provide a valid means for the study of human neural mirroring. Suggestions for improving the experimental and methodological approaches in using mu to study the human mirror system are offered.