Motion Cognitive Decoding of Cross-Subject Motor Imagery Guided on Different Visual Stimulus Materials

BACKGROUND

Motor imagery (MI) plays an important role in brain-computer interfaces, especially in evoking event-related desynchronization and synchronization (ERD/S) rhythms in electroencephalogram (EEG) signals. However, the procedure for performing a MI task for a single subject is subjective, making it difficult to determine the actual situation of an individual's MI task and resulting in significant individual EEG response variations during motion cognitive decoding.

METHODS

To explore this issue, we designed three visual stimuli (arrow, human, and robot), each of which was used to present three MI tasks (left arm, right arm, and feet), and evaluated differences in brain response in terms of ERD/S rhythms. To compare subject-specific variations of different visual stimuli, a novel cross-subject MI-EEG classification method was proposed for the three visual stimuli. The proposed method employed a covariance matrix centroid alignment for preprocessing of EEG samples, followed by a model agnostic meta-learning method for cross-subject MI-EEG classification.

RESULTS AND CONCLUSION

The experimental results showed that robot stimulus materials were better than arrow or human stimulus materials, with an optimal cross-subject motion cognitive decoding accuracy of 79.04%. Moreover, the proposed method produced robust classification of cross-subject MI-EEG signal decoding, showing superior results to conventional methods on collected EEG signals.

Enhancing motor imagery in the third-person perspective by manipulating sense of body ownership with virtual reality

Virtual reality (VR)-guided motor imagery (MI) is a widely used approach for motor rehabilitation, especially for patients with severe motor impairments. Most approaches provide visual guidance from the first-person perspective (1PP). MI training with visual guidance from the third-person perspective (3PP) remains largely unexplored. We argue that 3PP MI training has its own advantages and can supplement 1PP MI. For some movements beyond the view of 1PP, such as shoulder shrugging and other axial movements, MI are suitable performed under 3PP. However, the efficiency of existing paradigms for 3PP MI is unsatisfactory. We speculate that the absence of sense of body ownership (SOO) from 3PP could be one possible factor and hypothesize that 3PP MI could be enhanced by eliciting SOO over a 3PP avatar. Based on our hypothesis, a novel paradigm was proposed to enhance 3PP MI by inducing full-body illusion (FBI) from 3PP, which is similar to the so-called out-of-body experience (OBE), using synchronous visuo-tactile stimulus with VR. The event-related Electroencephalograph (EEG) desynchronization (ERD) at motor-related regions from 31 healthy participants were calculated and compared with a control paradigm without "OBE" FBI induction. This study attempts to enhance 3PP MI with FBI induction. It offers an opportunity to perform MI guided by action observation from 3PP with elicited SOO to the observed avatar. We believe that 3PP MI could provide more possibilities for effective rehabilitation training, when SOO could be elicited to a virtual avatar and the present work demonstrates its viability and effectiveness.

Effects of observing own/others hand movement in different perspectives on mu rhythm suppression: an EEG study

BACKGROUND

Previous studies have reported that the sense of "self" is associated with specific brain regions and neural network activities. In addition, the mirror system, which functions when executing or observing an action, might contribute to differentiating the self from others and form the basis of the sense of self as a fundamental physical representation. This study investigated whether differences in mu suppression, an indicator of mirror system activity, reflect cognitions related to self-other discrimination.

METHODS

The participants were 30 of healthy college students. The participants observed short video clips of hand movements performed by themselves or actors from two perspectives (i.e., first-person and third-person). The electroencephalogram (EEG) mu rhythm (8-13 Hz) was measured during video observation as an index of mirror neuron system activity. EEG activity related to self-detection was analyzed using participants' hand movements as self-relevant stimuli.

RESULTS

The results showed that mu suppression in the 8-13-Hz range exhibited perspective-dependent responses to self/other stimuli. There was a significant self-oriented mu suppression response in the first-person perspective. However, the study found no significant response orientation in the third-person perspective. The results suggest that mirror system activity may involve self-other discrimination differently depending on the perspective.

CONCLUSIONS

In summary, this study examined the mirror system's activity for self and others using the EEG's mu suppression. As a result, it was suggested that differences in self and others or perspectives may influence mu suppression.

Neural basis of lower-limb visual feedback therapy: an EEG study in healthy subjects

BACKGROUND

Video-feedback observational therapy (VOT) is an intensive rehabilitation technique based on movement repetition and visualization that has shown benefits for motor rehabilitation of the upper and lower limbs. Despite an increase in recent literature on the neurophysiological effects of VOT in the upper limb, there is little knowledge about the cortical effects of visual feedback therapies when applied to the lower limbs. The aim of our study was to better understand the neurophysiological effects of VOT. Thus, we identified and compared the EEG biomarkers of healthy subjects undergoing lower limb VOT during three tasks: passive observation, observation and motor imagery, observation and motor execution.

METHODS

We recruited 38 healthy volunteers and monitored their EEG activity while they performed a right ankle dorsiflexion task in the VOT. Three graded motor tasks associated with action observation were tested: action observation alone (O), motor imagery with action observation (OI), and motor execution synchronized with action observation (OM). The alpha and beta event-related desynchronization (ERD) and event-related synchronization (or beta rebound, ERS) rhythms were used as biomarkers of cortical activation and compared between conditions with a permutation test. Changes in connectivity during the task were computed with phase locking value (PLV).

RESULTS

During the task, in the alpha band, the ERD was comparable between O and OI activities across the precentral, central and parietal electrodes. OM involved the same regions but had greater ERD over the central electrodes. In the beta band, there was a gradation of ERD intensity in O, OI and OM over central electrodes. After the task, the ERS changes were weak during the O task but were strong during the OI and OM (Cz) tasks, with no differences between OI and OM.

CONCLUSION

Alpha band ERD results demonstrated the recruitment of mirror neurons during lower limb VOT due to visual feedback. Beta band ERD reflects strong recruitment of the sensorimotor cortex evoked by motor imagery and action execution. These results also emphasize the need for an active motor task, either motor imagery or motor execution task during VOT, to elicit a post-task ERS, which is absent during passive observation. Trial Registration NCT05743647.

The individual difference of motor imagery ability evoked by visual stimulus and its personality manifestation

Motor imagery has been commonly studied as a means of motor rehabilitation but, the individual differences limit its practical application. Visually evoked motor imagery has been widely highlighted by researchers because of its vivid stimulus. However, this modality is still not applicable to all persons. In this study, we studied the different performances of the visually evoked motor imagery between subjects and tried to explore the personality manifestation which can result in this performance. We found that conscientiousness and openness have negative connections with the performance of visually evoked motor imagery. To compare with spontaneous motor imagery, the visually evoked motor imagery reflects less personality difference between subjects with good and bad performances on motor imagery. This indicate that visually stimulus may increase the pervasive application of motor imagery. This study may provide benefits to predict the rehabilitation effect and to rapidly select the suitable motor rehabilitation methods.

Event-Related EEG Desynchronization Reveals Enhanced Motor Imagery From the Third Person Perspective by Manipulating Sense of Body Ownership With Virtual Reality for Stroke Patients

Virtual reality (VR)-based rehabilitation training holds great potential for post-stroke motor recovery. Existing VR-based motor imagery (MI) paradigms mostly focus on the first-person perspective, and the benefit of the third-person perspective (3PP) remains to be further exploited. The 3PP is advantageous for movements involving the back or those with a large range because of its field coverage. Some movements are easier to imagine from the 3PP. However, the 3PP training efficiency may be unsatisfactory, which may be attributed to the difficulty encountered when generating a strong sense of ownership (SOO). In this work, we attempt to enhance a visual-guided 3PP MI in stroke patients by eliciting the SOO over a virtual avatar with VR. We propose to achieve this by inducing the so-called out-of-body experience (OBE), which is a full-body illusion (FBI) that people misperceive a 3PP virtual body as his/her own (i.e., generating the SOO to the virtual body). Electroencephalography signals of 13 stroke patients are recorded while MI of the affected upper limb is being performed. The proposed paradigm is evaluated by comparing event-related desynchronization (ERD) with a control paradigm without FBI induction. The results show that the proposed paradigm leads to a significantly larger ERD during MI, indicating a bilateral activation pattern consistent with that in previous studies. In conclusion, 3PP MI can be enhanced in stroke patients by eliciting the SOO through induction of the "OBE" FBI. This study offers more possibilities for virtual rehabilitation in stroke patients and can further facilitate VR application in rehabilitation.

Brain oscillations in reflecting motor status and recovery induced by action observation-driven robotic hand intervention in chronic stroke

Hand rehabilitation in chronic stroke remains challenging, and finding markers that could reflect motor function would help to understand and evaluate the therapy and recovery. The present study explored whether brain oscillations in different electroencephalogram (EEG) bands could indicate the motor status and recovery induced by action observation-driven brain-computer interface (AO-BCI) robotic therapy in chronic stroke. The neurophysiological data of 16 chronic stroke patients who received 20-session BCI hand training is the basis of the study presented here. Resting-state EEG was recorded during the observation of non-biological movements, while task-stage EEG was recorded during the observation of biological movements in training. The motor performance was evaluated using the Action Research Arm Test (ARAT) and upper extremity Fugl-Meyer Assessment (FMA), and significant improvements (p < 0.05) on both scales were found in patients after the intervention. Averaged EEG band power in the affected hemisphere presented negative correlations with scales pre-training; however, no significant correlations (p > 0.01) were found both in the pre-training and post-training stages. After comparing the variation of oscillations over training, we found patients with good and poor recovery presented different trends in delta, low-beta, and high-beta variations, and only patients with good recovery presented significant changes in EEG band power after training (delta band, p < 0.01). Importantly, motor improvements in ARAT correlate significantly with task EEG power changes (low-beta, c.c = 0.71, p = 0.005; high-beta, c.c = 0.71, p = 0.004) and task/rest EEG power ratio changes (delta, c.c = -0.738, p = 0.003; low-beta, c.c = 0.67, p = 0.009; high-beta, c.c = 0.839, p = 0.000). These results suggest that, in chronic stroke, EEG band power may not be a good indicator of motor status. However, ipsilesional oscillation changes in the delta and beta bands provide potential biomarkers related to the therapeutic-induced improvement of motor function in effective BCI intervention, which may be useful in understanding the brain plasticity changes and contribute to evaluating therapy and recovery in chronic-stage motor rehabilitation.

Differences in the early stages of motor learning between visual-motor illusion and action observation

The visual-motor illusion (VMI) induces a kinesthetic illusion by watching one's physically-moving video while the body is at rest. It remains unclear whether the early stages (immediately to one hour later) of motor learning are promoted by VMI. This study investigated whether VMI changes the early stages of motor learning in healthy individuals. Thirty-six participants were randomly assigned to two groups: the VMI or action observation condition. Each condition was performed with the left hand for 20 min. The VMI condition induced a kinesthetic illusion by watching one's ball-rotation task video. The action observation condition involved watching the same video as the VMI condition but did not induce a kinesthetic illusion. The ball-rotation task and brain activity during the task were measured pre, post1 (immediately), and post2 (after 1 h) in both conditions, and brain activity was measured using functional near-infrared spectroscopy. The rate of the ball-rotation task improved significantly at post1 and post2 in the VMI condition than in the action observation condition. VMI condition lowers left dorsolateral prefrontal cortex and right premotor area activity from post1 to pre compared to the action observation condition. In conclusion, VMI effectively aids early stages of motor learning in healthy individuals.

The third-person perspective full-body illusion induced by visual-tactile stimulation in virtual reality for stroke patients

This paper attempts to induce the third-person perspective full body illusion (3PP-FBI) with virtual reality (VR) in stroke patients. Nineteen individuals with stroke were recruited. The 3PP-FBI induction method, which was well-established in healthy individuals, using synchronous visual-tactile stimulation on one body part was used. Questionnaire scores and proprioceptive drift values were collected under different conditions for characterizing the induced 3PP-FBI. Results showed that synchronous visual-tactile stimulation of a single body part (back or upper limb) was sufficient to elicit 3PP-FBI in stroke patients, forming a sense of ownership (SOO) over the entire virtual body. Moreover, the intensity of 3PP-FBI was stronger when the back was stimulated, compared to stimulating the impaired upper limb. This study demonstrated the viability of visual-guided rehabilitation training while having a SOO to a virtual body from the third-person perspective, in anticipation of achieving better rehabilitation outcome for movements beyond the first-person perspective.

The effect of combining action observation in virtual reality with kinesthetic motor imagery on cortical activity

Introduction

In the past, various techniques have been used to improve motor imagery (MI), such as immersive virtual-reality (VR) and kinesthetic rehearsal. While electroencephalography (EEG) has been used to study the differences in brain activity between VR-based action observation and kinesthetic motor imagery (KMI), there has been no investigation into their combined effect. Prior research has demonstrated that VR-based action observation can enhance MI by providing both visual information and embodiment, which is the perception of oneself as part of the observed entity. Additionally, KMI has been found to produce similar brain activity to physically performing a task. Therefore, we hypothesized that utilizing VR to offer an immersive visual scenario for action observation while participants performed kinesthetic motor imagery would significantly improve cortical activity related to MI.

Methods

In this study, 15 participants (9 male, 6 female) performed kinesthetic motor imagery of three hand tasks (drinking, wrist flexion-extension, and grabbing) both with and without VR-based action observation.

Results

Our results indicate that combining VR-based action observation with KMI enhances brain rhythmic patterns and provides better task differentiation compared to KMI without action observation.

Discussion

These findings suggest that using VR-based action observation alongside kinesthetic motor imagery can improve motor imagery performance.

Sensorimotor Rhythm-Based Brain-Computer Interfaces for Motor Tasks Used in Hand Upper Extremity Rehabilitation after Stroke: A Systematic Review

Brain-computer interfaces (BCIs) are becoming more popular in the neurological rehabilitation field, and sensorimotor rhythm (SMR) is a type of brain oscillation rhythm that can be captured and analyzed in BCIs. Previous reviews have testified to the efficacy of the BCIs, but seldom have they discussed the motor task adopted in BCIs experiments in detail, as well as whether the feedback is suitable for them. We focused on the motor tasks adopted in SMR-based BCIs, as well as the corresponding feedback, and searched articles in PubMed, Embase, Cochrane library, Web of Science, and Scopus and found 442 articles. After a series of screenings, 15 randomized controlled studies were eligible for analysis. We found motor imagery (MI) or motor attempt (MA) are common experimental paradigms in EEG-based BCIs trials. Imagining/attempting to grasp and extend the fingers is the most common, and there were multi-joint movements, including wrist, elbow, and shoulder. There were various types of feedback in MI or MA tasks for hand grasping and extension. Proprioception was used more frequently in a variety of forms. Orthosis, robot, exoskeleton, and functional electrical stimulation can assist the paretic limb movement, and visual feedback can be used as primary feedback or combined forms. However, during the recovery process, there are many bottleneck problems for hand recovery, such as flaccid paralysis or opening the fingers. In practice, we should mainly focus on patients' difficulties, and design one or more motor tasks for patients, with the assistance of the robot, FES, or other combined feedback, to help them to complete a grasp, finger extension, thumb opposition, or other motion. Future research should focus on neurophysiological changes and functional improvements and further elaboration on the changes in neurophysiology during the recovery of motor function.

Mirror visual feedback during unilateral finger movements is related to the desynchronization of cortical electroencephalographic somatomotor alpha rhythms

Using a mirror adequately oriented, the motion of just one hand induces the illusion of the movement with the other hand. Here, we tested the hypothesis that such a mirror phenomenon may be underpinned by an electroencephalographic (EEG) event-related desynchronization/synchronization (ERD/ERS) of central alpha rhythms (around 10 Hz) as a neurophysiological measure of the interactions among cerebral cortex, basal ganglia, and thalamus during movement preparation and execution. Eighteen healthy right-handed male participants performed standard auditory-triggered unilateral (right) or bilateral finger movements in the No Mirror (M-) conditions. In the Mirror (M+) condition, the unilateral right finger movements were performed in front of a mirror oriented to induce the illusion of simultaneous left finger movements. EEG activity was recorded from 64 scalp electrodes, and the artifact-free event-related EEG epochs were used to compute alpha ERD. In the M- conditions, a bilateral prominent central alpha ERD was observed during the bilateral movements, while left central alpha ERD and right alpha ERS were seen during unilateral right movements. In contrast, the M+ condition showed significant bilateral and widespread alpha ERD during the unilateral right movements. These results suggest that the above illusion of the left movements may be related to alpha ERD measures reflecting excitatory desynchronizing signals in right lateral premotor and primary somatomotor areas possibly in relation to basal ganglia-thalamic loops.

The acute effects of action observation training on upper extremity functions, cognitive processes and reaction times: a randomized controlled trial

Aim: To investigate the acute effects of action observation training on upper extremity functions, cognitive functions and response time in healthy, young adults. Materials & methods: A total of 60 participants were randomly divided into five groups: the self-action observation group, action observation group, action practice group, non-action observation group and control group. The Jebsen-Taylor hand function test (JTHFT), nine-hole peg test, serial reaction time task and d2 test of attention were applied to the participants before and after the interventions. Results: JTHFT performance with both non-dominant and dominant hands improved significantly compared with baseline in all groups (p < 0.001). JTHFT performance with non-dominant and dominant hands differed between the groups (p < 0.001). Conclusion: Action observation training seems to enhance the performance of upper extremity-related functions. Observing self-actions resulted in statistically significant positive changes in more variables compared with other methods. However, its clinical effectiveness over the other methods should be investigated in future long-term studies. Clinical Trial Registration: NCT04932057 (ClinicalTrials.gov).

Sensorimotor Rhythm-Brain Computer Interface With Audio-Cue, Motor Observation and Multisensory Feedback for Upper-Limb Stroke Rehabilitation: A Controlled Study

Several studies have shown the positive clinical effect of brain computer interface (BCI) training for stroke rehabilitation. This study investigated the efficacy of the sensorimotor rhythm (SMR)-based BCI with audio-cue, motor observation and multisensory feedback for post-stroke rehabilitation. Furthermore, we discussed the interaction between training intensity and training duration in BCI training. Twenty-four stroke patients with severe upper limb (UL) motor deficits were randomly assigned to two groups: 2-week SMR-BCI training combined with conventional treatment (BCI Group, BG, n = 12) and 2-week conventional treatment without SMR-BCI intervention (Control Group, CG, n = 12). Motor function was measured using clinical measurement scales, including Fugl-Meyer Assessment-Upper Extremities (FMA-UE; primary outcome measure), Wolf Motor Functional Test (WMFT), and Modified Barthel Index (MBI), at baseline (Week 0), post-intervention (Week 2), and follow-up week (Week 4). EEG data from patients allocated to the BG was recorded at Week 0 and Week 2 and quantified by mu suppression means event-related desynchronization (ERD) in mu rhythm (8–12 Hz). All functional assessment scores (FMA-UE, WMFT, and MBI) significantly improved at Week 2 for both groups (p < 0.05). The BG had significantly higher FMA-UE and WMFT improvement at Week 4 compared to the CG. The mu suppression of bilateral hemisphere both had a positive trend with the motor function scores at Week 2. This study proposes a new effective SMR-BCI system and demonstrates that the SMR-BCI training with audio-cue, motor observation and multisensory feedback, together with conventional therapy may promote long-lasting UL motor improvement.

Clinical Trial Registration: [http://www.chictr.org.cn], identifier [ChiCTR2000041119].

A Novel Online Action Observation-Based Brain-Computer Interface That Enhances Event-Related Desynchronization

Brain-computer interface (BCI)-based stroke rehabilitation is an emerging field in which different studies have reported variable outcomes. Among the BCI paradigms, motor imagery (MI)-based closed-loop BCI is still the main pattern in rehabilitation training. It can estimate a patient' motor intention and provide corresponding feedback. However, the individual difference in the ability to generate event-related desynchronization (ERD) and the low classification accuracy of the multi-class scenario restrict the application of MI-based BCI. In the current study, a novel online action observation (AO)-based BCI was proposed. The visual stimuli of four types of hand movements were designed to simultaneously induce steady-state motion visual evoked potential (SSMVEP) in the occipital region and to activate the sensorimotor region. Task-related component analysis was performed to identify the SSMVEP. Results showed that the amplitude of the induced frequency in the SSMVEP had a negative relationship with the stimulus frequency. The classification accuracy in the four-class scenario reached 72.81 ± 13.55% within 2.5s. Importantly, the AO-based closed-loop BCI, which provided visual feedback based on the SSMVEP, could enhance ERD compared with AO-alone. The increased attentiveness might be one key factor for the enhancement of the ERD in the designed AO-based BCI. In summary, the proposed AO-based BCI provides a new insight for BCI-based rehabilitation.

Participant-specific classifier tuning increases the performance of hand movement detection from EEG in patients with amyotrophic lateral sclerosis

Objective.Brain-computer interface (BCI) systems can be employed to provide motor and communication assistance to patients suffering from neuromuscular diseases, such as amyotrophic lateral sclerosis (ALS). Movement related cortical potentials (MRCPs), which are naturally generated during movement execution, can be used to implement a BCI triggered by motor attempts. Such BCI could assist impaired motor functions of ALS patients during disease progression, and facilitate the training for the generation of reliable MRCPs. The training aspect is relevant to establish a communication channel in the late stage of the disease. Therefore, the aim of this study was to investigate the possibility of detecting MRCPs associated to movement intention in ALS patients with different levels of disease progression from slight to complete paralysis.Approach.Electroencephalography signals were recorded from nine channels in 30 ALS patients at various stages of the disease while they performed or attempted to perform hand movements timed to a visual cue. The movement detection was implemented using offline classification between movement and rest phase. Temporal and spectral features were extracted using 500 ms sliding windows with 50% overlap. The detection was tested for each individual channel and two surrogate channels by performing feature selection followed by classification using linear and non-linear support vector machine and linear discriminant analysis.Main results.The results demonstrated that the detection performance was high in all patients (accuracy 80.5 ± 5.6%) but that the classification parameters (channel, features and classifier) leading to the best performance varied greatly across patients. When the same channel and classifier were used for all patients (participant-generic analysis), the performance significantly decreased (accuracy 74 ± 8.3%).Significance.The present study demonstrates that to maximize the detection of brain waves across ALS patients at different stages of the disease, the classification pipeline should be tuned to each patient individually.

Influence of the visuo-proprioceptive illusion of movement and motor imagery of the wrist on EEG cortical excitability among healthy participants

INTRODUCTION

Motor Imagery (MI) is a powerful tool to stimulate sensorimotor brain areas and is currently used in motor rehabilitation after a stroke. The aim of our study was to evaluate whether an illusion of movement induced by visuo-proprioceptive immersion (VPI) including tendon vibration (TV) and Virtual moving hand (VR) combined with MI tasks could be more efficient than VPI alone or MI alone on cortical excitability assessed using Electroencephalography (EEG).

METHODS

We recorded EEG signals in 20 healthy participants in 3 different conditions: MI tasks involving their non-dominant wrist (MI condition); VPI condition; and VPI with MI tasks (combined condition). Each condition lasted 3 minutes, and was repeated 3 times in randomized order. Our main judgment criterion was the Event-Related De-synchronization (ERD) threshold in sensori-motor areas in each condition in the brain motor area.

RESULTS

The combined condition induced a greater change in the ERD percentage than the MI condition alone, but no significant difference was found between the combined and the VPI condition (p = 0.07) and between the VPI and MI condition (p = 0.20).

CONCLUSION

This study demonstrated the interest of using a visuo-proprioceptive immersion with MI rather than MI alone in order to increase excitability in motor areas of the brain. Further studies could test this hypothesis among patients with stroke to provide new perspectives for motor rehabilitation in this population.

Enhancing Detection of SSMVEP Induced by Action Observation Stimuli Based on Task-Related Component Analysis

Action observation (AO)-based brain-computer interface (BCI) is an important technology in stroke rehabilitation training. It has the advantage of simultaneously inducing steady-state motion visual evoked potential (SSMVEP) and activating sensorimotor rhythm. Moreover, SSMVEP could be utilized to perform classification. However, SSMVEP is composed of complex modulation frequencies. Traditional canonical correlation analysis (CCA) suffers from poor recognition performance in identifying those modulation frequencies at short stimulus duration. To address this issue, task-related component analysis (TRCA) was utilized to deal with SSMVEP for the first time. An interesting phenomenon was found: different modulated frequencies in SSMVEP distributed in different task-related components. On this basis, a multi-component TRCA method was proposed. All the significant task-related components were utilized to construct multiple spatial filters to enhance the detection of SSMVEP. Further, a combination of TRCA and CCA was proposed to utilize both advantages. Results showed that the accuracies using the proposed methods were significant higher than that using CCA at all window lengths and significantly higher than that using ensemble-TRCA at short window lengths (≤2 s). Therefore, the proposed methods further validate the induced modulation frequencies and will speed up the application of the AO-based BCI in rehabilitation.

An action-observation/motor-imagery based approach to differentiate disorders of consciousness: what is beneath the tip of the iceberg?

BACKGROUND

The evaluation of motor imagery in persons with prolonged Disorders of Consciousness (pDOC) is a practical approach to differentiate between patients with Minimally Conscious State (MCS) and Unresponsive Wakefulness Syndrome (UWS) and to identify residual awareness even in individuals with UWS. Investigating the influence of motor observation on motor imagery could be helpful in this regard.

OBJECTIVE

In order to corroborate the clinical diagnosis and identify misdiagnosed individuals, we used EEG recordings, to assess the influence of the low-level perceptual and motoric mechanisms on motor observation on motor imagery, taking into account the role of the high-level cognitive mechanisms in patients with pDOC.

METHODS

We assessed the influence of motor observation of walking in first-person or third-person view (by a video provision) on motor imagery of walking in the first-person view on the visual N190 (expression of motor observation processing), the readiness potential (RP) (expressing motor preparation), and the P3 component (high-level cognitive processes) in a sample of 10 persons with MCS, 10 with UWS, and 10 healthy controls (CG). Specifically, the video showed a first-view or third-view walk down the street while the participants were asked to imagine a first-view walking down the street.

RESULTS

CG showed greater N190 response (low-level sensorimotor processing) in the non-matching than in the matching condition. Conversely, the P3 and RP responses (high-level sensorimotor processing) were greater in the matching than in the non-matching condition. Remarkably, 6 out of 10 patients with MCS showed the preservation of both high- and low-level sensorimotor processing. One UWS patient showed responses similar to those six patients, suggesting a preservation of cognitively-mediated sensorimotor processing despite a detrimental motor preparation process. The remaining patients with MCS did not show diversified EEG responses, suggesting limited cognitive functioning.

CONCLUSIONS

Our study suggests that identifying the low-level visual and high-level motor preparation processes in response to a simple influence of motor observation of motor imagery tasks potentially supports the clinical differential diagnosis of with MCS and UWS. This might help identify UWS patients which were misdiagnosed and who deserve more sophisticated diagnoses.

An Introductory Tutorial on Brain–Computer Interfaces and Their Applications

The prospect and potentiality of interfacing minds with machines has long captured human imagination. Recent advances in biomedical engineering, computer science, and neuroscience are making brain–computer interfaces a reality, paving the way to restoring and potentially augmenting human physical and mental capabilities. Applications of brain–computer interfaces are being explored in applications as diverse as security, lie detection, alertness monitoring, gaming, education, art, and human cognition augmentation. The present tutorial aims to survey the principal features and challenges of brain–computer interfaces (such as reliable acquisition of brain signals, filtering and processing of the acquired brainwaves, ethical and legal issues related to brain–computer interface (BCI), data privacy, and performance assessment) with special emphasis to biomedical engineering and automation engineering applications. The content of this paper is aimed at students, researchers, and practitioners to glimpse the multifaceted world of brain–computer interfacing.

Improving performance in motor imagery BCI-based control applications via virtually embodied feedback

OBJECTIVE

Brain-computer interfaces (BCIs) based on motor imagery (MI) are commonly used for control applications. However, these applications require strong and discriminant neural patterns for which extensive experience in MI may be necessary. Inspired by the field of rehabilitation where embodiment is a key element for improving cortical activity, our study proposes a novel control scheme in which virtually embodiable feedback is provided during control to enhance performance.

METHODS

Subjects underwent two immersive virtual reality control scenarios in which they controlled the two-dimensional movement of a device using electroencephalography (EEG). The two scenarios only differ on whether embodiable feedback, which mirrors the movement of the classified intention, is provided. After undergoing each scenario, subjects also answered a questionnaire in which they rated how immersive the scenario and embodiable the feedback were.

RESULTS

Subjects exhibited higher control performance, greater discriminability in brain activity patterns, and enhanced cortical activation when using our control scheme compared to the standard control scheme in which embodiable feedback is absent. Moreover, the self-rated embodiment and presence scores showed significantly positive linear relationships with performance.

SIGNIFICANCE

The findings in our study provide evidence that providing embodiable feedback as guidance on how intention is classified may be effective for control applications by inducing enhanced neural activity and patterns with greater discriminability. By applying embodiable feedback to immersive virtual reality, our study also serves as another instance in which virtual reality is shown to be a promising tool for improving MI.

The cortical oscillatory patterns associated with varying levels of reward during an effortful vigilance task

We explored how reward and value of effort shapes performance in a sustained vigilance, reaction time (RT) task. It was posited that reward and value would hasten RTs and increase cognitive effort by boosting activation in the sensorimotor cortex and inhibition in the frontal cortex, similar to the horse-race model of motor actions. Participants performed a series of speeded responses while expecting differing monetary rewards (0 pence (p), 1 p, and 10 p) if they responded faster than their median RT. Amplitudes of cortical alpha, beta, and theta oscillations were analysed using the event-related desynchronization method. In experiment 1 (N = 29, with 12 females), reward was consistent within block, while in experiment 2 (N = 17, with 12 females), reward amount was displayed before each trial. Each experiment evaluated the baseline amplitude of cortical oscillations differently. The value of effort was evaluated using a cognitive effort discounting task (COGED). In both experiments, RTs decreased significantly with higher rewards. Reward level sharpened the increased amplitudes of beta oscillations during fast responses in experiment 1. In experiment 2, reward decreased the amplitudes of beta oscillations in the ipsilateral sensorimotor cortex. Individual effort values did not significantly correlate with oscillatory changes in either experiment. Results suggest that reward level and response speed interacted with the task- and baseline-dependent patterns of cortical inhibition in the frontal cortex and with activation in the sensorimotor cortex during the period of motor preparation in a sustained vigilance task. However, neither the shortening of RT with increasing reward nor the value of effort correlated with oscillatory changes. This implies that amplitudes of cortical oscillations may shape upcoming motor responses but do not translate higher-order motivational factors into motor performance.