EEG-based neuroprosthesis control: a step towards clinical practice

EEG-based sensorimotor neurofeedback for motor neurorehabilitation in children and adults: A scoping review

OBJECTIVE

Therapeutic interventions for children and young people with dystonia and dystonic/dyskinetic cerebral palsy are limited. EEG-based neurofeedback is emerging as a neurorehabilitation tool. This scoping review maps research investigating EEG-based sensorimotor neurofeedback in adults and children with neurological motor impairments, including augmentative strategies.

METHODS

MEDLINE, CINAHL and Web of Science databases were searched up to 2023 for relevant studies. Study selection and data extraction were conducted independently by at least two reviewers.

RESULTS

Of 4380 identified studies, 133 were included, only three enrolling children. The most common diagnosis was adult-onset stroke (77%). Paradigms mostly involved upper limb motor imagery or motor attempt. Common neurofeedback modes included visual, haptic and/or electrical stimulation. EEG parameters varied widely and were often incompletely described. Two studies applied augmentative strategies. Outcome measures varied widely and included classification accuracy of the Brain-Computer Interface, degree of enhancement of mu rhythm modulation or other neurophysiological parameters, and clinical/motor outcome scores. Few studies investigated whether functional outcomes related specifically to the EEG-based neurofeedback.

CONCLUSIONS

There is limited evidence exploring EEG-based sensorimotor neurofeedback in individuals with movement disorders, especially in children. Further clarity of neurophysiological parameters is required to develop optimal paradigms for evaluating sensorimotor neurofeedback.

SIGNIFICANCE

The expanding field of sensorimotor neurofeedback offers exciting potential as a non-invasive therapy. However, this needs to be balanced by robust study design and detailed methodological reporting to ensure reproducibility and validation that clinical improvements relate to induced neurophysiological changes.

Decrease in reaction time for volleyball athletes during saccadic eye movement task: A preliminary study with evoked potentials

AIM

This preliminary study investigated the differences in event-related potential and reaction time under two groups (athletes vs. non-athletes).

MATERIAL AND METHODS

The P300 was analyzed for Fz, Cz, and Pz electrodes in thirty-one healthy volunteers divided into two groups (volleyball athletes and non-athletes). In addition, the participants performed a saccadic eye movement task to measure reaction time.

RESULTS

The EEG analysis showed that the athletes, in comparison to the no-athletes, have differences in the P300 in the frontal area (p = 0.021). In relation to reaction time, the results show lower reaction time for athletes (p = 0.001).

CONCLUSIONS

The volleyball athletes may present a greater allocation of attention during the execution of the inhibition task, since they have a lower reaction time for responses when compared to non-athletes.

A Brain-Controlled Quadruped Robot: A Proof-of-Concept Demonstration

Coupling brain-computer interfaces (BCIs) and robotic systems in the future can enable seamless personal assistant systems in everyday life, with the requests that can be performed in a discrete manner, using one's brain activity only. These types of systems might be of a particular interest for people with locked-in syndrome (LIS) or amyotrophic lateral sclerosis (ALS) because they can benefit from communicating with robotic assistants using brain sensing interfaces. In this proof-of-concept work, we explored how a wireless and wearable BCI device can control a quadruped robot-Boston Dynamics' Spot. The device measures the user's electroencephalography (EEG) and electrooculography (EOG) activity of the user from the electrodes embedded in the glasses' frame. The user responds to a series of questions with YES/NO answers by performing a brain-teaser activity of mental calculus. Each question-answer pair has a pre-configured set of actions for Spot. For instance, Spot was prompted to walk across a room, pick up an object, and retrieve it for the user (i.e., bring a bottle of water) when a sequence resolved to a YES response. Our system achieved at a success rate of 83.4%. To the best of our knowledge, this is the first integration of wireless, non-visual-based BCI systems with Spot in the context of personal assistant use cases. While this BCI quadruped robot system is an early prototype, future iterations may embody friendly and intuitive cues similar to regular service dogs. As such, this project aims to pave a path towards future developments in modern day personal assistant robots powered by wireless and wearable BCI systems in everyday living conditions.

Boosting brain-computer interfaces with functional electrical stimulation: potential applications in people with locked-in syndrome

Individuals with a locked-in state live with severe whole-body paralysis that limits their ability to communicate with family and loved ones. Recent advances in brain-computer interface (BCI) technology have presented a potential alternative for these people to communicate by detecting neural activity associated with attempted hand or speech movements and translating the decoded intended movements to a control signal for a computer. A technique that could potentially enrich the communication capacity of BCIs is functional electrical stimulation (FES) of paralyzed limbs and face to restore body and facial movements of paralyzed individuals, allowing to add body language and facial expression to communication BCI utterances. Here, we review the current state of the art of existing BCI and FES work in people with paralysis of body and face and propose that a combined BCI-FES approach, which has already proved successful in several applications in stroke and spinal cord injury, can provide a novel promising mode of communication for locked-in individuals.

A novel noninvasive brain-computer interface by imagining isometric force levels

Physiological circuits differ across increasing isometric force levels during unilateral contraction. Therefore, we first explored the possibility of predicting the force level based on electroencephalogram (EEG) activity recorded during a single trial of unilateral 5% or 40% of maximal isometric voluntary contraction (MVC) in right-hand grip imagination. Nine healthy subjects were involved in this study. The subjects were required to randomly perform 20 trials for each force level while imagining a right-hand grip. We proposed the use of common spatial patterns (CSPs) and coherence between EEG signals as features in a support vector machine for force level prediction. The results showed that the force levels could be predicted through single-trial EEGs while imagining the grip (mean accuracy = 81.4 ± 13.29%). Additionally, we tested the possibility of online control of a ball game using the above paradigm through unilateral grip imagination at different force levels (i.e., 5% of MVC imagination and 40% of MVC imagination for right-hand movement control). Subjects played the ball games effectively by controlling direction with our novel BCI system (n = 9, mean accuracy = 76.67 ± 9.35%). Data analysis validated the use of our BCI system in the online control of a ball game. This information may provide additional commands for the control of robots by users through combinations with other traditional brain-computer interfaces, e.g., different limb imaginations.

Hybrid mental tasks based human computer interface via integration of pronunciation and motor imagery

Objective.Among the existing active brain-computer interfaces (BCI), the motor imagination (MI) is widely used. To operate the MI BCI effectively, subjects need to carry out trainings on corresponding imagining tasks. Here, we studied how to reduce the discomfort and fatigue of active BCI imaginary tasks and the inability to concentrate on them while improving the accuracy.Approach.This paper proposes a hybrid BCI composed of MI and pronunciation imagination (PI). The electroencephalogram signals of ten subjects are recognized by the adaptive Riemannian distance classification and the improved frequency selective filter-bank Common Spatial Pattern recognition.Main results.The results show that under the new paradigm with the combination of MI and PI, the recognition accuracy is higher than the MI alone. The highest recognition rate of the proposed hybrid system can reach more than 90%. Furthermore, through the subjects' scoring results of the operation difficulty, it is concluded that the designed hybrid paradigm is more operable than the traditional BCI paradigm.Significance.The separable tasks in the active BCI are limited and the accuracy needs to be improved. The new hybrid paradigm proposed by us improves the accuracy and operability of the active BCI system, providing a new possibility for the research direction of the active BCI.

Performance Variation of a Somatosensory BCI Based on Imagined Sensation: A Large Population Study

A proportion of users cannot achieve adequate brain-computer interface (BCI) control. The diversity of BCI modalities provides a way to solve this emerging issue. Here, we investigate the accuracy of a somatosensory BCI based on sensory imagery (SI). During the SI tasks, subjects were instructed to imagine a tactile sensation and to maintain the attention on the corresponding hand, as if there was tactile stimulus on the skin of the wrist. The performance across 106 healthy subjects in left- and right-hand SI discrimination was 78.9±13.2%. In 70.7% of the subjects the performance was above 70%. The SI task induced a contralateral cortical activation, and high-density EEG source localization showed that the real tactile stimulation and imagined tactile stimulation shared similar cortical activations within the somatosensory cortex. The somatosensory BCI based on SI provides a new signal modality for independent BCI development. Moreover, a combination of SI and other BCI modalities, such as motor imagery, may provide new avenues for further improving BCI usage and applicability, especially in those subjects unable to attain adequate BCI control with conventional BCI modalities.

Reducing the Calibration Time in Somatosensory BCI by Using Tactile ERD

OBJECTIVE

We propose a tactile-induced-oscillation approach to reduce the calibration time in somatosensory brain-computer interfaces (BCI).

METHODS

Based on the similarity between tactile induced event-related desynchronization (ERD) and imagined sensation induced ERD activation, we extensively evaluated BCI performance when using a conventional and a novel calibration strategy. In the conventional calibration, the tactile imagined data was used, while in the sensory calibration model sensory stimulation data was used. Subjects were required to sense the tactile stimulus when real tactile was applied to the left or right wrist and were required to perform imagined sensation tasks in the somatosensory BCI paradigm.

RESULTS

The sensory calibration led to a significantly better performance than the conventional calibration when tested on the same imagined sensation dataset ( [Formula: see text]=10.89, P=0.0038), with an average 5.1% improvement in accuracy. Moreover, the sensory calibration was 39.3% faster in reaching a performance level of above 70% accuracy.

CONCLUSION

The proposed approach of using tactile ERD from the sensory cortex provides an effective way of reducing the calibration time in a somatosensory BCI system.

SIGNIFICANCE

The tactile stimulation would be specifically useful before BCI usage, avoiding excessive fatigue when the mental task is difficult to perform. The tactile ERD approach may find BCI applications for patients or users with preserved afferent pathways.

Workshops of the Eighth International Brain-Computer Interface Meeting: BCIs: The Next Frontier

The Eighth International Brain-Computer Interface (BCI) Meeting was held June 7-9th, 2021 in a virtual format. The conference continued the BCI Meeting series' interactive nature with 21 workshops covering topics in BCI (also called brain-machine interface) research. As in the past, workshops covered the breadth of topics in BCI. Some workshops provided detailed examinations of specific methods, hardware, or processes. Others focused on specific BCI applications or user groups. Several workshops continued consensus building efforts designed to create BCI standards and increase the ease of comparisons between studies and the potential for meta-analysis and large multi-site clinical trials. Ethical and translational considerations were both the primary topic for some workshops or an important secondary consideration for others. The range of BCI applications continues to expand, with more workshops focusing on approaches that can extend beyond the needs of those with physical impairments. This paper summarizes each workshop, provides background information and references for further study, presents an overview of the discussion topics, and describes the conclusion, challenges, or initiatives that resulted from the interactions and discussion at the workshop.

An FPGA-Embedded Brain-Computer Interface System to Support Individual Autonomy in Locked-In Individuals

Brain-computer interfaces (BCI) can detect specific EEG patterns and translate them into control signals for external devices by providing people suffering from severe motor disabilities with an alternative/additional channel to communicate and interact with the outer world. Many EEG-based BCIs rely on the P300 event-related potentials, mainly because they require training times for the user relatively short and provide higher selection speed. This paper proposes a P300-based portable embedded BCI system realized through an embedded hardware platform based on FPGA (field-programmable gate array), ensuring flexibility, reliability, and high-performance features. The system acquires EEG data during user visual stimulation and processes them in a real-time way to correctly detect and recognize the EEG features. The BCI system is designed to allow to user to perform communication and domotic controls.

Enhancing Sustained Attention

Arguably, automation is fast transforming many enterprise business processes, transforming operational jobs into monitoring tasks. Consequently, the ability to sustain attention during extended periods of monitoring is becoming a critical skill. This manuscript presents a Brain-Computer Interface (BCI) prototype which seeks to combat decrements in sustained attention during monitoring tasks within an enterprise system. A brain-computer interface is a system which uses physiological signals output by the user as an input. The goal is to better understand human responses while performing tasks involving decision and monitoring cycles, finding ways to improve performance and decrease on-task error. Decision readiness and the ability to synthesize complex and abundant information in a brief period during critical events has never been more important. Closed-loop control and motivational control theory were synthesized to provide the basis from which a framework for a prototype was developed to demonstrate the feasibility and value of a BCI in critical enterprise activities. In this pilot study, the BCI was implemented and evaluated through laboratory experimentation using an ecologically valid task. The results show that the technological artifact allowed users to regulate sustained attention positively while performing the task. Levels of sustained attention were shown to be higher in the conditions assisted by the BCI. Furthermore, this increased cognitive response seems to be related to increased on-task action and a small reduction in on-task errors. The research concludes with a discussion of the future research directions and their application in the enterprise.

Characterizing the stimulation interference in electroencephalographic signals during brain-computer interface-controlled functional electrical stimulation therapy

INTRODUCTION

The integration of brain-computer interface (BCI) and functional electrical stimulation (FES) has brought about a new rehabilitation strategy: BCI-controlled FES therapy or BCI-FEST. During BCI-FEST, the stimulation is triggered by the patient's brain activity, often monitored using electroencephalography (EEG). Several studies have demonstrated that BCI-FEST can improve voluntary arm and hand function after an injury, but few studies have investigated the FES interference in EEG signals during BCI-FEST. In this study, we evaluated the effectiveness of band-pass filters, used to extract the BCI-relevant EEG components, in simultaneously reducing stimulation interference.

METHODS

We used EEG data from eight participants recorded during BCI-FEST. Additionally, we separately recorded the FES signal generated by the stimulator to estimate the spectral components of the FES interference, and extract the noise in time domain. Finally, we calculated signal-to-noise ratio (SNR) values before and after band-pass filtering, for two types of movements practiced during BCI-FEST: reaching and grasping.

RESULTS

The SNR values were greater after filtering across all participants for both movement types. For reaching movements, mean SNR values increased between 1.31 dB and 36.3 dB. Similarly, for grasping movements, mean SNR values increased between 2.82 dB and 40.16 dB, after filtering.

CONCLUSIONS

Band-pass filters, used to isolate EEG frequency bands for BCI application, were also effective in reducing stimulation interference. In addition, we provide a general algorithm that can be used in future studies to estimate the frequencies of FES interference as a function of the selected stimulation pulse frequency, F_STIM , and the EEG sampling rate, F_S .

Improving motor imagery classification during induced motor perturbations

Objective.Motor imagery is the mental simulation of movements. It is a common paradigm to design brain-computer interfaces (BCIs) that elicits the modulation of brain oscillatory activity similar to real, passive and induced movements. In this study, we used peripheral stimulation to provoke movements of one limb during the performance of motor imagery tasks. Unlike other works, in which induced movements are used to support the BCI operation, our goal was to test and improve the robustness of motor imagery based BCI systems to perturbations caused by artificially generated movements.Approach.We performed a BCI session with ten participants who carried out motor imagery of three limbs. In some of the trials, one of the arms was moved by neuromuscular stimulation. We analysed 2-class motor imagery classifications with and without movement perturbations. We investigated the performance decrease produced by these disturbances and designed different computational strategies to attenuate the observed classification accuracy drop.Main results.When the movement was induced in a limb not coincident with the motor imagery classes, extracting oscillatory sources of the movement imagination tasks resulted in BCI performance being similar to the control (undisturbed) condition; when the movement was induced in a limb also involved in the motor imagery tasks, the performance drop was significantly alleviated by spatially filtering out the neural noise caused by the stimulation. We also show that the loss of BCI accuracy was accompanied by weaker power of the sensorimotor rhythm. Importantly, this residual power could be used to predict whether a BCI user will perform with sufficient accuracy under the movement disturbances.Significance.We provide methods to ameliorate and even eliminate motor related afferent disturbances during the performance of motor imagery tasks. This can help improving the reliability of current motor imagery based BCI systems.

Online detection of movement during natural and self-initiated reach-and-grasp actions from EEG signals

Movement intention detection using electroencephalography (EEG) is a challenging but essential component of brain-computer interfaces (BCIs) for people with motor disabilities.Objective.The goal of this study is to develop a new experimental paradigm to perform asynchronous online detection of movement based on low-frequency time-domain EEG features, concretely on movement-related cortical potentials. The paradigm must be easily transferable to people without any residual upper-limb movement function and the BCI must be independent of upper-limb movement onset measurements and external cues.Approach. In a study with non-disabled participants, we evaluated a novel BCI paradigm to detect self-initiated reach-and-grasp movements. Two experimental conditions were involved. In one condition, participants performed reach-and-grasp movements to a target and simultaneously shifted their gaze towards it. In a control condition, participants solely shifted their gaze towards the target (oculomotor task). The participants freely decided when to initiate the tasks. After eye artefact correction, the EEG signals were time-locked to the saccade onset and the resulting amplitude features were exploited on a hierarchical classification approach to detect movement asynchronously.Main results. With regards to BCI performance, 54.1% (14.4% SD) of the movements were correctly identified, and all participants achieved a performance above chance-level (around 12%). An average of 21.5% (14.1% SD) of the oculomotor tasks were falsely detected as upper-limb movement. In an additional rest condition, 1.7 (1.6 SD) false positives per minute were measured. Through source imaging, movement information was mapped to sensorimotor, posterior parietal and occipital areas.Significance. We present a novel approach for movement detection using EEG signals which does not rely on upper-limb movement onset measurements or on the presentation of external cues. The participants' behaviour closely matches the natural behaviour during goal-directed reach-and-grasp movements, which also constitutes an advantage with respect to current BCI protocols.

Cluster decomposing and multi-objective optimization based-ensemble learning framework for motor imagery-based brain-computer interfaces

OBJECTIVE

Motor imagery (MI) is a mental representation of motor behavior and a widely used pattern in electroencephalogram (EEG) based brain-computer interface (BCI) systems. EEG is known for its non-stationary, non-linear features and sensitivity to artifacts from various sources. This study aimed to design a powerful classifier with a strong generalization capability for MI based BCIs.

APPROACH

In this study, we proposed a cluster decomposing based ensemble learning framework (CDECL) for EEG classification of MI based BCIs. The EEG data was decomposed into sub-data sets with different distributions by clustering decomposition. Then a set of heterogeneous classifiers was trained on each sub-data set for generating a diversified classifier search space. To obtain the optimal classifier combination, the ensemble learning was formulated as a multi-objective optimization problem and a stochastic fractal based binary multi-objective fruit fly optimization algorithm was proposed for solving the ensemble learning problem.

MAIN RESULTS

The proposed method was validated on two public EEG datasets (BCI Competition IV datasets IIb and BCI Competition IV dataset IIa) and compared with several other competing classification methods. Experimental results showed that the proposed CDECL based methods can effectively construct a diversity ensemble classifier and exhibits superior classification performance in comparison with several competing methods.

SIGNIFICANCE

The proposed method is promising for improving the performance of MI-based BCIs.

Summary of over Fifty Years with Brain-Computer Interfaces-A Review

Over the last few decades, the Brain-Computer Interfaces have been gradually making their way to the epicenter of scientific interest. Many scientists from all around the world have contributed to the state of the art in this scientific domain by developing numerous tools and methods for brain signal acquisition and processing. Such a spectacular progress would not be achievable without accompanying technological development to equip the researchers with the proper devices providing what is absolutely necessary for any kind of discovery as the core of every analysis: the data reflecting the brain activity. The common effort has resulted in pushing the whole domain to the point where the communication between a human being and the external world through BCI interfaces is no longer science fiction but nowadays reality. In this work we present the most relevant aspects of the BCIs and all the milestones that have been made over nearly 50-year history of this research domain. We mention people who were pioneers in this area as well as we highlight all the technological and methodological advances that have transformed something available and understandable by a very few into something that has a potential to be a breathtaking change for so many. Aiming to fully understand how the human brain works is a very ambitious goal and it will surely take time to succeed. However, even that fraction of what has already been determined is sufficient e.g., to allow impaired people to regain control on their lives and significantly improve its quality. The more is discovered in this domain, the more benefit for all of us this can potentially bring.

KITE-BCI: A brain-computer interface system for functional electrical stimulation therapy

CONTEXT/OBJECTIVE

Integrating brain-computer interface (BCI) technology with functional electrical stimulation therapy (FEST) is an emerging strategy for upper limb motor rehabilitation after spinal cord injury (SCI). Despite promising results, the combined use of these technologies (BCI-FEST) in clinical practice is minimal. To address this issue, we developed KITE-BCI, a BCI system specifically designed for clinical application and integration with dynamic FEST. In this paper, we report its technical features and performance. In addition, we discuss the differences in distributions of the BCI- and therapist-triggered stimulation latencies.

DESIGN

Two single-arm 40-session interventional studies to test the feasibility of BCI-controlled FEST for upper limb motor rehabilitation in individuals with cervical SCI.

SETTING

Rehabilitation programs within the University and Lyndhurst Centres of the Toronto Rehabilitation Institute - University Health Network, Toronto, Canada.

PARTICIPANTS

Five individuals with sub-acute (< 6 months post-injury) SCI at the C4-C5 level, AIS B-D, and three individuals with chronic (> 24 months post-injury) SCI at C4 level, AIS B-C.

OUTCOME MEASURES

We measured BCI setup duration, and to characterize the performance of KITE-BCI, we recorded BCI sensitivity, defined as the percentage of successful BCI activations out of the total number of cued movements.

RESULTS

The overall BCI sensitivities were 74.46% and 79.08% for the sub-acute and chronic groups, respectively. The average KITE-BCI setup duration across the two studies was 11 min and 13 s.

CONCLUSION

KITE-BCI demonstrates a clinically viable single-channel BCI system for integration with FEST resulting in a versatile technology-enhanced upper limb motor rehabilitation strategy after SCI.

Brain-controlled cycling system for rehabilitation following paraplegia with delay-time prediction

Objective.Robotic rehabilitation systems have been investigated to assist with motor dysfunction recovery in patients with lower-extremity paralysis caused by central nervous system lesions. These systems are intended to provide appropriate sensory feedback associated with locomotion. Appropriate feedback is thought to cause synchronous neuron firing, resulting in the recovery of function.Approach.In this study, we designed and evaluated an ergometric cycling wheelchair, with a brain-machine interface (BMI), that can force the legs to move by including normal stepping speeds and quick responses. Experiments were conducted in five healthy subjects and one patient with spinal cord injury (SCI), who experienced the complete paralysis of the lower limbs. Event-related desynchronization (ERD) in the β band (18-28 Hz) was used to detect lower-limb motor images.Main results.An ergometer-based BMI system was able to safely and easily force patients to perform leg movements, at a rate of approximately 1.6 seconds/step (19 rpm), with an online accuracy rate of 73.1% for the SCI participant. Mean detection time from the cue to pedaling onset was 0.83±0.31 s.Significance.This system can easily and safely maintain a normal walking speed during the experiment and be designed to accommodate the expected delay between the intentional onset and physical movement, to achieve rehabilitation effects for each participant. Similar BMI systems, implemented with rehabilitation systems, may be applicable to a wide range of patients.

Neural decoding of continuous upper limb movements: a meta-analysis

OBJECTIVE

EEG-based motion trajectory decoding makes a promising approach for neurotechnology which can be used for neural control of motion reconstruction and neurorehabilitation tools. However, the feasibility and validity of continuous motion decoding by non-invasive brain activity are not clear. The main aim of this study was to perform a meta-analysis across studies that examined the ability of EEG-based continuous motion decoding of upper limb movements.

APPROACH

Pearson's correlation coefficient (CC) was used to evaluate the model performance of the studies and considered as an effect size. To estimate the overall effect size of neural decoding of motion trajectory across studies, characteristics of included studies were addressed and the random effect model was applied to the heterogeneous studies which estimated overall effect size distribution. Furthermore, the significant difference between the two subgroups of imagined and executed movements was analysed.

MAIN RESULTS

The mean of the overall effect size was computed 0.46 across the nonhomogeneous studies. The results showed no significant difference between imagined and executed movements (Chi²=0.28, df = 1, p = 0.60).

SIGNIFICANCE

Meta-analysis results confirm that imagination like execution movements can be used for neural decoding of motion trajectory in neural motor control systems. Also, nonlinear compare with linear model statistically confirmed to be more beneficial for complex movements. Furthermore, a new approach of synergy-based motion decoding can be significantly effective to increase model performance and more research needs to evaluate this method for different levels of complexity of movements.IMPLICATIONS FOR REHABILITATIONNeural decoding methods base on EEG as a non-invasive brain activity, are more user friendly for neurorehabilitation than invasive methods that developing of it makes it more applicable for reconstructing activities of daily living.Neurotechnology for neural control of motion reconstruction, makes the rehabilitation tools to be more synchrony with human intentional movement that can be used to improve the brain neuroplastisity in stroke or other paralysed people.The feasibility and validity of imagined movements equal with executed movements show that amputee people also can benefit EEG-based motion decoding for controling rehabilitation tools just by imagination of their intentional movements.For neurorehabilitation tools, comparing the study outcomes illucidate that the approach of synergy-based motor control in brain activities concluded significantly high performance that highlighted the need it to more investigated in future research.

Spatial-temporal aspects of continuous EEG-based neurorobotic control

Objective.The goal of this work is to identify the spatio-temporal facets of state-of-the-art electroencephalography (EEG)-based continuous neurorobotics that need to be addressed, prior to deployment in practical applications at home and in the clinic.Approach.Nine healthy human subjects participated in five sessions of one-dimensional (1D) horizontal (LR), 1D vertical (UD) and two-dimensional (2D) neural tracking from EEG. Users controlled a robotic arm and virtual cursor to continuously track a Gaussian random motion target using EEG sensorimotor rhythm modulation via motor imagery (MI) commands. Continuous control quality was analyzed in the temporal and spatial domains separately.Main results.Axis-specific errors during 2D tasks were significantly larger than during 1D counterparts. Fatigue rates were larger for control tasks with higher cognitive demand (LR, left- and right-hand MI) compared to those with lower cognitive demand (UD, both hands MI and rest). Additionally robotic arm and virtual cursor control exhibited equal tracking error during all tasks. However, further spatial error analysis of 2D control revealed a significant reduction in tracking quality that was dependent on the visual interference of the physical device. In fact, robotic arm performance was significantly greater than that of virtual cursor control when the users' sightlines were not obstructed.Significance.This work emphasizes the need for practical interfaces to be designed around real-world tasks of increased complexity. Here, the dependence of control quality on cognitive task demand emphasizes the need for decoders that facilitate the translation of 1D task mastery to 2D control. When device footprint was accounted for, the introduction of a physical robotic arm improved control quality, likely due to increased user engagement. In general, this work demonstrates the need to consider both the physical footprint of devices, the complexity of training tasks, and the synergy of control strategies during the development of neurorobotic control.

Why brain-controlled neuroprosthetics matter: mechanisms underlying electrical stimulation of muscles and nerves in rehabilitation

Delivering short trains of electric pulses to the muscles and nerves can elicit action potentials resulting in muscle contractions. When the stimulations are sequenced to generate functional movements, such as grasping or walking, the application is referred to as functional electrical stimulation (FES). Implications of the motor and sensory recruitment of muscles using FES go beyond simple contraction of muscles. Evidence suggests that FES can induce short- and long-term neurophysiological changes in the central nervous system by varying the stimulation parameters and delivery methods. By taking advantage of this, FES has been used to restore voluntary movement in individuals with neurological injuries with a technique called FES therapy (FEST). However, long-lasting cortical re-organization (neuroplasticity) depends on the ability to synchronize the descending (voluntary) commands and the successful execution of the intended task using a FES. Brain-computer interface (BCI) technologies offer a way to synchronize cortical commands and movements generated by FES, which can be advantageous for inducing neuroplasticity. Therefore, the aim of this review paper is to discuss the neurophysiological mechanisms of electrical stimulation of muscles and nerves and how BCI-controlled FES can be used in rehabilitation to improve motor function.

Distance- and speed-informed kinematics decoding improves M/EEG based upper-limb movement decoder accuracy

OBJECTIVE

One of the main goals in brain-computer interface (BCI) research is the replacement or restoration of lost function in individuals with paralysis. One line of research investigates the inference of movement kinematics from brain activity during different volitional states. A growing number of electroencephalography (EEG) and magnetoencephalography (MEG) studies suggest that information about directional (e.g. velocity) and nondirectional (e.g. speed) movement kinematics is accessible noninvasively. We sought to assess if the neural information associated with both types of kinematics can be combined to improve the decoding accuracy.

APPROACH

In an offline analysis, we reanalyzed the data of two previous experiments containing the recordings of 34 healthy participants (15 EEG, 19 MEG). We decoded 2D movement trajectories from low-frequency M/EEG signals in executed and observed tracking movements, and compared the accuracy of an unscented Kalman filter (UKF) that explicitly modeled the nonlinear relation between directional and nondirectional kinematics to the accuracies of linear Kalman (KF) and Wiener filters which did not combine both types of kinematics.

MAIN RESULTS

At the group level, posterior-parietal and parieto-occipital (executed and observed movements) and sensorimotor areas (executed movements) encoded kinematic information. Correlations between the recorded position and velocity trajectories and the UKF decoded ones were on average 0.49 during executed and 0.36 during observed movements. Compared to the other filters, the UKF could achieve the best trade-off between maximizing the signal to noise ratio and minimizing the amplitude mismatch between the recorded and decoded trajectories.

SIGNIFICANCE

We present direct evidence that directional and nondirectional kinematic information is simultaneously detectable in low-frequency M/EEG signals. Moreover, combining directional and nondirectional kinematic information significantly improves the decoding accuracy upon a linear KF.

Analyzing and Decoding Natural Reach-and-Grasp Actions Using Gel, Water and Dry EEG Systems

Reaching and grasping is an essential part of everybody's life, it allows meaningful interaction with the environment and is key to independent lifestyle. Recent electroencephalogram (EEG)-based studies have already shown that neural correlates of natural reach-and-grasp actions can be identified in the EEG. However, it is still in question whether these results obtained in a laboratory environment can make the transition to mobile applicable EEG systems for home use. In the current study, we investigated whether EEG-based correlates of natural reach-and-grasp actions can be successfully identified and decoded using mobile EEG systems, namely the water-based EEG-Versatile ^TM system and the dry-electrodes EEG-Hero ^TM headset. In addition, we also analyzed gel-based recordings obtained in a laboratory environment (g.USBamp/g.Ladybird, gold standard), which followed the same experimental parameters. For each recording system, 15 study participants performed 80 self-initiated reach-and-grasp actions toward a glass (palmar grasp) and a spoon (lateral grasp). Our results confirmed that EEG-based correlates of reach-and-grasp actions can be successfully identified using these mobile systems. In a single-trial multiclass-based decoding approach, which incorporated both movement conditions and rest, we could show that the low frequency time domain (LFTD) correlates were also decodable. Grand average peak accuracy calculated on unseen test data yielded for the water-based electrode system 62.3% (9.2% STD), whereas for the dry-electrodes headset reached 56.4% (8% STD). For the gel-based electrode system 61.3% (8.6% STD) could be achieved. To foster and promote further investigations in the field of EEG-based movement decoding, as well as to allow the interested community to make their own conclusions, we provide all datasets publicly available in the BNCI Horizon 2020 database (http://bnci-horizon-2020.eu/database/data-sets).

User Adaptation to Closed-Loop Decoding of Motor Imagery Termination

One of the most popular methods in non-invasive brain machine interfaces (BMI) relies on the decoding of sensorimotor rhythms associated to sustained motor imagery. Although motor imagery has been intensively studied, its termination is mostly neglected.

OBJECTIVE

Here, we provide insights in the decoding of motor imagery termination and investigate the use of such decoder in closed-loop BMI.

METHODS

Participants (N = 9) were asked to perform kinesthetic motor imagery of both hands simultaneously cued with a clock indicating the initiation and termination of the action. Using electroencephalogram (EEG) signals, we built a decoder to detect the transition between event-related desynchronization and event-related synchronization. Features for this decoder were correlates of motor termination in the upper μ and β bands.

RESULTS

The decoder reached an accuracy of 76.2% (N = 9), revealing the high robustness of our approach. More importantly, this paper shows that the decoding of motor termination has an intrinsic latency mainly due to the delayed appearance of its correlates. Because the latency was consistent and thus predictable, users were able to compensate it after training.

CONCLUSION

Using our decoding system, BMI users were able to adapt their behavior and modulate their sensorimotor rhythm to stop the device (clock) accurately on time.

SIGNIFICANCE

These results show the importance of closed-loop evaluations of BMI decoders and open new possibilities for BMI control using decoding of movement termination.

Dream engineering: Simulating worlds through sensory stimulation

We explore the application of a wide range of sensory stimulation technologies to the area of sleep and dream engineering. We begin by emphasizing the causal role of the body in dream generation, and describe a circuitry between the sleeping body and the dreaming mind. We suggest that nearly any sensory stimuli has potential for modulating experience in sleep. Considering other areas that might afford tools for engineering sensory content in simulated worlds, we turn to Virtual Reality (VR). We outline a collection of relevant VR technologies, including devices engineered to stimulate haptic, temperature, vestibular, olfactory, and auditory sensations. We believe these technologies, which have been developed for high mobility and low cost, can be translated to the field of dream engineering. We close by discussing possible future directions in this field and the ethics of a world in which targeted dream direction and sleep manipulation are feasible.

Applying intuitive EEG-controlled grasp neuroprostheses in individuals with spinal cord injury: Preliminary results from the MoreGrasp clinical feasibility study

The aim of the MoreGrasp project is to develop a non-invasive, multimodal user interface including a brain-computer interface (BCI) for control of a grasp neuroprostheses in individuals with high spinal cord injury (SCI). The first results of the ongoing MoreGrasp clinical feasibility study involving end users with SCI are presented. This includes BCI screening sessions, in which we investigate the electroencephalography (EEG) patterns associated with single, natural movements of the upper limb. These patterns will later be used to control the neuroprosthesis. Additionally, the MoreGrasp grasp neuroprosthesis consisting of electrode arrays embedded in an individualized textile forearm sleeve is presented. The general feasibility of this electrode array in terms of corrections of misalignments during donning is shown together with the functional results in end users of the electrode forearm sleeve.

Decoding hand movements from human EEG to control a robotic arm in a simulation environment

OBJECTIVE

Daily life tasks can become a significant challenge for motor impaired persons. Depending on the severity of their impairment, they require more complex solutions to retain an independent life. Brain-computer interfaces (BCIs) are targeted to provide an intuitive form of control for advanced assistive devices such as robotic arms or neuroprostheses. In our current study we aim to decode three different executed hand movements in an online BCI scenario from electroencephalographic (EEG) data.

APPROACH

Immersed in a desktop-based simulation environment, 15 non-disabled participants interacted with virtual objects from daily life by an avatar's robotic arm. In a short calibration phase, participants performed executed palmar and lateral grasps and wrist supinations. Using this data, we trained a classification model on features extracted from the low frequency time domain. In the subsequent evaluation phase, participants controlled the avatar's robotic arm and interacted with the virtual objects in case of a correct classification.

MAIN RESULTS

On average, participants scored online 48% of all movement trials correctly (3-condition scenario, adjusted chance level 40%, alpha = 0.05). The underlying movement-related cortical potentials (MRCPs) of the acquired calibration data show significant differences between conditions over contralateral central sensorimotor areas, which are retained in the data acquired from the online BCI use.

SIGNIFICANCE

We could show the successful online decoding of two grasps and one wrist supination movement using low frequency time domain features of the human EEG. These findings can potentially contribute to the development of a more natural and intuitive BCI-based control modality for upper limb motor neuroprostheses or robotic arms for people with motor impairments.

Functional electrical stimulation therapy for restoration of motor function after spinal cord injury and stroke: a review

Functional electrical stimulation is a technique to produce functional movements after paralysis. Electrical discharges are applied to a person's muscles making them contract in a sequence that allows performing tasks such as grasping a key, holding a toothbrush, standing, and walking. The technology was developed in the sixties, during which initial clinical use started, emphasizing its potential as an assistive device. Since then, functional electrical stimulation has evolved into an important therapeutic intervention that clinicians can use to help individuals who have had a stroke or a spinal cord injury regain their ability to stand, walk, reach, and grasp. With an expected growth in the aging population, it is likely that this technology will undergo important changes to increase its efficacy as well as its widespread adoption. We present here a series of functional electrical stimulation systems to illustrate the fundamentals of the technology and its applications. Most of the concepts continue to be in use today by modern day devices. A brief description of the potential future of the technology is presented, including its integration with brain-computer interfaces and wearable (garment) technology.

Using machine learning to reveal the population vector from EEG signals

OBJECTIVE

Since the discovery of the population vector that directly relates neural spiking activity with arm movement direction, it has become feasible to control robotic arms and neuroprostheses using invasively recorded brain signals. For non-invasive approaches, a direct relation between human brain signals and arm movement direction is yet to be established.

APPROACH

Here, we investigated electroencephalographic (EEG) signals in temporal and spectral domains in a continuous, circular arm movement task. Using machine learning methods that respect the linear mixture of brain activity within EEG signals, we show that directional information is represented in the temporal domain in amplitude modulations of the same frequency as the arm movement, and in the spectral domain in power modulations of the 20-24 Hz frequency band.

MAIN RESULTS

In the temporal domain, the directional information was mainly expressed in primary sensorimotor cortex (SM1) and posterior parietal cortex (PPC) contralateral to the moving arm, while in the spectral domain SM1 and PPC of both hemispheres predicted arm movement direction. The different cortical representations suggest distinct neural representations in both domains.

SIGNIFICANCE

This direct relation between neural activity and arm movement direction in both domains demonstrates the potential of machine learning to reveal neuroscientific insights about the dynamics of human arm movements.

Low-Cost Robotic Guide Based on a Motor Imagery Brain-Computer Interface for Arm Assisted Rehabilitation

Motor imagery has been suggested as an efficient alternative to improve the rehabilitation process of affected limbs. In this study, a low-cost robotic guide is implemented so that linear position can be controlled via the user’s motor imagination of movement intention. The patient can use this device to move the arm attached to the guide according to their own intentions. The first objective of this study was to check the feasibility and safety of the designed robotic guide controlled via a motor imagery (MI)-based brain–computer interface (MI-BCI) in healthy individuals, with the ultimate aim to apply it to rehabilitation patients. The second objective was to determine which are the most convenient MI strategies to control the different assisted rehabilitation arm movements. The results of this study show a better performance when the BCI task is controlled with an action–action MI strategy versus an action–relaxation one. No statistically significant difference was found between the two action–action MI strategies.

Brain-computer interfaces in neurologic rehabilitation practice

The brain-computer interfaces (BCIs) for neurologic rehabilitation are based on the assumption that by retraining the brain to specific activities, an ultimate improvement of function can be expected. In this chapter, we review the present status, key determinants, and future directions of the clinical use of BCI in neurorehabilitation. The recent advancements in noninvasive BCIs as a therapeutic tool to promote functional motor recovery by inducing neuroplasticity are described, focusing on stroke as it represents the major cause of long-term motor disability. The relevance of recent findings on BCI use in spinal cord injury beyond the control of neuroprosthetic devices to restore motor function is briefly discussed. In a dedicated section, we examine the potential role of BCI technology in the domain of cognitive function recovery by instantiating BCIs in the long history of neurofeedback and some emerging BCI paradigms to address cognitive rehabilitation are highlighted. Despite the knowledge acquired over the last decade and the growing number of studies providing evidence for clinical efficacy of BCI in motor rehabilitation, an exhaustive deployment of this technology in clinical practice is still on its way. The pipeline to translate BCI to clinical practice in neurorehabilitation is the subject of this chapter.

Electroencephalography

The electroencephalogram (EEG) was invented almost 100 years ago and is still a method of choice for many research questions, even applications-from functional brain imaging in neuroscientific investigations during movement to real-time applications like brain-computer interfacing. This chapter gives some background information on the establishment and properties of the EEG. This chapter starts with a closer look at the sources of EEG at a micro or neuronal level, followed by recording techniques, types of electrodes, and common EEG artifacts. Then an overview on EEG phenomena, namely, spontaneous EEG and event-related potentials build the middle part of this chapter. The last part discusses brain signals, which are used in current BCI research, including short descriptions and examples of applications.

Motor imagery based brain-computer interface control of continuous passive motion for wrist extension recovery in chronic stroke patients

Motor recovery of wrist and fingers is still a great challenge for chronic stroke survivors. The present study aimed to verify the efficiency of motor imagery based brain-computer interface (BCI) control of continuous passive motion (CPM) in the recovery of wrist extension due to stroke. An observational study was conducted in 26 chronic stroke patients, aged 49.0 ± 15.4 years, with upper extremity motor impairment. All patients showed no wrist extension recovery. A 24-channel highresolution electroencephalogram (EEG) system was used to acquire cortical signal while they were imagining extension of the affected wrist. Then, 20 sessions of BCI-driven CPM training were carried out for 6 weeks. Primary outcome was the increase of active range of motion (ROM) of the affected wrist from the baseline to final evaluation. Improvement of modified Barthel Index, EEG classification and motor imagery pattern of wrist extension were recorded as secondary outcomes. Twenty-one patients finally passed the EEG screening and completed all the BCI-driven CPM trainings. From baseline to the final evaluation, the increase of active ROM of the affected wrists was (24.05 ± 14.46)˚. The increase of modified Barthel Index was 3.10 ± 4.02 points. But no statistical difference was detected between the baseline and final evaluations (P > 0.05). Both EEG classification and motor imagery pattern improved. The present study demonstrated beneficial outcomes of MI-based BCI control of CPM training in motor recovery of wrist extension using motor imagery signal of brain in chronic stroke patients.

Workshops of the Seventh International Brain-Computer Interface Meeting: Not Getting Lost in Translation

The Seventh International Brain-Computer Interface (BCI) Meeting was held May 21-25th, 2018 at the Asilomar Conference Grounds, Pacific Grove, California, United States. The interactive nature of this conference was embodied by 25 workshops covering topics in BCI (also called brain-machine interface) research. Workshops covered foundational topics such as hardware development and signal analysis algorithms, new and imaginative topics such as BCI for virtual reality and multi-brain BCIs, and translational topics such as clinical applications and ethical assumptions of BCI development. BCI research is expanding in the diversity of applications and populations for whom those applications are being developed. BCI applications are moving toward clinical readiness as researchers struggle with the practical considerations to make sure that BCI translational efforts will be successful. This paper summarizes each workshop, providing an overview of the topic of discussion, references for additional information, and identifying future issues for research and development that resulted from the interactions and discussion at the workshop.

Development of a robust asynchronous brain-switch using ErrP-based error correction

OBJECTIVE

The ultimate goal of many brain-computer interface (BCI) research efforts is to provide individuals with severe motor impairments with a communication channel that they can control at will. To achieve this goal, an important system requirement is asynchronous control, whereby users can initiate intentional brain activation in a self-paced rather than system-cued manner. However, to date, asynchronous BCIs have been explored in a minority of BCI studies and their performance is generally below that of system-paced alternatives. In this paper, we present an asynchronous electroencephalography (EEG) BCI that detects a non-motor imagery cognitive task and investigated the possibility of improving its performance using error-related potentials (ErrP).

APPROACH

Ten able-bodied adults attended two sessions of data collection each, one for training and one for testing the BCI. The visual interface consisted of a centrally located cartoon icon. For each participant, an asynchronous BCI differentiated among the idle state and a personally selected cognitive task (mental arithmetic, word generation or figure rotation). The BCI continuously analyzed the EEG data stream and displayed real-time feedback (i.e. icon fell over) upon detection of brain activity indicative of a cognitive task. The BCI also monitored the EEG signals for the presence of error-related potentials following the presentation of feedback. An ErrP classifier was invoked to automatically alter the task classifier outcome when an error-related potential was detected.

MAIN RESULTS

The average post-error correction trial success rate across participants, 85% [Formula: see text] 12%, was significantly higher (p   <  0.05) than that pre-error correction (78% [Formula: see text] 11%).

SIGNIFICANCE

Our findings support the addition of ErrP-correction to maximize the performance of asynchronous BCIs..

Novel hybrid brain-computer interface system based on motor imagery and P300

Motor imagery (MI) is a mental representation of motor behavior and has been widely used in electroencephalogram based brain-computer interfaces (BCIs). Several studies have demonstrated the efficacy of MI-based BCI-feedback training in post-stroke rehabilitation. However, in the earliest stage of the training, calibration data typically contain insufficient discriminability, resulting in unreliable feedback, which may decrease subjects' motivation and even hinder their training. To improve the performance in the early stages of MI training, a novel hybrid BCI paradigm based on MI and P300 is proposed in this study. In this paradigm, subjects are instructed to imagine writing the Chinese character following the flash order of the desired Chinese character displayed on the screen. The event-related desynchronization/synchronization (ERD/ERS) phenomenon is produced with writing based on one's imagination. Simultaneously, the P300 potential is evoked by the flash of each stroke. Moreover, a fusion method of P300 and MI classification is proposed, in which unreliable P300 classifications are corrected by reliable MI classifications. Twelve healthy naïve MI subjects participated in this study. Results demonstrated that the proposed hybrid BCI paradigm yielded significantly better performance than the single-modality BCI paradigm. The recognition accuracy of the fusion method is significantly higher than that of P300 (p < 0.05) and MI (p < 0.01). Moreover, the training data size can be reduced through fusion of these two modalities.

Brain Computer Interfaces in Rehabilitation Medicine

One innovation currently influencing physical medicine and rehabilitation is brain-computer interface (BCI) technology. BCI systems used for motor control record neural activity associated with thoughts, perceptions, and motor intent; decode brain signals into commands for output devices; and perform the user's intended action through an output device. BCI systems used for sensory augmentation transduce environmental stimuli into neural signals interpretable by the central nervous system. Both types of systems have potential for reducing disability by facilitating a user's interaction with the environment. Investigational BCI systems are being used in the rehabilitation setting both as neuroprostheses to replace lost function and as potential plasticity-enhancing therapy tools aimed at accelerating neurorecovery. Populations benefitting from motor and somatosensory BCI systems include those with spinal cord injury, motor neuron disease, limb amputation, and stroke. This article discusses the basic components of BCI for rehabilitation, including recording systems and locations, signal processing and translation algorithms, and external devices controlled through BCI commands. An overview of applications in motor and sensory restoration is provided, along with ethical questions and user perspectives regarding BCI technology.

Decoding natural reach-and-grasp actions from human EEG

OBJECTIVE

Despite the high number of degrees of freedom of the human hand, most actions of daily life can be executed incorporating only palmar, pincer and lateral grasp. In this study we attempt to discriminate these three different executed reach-and-grasp actions utilizing their EEG neural correlates.

APPROACH

In a cue-guided experiment, 15 healthy individuals were asked to perform these actions using daily life objects. We recorded 72 trials for each reach-and-grasp condition and from a no-movement condition.

MAIN RESULTS

Using low-frequency time domain features from 0.3 to 3 Hz, we achieved binary classification accuracies of 72.4%, STD  ±  5.8% between grasp types, for grasps versus no-movement condition peak performances of 93.5%, STD  ±  4.6% could be reached. In an offline multiclass classification scenario which incorporated not only all reach-and-grasp actions but also the no-movement condition, the highest performance could be reached using a window of 1000 ms for feature extraction. Classification performance peaked at 65.9%, STD  ±  8.1%. Underlying neural correlates of the reach-and-grasp actions, investigated over the primary motor cortex, showed significant differences starting from approximately 800 ms to 1200 ms after the movement onset which is also the same time frame where classification performance reached its maximum.

SIGNIFICANCE

We could show that it is possible to discriminate three executed reach-and-grasp actions prominent in people's everyday use from non-invasive EEG. Underlying neural correlates showed significant differences between all tested conditions. These findings will eventually contribute to our attempt of controlling a neuroprosthesis in a natural and intuitive way, which could ultimately benefit motor impaired end users in their daily life actions.

Unimanual and Bimanual Reach-and-Grasp Actions Can Be Decoded From Human EEG

While most tasks of daily life can be handled through a small number of different grasps, many tasks require the action of both hands. In these bimanual tasks, the second hand has either a supporting role (e.g. for fixating a jar) or a more active role (e.g. grasping a pot on both handles). In this study we attempt to discriminate the neural correlates of unimanual (performed with left and right hand) from bimanual reach-and-grasp actions using the low-frequency time-domain electroencephalogram (EEG). In a self-initiated movement task, 15 healthy participants were asked to perform unimanual (palmar and lateral grasps with left and right hand) and bimanual (double lateral, mixed palmar/lateral) reach-and-grasps on objects of daily life. Using EEG time-domain features in the frequency range of 0.3-3 Hz, we achieved multiclass-classification accuracies of 38.6 ± 6.6% (7 classes, 17.1% chance level) for a combination of 6 movements and 1 rest condition. The grand average confusion matrix shows highest true positive rates (TPR) for the rest (63%) condition while TPR for the movement classes varied between 33 to 41%. The underlying movement-related cortical potentials (MRCPs) show significant differences between unimanual (e.g left hand vs. right hand grasps) as well unimanual vs. bimanual conditions which both can be attributed to lateralization effects. We believe that these findings can be exploited and further used for attempts in providing persons with spinal cord injury a form of natural control for bimanual neuroprostheses.

Direct comparison of supervised and semi-supervised retraining approaches for co-adaptive BCIs

For Brain-Computer interfaces (BCIs), system calibration is a lengthy but necessary process for successful operation. Co-adaptive BCIs aim to shorten training and imply positive motivation to users by presenting feedback already at early stages: After just 5 min of gathering calibration data, the systems are able to provide feedback and engage users in a mutual learning process. In this work, we investigate whether the retraining stage of co-adaptive BCIs can be adapted to a semi-supervised concept, where only a small amount of labeled data is available and all additional data needs to be labeled by the BCI itself. The aim of the current work was to evaluate whether a semi-supervised co-adaptive BCI could successfully compete with a supervised co-adaptive BCI model. In a supporting two-class (190 trials per condition) BCI study based on motor imagery tasks, we evaluated both approaches in two separate groups of 10 participants online, while we simulated the other approach in each group offline. Our results indicate that despite the lack of true labeled data, the semi-supervised driven BCI did not perform significantly worse (p > 0.05) than the supervised counterpart. We believe that these findings contribute to developing BCIs for long-term use, where continuous adaptation becomes imperative for maintaining meaningful BCI performance.

Graphical abstract

The Sensitivity of Single-Trial Mu-Suppression Detection for Motor Imagery Performance as Compared to Motor Execution and Motor Observation Performance

Motor imagery (MI) has been widely used to operate brain-computer interface (BCI) systems for rehabilitation and some life assistive devices. However, the current performance of an MI-based BCI cannot fully meet the needs of its in-field applications. Most of the BCIs utilizing a generalized feature for all participants have been found to greatly hamper the efficacy of the BCI system. Hence, some attempts have made on the exploration of subject-dependent parameters, but it remains challenging to enhance BCI performance as expected. To this end, in this study, we used the independent component analysis (ICA), which has been proved capable of isolating the pure motor-related component from non-motor-related brain processes and artifacts and extracting the common motor-related component across MI, motor execution (ME), and motor observation (MO) conditions. Then, a sliding window approach was used to detect significant mu-suppression from the baseline using the electroencephalographic (EEG) alpha power time course and, thus, the success rate of the mu-suppression detection could be assessed on a single-trial basis. By comparing the success rates using different parameters, we further quantified the extent of the improvement in each motor condition to evaluate the effectiveness of both generalized and individualized parameters. The results showed that in ME condition, the success rate under individualized latency and that under generalized latency was 90.0% and 77.75%, respectively; in MI condition, the success rate was 74.14% for individual latency and 58.47% for generalized latency, and in MO condition, the success rate was 67.89% and 61.26% for individual and generalized latency, respectively. As can be seen, the success rate in each motor condition was significantly improved by utilizing an individualized latency compared to that using the generalized latency. Moreover, the comparison of the individualized window latencies for the mu-suppression detection across different runs of the same participant as well as across different participants showed that the window latency was significantly more consistent in the intra-subject than in the inter-subject settings. As a result, we proposed that individualizing the latency for detecting the mu-suppression feature for each participant might be a promising attempt to improve the MI-based BCI performance.

Attempted Arm and Hand Movements can be Decoded from Low-Frequency EEG from Persons with Spinal Cord Injury

We show that persons with spinal cord injury (SCI) retain decodable neural correlates of attempted arm and hand movements. We investigated hand open, palmar grasp, lateral grasp, pronation, and supination in 10 persons with cervical SCI. Discriminative movement information was provided by the time-domain of low-frequency electroencephalography (EEG) signals. Based on these signals, we obtained a maximum average classification accuracy of 45% (chance level was 20%) with respect to the five investigated classes. Pattern analysis indicates central motor areas as the origin of the discriminative signals. Furthermore, we introduce a proof-of-concept to classify movement attempts online in a closed loop, and tested it on a person with cervical SCI. We achieved here a modest classification performance of 68.4% with respect to palmar grasp vs hand open (chance level 50%).

Brain-Machine Interfaces: Powerful Tools for Clinical Treatment and Neuroscientific Investigations

Brain-machine interfaces (BMIs) have exploded in popularity in the past decade. BMIs, also called brain-computer interfaces, provide a direct link between the brain and a computer, usually to control an external device. BMIs have a wide array of potential clinical applications, ranging from restoring communication to people unable to speak due to amyotrophic lateral sclerosis or a stroke, to restoring movement to people with paralysis from spinal cord injury or motor neuron disease, to restoring memory to people with cognitive impairment. Because BMIs are controlled directly by the activity of prespecified neurons or cortical areas, they also provide a powerful paradigm with which to investigate fundamental questions about brain physiology, including neuronal behavior, learning, and the role of oscillations. This article reviews the clinical and neuroscientific applications of BMIs, with a primary focus on motor BMIs.

Clinically Significant Gains in Skillful Grasp Coordination by an Individual With Tetraplegia Using an Implanted Brain-Computer Interface With Forearm Transcutaneous Muscle Stimulation

OBJECTIVE

To demonstrate naturalistic motor control speed, coordinated grasp, and carryover from trained to novel objects by an individual with tetraplegia using a brain-computer interface (BCI)-controlled neuroprosthetic.

DESIGN

Phase I trial for an intracortical BCI integrated with forearm functional electrical stimulation (FES). Data reported span postimplant days 137 to 1478.

SETTING

Tertiary care outpatient rehabilitation center.

PARTICIPANT

A 27-year-old man with C5 class A (on the American Spinal Injury Association Impairment Scale) traumatic spinal cord injury INTERVENTIONS: After array implantation in his left (dominant) motor cortex, the participant trained with BCI-FES to control dynamic, coordinated forearm, wrist, and hand movements.

MAIN OUTCOME MEASURES

Performance on standardized tests of arm motor ability (Graded Redefined Assessment of Strength, Sensibility, and Prehension [GRASSP], Action Research Arm Test [ARAT], Grasp and Release Test [GRT], Box and Block Test), grip myometry, and functional activity measures (Capabilities of Upper Extremity Test [CUE-T], Quadriplegia Index of Function-Short Form [QIF-SF], Spinal Cord Independence Measure-Self-Report [SCIM-SR]) with and without the BCI-FES.

RESULTS

With BCI-FES, scores improved from baseline on the following: Grip force (2.9 kg); ARAT cup, cylinders, ball, bar, and blocks; GRT can, fork, peg, weight, and tape; GRASSP strength and prehension (unscrewing lids, pouring from a bottle, transferring pegs); and CUE-T wrist and hand skills. QIF-SF and SCIM-SR eating, grooming, and toileting activities were expected to improve with home use of BCI-FES. Pincer grips and mobility were unaffected. BCI-FES grip skills enabled the participant to play an adapted "Battleship" game and manipulate household objects.

CONCLUSIONS

Using BCI-FES, the participant performed skillful and coordinated grasps and made clinically significant gains in tests of upper limb function. Practice generalized from training objects to household items and leisure activities. Motor ability improved for palmar, lateral, and tip-to-tip grips. The expects eventual home use to confer greater independence for activities of daily living, consistent with observed neurologic level gains from C5-6 to C7-T1. This marks a critical translational step toward clinical viability for BCI neuroprosthetics.

Network neuroscience for optimizing brain-computer interfaces

Human-machine interactions are being increasingly explored to create alternative ways of communication and to improve our daily life. Based on a classification of the user's intention from the user's underlying neural activity, brain-computer interfaces (BCIs) allow direct interactions with the external environment while bypassing the traditional effector of the musculoskeletal system. Despite the enormous potential of BCIs, there are still a number of challenges that limit their societal impact, ranging from the correct decoding of a human's thoughts, to the application of effective learning strategies. Despite several important engineering advances, the basic neuroscience behind these challenges remains poorly explored. Indeed, BCIs involve complex dynamic changes related to neural plasticity at a diverse range of spatiotemporal scales. One promising antidote to this complexity lies in network science, which provides a natural language in which to model the organizational principles of brain architecture and function as manifest in its interconnectivity. Here, we briefly review the main limitations currently affecting BCIs, and we offer our perspective on how they can be addressed by means of network theoretic approaches. We posit that the emerging field of network neuroscience will prove to be an effective tool to unlock human-machine interactions.