Gamma band activity associated with BCI performance: simultaneous MEG/EEG study

MEANSP: How Many Channels are Needed to Predict the Performance of a SMR-Based BCI?

Predicting whether a particular individual would reach an adequate control of a Brain-Computer Interface (BCI) has many practical advantages. On the one hand, participants with low predicted performance could be trained with specifically designed sessions and avoid frustrating experiments; on the other hand, planning time and resources would be more efficient; and finally, the variables related to an accurate prediction could be manipulated to improve the prospective BCI performance. To this end, several predictors have been proposed in the literature, most of them based on the power estimation of EEG signals at the specific frequency bands. Many of these studies evaluate their predictors in relatively small datasets and/or using a relatively high number of channels. In this manuscript, we propose a novel predictor called [Formula: see text] to predict the performance of participants using BCIs that are based on the modulation of sensorimotor rhythms. This novel predictor has been positively evaluated using only 2, 3, 4 or 5 channels. [Formula: see text] has shown to perform as well as or better than other state-of-the-art predictors. The best sets of different number of channels are also provided, which have been tested in two different settings to prove their robustness. The proposed predictor has been successfully evaluated using two large-scale datasets containing 150 and 80 participants, respectively. We also discuss predictor thresholds for users to expect good performance in feedback experiments and show the advantages in comparison to a competing algorithm.

Brief Visual Deprivation Effects on Brain Oscillations During Kinesthetic and Visual-motor Imagery

It is widely recognized that opening and closing the eyes can direct attention to external or internal stimuli processing. This has been confirmed by studies showing the effects of changes in visual stimulation changes on cerebral activity during different tasks, e.g., motor imagery and execution. However, an essential aspect of creating a mental representation of motion, such as imagery perspective, has not yet been investigated in the present context. Our study aimed to verify the effect of brief visual deprivation (under eyes open [EO] and eyes closed [EC] conditions) on brain wave oscillations and behavioral performance during kinesthetic imagery (KMI) and visual-motor imagery (VMI) tasks. We focused on the alpha and beta rhythms from visual- and motor-related EEG activity sources. Additionally, we used machine learning algorithms to establish whether the registered differences in brain oscillations might affect motor imagery brain-computer interface (MI-BCI) performance. The results showed that the occipital areas in the EC condition presented significantly stronger desynchronization during VMI tasks, which is typical for enhanced visual stimuli processing. Furthermore, the stronger desynchronization of alpha rhythms from motor areas in the EO, than EC condition confirmed previous effects obtained during real movements. It was also found that simulating movement under EC/EO conditions affected signal classification accuracy, which has practical implications for MI-BCI effectiveness. These findings suggest that shifting processing toward external or internal stimuli modulates brain rhythm oscillations associated with different perspectives on the mental representation of movement.

Review of public motor imagery and execution datasets in brain-computer interfaces

The demand for public datasets has increased as data-driven methodologies have been introduced in the field of brain-computer interfaces (BCIs). Indeed, many BCI datasets are available in various platforms or repositories on the web, and the studies that have employed these datasets appear to be increasing. Motor imagery is one of the significant control paradigms in the BCI field, and many datasets related to motor tasks are open to the public already. However, to the best of our knowledge, these studies have yet to investigate and evaluate the datasets, although data quality is essential for reliable results and the design of subject- or system-independent BCIs. In this study, we conducted a thorough investigation of motor imagery/execution EEG datasets recorded from healthy participants published over the past 13 years. The 25 datasets were collected from six repositories and subjected to a meta-analysis. In particular, we reviewed the specifications of the recording settings and experimental design, and evaluated the data quality measured by classification accuracy from standard algorithms such as Common Spatial Pattern (CSP) and Linear Discriminant Analysis (LDA) for comparison and compatibility across the datasets. As a result, we found that various stimulation types, such as text, figure, or arrow, were used to instruct subjects what to imagine and the length of each trial also differed, ranging from 2.5 to 29 s with a mean of 9.8 s. Typically, each trial consisted of multiple sections: pre-rest (2.38 s), imagination ready (1.64 s), imagination (4.26 s, ranging from 1 to 10 s), the post-rest (3.38 s). In a meta-analysis of the total of 861 sessions from all datasets, the mean classification accuracy of the two-class (left-hand vs. right-hand motor imagery) problem was 66.53%, and the population of the BCI poor performers, those who are unable to reach proficiency in using a BCI system, was 36.27% according to the estimated accuracy distribution. Further, we analyzed the CSP features and found that each dataset forms a cluster, and some datasets overlap in the feature space, indicating a greater similarity among them. Finally, we checked the minimal essential information (continuous signals, event type/latency, and channel information) that should be included in the datasets for convenient use, and found that only 71% of the datasets met those criteria. Our attempts to evaluate and compare the public datasets are timely, and these results will contribute to understanding the dataset's quality and recording settings as well as the use of using public datasets for future work on BCIs.

Riemannian geometry-based metrics to measure and reinforce user performance changes during brain-computer interface user training

Despite growing interest and research into brain-computer interfaces (BCI), their usage remains limited outside of research laboratories. One reason for this is BCI inefficiency, the phenomenon where a significant number of potential users are unable to produce machine-discernible brain signal patterns to control the devices. To reduce the prevalence of BCI inefficiency, some have advocated for novel user-training protocols that enable users to more effectively modulate their neural activity. Important considerations for the design of these protocols are the assessment measures that are used for evaluating user performance and for providing feedback that guides skill acquisition. Herein, we present three trial-wise adaptations (running, sliding window and weighted average) of Riemannian geometry-based user-performance metrics (classDistinct reflecting the degree of class separability and classStability reflecting the level of within-class consistency) to enable feedback to the user following each individual trial. We evaluated these metrics, along with conventional classifier feedback, using simulated and previously recorded sensorimotor rhythm-BCI data to assess their correlation with and discrimination of broader trends in user performance. Analysis revealed that the sliding window and weighted average variants of our proposed trial-wise Riemannian geometry-based metrics more accurately reflected performance changes during BCI sessions compared to conventional classifier output. The results indicate the metrics are a viable method for evaluating and tracking user performance changes during BCI-user training and, therefore, further investigation into how these metrics may be presented to users during training is warranted.

Dependence of Brain-Computer Interface Control Training on Personality Traits

Personality traits (PTs) are predictors of the success of control of brain-computer interfaces (BCIs); however, it is unknown how the PTs that are optimal for BCI control changes during training. The paper for the first time analyzes the correlations between PTs and the accuracy of the classification (AC) of brain states in imagining the movements of the hands, feet, and locomotion during 10-day training of ten volunteers in BCI control. In the first 3 days of training, the AC is higher for more stressed and anxious volunteers; in the last days, for calmer ones. In the middle of the training period, AC is higher in low-demonstrativeness persons, it is more pronounced when imagining foot movements. Correlations of low demonstrativeness, as well as of foresight and self-control with AC when imagining foot movements are revealed significantly more often than when imagining hand movements and locomotions. During almost the entire period of training, AC with locomotion imagination is higher in individualists. The results make it possible to propose individually-oriented recommendations for the use of BCI based on the imagination of movements for the rehabilitation of patients with motor disorders.

Brain augmentation and neuroscience technologies: current applications, challenges, ethics and future prospects

Ever since the dawn of antiquity, people have strived to improve their cognitive abilities. From the advent of the wheel to the development of artificial intelligence, technology has had a profound leverage on civilization. Cognitive enhancement or augmentation of brain functions has become a trending topic both in academic and public debates in improving physical and mental abilities. The last years have seen a plethora of suggestions for boosting cognitive functions and biochemical, physical, and behavioral strategies are being explored in the field of cognitive enhancement. Despite expansion of behavioral and biochemical approaches, various physical strategies are known to boost mental abilities in diseased and healthy individuals. Clinical applications of neuroscience technologies offer alternatives to pharmaceutical approaches and devices for diseases that have been fatal, so far. Importantly, the distinctive aspect of these technologies, which shapes their existing and anticipated participation in brain augmentations, is used to compare and contrast them. As a preview of the next two decades of progress in brain augmentation, this article presents a plausible estimation of the many neuroscience technologies, their virtues, demerits, and applications. The review also focuses on the ethical implications and challenges linked to modern neuroscientific technology. There are times when it looks as if ethics discussions are more concerned with the hypothetical than with the factual. We conclude by providing recommendations for potential future studies and development areas, taking into account future advancements in neuroscience innovation for brain enhancement, analyzing historical patterns, considering neuroethics and looking at other related forecasts.

2020 International brain-computer interface competition: A review

The brain-computer interface (BCI) has been investigated as a form of communication tool between the brain and external devices. BCIs have been extended beyond communication and control over the years. The 2020 international BCI competition aimed to provide high-quality neuroscientific data for open access that could be used to evaluate the current degree of technical advances in BCI. Although there are a variety of remaining challenges for future BCI advances, we discuss some of more recent application directions: (i) few-shot EEG learning, (ii) micro-sleep detection (iii) imagined speech decoding, (iv) cross-session classification, and (v) EEG(+ear-EEG) detection in an ambulatory environment. Not only did scientists from the BCI field compete, but scholars with a broad variety of backgrounds and nationalities participated in the competition to address these challenges. Each dataset was prepared and separated into three data that were released to the competitors in the form of training and validation sets followed by a test set. Remarkable BCI advances were identified through the 2020 competition and indicated some trends of interest to BCI researchers.

Does transcranial direct current stimulation enhance cognitive performance in Parkinson's disease mild cognitive impairment? An event-related potentials and neuropsychological assessment study

BACKGROUND

Parkinson's disease-mild cognitive impairment (PD-MCI) is garnering attention as a key interventional period for cognitive impairment. Currently, there are no approved treatments for PD-MCI and encouraging results of transcranial direct current stimulation (tDCS) combined with other interventions have been proposed, though the efficacy and neural mechanisms of tDCS alone have not been studied in PD-MCI yet.

OBJECTIVES

The present double-blind, randomized, sham-controlled study assessed the effects of tDCS over the dorsolateral prefrontal cortex on cognitive functions via neuropsychological and electrophysiological evaluations in individuals with PD-MCI for the first time.

METHOD

Twenty-six individuals with PD-MCI were administered 10 sessions of active (n = 13) or sham (n = 13) prefrontal tDCS twice a day, for 5 days. Changes were tested through a comprehensive neuropsychological battery and event-related potential recordings, which were performed before, immediately, and 1 month after the administrations.

RESULTS

Neuropsychological assessment showed an improvement in delayed recall and executive functions in the active group. N1 amplitudes in response to targets in the oddball test-likely indexing attention and discriminability and NoGo N2 amplitudes in the continuous performance test-likely indexing cognitive control and conflict monitoring increased in the active group. Active stimulation elicited higher benefits 1 month after the administrations.

CONCLUSION

The present findings substantiate the efficacy of tDCS on cognitive control and episodic memory, along with the neural underpinnings of cognitive control, highlighting its potential for therapeutic utility in PD-MCI.

TRIAL REGISTRATION

NCT 04,171,804. Date of registration: 21/11/2019.

Brain-Computer Interface: Advancement and Challenges

Brain-Computer Interface (BCI) is an advanced and multidisciplinary active research domain based on neuroscience, signal processing, biomedical sensors, hardware, etc. Since the last decades, several groundbreaking research has been conducted in this domain. Still, no comprehensive review that covers the BCI domain completely has been conducted yet. Hence, a comprehensive overview of the BCI domain is presented in this study. This study covers several applications of BCI and upholds the significance of this domain. Then, each element of BCI systems, including techniques, datasets, feature extraction methods, evaluation measurement matrices, existing BCI algorithms, and classifiers, are explained concisely. In addition, a brief overview of the technologies or hardware, mostly sensors used in BCI, is appended. Finally, the paper investigates several unsolved challenges of the BCI and explains them with possible solutions.

An Open Source-Based BCI Application for Virtual World Tour and Its Usability Evaluation

Brain-computer interfaces can provide a new communication channel and control functions to people with restricted movements. Recent studies have indicated the effectiveness of brain-computer interface (BCI) applications. Various types of applications have been introduced so far in this field, but the number of those available to the public is still insufficient. Thus, there is a need to expand the usability and accessibility of BCI applications. In this study, we introduce a BCI application for users to experience a virtual world tour. This software was built on three open-source environments and is publicly available through the GitHub repository. For a usability test, 10 healthy subjects participated in an electroencephalography (EEG) experiment and evaluated the system through a questionnaire. As a result, all the participants successfully played the BCI application with 96.6% accuracy with 20 blinks from two sessions and gave opinions on its usability (e.g., controllability, completeness, comfort, and enjoyment) through the questionnaire. We believe that this open-source BCI world tour system can be used in both research and entertainment settings and hopefully contribute to open science in the BCI field.

Success of Hand Movement Imagination Depends on Personality Traits, Brain Asymmetry, and Degree of Handedness

Brain-computer interfaces (BCIs), based on motor imagery, are increasingly used in neurorehabilitation. However, some people cannot control BCI, predictors of this are the features of brain activity and personality traits. It is not known whether the success of BCI control is related to interhemispheric asymmetry. The study was conducted on 44 BCI-naive subjects and included one BCI session, EEG-analysis, 16PF Cattell Questionnaire, estimation of latent left-handedness, and of subjective complexity of real and imagery movements. The success of brain states recognition during imagination of left hand (LH) movement compared to the rest is higher in reserved, practical, skeptical, and not very sociable individuals. Extraversion, liveliness, and dominance are significant for the imagination of right hand (RH) movements in "pure" right-handers, and sensitivity in latent left-handers. Subjective complexity of real LH and of imagery RH movements correlates with the success of brain states recognition in the imagination of movement of LH compared to RH and depends on the level of handedness. Thus, the level of handedness is the factor influencing the success of BCI control. The data are supposed to be connected with hemispheric differences in motor control, lateralization of dopamine, and may be important for rehabilitation of patients after a stroke.

Handedness effects on motor imagery during kinesthetic and visual-motor conditions

Recent studies show that during a simple movement imagery task, the power of sensorimotor rhythms differs according to handedness. However, the effects of motor imagery perspectives on these differences have not been investigated yet. Our study aimed to check how handedness impacts the activity of alpha (8-13 Hz) and beta (15-30 Hz) oscillations during creating a kinesthetic (KMI) or visual-motor (VMI) representation of movement. Forty subjects (20 right-handed and 20 left-handed) who participated in the experiment were tasked with imagining sequential finger movement from a visual or kinesthetic perspective. Both the electroencephalographic (EEG) activity and behavioral correctness of the imagery task performance were measured. After the registration, we used independent component analysis (ICA) on EEG data to localize visual- and motor-related EEG sources of activity shared by both motor imagery conditions. Significant differences were obtained in the visual cortex (the occipital ICs cluster) and the right motor-related area (right parietal ICs cluster). In comparison to right-handers who, regardless of the task, demonstrated the same pattern in the visual area, left-handers obtained higher power in the alpha waves in the VMI task and better performance in this condition. On the other hand, only the right-handed showed different patterns in the alpha waves in the right motor cortex during the KMI condition. The results indicate that left-handers imagine movement differently than right-handers, focusing on visual experience. This provides new empirical evidence on the influence of movement preferences on imagery processes and has possible future implications for research in the area of neurorehabilitation and motor imagery-based brain-computer interfaces (MI-BCIs).

Benefits of deep learning classification of continuous noninvasive brain-computer interface control

Objective. Noninvasive brain-computer interfaces (BCIs) assist paralyzed patients by providing access to the world without requiring surgical intervention. Prior work has suggested that EEG motor imagery based BCI can benefit from increased decoding accuracy through the application of deep learning methods, such as convolutional neural networks (CNNs).Approach. Here, we examine whether these improvements can generalize to practical scenarios such as continuous control tasks (as opposed to prior work reporting one classification per trial), whether valuable information remains latent outside of the motor cortex (as no prior work has compared full scalp coverage to motor only electrode montages), and the existing challenges to the practical implementation of deep-learning based continuous BCI control.Main results. We report that: (1) deep learning methods significantly increase offline performance compared to standard methods on an independent, large, and longitudinal online motor imagery BCI dataset with up to 4-classes and continuous 2D feedback; (2) our results suggest that a variety of neural biomarkers for BCI, including those outside the motor cortex, can be detected and used to improve performance through deep learning methods, and (3) tuning neural network output will be an important step in optimizing online BCI control, as we found the CNN models trained with full scalp EEG also significantly reduce the average trial length in a simulated online cursor control environment.Significance. This work demonstrates the benefits of CNNs classification during BCI control while providing evidence that electrode montage selection and the mapping of CNN output to device control will be important design choices in CNN based BCIs.

Classification of Relaxation and Concentration Mental States with EEG

In this paper, we study the use of EEG (Electroencephalography) to classify between concentrated and relaxed mental states. In the literature, most EEG recording systems are expensive, medical-graded devices. The expensive devices limit the availability in a consumer market. The EEG signals are obtained from a toy-grade EEG device with one channel of output data. The experiments are conducted in two runs, with 7 and 10 subjects, respectively. Each subject is asked to silently recite a five-digit number backwards given by the tester. The recorded EEG signals are converted to time-frequency representations by the software accompanying the device. A simple average is used to aggregate multiple spectral components into EEG bands, such as α, β, and γ bands. The chosen classifiers are SVM (support vector machine) and multi-layer feedforward network trained individually for each subject. Experimental results show that features, with α+β+γ bands and bandwidth 4 Hz, the average accuracy over all subjects in both runs can reach more than 80% and some subjects up to 90+% with the SVM classifier. The results suggest that a brain machine interface could be implemented based on the mental states of the user even with the use of a cheap EEG device.

Optimizing Motor Intention Detection With Deep Learning: Towards Management of Intraoperative Awareness

OBJECTIVE

This article shows the interest in deep learning techniques to detect motor imagery (MI) from raw electroencephalographic (EEG) signals when a functional electrical stimulation is added or not. Impacts of electrode montages and bandwidth are also reported. The perspective of this work is to improve the detection of intraoperative awareness during general anesthesia.

METHODS

Various architectures of EEGNet were investigated to optimize MI detection. They have been compared to the state-of-the-art classifiers in Brain-Computer Interfaces (based on Riemannian geometry, linear discriminant analysis), and other deep learning architectures (deep convolution network, shallow convolutional network). EEG data were measured from 22 participants performing motor imagery with and without median nerve stimulation.

RESULTS

The proposed architecture of EEGNet reaches the best classification accuracy (83.2%) and false-positive rate (FPR 19.0%) for a setup with only six electrodes over the motor cortex and frontal lobe and for an extended 4-38 Hz EEG frequency range while the subject is being stimulated via a median nerve. Configurations with a larger number of electrodes result in higher accuracy (94.5%) and FPR (6.1%) for 128 electrodes (and respectively 88.0% and 12.9% for 13 electrodes).

CONCLUSION

The present work demonstrates that using an extended EEG frequency band and a modified EEGNet deep neural network increases the accuracy of MI detection when used with as few as 6 electrodes which include frontal channels.

SIGNIFICANCE

The proposed method contributes to the development of Brain-Computer Interface systems based on MI detection from EEG.

Subject inefficiency phenomenon of motor imagery brain-computer interface: Influence factors and potential solutions

Motor imagery brain–computer interfaces (MI‐BCIs) have great potential value in prosthetics control, neurorehabilitation, and gaming; however, currently, most such systems only operate in controlled laboratory environments. One of the most important obstacles is the MI‐BCI inefficiency phenomenon. The accuracy of MI‐BCI control varies significantly (from chance level to 100% accuracy) across subjects due to the not easily induced and unstable MI‐related EEG features. An MI‐BCI inefficient subject is defined as a subject who cannot achieve greater than 70% accuracy after sufficient training time, and multiple survey results indicate that inefficient subjects account for 10%–50% of the experimental population. The widespread use of MI‐BCI has been seriously limited due to these large percentages of inefficient subjects. In this review, we summarize recent findings of the cause of MI‐BCI inefficiency from resting‐state brain function, task‐related brain activity, brain structure, and psychological perspectives. These factors help understand the reasons for inter‐subject MI‐BCI control performance variability, and it can be concluded that the lower resting‐state sensorimotor rhythm (SMR) is the key factor in MI‐BCI inefficiency, which has been confirmed by multiple independent laboratories. We then propose to divide MI‐BCI inefficient subjects into three categories according to the resting‐state SMR and offline/online accuracy to apply more accurate approaches to solve the inefficiency problem. The potential solutions include developing transfer learning algorithms, new experimental paradigms, mindfulness meditation practice, novel training strategies, and identifying new motor imagery‐related EEG features. To date, few studies have focused on improving the control accuracy of MI‐BCI inefficient subjects; thus, we appeal to the BCI community to focus more on this research area. Only by reducing the percentage of inefficient subjects can we create the opportunity to expand the value and influence of MI‐BCI.

Elucidation of EEG Characteristics of Fuzzy Reasoning-Based Heuristic BCI and Its Application to Patient With Brain Infarction

Non-invasive brain–computer interfaces (BCIs) based on common electroencephalography (EEG) are limited to specific instrumentation sites and frequency bands. These BCI induce certain targeted electroencephalographic features of cognitive tasks, identify them, and determine BCI's performance, and use machine-learning to extract these electroencephalographic features, which makes them enormously time-consuming. In addition, there is a problem in which the neurorehabilitation using BCI cannot receive ambulatory and immediate rehabilitation training. Therefore, we proposed an exploratory BCI that did not limit the targeted electroencephalographic features. This system did not determine the electroencephalographic features in advance, determined the frequency bands and measurement sites appropriate for detecting electroencephalographic features based on their target movements, measured the electroencephalogram, created each rule (template) with only large “High” or small “Low” electroencephalograms for arbitrarily determined thresholds (classification of cognitive tasks in the imaginary state of moving the feet by the size of the area constituted by the power spectrum of the EEG in each frequency band), and successfully detected the movement intention by detecting the electroencephalogram consistent with the rules during motor tasks using a fuzzy inference-based template matching method (FTM). However, the electroencephalographic features acquired by this BCI are not known, and their usefulness for patients with actual cerebral infarction is not known. Therefore, this study clarifies the electroencephalographic features captured by the heuristic BCI, as well as clarifies the effectiveness and challenges of this system by its application to patients with cerebral infarction.

Sensorimotor Functional Connectivity: A Neurophysiological Factor Related to BCI Performance

Brain-Computer Interfaces (BCIs) are systems that allow users to control devices using brain activity alone. However, the ability of participants to command BCIs varies from subject to subject. About 20% of potential users of sensorimotor BCIs do not gain reliable control of the system. The inefficiency to decode user's intentions requires the identification of neurophysiological factors determining “good” and “poor” BCI performers. One of the important neurophysiological aspects in BCI research is that the neuronal oscillations, used to control these systems, show a rich repertoire of spatial sensorimotor interactions. Considering this, we hypothesized that neuronal connectivity in sensorimotor areas would define BCI performance. Analyses for this study were performed on a large dataset of 80 inexperienced participants. They took part in a calibration and an online feedback session recorded on the same day. Undirected functional connectivity was computed over sensorimotor areas by means of the imaginary part of coherency. The results show that post- as well as pre-stimulus connectivity in the calibration recording is significantly correlated to online feedback performance in μ and feedback frequency bands. Importantly, the significance of the correlation between connectivity and BCI feedback accuracy was not due to the signal-to-noise ratio of the oscillations in the corresponding post and pre-stimulus intervals. Thus, this study demonstrates that BCI performance is not only dependent on the amplitude of sensorimotor oscillations as shown previously, but that it also relates to sensorimotor connectivity measured during the preceding training session. The presence of such connectivity between motor and somatosensory systems is likely to facilitate motor imagery, which in turn is associated with the generation of a more pronounced modulation of sensorimotor oscillations (manifested in ERD/ERS) required for the adequate BCI performance. We also discuss strategies for the up-regulation of such connectivity in order to enhance BCI performance.

Bispectrum-Based Channel Selection for Motor Imagery Based Brain-Computer Interfacing

The performance of motor imagery (MI) based Brain-computer interfacing (BCI) is easily affected by noise and redundant information that exists in the multi-channel electroencephalogram (EEG). To solve this problem, many temporal and spatial feature based channel selection methods have been proposed. However, temporal and spatial features do not accurately reflect changes in the power of the oscillatory EEG. Thus, spectral features of MI-related EEG signals may be useful for channel selection. Bispectrum analysis is a technique developed for extracting non-linear and non-Gaussian information from non-linear and non-Gaussian signals. The features extracted from bispectrum analysis can provide frequency domain information about the EEG. Therefore, in this study, we propose a bispectrum-based channel selection (BCS) method for MI-based BCI. The proposed method uses the sum of logarithmic amplitudes (SLA) and the first order spectral moment (FOSM) features extracted from bispectrum analysis to select EEG channels without redundant information. Three public BCI competition datasets (BCI competition IV dataset 1, BCI competition III dataset IVa and BCI competition III dataset IIIa) were used to validate the effectiveness of our proposed method. The results indicate that our BCS method outperforms use of all channels (83.8% vs 69.4%, 86.3% vs 82.9% and 77.8% vs 68.2%, respectively). Furthermore, compared to the other state-of-the-art methods, our BCS method also can achieve significantly better classification accuracies for MI-based BCI (Wilcoxon signed test, p < 0.05).

Entropy-Based Estimation of Event-Related De/Synchronization in Motor Imagery Using Vector-Quantized Patterns

Assessment of brain dynamics elicited by motor imagery (MI) tasks contributes to clinical and learning applications. In this regard, Event-Related Desynchronization/Synchronization (ERD/S) is computed from Electroencephalographic signals, which show considerable variations in complexity. We present an Entropy-based method, termed VQEnt, for estimation of ERD/S using quantized stochastic patterns as a symbolic space, aiming to improve their discriminability and physiological interpretability. The proposed method builds the probabilistic priors by assessing the Gaussian similarity between the input measured data and their reduced vector-quantized representation. The validating results of a bi-class imagine task database (left and right hand) prove that VQEnt holds symbols that encode several neighboring samples, providing similar or even better accuracy than the other baseline sample-based algorithms of Entropy estimation. Besides, the performed ERD/S time-series are close enough to the trajectories extracted by the variational percentage of EEG signal power and fulfill the physiological MI paradigm. In BCI literate individuals, the VQEnt estimator presents the most accurate outcomes at a lower amount of electrodes placed in the sensorimotor cortex so that reduced channel set directly involved with the MI paradigm is enough to discriminate between tasks, providing an accuracy similar to the performed by the whole electrode set.

Induced Gamma-Band Activity during Actual and Imaginary Movements: EEG Analysis

The purpose of this paper is to record and analyze induced gamma-band activity (GBA) (30-60 Hz) in cerebral motor areas during imaginary movement and to compare it quantitatively with activity recorded in the same areas during actual movement using a simplified electroencephalogram (EEG). Brain activity (basal activity, imaginary motor task and actual motor task) is obtained from 12 healthy volunteer subjects using an EEG (Cz channel). GBA is analyzed using the mean power spectral density (PSD) value. Event-related synchronization (ERS) is calculated from the PSD values of the basal GBA (GBAb), the GBA of the imaginary movement (GBAim) and the GBA of the actual movement (GBAac). The mean GBAim and GBAac values for the right and left hands are significantly higher than the GBAb value (p = 0.007). No significant difference is detected between mean GBA values during the imaginary and actual movement (p = 0.242). The mean ERS values for the imaginary movement (ERSimM (%) = 23.52) and for the actual movement (ERSacM = 27.47) do not present any significant difference (p = 0.117). We demonstrated that ERS could provide a useful way of indirectly checking the function of neuronal motor circuits activated by voluntary movement, both imaginary and actual. These results, as a proof of concept, could be applied to physiology studies, brain-computer interfaces, and diagnosis of cognitive or motor pathologies.

Emotion-Inducing Imagery Versus Motor Imagery for a Brain-Computer Interface

Neural correlates of intentionally induced human emotions may offer alternative imagery strategies to control brain-computer interface (BCI) applications. In this paper, a novel BCI control strategy i.e., imagining fictional or recalling mnemonic sad and happy events, emotion-inducing imagery (EII), is compared to motor imagery (MI) in a study involving multiple sessions using a two-class electroencephalogram (EEG)-based BCI paradigm with 12 participants. The BCI setup enabled online continuous visual feedback presentation in a game involving one-dimensional control of a game character. MI and EII are compared across different signal-processing frameworks which are based on neural-time-series-prediction-preprocessing (NTSPP), filter bank common spatial patterns (FBCSP) and hemispheric asymmetry (ASYM). Online single-trial classification accuracies (CA) results indicate that MI performance across all participants is 77.54% compared to EII performance of 68.78% ( ). The results show that an ensemble of the NTSPP, FBCSP and ASYM frameworks maximizes performance for EII with average CA of 71.64% across all participants. Furthermore, the participants' subjective responses indicate that they preferred MI over emotion-inducing imagery (EII) in controlling the game character, and MI was perceived to offer most control over the game character. The results suggest that EII is not a viable alternative to MI for the majority of participants in this study but may be an alternative imagery for a subset of BCI users based on acceptable EII performance (CA >70%) observed for some participants.

Functional disconnection of associative cortical areas predicts performance during BCI training

Brain-computer interfaces (BCIs) have been largely developed to allow communication, control, and neurofeedback in human beings. Despite their great potential, BCIs perform inconsistently across individuals and the neural processes that enable humans to achieve good control remain poorly understood. To address this question, we performed simultaneous high-density electroencephalographic (EEG) and magnetoencephalographic (MEG) recordings in a motor imagery-based BCI training involving a group of healthy subjects. After reconstructing the signals at the cortical level, we showed that the reinforcement of motor-related activity during the BCI skill acquisition is paralleled by a progressive disconnection of associative areas which were not directly targeted during the experiments. Notably, these network connectivity changes reflected growing automaticity associated with BCI performance and predicted future learning rate. Altogether, our findings provide new insights into the large-scale cortical organizational mechanisms underlying BCI learning, which have implications for the improvement of this technology in a broad range of real-life applications.

Neural Decoding of Multi-Modal Imagery Behavior Focusing on Temporal Complexity

Mental imagery behaviors of various modalities include visual, auditory, and motor behaviors. Their alterations are pathologically involved in various psychiatric disorders. Results of earlier studies suggest that imagery behaviors are correlated with the modulated activities of the respective modality-specific regions and the additional activities of supramodal imagery-related regions. Additionally, despite the availability of complexity analysis in the neuroimaging field, it has not been used for neural decoding approaches. Therefore, we sought to characterize neural oscillation related to multimodal imagery through complexity-based neural decoding. For this study, we modified existing complexity measures to characterize the time evolution of temporal complexity. We took magnetoencephalography (MEG) data of eight healthy subjects as they performed multimodal imagery and non-imagery tasks. The MEG data were decomposed into amplitude and phase of sub-band frequencies by Hilbert-Huang transform. Subsequently, we calculated the complexity values of each reconstructed time series, along with raw data and band power for comparison, and applied these results as inputs to decode visual perception (VP), visual imagery (VI), motor execution (ME), and motor imagery (MI) functions. Consequently, intra-subject decoding with the complexity yielded a characteristic sensitivity map for each task with high decoding accuracy. The map is inverted in the occipital regions between VP and VI and in the central regions between ME and MI. Additionally, replacement of the labels into two classes as imagery and non-imagery also yielded better classification performance and characteristic sensitivity with the complexity. It is particularly interesting that some subjects showed characteristic sensitivities not only in modality-specific regions, but also in supramodal regions. These analyses indicate that two-class and four-class classifications each provided better performance when using complexity than when using raw data or band power as input. When inter-subject decoding was used with the same model, characteristic sensitivity maps were also obtained, although their decoding performance was lower. Results of this study underscore the availability of complexity measures in neural decoding approaches and suggest the possibility of a modality-independent imagery-related mechanism. The use of time evolution of temporal complexity in neural decoding might extend our knowledge of the neural bases of hierarchical functions in the human brain.

Correlation-based channel selection and regularized feature optimization for MI-based BCI

Multi-channel EEG data are usually necessary for spatial pattern identification in motor imagery (MI)-based brain computer interfaces (BCIs). To some extent, signals from some channels containing redundant information and noise may degrade BCI performance. We assume that the channels related to MI should contain common information when participants are executing the MI tasks. Based on this hypothesis, a correlation-based channel selection (CCS) method is proposed to select the channels that contained more correlated information in this study. The aim is to improve the classification performance of MI-based BCIs. Furthermore, a novel regularized common spatial pattern (RCSP) method is used to extract effective features. Finally, a support vector machine (SVM) classifier with the Radial Basis Function (RBF) kernel is trained to accurately identify the MI tasks. An experimental study is implemented on three public EEG datasets (BCI competition IV dataset 1, BCI competition III dataset IVa and BCI competition III dataset IIIa) to validate the effectiveness of the proposed methods. The results show that the CCS algorithm obtained superior classification accuracy (78% versus 56.4% for dataset1, 86.6% versus 76.5% for dataset 2 and 91.3% versus 85.1% for dataset 3) compared to the algorithm using all channels (AC), when CSP is used to extract the features. Furthermore, RCSP could further improve the classification accuracy (81.6% for dataset1, 87.4% for dataset2 and 91.9% for dataset 3), when CCS is used to select the channels.

Direct Interaction on Specific Frequency Bands in Functional Corticomuscular Coupling

OBJECTIVE

Direct interaction between the brain and muscle is significant for investigating the oscillation mechanisms in the motor control system.

METHODS

To our knowledge, the partial directed coherence (PDC) method is sufficient to reflect the direct interaction among multivariate time series in the frequency domain, but fails to eliminate the spectral overlap among frequency bands. Therefore, we expanded the PDC method and constructed a novel method, named variational-mode-decomposition-based PDC (VMDPDC), to describe the direct interaction on specific frequency bands.

RESULTS

To verify this, we made a comparison with the Granger causality (GC), PDC, and FIR-based PDC (FIRPDC) methods in two numerical models (bivariate coupling model and multivariate coupling model). After that, we applied this method to analyze the functional corticomuscular coupling (FCMC) during steady-state grip task. Simulation results showed that, compared with the GC, PDC, and FIRPDC methods, the VMDPDC method could accurately detect the direct interaction on specific frequency bands. The results on experimental data showed that the direct interaction in FCMC mainly focused on the alpha (8-15 Hz), beta (15-35 Hz), and gamma (35-60 Hz) bands. Further analysis demonstrated that the coupling strength in descending direction was significantly higher than that in the opposite direction.

CONCLUSION

Both simulation and experimental results indicated that the proposed method could effectively describe the direct interaction on specific frequency bands.

SIGNIFICANCE

This study also provides a theoretical foundation for further exploration on the mechanism of the motor control.

Exploring Training Effect in 42 Human Subjects Using a Non-invasive Sensorimotor Rhythm Based Online BCI

Electroencephalography based brain-computer interfaces (BCIs) show promise of providing an alternative communication channel between the brain and an external device. It is well acknowledged that BCI control is a skill and could be improved through practice and training. In this study, we explore the change of BCI behavioral performance as well as the electrophysiological properties across three training sessions in a pool of 42 human subjects. Our results show that the group average of BCI accuracy and the information transfer rate improved significantly in the third session compared to the first session; especially the significance reached in a smaller subset of a low BCI performance group (average accuracy <70%) as well. There was a significant difference of event-related desynchronization (ERD) lateralization for BCI control between the left- and right-hand imagination task in the last two sessions, but this significant difference was not revealed in the first training sessions. No significant change of R 2 value or event-related desynchronization and synchronization (ERD/ERS) for either channel C3 or channel C4, which were used for online control, was found across the training sessions. The change of ERD lateralization was also not significant across the training sessions. The present results indicate that BCI training could induce a change of behavioral performance and electrophysiological properties quickly, within just a few hours of training, distributed into three sessions. Multiple training sessions might especially be beneficial for the low BCI performers.

Does Fractional Anisotropy Predict Motor Imagery Neurofeedback Performance in Healthy Older Adults?

Motor imagery neurofeedback training has been proposed as a potential add-on therapy for motor impairment after stroke, but not everyone benefits from it. Previous work has used white matter integrity to predict motor imagery neurofeedback aptitude in healthy young adults. We set out to test this approach with motor imagery neurofeedback that is closer to that used for stroke rehabilitation and in a sample whose age is closer to that of typical stroke patients. Using shrinkage linear discriminant analysis with fractional anisotropy values in 48 white matter regions as predictors, we predicted whether each participant in a sample of 21 healthy older adults (48–77 years old) was a good or a bad performer with 84.8% accuracy. However, the regions used for prediction in our sample differed from those identified previously, and previously suggested regions did not yield significant prediction in our sample. Including demographic and cognitive variables which may correlate with motor imagery neurofeedback performance and white matter structure as candidate predictors revealed an association with age but also led to loss of statistical significance and somewhat poorer prediction accuracy (69.6%). Our results suggest cast doubt on the feasibility of predicting the benefit of motor imagery neurofeedback from fractional anisotropy. At the very least, such predictions should be based on data collected using the same paradigm and with subjects whose characteristics match those of the target case as closely as possible.

Neurotechnologies for Human Cognitive Augmentation: Current State of the Art and Future Prospects

Recent advances in neuroscience have paved the way to innovative applications that cognitively augment and enhance humans in a variety of contexts. This paper aims at providing a snapshot of the current state of the art and a motivated forecast of the most likely developments in the next two decades. Firstly, we survey the main neuroscience technologies for both observing and influencing brain activity, which are necessary ingredients for human cognitive augmentation. We also compare and contrast such technologies, as their individual characteristics (e.g., spatio-temporal resolution, invasiveness, portability, energy requirements, and cost) influence their current and future role in human cognitive augmentation. Secondly, we chart the state of the art on neurotechnologies for human cognitive augmentation, keeping an eye both on the applications that already exist and those that are emerging or are likely to emerge in the next two decades. Particularly, we consider applications in the areas of communication, cognitive enhancement, memory, attention monitoring/enhancement, situation awareness and complex problem solving, and we look at what fraction of the population might benefit from such technologies and at the demands they impose in terms of user training. Thirdly, we briefly review the ethical issues associated with current neuroscience technologies. These are important because they may differentially influence both present and future research on (and adoption of) neurotechnologies for human cognitive augmentation: an inferior technology with no significant ethical issues may thrive while a superior technology causing widespread ethical concerns may end up being outlawed. Finally, based on the lessons learned in our analysis, using past trends and considering other related forecasts, we attempt to forecast the most likely future developments of neuroscience technology for human cognitive augmentation and provide informed recommendations for promising future research and exploitation avenues.

A large scale screening study with a SMR-based BCI: Categorization of BCI users and differences in their SMR activity

Brain-Computer Interfaces (BCIs) are inefficient for a non-negligible part of the population, estimated around 25%. To understand this phenomenon in Sensorimotor Rhythm (SMR) based BCIs, data from a large-scale screening study conducted on 80 novice participants with the Berlin BCI system and its standard machine-learning approach were investigated. Each participant performed one BCI session with resting state Encephalography, Motor Observation, Motor Execution and Motor Imagery recordings and 128 electrodes. A significant portion of the participants (40%) could not achieve BCI control (feedback performance > 70%). Based on the performance of the calibration and feedback runs, BCI users were stratified in three groups. Analyses directed to detect and elucidate the differences in the SMR activity of these groups were performed. Statistics on reactive frequencies, task prevalence and classification results are reported. Based on their SMR activity, also a systematic list of potential reasons leading to performance drops and thus hints for possible improvements of BCI experimental design are given. The categorization of BCI users has several advantages, allowing researchers 1) to select subjects for further analyses as well as for testing new BCI paradigms or algorithms, 2) to adopt a better subject-dependent training strategy and 3) easier comparisons between different studies.

Neurophysiological predictors and spectro-spatial discriminative features for enhancing SMR-BCI

Neural engineering research is actively engaged in optimizing the robustness of sensorimotor rhythms (SMR)-brain-computer interface (BCI) to boost its potential real-world use.

OBJECTIVE

This paper investigates two vital factors in efficient and robust SMR-BCI design-algorithms that address subject-variability of optimal features and neurophysiological factors that correlate with BCI performance. Existing SMR-BCI research using electroencephalogram (EEG) to classify bilateral motor imagery (MI) focus on identifying subject-specific frequency bands with most discriminative motor patterns localized to sensorimotor region.

APPROACH

A novel strategy to further optimize BCI performance by taking into account the variability of discriminative spectral regions across various EEG channels is proposed in this paper.

MAIN RESULTS

The proposed technique results in a significant ([Formula: see text]) increase in average ([Formula: see text]) classification accuracy by [Formula: see text] accompanied by a considerable reduction in number of channels and bands. The session-to-session transfer variation in spectro-spatial patterns using proposed algorithm is investigated offline and classification performance of the optimized BCI model is successfully evaluated in an online SMR-BCI. Further, the effective prediction of SMR-BCI performance with physiological indicators derived from multi-channel resting-state EEG is demonstrated. The results indicate that the resting state activation patterns such as entropy and gamma power from pre-motor (fronto-central) and posterior (parietal and centro-parietal) areas, and beta power from posterior (centro-parietal) areas estimate BCI performance with minimum error. These patterns, strongly related to BCI performance, may represent certain cognitive states during rest.

SIGNIFICANCE

Findings reported in this paper imply the need for subject-specific modelling of BCI and the prediction of BCI performance using multi-channel rest-state parameters, to ensure enhanced BCI performance.

Fast Recognition of BCI-Inefficient Users Using Physiological Features from EEG Signals: A Screening Study of Stroke Patients

Motor imagery (MI) based brain-computer interface (BCI) has been developed as an alternative therapy for stroke rehabilitation. However, experimental evidence demonstrates that a significant portion (10-50%) of subjects are BCI-inefficient users (accuracy less than 70%). Thus, predicting BCI performance prior to clinical BCI usage would facilitate the selection of suitable end-users and improve the efficiency of stroke rehabilitation. In the current study, we proposed two physiological variables, i.e., laterality index (LI) and cortical activation strength (CAS), to predict MI-BCI performance. Twenty-four stroke patients and 10 healthy subjects were recruited for this study. Each subject was required to perform two blocks of left- and right-hand MI tasks. Linear regression analyses were performed between the BCI accuracies and two physiological predictors. Here, the predictors were calculated from the electroencephalography (EEG) signals during paretic hand MI tasks (5 trials; approximately 1 min). LI values exhibited a statistically significant correlation with two-class BCI (left vs. right) performance (r = -0.732, p < 0.001), and CAS values exhibited a statistically significant correlation with brain-switch BCI (task vs. idle) performance (r = 0.641, p < 0.001). Furthermore, the BCI-inefficient users were successfully recognized with a sensitivity of 88.2% and a specificity of 85.7% in the two-class BCI. The brain-switch BCI achieved a sensitivity of 100.0% and a specificity of 87.5% in the discrimination of BCI-inefficient users. These results demonstrated that the proposed BCI predictors were promising to promote the BCI usage in stroke rehabilitation and contribute to a better understanding of the BCI-inefficiency phenomenon in stroke patients.

User's Self-Prediction of Performance in Motor Imagery Brain-Computer Interface

Performance variation is a critical issue in motor imagery brain–computer interface (MI-BCI), and various neurophysiological, psychological, and anatomical correlates have been reported in the literature. Although the main aim of such studies is to predict MI-BCI performance for the prescreening of poor performers, studies which focus on the user’s sense of the motor imagery process and directly estimate MI-BCI performance through the user’s self-prediction are lacking. In this study, we first test each user’s self-prediction idea regarding motor imagery experimental datasets. Fifty-two subjects participated in a classical, two-class motor imagery experiment and were asked to evaluate their easiness with motor imagery and to predict their own MI-BCI performance. During the motor imagery experiment, an electroencephalogram (EEG) was recorded; however, no feedback on motor imagery was given to subjects. From EEG recordings, the offline classification accuracy was estimated and compared with several questionnaire scores of subjects, as well as with each subject’s self-prediction of MI-BCI performance. The subjects’ performance predictions during motor imagery task showed a high positive correlation (r = 0.64, p < 0.01). Interestingly, it was observed that the self-prediction became more accurate as the subjects conducted more motor imagery tasks in the Correlation coefficient (pre-task to 2nd run: r = 0.02 to r = 0.54, p < 0.01) and root mean square error (pre-task to 3rd run: 17.7% to 10%, p < 0.01). We demonstrated that subjects may accurately predict their MI-BCI performance even without feedback information. This implies that the human brain is an active learning system and, by self-experiencing the endogenous motor imagery process, it can sense and adopt the quality of the process. Thus, it is believed that users may be able to predict MI-BCI performance and results may contribute to a better understanding of low performance and advancing BCI.

EEG-Based Brain-Computer Interfaces for Communication and Rehabilitation of People with Motor Impairment: A Novel Approach of the 21 st Century

People with severe neurological impairments face many challenges in sensorimotor functions and communication with the environment; therefore they have increased demand for advanced, adaptive and personalized rehabilitation. During the last several decades, numerous studies have developed brain-computer interfaces (BCIs) with the goals ranging from providing means of communication to functional rehabilitation. Here we review the research on non-invasive, electroencephalography (EEG)-based BCI systems for communication and rehabilitation. We focus on the approaches intended to help severely paralyzed and locked-in patients regain communication using three different BCI modalities: slow cortical potentials, sensorimotor rhythms and P300 potentials, as operational mechanisms. We also review BCI systems for restoration of motor function in patients with spinal cord injury and chronic stroke. We discuss the advantages and limitations of these approaches and the challenges that need to be addressed in the future.

A Comparative Study on the Detection of Covert Attention in Event-Related EEG and MEG Signals to Control a BCI

In brain-computer interface (BCI) applications the detection of neural processing as revealed by event-related potentials (ERPs) is a frequently used approach to regain communication for people unable to interact through any peripheral muscle control. However, the commonly used electroencephalography (EEG) provides signals of low signal-to-noise ratio, making the systems slow and inaccurate. As an alternative noninvasive recording technique, the magnetoencephalography (MEG) could provide more advantageous electrophysiological signals due to a higher number of sensors and the magnetic fields not being influenced by volume conduction. We investigated whether MEG provides higher accuracy in detecting event-related fields (ERFs) compared to detecting ERPs in simultaneously recorded EEG, both evoked by a covert attention task, and whether a combination of the modalities is advantageous. In our approach, a detection algorithm based on spatial filtering is used to identify ERP/ERF components in a data-driven manner. We found that MEG achieves higher decoding accuracy (DA) compared to EEG and that the combination of both further improves the performance significantly. However, MEG data showed poor performance in cross-subject classification, indicating that the algorithm's ability for transfer learning across subjects is better in EEG. Here we show that BCI control by covert attention is feasible with EEG and MEG using a data-driven spatial filter approach with a clear advantage of the MEG regarding DA but with a better transfer learning in EEG.

Interbrain phase synchronization during turn-taking verbal interaction-a hyperscanning study using simultaneous EEG/MEG

Recently, neurophysiological findings about social interaction have been investigated widely, and hardware has been developed that can measure multiple subjects' brain activities simultaneously. These hyperscanning studies have enabled us to discover new and important evidences of interbrain interactions. Yet, very little is known about verbal interaction without any visual input. Therefore, we conducted a new hyperscanning study based on verbal, interbrain turn-taking interaction using simultaneous EEG/MEG, which measures rapidly changing brain activities. To establish turn-taking verbal interactions between a pair of subjects, we set up two EEG/MEG systems (19 and 146 channels of EEG and MEG, respectively) located ∼100 miles apart. Subjects engaged in verbal communication via condenser microphones and magnetic-compatible earphones, and a network time protocol synchronized the two systems. Ten subjects participated in this experiment and performed verbal interaction and noninteraction tasks separately. We found significant oscillations in EEG alpha and MEG alpha/gamma bands in several brain regions for all subjects. Furthermore, we estimated phase synchronization between two brains using the weighted phase lag index and found statistically significant synchronization in EEG and MEG data. Our novel paradigm and neurophysiological findings may foster a basic understanding of the functional mechanisms involved in human social interactions. Hum Brain Mapp 39:171-188, 2018. © 2017 Wiley Periodicals, Inc.

Utilization of a combined EEG/NIRS system to predict driver drowsiness

The large number of automobile accidents due to driver drowsiness is a critical concern of many countries. To solve this problem, numerous methods of countermeasure have been proposed. However, the results were unsatisfactory due to inadequate accuracy of drowsiness detection. In this study, we introduce a new approach, a combination of EEG and NIRS, to detect driver drowsiness. EEG, EOG, ECG and NIRS signals have been measured during a simulated driving task, in which subjects underwent both awake and drowsy states. The blinking rate, eye closure, heart rate, alpha and beta band power were used to identify subject's condition. Statistical tests were performed on EEG and NIRS signals to find the most informative parameters. Fisher's linear discriminant analysis method was employed to classify awake and drowsy states. Time series analysis was used to predict drowsiness. The oxy-hemoglobin concentration change and the beta band power in the frontal lobe were found to differ the most between the two states. In addition, these two parameters correspond well to an awake to drowsy state transition. A sharp increase of the oxy-hemoglobin concentration change, together with a dramatic decrease of the beta band power, happened several seconds before the first eye closure.

Heading for new shores! Overcoming pitfalls in BCI design

Research in brain-computer interfaces has achieved impressive progress towards implementing assistive technologies for restoration or substitution of lost motor capabilities, as well as supporting technologies for able-bodied subjects. Notwithstanding this progress, effective translation of these interfaces from proof-of concept prototypes into reliable applications remains elusive. As a matter of fact, most of the current BCI systems cannot be used independently for long periods of time by their intended end-users. Multiple factors that impair achieving this goal have already been identified. However, it is not clear how do they affect the overall BCI performance or how they should be tackled. This is worsened by the publication bias where only positive results are disseminated, preventing the research community from learning from its errors. This paper is the result of a workshop held at the 6th International BCI meeting in Asilomar. We summarize here the discussion on concrete research avenues and guidelines that may help overcoming common pitfalls and make BCIs become a useful alternative communication device.

Long-Term Stable Control of Motor-Imagery BCI by a Locked-In User Through Adaptive Assistance

Performance variation is one of the main challenges that BCIs are confronted with, when being used over extended periods of time. Shared control techniques could partially cope with such a problem. In this paper, we propose a taxonomy of shared control approaches used for BCIs and we review some of the recent studies at the light of these approaches. We posit that the level of assistance provided to the BCI user should be adjusted in real time in order to enhance BCI reliability over time. This approach has not been extensively studied in the recent literature on BCIs. In addition, we investigate the effectiveness of providing online adaptive assistance in a motor-imagery BCI for a tetraplegic end-user with an incomplete locked-in syndrome in a longitudinal study lasting 11 months. First, we report a reliable estimation of the BCI performance (in terms of command delivery time) using only a window of 1 s in the beginning of trials (AUC ≈ 0.8 ). Second, we demonstrate how adaptive shared control can exploit the output of the performance estimator to adjust online the level of assistance in a BCI game by regulating its speed. In particular, online adaptive assistance was superior to a fixed condition in terms of success rate ( ). Remarkably, the results exhibited a stable performance over severalmonths without recalibration of the BCI classifier or the performance estimator.

Neurofeedback Therapy for Enhancing Visual Attention: State-of-the-Art and Challenges

We have witnessed a rapid development of brain-computer interfaces (BCIs) linking the brain to external devices. BCIs can be utilized to treat neurological conditions and even to augment brain functions. BCIs offer a promising treatment for mental disorders, including disorders of attention. Here we review the current state of the art and challenges of attention-based BCIs, with a focus on visual attention. Attention-based BCIs utilize electroencephalograms (EEGs) or other recording techniques to generate neurofeedback, which patients use to improve their attention, a complex cognitive function. Although progress has been made in the studies of neural mechanisms of attention, extraction of attention-related neural signals needed for BCI operations is a difficult problem. To attain good BCI performance, it is important to select the features of neural activity that represent attentional signals. BCI decoding of attention-related activity may be hindered by the presence of different neural signals. Therefore, BCI accuracy can be improved by signal processing algorithms that dissociate signals of interest from irrelevant activities. Notwithstanding recent progress, optimal processing of attentional neural signals remains a fundamental challenge for the development of efficient therapies for disorders of attention.

Exploring Neuro-Physiological Correlates of Drivers' Mental Fatigue Caused by Sleep Deprivation Using Simultaneous EEG, ECG, and fNIRS Data

Investigations of the neuro-physiological correlates of mental loads, or states, have attracted significant attention recently, as it is particularly important to evaluate mental fatigue in drivers operating a motor vehicle. In this research, we collected multimodal EEG/ECG/EOG and fNIRS data simultaneously to develop algorithms to explore neuro-physiological correlates of drivers' mental states. Each subject performed simulated driving under two different conditions (well-rested and sleep-deprived) on different days. During the experiment, we used 68 electrodes for EEG/ECG/EOG and 8 channels for fNIRS recordings. We extracted the prominent features of each modality to distinguish between the well-rested and sleep-deprived conditions, and all multimodal features, except EOG, were combined to quantify mental fatigue during driving. Finally, a novel driving condition level (DCL) was proposed that distinguished clearly between the features of well-rested and sleep-deprived conditions. This proposed DCL measure may be applicable to real-time monitoring of the mental states of vehicle drivers. Further, the combination of methods based on each classifier yielded substantial improvements in the classification accuracy between these two conditions.

Consumer-grade EEG devices: are they usable for control tasks?

We present the evaluation of two well-known, low-cost consumer-grade EEG devices: the Emotiv EPOC and the Neurosky MindWave. Problems with using the consumer-grade EEG devices (BCI illiteracy, poor technical characteristics, and adverse EEG artefacts) are discussed. The experimental evaluation of the devices, performed with 10 subjects asked to perform concentration/relaxation and blinking recognition tasks, is given. The results of statistical analysis show that both devices exhibit high variability and non-normality of attention and meditation data, which makes each of them difficult to use as an input to control tasks. BCI illiteracy may be a significant problem, as well as setting up of the proper environment of the experiment. The results of blinking recognition show that using the Neurosky device means recognition accuracy is less than 50%, while the Emotiv device has achieved a recognition accuracy of more than 75%; for tasks that require concentration and relaxation of subjects, the Emotiv EPOC device has performed better (as measured by the recognition accuracy) by ∼9%. Therefore, the Emotiv EPOC device may be more suitable for control tasks using the attention/meditation level or eye blinking than the Neurosky MindWave device.

Steady-State Somatosensory Evoked Potential for Brain-Computer Interface-Present and Future

Brain-computer interface (BCI) performance has achieved continued improvement over recent decades, and sensorimotor rhythm-based BCIs that use motor function have been popular subjects of investigation. However, it remains problematic to introduce them to the public market because of their low reliability. As an alternative resolution to this issue, visual-based BCIs that use P300 or steady-state visually evoked potentials (SSVEPs) seem promising; however, the inherent visual fatigue that occurs with these BCIs may be unavoidable. For these reasons, steady-state somatosensory evoked potential (SSSEP) BCIs, which are based on tactile selective attention, have gained increasing attention recently. These may reduce the fatigue induced by visual attention and overcome the low reliability of motor activity. In this literature survey, recent findings on SSSEP and its methodological uses in BCI are reviewed. Further, existing limitations of SSSEP BCI and potential future directions for the technique are discussed.

Predicting Mental Imagery-Based BCI Performance from Personality, Cognitive Profile and Neurophysiological Patterns

Mental-Imagery based Brain-Computer Interfaces (MI-BCIs) allow their users to send commands to a computer using their brain-activity alone (typically measured by ElectroEncephaloGraphy-EEG), which is processed while they perform specific mental tasks. While very promising, MI-BCIs remain barely used outside laboratories because of the difficulty encountered by users to control them. Indeed, although some users obtain good control performances after training, a substantial proportion remains unable to reliably control an MI-BCI. This huge variability in user-performance led the community to look for predictors of MI-BCI control ability. However, these predictors were only explored for motor-imagery based BCIs, and mostly for a single training session per subject. In this study, 18 participants were instructed to learn to control an EEG-based MI-BCI by performing 3 MI-tasks, 2 of which were non-motor tasks, across 6 training sessions, on 6 different days. Relationships between the participants' BCI control performances and their personality, cognitive profile and neurophysiological markers were explored. While no relevant relationships with neurophysiological markers were found, strong correlations between MI-BCI performances and mental-rotation scores (reflecting spatial abilities) were revealed. Also, a predictive model of MI-BCI performance based on psychometric questionnaire scores was proposed. A leave-one-subject-out cross validation process revealed the stability and reliability of this model: it enabled to predict participants' performance with a mean error of less than 3 points. This study determined how users' profiles impact their MI-BCI control ability and thus clears the way for designing novel MI-BCI training protocols, adapted to the profile of each user.

Efficient resting-state EEG network facilitates motor imagery performance

OBJECTIVE

Motor imagery-based brain-computer interface (MI-BCI) systems hold promise in motor function rehabilitation and assistance for motor function impaired people. But the ability to operate an MI-BCI varies across subjects, which becomes a substantial problem for practical BCI applications beyond the laboratory.

APPROACH

Several previous studies have demonstrated that individual MI-BCI performance is related to the resting state of brain. In this study, we further investigate offline MI-BCI performance variations through the perspective of resting-state electroencephalography (EEG) network.

MAIN RESULTS

Spatial topologies and statistical measures of the network have close relationships with MI classification accuracy. Specifically, mean functional connectivity, node degrees, edge strengths, clustering coefficient, local efficiency and global efficiency are positively correlated with MI classification accuracy, whereas the characteristic path length is negatively correlated with MI classification accuracy. The above results indicate that an efficient background EEG network may facilitate MI-BCI performance. Finally, a multiple linear regression model was adopted to predict subjects' MI classification accuracy based on the efficiency measures of the resting-state EEG network, resulting in a reliable prediction.

SIGNIFICANCE

This study reveals the network mechanisms of the MI-BCI and may help to find new strategies for improving MI-BCI performance.

Increasing session-to-session transfer in a brain-computer interface with on-site background noise acquisition

OBJECTIVE

A brain-computer interface (BCI) usually requires a time-consuming training phase during which data are collected and used to generate a classifier. Because brain signals vary dynamically over time (and even over sessions), this training phase may be necessary each time the BCI system is used, which is impractical. However, the variability in background noise, which is less dependent on a control signal, may dominate the dynamics of brain signals. Therefore, we hypothesized that an understanding of variations in background noise may allow existing data to be reused by incorporating the noise characteristics into the feature extraction framework; in this way, new session data are not required each time and this increases the feasibility of the BCI systems.

APPROACH

In this work, we collected background noise during a single, brief on-site acquisition session (approximately 3 min) immediately before a new session, and we found that variations in background noise were predictable to some extent. Then we implemented this simple session-to-session transfer strategy with a regularized spatiotemporal filter (RSTF), and we tested it with a total of 20 cross-session datasets collected over multiple days from 12 subjects. We also proposed and tested a bias correction (BC) in the RSTF.

MAIN RESULTS

We found that our proposed session-to-session strategies yielded a slightly less or comparable performance to the conventional paradigm (each session training phase is needed with an on-site training dataset). Furthermore, using an RSTF only and an RSTF with a BC outperformed existing approaches in session-to-session transfers.

SIGNIFICANCE

We inferred from our results that, with an on-site background noise suppression feature extractor and pre-existing training data, further training time may be unnecessary.

A Link between the Increase in Electroencephalographic Coherence and Performance Improvement in Operating a Brain-Computer Interface

We study the relationship between electroencephalographic (EEG) coherence and accuracy in operating a brain-computer interface (BCI). In our case, the BCI is controlled through motor imagery. Hence, a number of volunteers were trained using different training paradigms: classical visual feedback, auditory stimulation, and functional electrical stimulation (FES). After each training session, the volunteers' accuracy in operating the BCI was assessed, and the event-related coherence (ErCoh) was calculated for all possible combinations of pairs of EEG sensors. After at least four training sessions, we searched for significant differences in accuracy and ErCoh using one-way analysis of variance (ANOVA) and multiple comparison tests. Our results show that there exists a high correlation between an increase in ErCoh and performance improvement, and this effect is mainly localized in the centrofrontal and centroparietal brain regions for the case of our motor imagery task. This result has a direct implication with the development of new techniques to evaluate BCI performance and the process of selecting a feedback modality that better enhances the volunteer's capacity to operate a BCI system.