EEG-Based Brain-Computer Interfaces Using Motor-Imagery: Techniques and Challenges

Induced Gamma-Band Activity during Actual and Imaginary Movements: EEG Analysis

The purpose of this paper is to record and analyze induced gamma-band activity (GBA) (30-60 Hz) in cerebral motor areas during imaginary movement and to compare it quantitatively with activity recorded in the same areas during actual movement using a simplified electroencephalogram (EEG). Brain activity (basal activity, imaginary motor task and actual motor task) is obtained from 12 healthy volunteer subjects using an EEG (Cz channel). GBA is analyzed using the mean power spectral density (PSD) value. Event-related synchronization (ERS) is calculated from the PSD values of the basal GBA (GBAb), the GBA of the imaginary movement (GBAim) and the GBA of the actual movement (GBAac). The mean GBAim and GBAac values for the right and left hands are significantly higher than the GBAb value (p = 0.007). No significant difference is detected between mean GBA values during the imaginary and actual movement (p = 0.242). The mean ERS values for the imaginary movement (ERSimM (%) = 23.52) and for the actual movement (ERSacM = 27.47) do not present any significant difference (p = 0.117). We demonstrated that ERS could provide a useful way of indirectly checking the function of neuronal motor circuits activated by voluntary movement, both imaginary and actual. These results, as a proof of concept, could be applied to physiology studies, brain-computer interfaces, and diagnosis of cognitive or motor pathologies.

Cognitive Ergonomics Evaluation Assisted by an Intelligent Emotion Recognition Technique

The study of the cognitive effects caused by work activities are vital to ensure the well-being of a worker, and this work presents a strategy to analyze these effects while they are carrying out their activities. Our proposal is based on the implementation of pattern recognition techniques to identify emotions in facial expressions and correlate them to a proposed situation awareness model that measures the levels of comfort and mental stability of a worker and proposes corrective actions. We present the experimental results that could not be collected through traditional techniques since we carry out a continuous and uninterrupted assessment of the cognitive situation of a worker.

Enhanced Multiple Instance Representation Using Time-Frequency Atoms in Motor Imagery Classification

Selection of the time-window mainly affects the effectiveness of piecewise feature extraction procedures. We present an enhanced bag-of-patterns representation that allows capturing the higher-level structures of brain dynamics within a wide window range. So, we introduce augmented instance representations with extended window lengths for the short-time Common Spatial Pattern algorithm. Based on multiple-instance learning, the relevant bag-of-patterns are selected by a sparse regression to feed a bag classifier. The proposed higher-level structure representation promotes two contributions: (i) accuracy improvement of bi-conditional tasks, (ii) A better understanding of dynamic brain behavior through the learned sparse regression fits. Using a support vector machine classifier, the achieved performance on a public motor imagery dataset (left-hand and right-hand tasks) shows that the proposed framework performs very competitive results, providing robustness to the time variation of electroencephalography recordings and favoring the class separability.

Assessing Time-Resolved fNIRS for Brain-Computer Interface Applications of Mental Communication

Brain-computer interfaces (BCIs) are becoming increasingly popular as a tool to improve the quality of life of patients with disabilities. Recently, time-resolved functional near-infrared spectroscopy (TR-fNIRS) based BCIs are gaining traction because of their enhanced depth sensitivity leading to lower signal contamination from the extracerebral layers. This study presents the first account of TR-fNIRS based BCI for “mental communication” on healthy participants. Twenty-one (21) participants were recruited and were repeatedly asked a series of questions where they were instructed to imagine playing tennis for “yes” and to stay relaxed for “no.” The change in the mean time-of-flight of photons was used to calculate the change in concentrations of oxy- and deoxyhemoglobin since it provides a good compromise between depth sensitivity and signal-to-noise ratio. Features were extracted from the average oxyhemoglobin signals to classify them as “yes” or “no” responses. Linear-discriminant analysis (LDA) and support vector machine (SVM) classifiers were used to classify the responses using the leave-one-out cross-validation method. The overall accuracies achieved for all participants were 75% and 76%, using LDA and SVM, respectively. The results also reveal that there is no significant difference in accuracy between questions. In addition, physiological parameters [heart rate (HR) and mean arterial pressure (MAP)] were recorded on seven of the 21 participants during motor imagery (MI) and rest to investigate changes in these parameters between conditions. No significant difference in these parameters was found between conditions. These findings suggest that TR-fNIRS could be suitable as a BCI for patients with brain injuries.

Electrocorticogram (ECoG) Is Highly Informative in Primate Visual Cortex

Neural signals recorded at different scales contain information about environment and behavior and have been used to control Brain Machine Interfaces with varying degrees of success. However, a direct comparison of their efficacy has not been possible due to different recording setups, tasks, species, etc. To address this, we implanted customized arrays having both microelectrodes and electrocorticogram (ECoG) electrodes in the primary visual cortex of 2 female macaque monkeys, and also recorded electroencephalogram (EEG), while they viewed a variety of naturalistic images and parametric gratings. Surprisingly, ECoG had higher information and decodability than all other signals. Combining a few ECoG electrodes allowed more accurate decoding than combining a much larger number of microelectrodes. Control analyses showed that higher decoding accuracy of ECoG compared with local field potential was not because of differences in low-level visual features captured by them but instead because of larger spatial summation of the ECoG. Information was high in the 30-80 Hz range and at lower frequencies. Information in different frequencies and scales was nonredundant. These results have strong implications for Brain Machine Interface applications and for study of population representation of visual stimuli.SIGNIFICANCE STATEMENT Electrophysiological signals captured across scales by different recording electrodes are regularly used for Brain Machine Interfaces, but the information content varies due to electrode size and location. A systematic comparison of their efficiency for Brain Machine Interfaces is important but technically challenging. Here, we recorded simultaneous signals across four scales: spikes, local field potential, electrocorticogram (ECoG), and EEG, and compared their information and decoding accuracy for a large variety of naturalistic stimuli. We found that ECoGs were highly informative and outperformed other signals in information content and decoding accuracy.

Neurorestoration: Advances in human brain–computer interface using microelectrode arrays

Neural damage has been a great challenge to the medical field for a very long time. The emergence of brain–computer interfaces (BCIs) offered a new possibility to enhance the activity of daily living and provide a new formation of entertainment for those with disabilities. Intracortical BCIs, which require the implantation of microelectrodes, can receive neuronal signals with a high spatial and temporal resolution from the individual’s cortex. When BCI decoded cortical signals and mapped them to external devices, it displayed the ability not only to replace part of the human motor function but also to help individuals restore certain neurological functions. In this review, we focus on human intracortical BCI research using microelectrode arrays and summarize the main directions and the latest results in this field. In general, we found that intracortical BCI research based on motor neuroprosthetics and functional electrical stimulation have already achieved some simple functional replacement and treatment of motor function. Pioneering work in the posterior parietal cortex has given us a glimpse of the potential that intracortical BCIs have to control external devices and receive various sensory information.

Classification of Drowsiness Levels Based on a Deep Spatio-Temporal Convolutional Bidirectional LSTM Network Using Electroencephalography Signals

Non-invasive brain-computer interfaces (BCI) have been developed for recognizing human mental states with high accuracy and for decoding various types of mental conditions. In particular, accurately decoding a pilot's mental state is a critical issue as more than 70% of aviation accidents are caused by human factors, such as fatigue or drowsiness. In this study, we report the classification of not only two mental states (i.e., alert and drowsy states) but also five drowsiness levels from electroencephalogram (EEG) signals. To the best of our knowledge, this approach is the first to classify drowsiness levels in detail using only EEG signals. We acquired EEG data from ten pilots in a simulated night flight environment. For accurate detection, we proposed a deep spatio-temporal convolutional bidirectional long short-term memory network (DSTCLN) model. We evaluated the classification performance using Karolinska sleepiness scale (KSS) values for two mental states and five drowsiness levels. The grand-averaged classification accuracies were 0.87 (±0.01) and 0.69 (±0.02), respectively. Hence, we demonstrated the feasibility of classifying five drowsiness levels with high accuracy using deep learning.

A BCI Gaze Sensing Method Using Low Jitter Code Modulated VEP

Visual evoked potentials (VEPs) are used in clinical applications in ophthalmology, neurology, and extensively in brain-computer interface (BCI) research. Many BCI implementations utilize steady-state VEP (SSVEP) and/or code modulated VEP (c-VEP) as inputs, in tandem with sophisticated methods to improve information transfer rates (ITR). There is a gap in knowledge regarding the adaptation dynamics and physiological generation mechanisms of the VEP response, and the relation of these factors with BCI performance. A simple, dual pattern display setup was used to evoke VEPs and to test signatures elicited by non-isochronic, non-singular, low jitter stimuli at the rates of 10, 32, 50, and 70 reversals per second (rps). Non-isochronic, low-jitter stimulation elicits quasi-steady-state VEPs (QSS-VEPs) that are utilized for the simultaneous generation of transient VEP and QSS-VEP. QSS-VEP is a special case of c-VEPs, and it is assumed that it shares similar generators of the SSVEPs. Eight subjects were recorded, and the performance of the overall system was analyzed using receiver operating characteristic (ROC) curves, accuracy plots, and ITRs. In summary, QSS-VEPs performed better than transient VEPs (TR-VEP). It was found that in general, 32 rps stimulation had the highest ROC area, accuracy, and ITRs. Moreover, QSS-VEPs were found to lead to higher accuracy by template matching compared to SSVEPs at 32 rps. To investigate the reasons behind this, adaptation dynamics of transient VEPs and QSS-VEPs at all four rates were analyzed and speculated.

Towards the Recognition of the Emotions of People with Visual Disabilities through Brain-Computer Interfaces

A brain–computer interface is an alternative for communication between people and computers, through the acquisition and analysis of brain signals. Research related to this field has focused on serving people with different types of motor, visual or auditory disabilities. On the other hand, affective computing studies and extracts information about the emotional state of a person in certain situations, an important aspect for the interaction between people and the computer. In particular, this manuscript considers people with visual disabilities and their need for personalized systems that prioritize their disability and the degree that affects them. In this article, a review of the state of the techniques is presented, where the importance of the study of the emotions of people with visual disabilities, and the possibility of representing those emotions through a brain–computer interface and affective computing, are discussed. Finally, the authors propose a framework to study and evaluate the possibility of representing and interpreting the emotions of people with visual disabilities for improving their experience with the use of technology and their integration into today’s society.